10000000:01000000:0.0F:1651531639.293257:0:166108:0:(mgc_request.c:609:do_requeue()) updating log lustre-client
10000000:01000000:0.0:1651531639.293262:0:166108:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff94e0d279b000 from 263
10000000:01000000:0.0:1651531639.293265:0:166108:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c)
00010000:00010000:0.0:1651531639.293287:0:166108:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC10.240.43.61@tcp lock: 00000000e9b84540/0x3234de053ca24af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 166108 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531639.293294:0:166108:0:(ldlm_request.c:1028:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC10.240.43.61@tcp lock: 00000000e9b84540/0x3234de053ca24af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 166108 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531639.293299:0:166108:0:(ldlm_request.c:1116:ldlm_cli_enqueue()) ### sending request ns: MGC10.240.43.61@tcp lock: 00000000e9b84540/0x3234de053ca24af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 166108 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531639.293310:0:166108:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000074959ba pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997337920:10.240.43.61@tcp:101:ll_cfg_requeue.0
00000100:00100000:0.0:1651531639.293348:0:166108:0:(client.c:2492:ptlrpc_set_wait()) set 0000000045cc2304 going to sleep for 6 seconds
00000100:00100000:0.0:1651531639.293787:0:166108:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000074959ba pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997337920:10.240.43.61@tcp:101:ll_cfg_requeue.0
00010000:00010000:0.0:1651531639.293795:0:166108:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC10.240.43.61@tcp lock: 00000000e9b84540/0x3234de053ca24af lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b1585546a12cc expref: -99 pid: 166108 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531639.293800:0:166108:0:(ldlm_request.c:798:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC10.240.43.61@tcp lock: 00000000e9b84540/0x3234de053ca24af lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e7b1585546a12cc expref: -99 pid: 166108 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531639.293837:0:166108:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000074959ba pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997337984:10.240.43.61@tcp:501:ll_cfg_requeue.0
00000100:00100000:0.0:1651531639.293854:0:166108:0:(client.c:2492:ptlrpc_set_wait()) set 0000000045cc2304 going to sleep for 6 seconds
00000100:00100000:0.0:1651531639.294148:0:166108:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000074959ba pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997337984:10.240.43.61@tcp:501:ll_cfg_requeue.0
00000100:00100000:0.0:1651531639.294159:0:166108:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000074959ba pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997338048:10.240.43.61@tcp:503:ll_cfg_requeue.0
00000100:00100000:0.0:1651531639.294179:0:166108:0:(client.c:2492:ptlrpc_set_wait()) set 0000000045cc2304 going to sleep for 6 seconds
00000100:00100000:0.0:1651531639.294438:0:166108:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000074959ba pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997338048:10.240.43.61@tcp:503:ll_cfg_requeue.0
00000040:00080000:0.0:1651531639.294738:0:218950:0:(llog.c:768:llog_process_thread()) stop processing plain 0x3:10:0 index 64768 count 258
00000020:01000000:0.0:1651531639.294776:0:166108:0:(obd_config.c:2042:class_config_parse_llog()) Processed log lustre-client gen 263-262 (rc=0)
10000000:01000000:0.0:1651531639.294782:0:166108:0:(mgc_request.c:2136:mgc_process_log()) MGC10.240.43.61@tcp: configuration from log 'lustre-client' succeeded (0).
00010000:00010000:0.0:1651531639.294784:0:166108:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC10.240.43.61@tcp lock: 00000000e9b84540/0x3234de053ca24af lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b1585546a12cc expref: -99 pid: 166108 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531639.294788:0:166108:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC10.240.43.61@tcp lock: 00000000e9b84540/0x3234de053ca24af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b1585546a12cc expref: -99 pid: 166108 timeout: 0 lvb_type: 0
10000000:01000000:0.0:1651531639.294791:0:166108:0:(mgc_request.c:609:do_requeue()) updating log lustre-OST0001
10000000:01000000:0.0:1651531639.294792:0:166108:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 29
10000000:01000000:0.0:1651531639.294793:0:166108:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c)
00010000:00010000:0.0:1651531639.294800:0:166108:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC10.240.43.61@tcp lock: 00000000ab087537/0x3234de053ca24b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 166108 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531639.294802:0:166108:0:(ldlm_request.c:1028:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC10.240.43.61@tcp lock: 00000000ab087537/0x3234de053ca24b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 166108 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531639.294805:0:166108:0:(ldlm_request.c:1116:ldlm_cli_enqueue()) ### sending request ns: MGC10.240.43.61@tcp lock: 00000000ab087537/0x3234de053ca24b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 166108 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531639.294810:0:166108:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000074959ba pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997338112:10.240.43.61@tcp:101:ll_cfg_requeue.0
00000100:00100000:0.0:1651531639.294826:0:166108:0:(client.c:2492:ptlrpc_set_wait()) set 000000009973ad87 going to sleep for 6 seconds
00000100:00100000:0.0:1651531639.295090:0:166108:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000074959ba pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997338112:10.240.43.61@tcp:101:ll_cfg_requeue.0
00010000:00010000:0.0:1651531639.295095:0:166108:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC10.240.43.61@tcp lock: 00000000ab087537/0x3234de053ca24b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b1585546a12d3 expref: -99 pid: 166108 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531639.295098:0:166108:0:(ldlm_request.c:798:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC10.240.43.61@tcp lock: 00000000ab087537/0x3234de053ca24b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e7b1585546a12d3 expref: -99 pid: 166108 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531639.295112:0:166108:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000074959ba pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997338176:10.240.43.61@tcp:501:ll_cfg_requeue.0
00000100:00100000:0.0:1651531639.295126:0:166108:0:(client.c:2492:ptlrpc_set_wait()) set 000000009973ad87 going to sleep for 6 seconds
00000100:00100000:0.0:1651531639.295319:0:166108:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000074959ba pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997338176:10.240.43.61@tcp:501:ll_cfg_requeue.0
00000100:00100000:0.0:1651531639.295328:0:166108:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000074959ba pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997338240:10.240.43.61@tcp:503:ll_cfg_requeue.0
00000100:00100000:0.0:1651531639.295341:0:166108:0:(client.c:2492:ptlrpc_set_wait()) set 000000009973ad87 going to sleep for 6 seconds
00000100:00100000:0.0:1651531639.295825:0:166108:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000074959ba pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997338240:10.240.43.61@tcp:503:ll_cfg_requeue.0
00000040:00080000:0.0:1651531639.296095:0:218951:0:(llog.c:768:llog_process_thread()) stop processing plain 0x9:10:0 index 64768 count 29
00000020:01000000:0.0:1651531639.296120:0:166108:0:(obd_config.c:2042:class_config_parse_llog()) Processed log lustre-OST0001 gen 29-28 (rc=0)
10000000:01000000:0.0:1651531639.296125:0:166108:0:(mgc_request.c:2136:mgc_process_log()) MGC10.240.43.61@tcp: configuration from log 'lustre-OST0001' succeeded (0).
00010000:00010000:0.0:1651531639.296126:0:166108:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC10.240.43.61@tcp lock: 00000000ab087537/0x3234de053ca24b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b1585546a12d3 expref: -99 pid: 166108 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531639.296130:0:166108:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC10.240.43.61@tcp lock: 00000000ab087537/0x3234de053ca24b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b1585546a12d3 expref: -99 pid: 166108 timeout: 0 lvb_type: 0
10000000:01000000:0.0:1651531639.296133:0:166108:0:(mgc_request.c:609:do_requeue()) updating log params
10000000:01000000:0.0:1651531639.296134:0:166108:0:(mgc_request.c:2064:mgc_process_log()) Process log params-ffff94e0d279b000 from 19
10000000:01000000:0.0:1651531639.296135:0:166108:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for params (res 0x736d61726170)
00010000:00010000:0.0:1651531639.296140:0:166108:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC10.240.43.61@tcp lock: 0000000000dcc150/0x3234de053ca24bd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 166108 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531639.296143:0:166108:0:(ldlm_request.c:1028:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC10.240.43.61@tcp lock: 0000000000dcc150/0x3234de053ca24bd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 166108 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531639.296146:0:166108:0:(ldlm_request.c:1116:ldlm_cli_enqueue()) ### sending request ns: MGC10.240.43.61@tcp lock: 0000000000dcc150/0x3234de053ca24bd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 166108 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531639.296151:0:166108:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000074959ba pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997338304:10.240.43.61@tcp:101:ll_cfg_requeue.0
00000100:00100000:0.0:1651531639.296162:0:166108:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d1a01315 going to sleep for 6 seconds
00000100:00100000:0.0:1651531639.296386:0:166108:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000074959ba pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997338304:10.240.43.61@tcp:101:ll_cfg_requeue.0
00010000:00010000:0.0:1651531639.296390:0:166108:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC10.240.43.61@tcp lock: 0000000000dcc150/0x3234de053ca24bd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b1585546a12da expref: -99 pid: 166108 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531639.296394:0:166108:0:(ldlm_request.c:798:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC10.240.43.61@tcp lock: 0000000000dcc150/0x3234de053ca24bd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e7b1585546a12da expref: -99 pid: 166108 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531639.296407:0:166108:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000074959ba pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997338368:10.240.43.61@tcp:501:ll_cfg_requeue.0
00000100:00100000:0.0:1651531639.296418:0:166108:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d1a01315 going to sleep for 6 seconds
00000100:00100000:0.0:1651531639.296613:0:166108:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000074959ba pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997338368:10.240.43.61@tcp:501:ll_cfg_requeue.0
00000100:00100000:0.0:1651531639.296623:0:166108:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000074959ba pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997338432:10.240.43.61@tcp:503:ll_cfg_requeue.0
00000100:00100000:0.0:1651531639.296636:0:166108:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d1a01315 going to sleep for 6 seconds
00000100:00100000:0.0:1651531639.296838:0:166108:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000074959ba pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997338432:10.240.43.61@tcp:503:ll_cfg_requeue.0
00000040:00080000:1.0F:1651531639.297387:0:218952:0:(llog.c:768:llog_process_thread()) stop processing plain 0x2:10:0 index 64768 count 19
00000020:01000000:0.0:1651531639.297411:0:166108:0:(obd_config.c:2042:class_config_parse_llog()) Processed log params gen 19-18 (rc=0)
10000000:01000000:0.0:1651531639.297418:0:166108:0:(mgc_request.c:2136:mgc_process_log()) MGC10.240.43.61@tcp: configuration from log 'params' succeeded (0).
00010000:00010000:0.0:1651531639.297420:0:166108:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC10.240.43.61@tcp lock: 0000000000dcc150/0x3234de053ca24bd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b1585546a12da expref: -99 pid: 166108 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531639.297423:0:166108:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC10.240.43.61@tcp lock: 0000000000dcc150/0x3234de053ca24bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b1585546a12da expref: -99 pid: 166108 timeout: 0 lvb_type: 0
10000000:01000000:0.0:1651531639.297426:0:166108:0:(mgc_request.c:609:do_requeue()) updating log nodemap
10000000:01000000:0.0:1651531639.297427:0:166108:0:(mgc_request.c:2064:mgc_process_log()) Process log nodemap-ffff94e0b53b8000 from 1
10000000:01000000:0.0:1651531639.297428:0:166108:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e)
00010000:00010000:0.0:1651531639.297433:0:166108:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC10.240.43.61@tcp lock: 000000008abee82b/0x3234de053ca24c4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 166108 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531639.297436:0:166108:0:(ldlm_request.c:1028:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC10.240.43.61@tcp lock: 000000008abee82b/0x3234de053ca24c4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 166108 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531639.297440:0:166108:0:(ldlm_request.c:1116:ldlm_cli_enqueue()) ### sending request ns: MGC10.240.43.61@tcp lock: 000000008abee82b/0x3234de053ca24c4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 166108 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531639.297445:0:166108:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000074959ba pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997338496:10.240.43.61@tcp:101:ll_cfg_requeue.0
00000100:00100000:0.0:1651531639.297457:0:166108:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d1a01315 going to sleep for 6 seconds
00000100:00100000:0.0:1651531639.297670:0:166108:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000074959ba pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997338496:10.240.43.61@tcp:101:ll_cfg_requeue.0
00010000:00010000:0.0:1651531639.297675:0:166108:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC10.240.43.61@tcp lock: 000000008abee82b/0x3234de053ca24c4 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b1585546a12e1 expref: -99 pid: 166108 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531639.297678:0:166108:0:(ldlm_request.c:798:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC10.240.43.61@tcp lock: 000000008abee82b/0x3234de053ca24c4 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e7b1585546a12e1 expref: -99 pid: 166108 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531639.297756:0:166108:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000074959ba pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997338560:10.240.43.61@tcp:256:ll_cfg_requeue.0
00000100:00100000:0.0:1651531639.297770:0:166108:0:(client.c:2492:ptlrpc_set_wait()) set 000000009a3829ee going to sleep for 6 seconds
00000100:00100000:0.0:1651531639.298274:0:166108:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000074959ba pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997338560:10.240.43.61@tcp:256:ll_cfg_requeue.0
00080000:10000000:0.0:1651531639.298705:0:166108:0:(osd_handler.c:5198:osd_index_try()) lustre-OST0001: index object [0x200000003:0x18:0x0] (8/32) registered
10000000:01000000:0.0:1651531639.298769:0:166108:0:(mgc_request.c:2136:mgc_process_log()) MGC10.240.43.61@tcp: configuration from log 'nodemap' succeeded (0).
00010000:00010000:0.0:1651531639.298771:0:166108:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC10.240.43.61@tcp lock: 000000008abee82b/0x3234de053ca24c4 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b1585546a12e1 expref: -99 pid: 166108 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531639.298775:0:166108:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC10.240.43.61@tcp lock: 000000008abee82b/0x3234de053ca24c4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b1585546a12e1 expref: -99 pid: 166108 timeout: 0 lvb_type: 0
10000000:01000000:0.0:1651531639.298778:0:166108:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc
10000000:01000000:0.0:1651531639.298778:0:166108:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff94e0b53b8000 from 1
10000000:01000000:0.0:1651531639.298779:0:166108:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c)
00010000:00010000:0.0:1651531639.298786:0:166108:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC10.240.43.61@tcp lock: 00000000bc1fa390/0x3234de053ca24cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 166108 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531639.298789:0:166108:0:(ldlm_request.c:1028:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC10.240.43.61@tcp lock: 00000000bc1fa390/0x3234de053ca24cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 166108 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531639.298792:0:166108:0:(ldlm_request.c:1116:ldlm_cli_enqueue()) ### sending request ns: MGC10.240.43.61@tcp lock: 00000000bc1fa390/0x3234de053ca24cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 166108 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531639.298797:0:166108:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000074959ba pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997338624:10.240.43.61@tcp:101:ll_cfg_requeue.0
00000100:00100000:0.0:1651531639.298815:0:166108:0:(client.c:2492:ptlrpc_set_wait()) set 000000009a3829ee going to sleep for 6 seconds
00000100:00100000:0.0:1651531639.299015:0:166108:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000074959ba pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997338624:10.240.43.61@tcp:101:ll_cfg_requeue.0
00010000:00010000:0.0:1651531639.299019:0:166108:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC10.240.43.61@tcp lock: 00000000bc1fa390/0x3234de053ca24cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b1585546a12e8 expref: -99 pid: 166108 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531639.299023:0:166108:0:(ldlm_request.c:798:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC10.240.43.61@tcp lock: 00000000bc1fa390/0x3234de053ca24cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e7b1585546a12e8 expref: -99 pid: 166108 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531639.299036:0:166108:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000074959ba pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997338688:10.240.43.61@tcp:501:ll_cfg_requeue.0
00000100:00100000:0.0:1651531639.299054:0:166108:0:(client.c:2492:ptlrpc_set_wait()) set 000000009a3829ee going to sleep for 6 seconds
00000100:00100000:0.0:1651531639.299236:0:166108:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000074959ba pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997338688:10.240.43.61@tcp:501:ll_cfg_requeue.0
10000000:01000000:0.0:1651531639.299244:0:166108:0:(mgc_request.c:2136:mgc_process_log()) MGC10.240.43.61@tcp: configuration from log 'lustre-sptlrpc' failed (-2).
00010000:00010000:0.0:1651531639.299246:0:166108:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC10.240.43.61@tcp lock: 00000000bc1fa390/0x3234de053ca24cb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b1585546a12e8 expref: -99 pid: 166108 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531639.299249:0:166108:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC10.240.43.61@tcp lock: 00000000bc1fa390/0x3234de053ca24cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b1585546a12e8 expref: -99 pid: 166108 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531641.056304:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651531641.056325:0:182071:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745950925760
00000100:00100000:1.0:1651531641.056348:0:182071:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 398
00000100:00100000:1.0:1651531641.056350:0:182071:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000080bc1e67 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745950925760:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:1.0:1651531641.056369:0:182071:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 354734144 pending 0 free 81292156928 avail 77121445888
00000100:00100000:1.0:1651531641.056399:0:182071:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000080bc1e67 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745950925760:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 48us (100us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531641.056403:0:182071:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 398
00000001:00080000:1.0:1651531641.531432:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474868953 is committed
00000001:00100000:1.0:1651531641.531445:0:166098:0:(tgt_lastrcvd.c:537:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID
00000100:00100000:1.0:1651531641.616916:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531641.616945:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754464953728
00000100:00100000:1.0:1651531641.616967:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 55
00000100:00100000:1.0:1651531641.616969:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000320c8a1d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:37d7cd70-23c8-4282-b9a2-e45fd1319801+5:438148:x1731754464953728:12345-10.240.43.64@tcp:400:kworker/u4:2.0
00000100:00100000:1.0:1651531641.617013:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000320c8a1d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:37d7cd70-23c8-4282-b9a2-e45fd1319801+5:438148:x1731754464953728:12345-10.240.43.64@tcp:400:kworker/u4:2.0 Request processed in 43us (101us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531641.617017:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 55
00000100:00100000:0.0:1651531643.005428:0:39099:0:(ptlrpcd.c:414:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1651531643.005442:0:39099:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000074959ba pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:39099:1731745997338752:10.240.43.61@tcp:400:kworker/u4:1.0
00000100:00100000:0.0:1651531643.006245:0:39099:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000074959ba pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:39099:1731745997338752:10.240.43.61@tcp:400:kworker/u4:1.0
00000400:00000080:1.0:1651531644.356963:0:219115:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648
00000001:02000400:1.0:1651531644.356965:0:219115:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 257: xattr locks are not lost ============= 22:47:24 (1651531644)
00000100:00100000:0.0:1651531646.176281:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651531646.176317:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745950926016
00000100:00100000:1.0:1651531646.176342:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 399
00000100:00100000:1.0:1651531646.176345:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000074959ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745950926016:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:1.0:1651531646.176364:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 354734144 pending 0 free 81292156928 avail 77121445888
00000100:00100000:1.0:1651531646.176392:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000074959ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745950926016:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 47us (116us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531646.176396:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 399
00000100:00100000:0.0:1651531646.291838:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651531646.291882:0:191990:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745950926528
00000100:00100000:1.0:1651531646.291904:0:191990:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 44161
00000100:00100000:1.0:1651531646.291906:0:191990:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ec383f97 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:317807:x1731745950926528:12345-10.240.43.61@tcp:9:umount.0
00000020:00000080:1.0:1651531646.291921:0:191990:0:(genops.c:1442:class_disconnect()) disconnect: cookie 0x3234de053ca2400
00000100:00080000:1.0:1651531646.291925:0:191990:0:(import.c:85:import_set_state_nolock()) 00000000c3a45a19 ��������: changing import state from FULL to CLOSED
00000001:00000004:1.0:1651531646.291945:0:191990:0:(tgt_lastrcvd.c:701:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 5, last_transno is 21474868953
00000100:00100000:1.0:1651531646.292025:0:191990:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ec383f97 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+2:317807:x1731745950926528:12345-10.240.43.61@tcp:9:umount.0 Request processed in 118us (189us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531646.292028:0:191990:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 44161
00000001:00100000:1.0:1651531652.298438:0:166098:0:(tgt_lastrcvd.c:537:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID
00000020:00000080:1.0:1651531652.298441:0:166098:0:(genops.c:985:class_export_put()) final put 00000000a869047f/lustre-MDT0000-mdtlov_UUID
00000020:00000080:0.0:1651531652.298466:0:213652:0:(genops.c:944:class_export_destroy()) destroying export 00000000a869047f/lustre-MDT0000-mdtlov_UUID for lustre-OST0001
00000020:00000080:0.0:1651531652.298486:0:213652:0:(genops.c:1164:obd_zombie_import_free()) destroying import 00000000c3a45a19 for lustre-OST0001
00000100:00100000:0.0:1651531655.440344:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651531655.440387:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745950927424
00000100:00100000:1.0:1651531655.440408:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 44162
00000100:00100000:1.0:1651531655.440411:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000051619ab4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:39028:x1731745950927424:12345-10.240.43.61@tcp:8:llog_process_th.0
00010000:00080000:1.0:1651531655.440425:0:166112:0:(ldlm_lib.c:1365:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@10.240.43.61@tcp t0 exp 0000000055bfac58 cur 22314 last 0
00000020:00000080:1.0:1651531655.440439:0:166112:0:(genops.c:1359:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3234de053ca24d2
00002000:00100000:1.0:1651531655.440444:0:166112:0:(ofd_obd.c:150:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/00000000747c1313 ocd_connect_flags: 0x2044401443000066 ocd_version: 20f0000 ocd_grant: 0 ocd_index: 1 ocd_group 0
00002000:00080000:1.0:1651531655.440445:0:166112:0:(ofd_obd.c:168:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0
00002000:00100000:1.0:1651531655.440447:0:166112:0:(ofd_obd.c:257:ofd_parse_connect_data()) lustre-OST0001: cli <unknown> does not support OBD_CONNECT_CKSUM
00000020:01000000:1.0:1651531655.440478:0:166112:0:(lprocfs_status_server.c:544:lprocfs_exp_setup()) using hash 00000000427049c0
00002000:00080000:1.0:1651531655.440483:0:166112:0:(ofd_obd.c:391:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0
00000100:00080000:1.0:1651531655.440496:0:166112:0:(import.c:85:import_set_state_nolock()) 00000000bac59f98 ��������: changing import state from RECOVER to FULL
00000100:00100000:1.0:1651531655.440524:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000051619ab4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:39028:x1731745950927424:12345-10.240.43.61@tcp:8:llog_process_th.0 Request processed in 112us (184us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531655.440527:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 44162
00000100:00100000:0.0:1651531655.440791:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651531655.440817:0:182071:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745950927552
00000100:00100000:1.0:1651531655.440833:0:182071:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 400
00000100:00100000:1.0:1651531655.440836:0:182071:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aacbbaef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745950927552:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:1.0:1651531655.440845:0:182071:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 354734144 pending 0 free 81292156928 avail 77121445888
00000100:00100000:1.0:1651531655.440858:0:182071:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aacbbaef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745950927552:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 22us (67us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531655.440861:0:182071:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 400
00000100:00100000:0.0:1651531659.037293:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651531659.037336:0:191990:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745950929472
00000100:00100000:1.0:1651531659.037371:0:191990:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 44163
00000100:00100000:1.0:1651531659.037375:0:191990:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005dd15341 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:318354:x1731745950929472:12345-10.240.43.61@tcp:5:osp-pre-1-0.0
00002000:00080000:1.0:1651531659.037397:0:191990:0:(ofd_dev.c:1586:ofd_create_hdl()) ofd_last_id() = 214273 -> diff = -28
00002000:02000040:1.0:1651531659.037399:0:191990:0:(ofd_dev.c:1442:ofd_orphans_destroy()) lustre-OST0001: deleting orphan objects from 0x0:214246 to 0x0:214273
00002000:00010000:1.0:1651531659.039822:0:191990:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34501:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:1.0:1651531659.039828:0:191990:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f2479f0/0x3234de053ca24d9 lrc: 3/0,1 mode: --/PW res: [0x34501:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531659.039840:0:191990:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531659.039842:0:191990:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531659.039845:0:191990:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002f2479f0/0x3234de053ca24d9 lrc: 3/0,1 mode: PW/PW res: [0x34501:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531659.039856:0:191990:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002f2479f0/0x3234de053ca24d9 lrc: 3/0,1 mode: PW/PW res: [0x34501:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531659.039863:0:191990:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f2479f0/0x3234de053ca24d9 lrc: 3/0,1 mode: PW/PW res: [0x34501:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531659.039868:0:191990:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002f2479f0/0x3234de053ca24d9 lrc: 2/0,0 mode: PW/PW res: [0x34501:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651531659.040024:0:191990:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34500:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:1.0:1651531659.040028:0:191990:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000049c67f6a/0x3234de053ca24e0 lrc: 3/0,1 mode: --/PW res: [0x34500:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531659.040035:0:191990:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531659.040035:0:191990:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531659.040037:0:191990:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049c67f6a/0x3234de053ca24e0 lrc: 3/0,1 mode: PW/PW res: [0x34500:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531659.040044:0:191990:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000049c67f6a/0x3234de053ca24e0 lrc: 3/0,1 mode: PW/PW res: [0x34500:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531659.040049:0:191990:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000049c67f6a/0x3234de053ca24e0 lrc: 3/0,1 mode: PW/PW res: [0x34500:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531659.040054:0:191990:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000049c67f6a/0x3234de053ca24e0 lrc: 2/0,0 mode: PW/PW res: [0x34500:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651531659.040123:0:191990:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x344ff:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:1.0:1651531659.040126:0:191990:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f7e6a6f/0x3234de053ca24e7 lrc: 3/0,1 mode: --/PW res: [0x344ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531659.040133:0:191990:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531659.040133:0:191990:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531659.040135:0:191990:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f7e6a6f/0x3234de053ca24e7 lrc: 3/0,1 mode: PW/PW res: [0x344ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531659.040141:0:191990:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003f7e6a6f/0x3234de053ca24e7 lrc: 3/0,1 mode: PW/PW res: [0x344ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531659.040148:0:191990:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f7e6a6f/0x3234de053ca24e7 lrc: 3/0,1 mode: PW/PW res: [0x344ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531659.040153:0:191990:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003f7e6a6f/0x3234de053ca24e7 lrc: 2/0,0 mode: PW/PW res: [0x344ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651531659.040214:0:191990:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x344fe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:1.0:1651531659.040218:0:191990:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2f464ac/0x3234de053ca24ee lrc: 3/0,1 mode: --/PW res: [0x344fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531659.040257:0:191990:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531659.040258:0:191990:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531659.040259:0:191990:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2f464ac/0x3234de053ca24ee lrc: 3/0,1 mode: PW/PW res: [0x344fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531659.040266:0:191990:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2f464ac/0x3234de053ca24ee lrc: 3/0,1 mode: PW/PW res: [0x344fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531659.040271:0:191990:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2f464ac/0x3234de053ca24ee lrc: 3/0,1 mode: PW/PW res: [0x344fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531659.040276:0:191990:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e2f464ac/0x3234de053ca24ee lrc: 2/0,0 mode: PW/PW res: [0x344fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.040276:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002f2479f0/0x3234de053ca24d9 lrc: 2/0,0 mode: PW/PW res: [0x34501:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.040283:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002f2479f0 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531659.040284:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002f2479f0/0x3234de053ca24d9 lrc: 2/0,0 mode: PW/PW res: [0x34501:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.040289:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002f2479f0/0x3234de053ca24d9 lrc: 3/0,0 mode: PW/PW res: [0x34501:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.040298:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002f2479f0/0x3234de053ca24d9 lrc: 1/0,0 mode: --/PW res: [0x34501:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.040301:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002f2479f0/0x3234de053ca24d9 lrc: 0/0,0 mode: --/PW res: [0x34501:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.040308:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000049c67f6a/0x3234de053ca24e0 lrc: 2/0,0 mode: PW/PW res: [0x34500:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.040316:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000049c67f6a already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531659.040316:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000049c67f6a/0x3234de053ca24e0 lrc: 2/0,0 mode: PW/PW res: [0x34500:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.040319:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000049c67f6a/0x3234de053ca24e0 lrc: 3/0,0 mode: PW/PW res: [0x34500:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.040322:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000049c67f6a/0x3234de053ca24e0 lrc: 1/0,0 mode: --/PW res: [0x34500:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.040325:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000049c67f6a/0x3234de053ca24e0 lrc: 0/0,0 mode: --/PW res: [0x34500:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.040329:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003f7e6a6f/0x3234de053ca24e7 lrc: 2/0,0 mode: PW/PW res: [0x344ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.040331:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003f7e6a6f already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531659.040332:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003f7e6a6f/0x3234de053ca24e7 lrc: 2/0,0 mode: PW/PW res: [0x344ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.040335:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003f7e6a6f/0x3234de053ca24e7 lrc: 3/0,0 mode: PW/PW res: [0x344ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.040338:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003f7e6a6f/0x3234de053ca24e7 lrc: 1/0,0 mode: --/PW res: [0x344ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.040340:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003f7e6a6f/0x3234de053ca24e7 lrc: 0/0,0 mode: --/PW res: [0x344ff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651531659.040343:0:191990:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x344fd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:0.0:1651531659.040345:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e2f464ac/0x3234de053ca24ee lrc: 2/0,0 mode: PW/PW res: [0x344fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531659.040346:0:191990:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035e369e2/0x3234de053ca24f5 lrc: 3/0,1 mode: --/PW res: [0x344fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.040348:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e2f464ac already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531659.040348:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2f464ac/0x3234de053ca24ee lrc: 2/0,0 mode: PW/PW res: [0x344fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.040351:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2f464ac/0x3234de053ca24ee lrc: 3/0,0 mode: PW/PW res: [0x344fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.040354:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e2f464ac/0x3234de053ca24ee lrc: 1/0,0 mode: --/PW res: [0x344fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.040356:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2f464ac/0x3234de053ca24ee lrc: 0/0,0 mode: --/PW res: [0x344fe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531659.040361:0:191990:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531659.040362:0:191990:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531659.040363:0:191990:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000035e369e2/0x3234de053ca24f5 lrc: 3/0,1 mode: PW/PW res: [0x344fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531659.040369:0:191990:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000035e369e2/0x3234de053ca24f5 lrc: 3/0,1 mode: PW/PW res: [0x344fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531659.040374:0:191990:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035e369e2/0x3234de053ca24f5 lrc: 3/0,1 mode: PW/PW res: [0x344fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531659.040379:0:191990:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000035e369e2/0x3234de053ca24f5 lrc: 2/0,0 mode: PW/PW res: [0x344fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651531659.040445:0:191990:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x344fc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:1.0:1651531659.040448:0:191990:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000083070e4b/0x3234de053ca24fc lrc: 3/0,1 mode: --/PW res: [0x344fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531659.040454:0:191990:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531659.040455:0:191990:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531659.040456:0:191990:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000083070e4b/0x3234de053ca24fc lrc: 3/0,1 mode: PW/PW res: [0x344fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531659.040462:0:191990:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000083070e4b/0x3234de053ca24fc lrc: 3/0,1 mode: PW/PW res: [0x344fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531659.040466:0:191990:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000083070e4b/0x3234de053ca24fc lrc: 3/0,1 mode: PW/PW res: [0x344fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531659.040476:0:191990:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000083070e4b/0x3234de053ca24fc lrc: 2/0,0 mode: PW/PW res: [0x344fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651531659.040546:0:191990:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x344fb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:1.0:1651531659.040549:0:191990:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000007a8a843/0x3234de053ca2503 lrc: 3/0,1 mode: --/PW res: [0x344fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531659.040555:0:191990:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531659.040555:0:191990:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531659.040557:0:191990:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000007a8a843/0x3234de053ca2503 lrc: 3/0,1 mode: PW/PW res: [0x344fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531659.040563:0:191990:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000007a8a843/0x3234de053ca2503 lrc: 3/0,1 mode: PW/PW res: [0x344fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.040565:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000035e369e2/0x3234de053ca24f5 lrc: 2/0,0 mode: PW/PW res: [0x344fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531659.040568:0:191990:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000007a8a843/0x3234de053ca2503 lrc: 3/0,1 mode: PW/PW res: [0x344fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.040569:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000035e369e2 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531659.040570:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000035e369e2/0x3234de053ca24f5 lrc: 2/0,0 mode: PW/PW res: [0x344fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531659.040573:0:191990:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000007a8a843/0x3234de053ca2503 lrc: 2/0,0 mode: PW/PW res: [0x344fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.040573:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000035e369e2/0x3234de053ca24f5 lrc: 3/0,0 mode: PW/PW res: [0x344fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.040578:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000035e369e2/0x3234de053ca24f5 lrc: 1/0,0 mode: --/PW res: [0x344fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.040590:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000035e369e2/0x3234de053ca24f5 lrc: 0/0,0 mode: --/PW res: [0x344fd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.040596:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000083070e4b/0x3234de053ca24fc lrc: 2/0,0 mode: PW/PW res: [0x344fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.040599:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000083070e4b already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531659.040600:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000083070e4b/0x3234de053ca24fc lrc: 2/0,0 mode: PW/PW res: [0x344fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.040602:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000083070e4b/0x3234de053ca24fc lrc: 3/0,0 mode: PW/PW res: [0x344fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.040606:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000083070e4b/0x3234de053ca24fc lrc: 1/0,0 mode: --/PW res: [0x344fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.040608:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000083070e4b/0x3234de053ca24fc lrc: 0/0,0 mode: --/PW res: [0x344fc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.040611:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000007a8a843/0x3234de053ca2503 lrc: 2/0,0 mode: PW/PW res: [0x344fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.040614:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000007a8a843 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531659.040615:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000007a8a843/0x3234de053ca2503 lrc: 2/0,0 mode: PW/PW res: [0x344fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.040620:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000007a8a843/0x3234de053ca2503 lrc: 3/0,0 mode: PW/PW res: [0x344fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.040624:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000007a8a843/0x3234de053ca2503 lrc: 1/0,0 mode: --/PW res: [0x344fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.040626:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000007a8a843/0x3234de053ca2503 lrc: 0/0,0 mode: --/PW res: [0x344fb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651531659.040641:0:191990:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x344fa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:1.0:1651531659.040644:0:191990:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cfb802a0/0x3234de053ca250a lrc: 3/0,1 mode: --/PW res: [0x344fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531659.040650:0:191990:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531659.040651:0:191990:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531659.040653:0:191990:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cfb802a0/0x3234de053ca250a lrc: 3/0,1 mode: PW/PW res: [0x344fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531659.040661:0:191990:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cfb802a0/0x3234de053ca250a lrc: 3/0,1 mode: PW/PW res: [0x344fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531659.040666:0:191990:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cfb802a0/0x3234de053ca250a lrc: 3/0,1 mode: PW/PW res: [0x344fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531659.040671:0:191990:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cfb802a0/0x3234de053ca250a lrc: 2/0,0 mode: PW/PW res: [0x344fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.040697:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cfb802a0/0x3234de053ca250a lrc: 2/0,0 mode: PW/PW res: [0x344fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.040700:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cfb802a0 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531659.040701:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cfb802a0/0x3234de053ca250a lrc: 2/0,0 mode: PW/PW res: [0x344fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.040704:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cfb802a0/0x3234de053ca250a lrc: 3/0,0 mode: PW/PW res: [0x344fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.040708:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cfb802a0/0x3234de053ca250a lrc: 1/0,0 mode: --/PW res: [0x344fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.040711:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cfb802a0/0x3234de053ca250a lrc: 0/0,0 mode: --/PW res: [0x344fa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651531659.040743:0:191990:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x344f9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:1.0:1651531659.040746:0:191990:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000768f2bc3/0x3234de053ca2511 lrc: 3/0,1 mode: --/PW res: [0x344f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531659.040752:0:191990:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531659.040753:0:191990:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531659.040754:0:191990:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000768f2bc3/0x3234de053ca2511 lrc: 3/0,1 mode: PW/PW res: [0x344f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531659.040761:0:191990:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000768f2bc3/0x3234de053ca2511 lrc: 3/0,1 mode: PW/PW res: [0x344f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531659.040766:0:191990:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000768f2bc3/0x3234de053ca2511 lrc: 3/0,1 mode: PW/PW res: [0x344f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531659.040771:0:191990:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000768f2bc3/0x3234de053ca2511 lrc: 2/0,0 mode: PW/PW res: [0x344f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.040800:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000768f2bc3/0x3234de053ca2511 lrc: 2/0,0 mode: PW/PW res: [0x344f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.040807:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000768f2bc3 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531659.040808:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000768f2bc3/0x3234de053ca2511 lrc: 2/0,0 mode: PW/PW res: [0x344f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.040811:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000768f2bc3/0x3234de053ca2511 lrc: 3/0,0 mode: PW/PW res: [0x344f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.040815:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000768f2bc3/0x3234de053ca2511 lrc: 1/0,0 mode: --/PW res: [0x344f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.040818:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000768f2bc3/0x3234de053ca2511 lrc: 0/0,0 mode: --/PW res: [0x344f9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651531659.040849:0:191990:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x344f8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:1.0:1651531659.040852:0:191990:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000030d4a6f9/0x3234de053ca2518 lrc: 3/0,1 mode: --/PW res: [0x344f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531659.040859:0:191990:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531659.040860:0:191990:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531659.040861:0:191990:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000030d4a6f9/0x3234de053ca2518 lrc: 3/0,1 mode: PW/PW res: [0x344f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531659.040867:0:191990:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000030d4a6f9/0x3234de053ca2518 lrc: 3/0,1 mode: PW/PW res: [0x344f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531659.040872:0:191990:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000030d4a6f9/0x3234de053ca2518 lrc: 3/0,1 mode: PW/PW res: [0x344f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531659.040877:0:191990:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000030d4a6f9/0x3234de053ca2518 lrc: 2/0,0 mode: PW/PW res: [0x344f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.040900:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000030d4a6f9/0x3234de053ca2518 lrc: 2/0,0 mode: PW/PW res: [0x344f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.040904:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000030d4a6f9 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531659.040905:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000030d4a6f9/0x3234de053ca2518 lrc: 2/0,0 mode: PW/PW res: [0x344f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.040908:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000030d4a6f9/0x3234de053ca2518 lrc: 3/0,0 mode: PW/PW res: [0x344f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.040911:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000030d4a6f9/0x3234de053ca2518 lrc: 1/0,0 mode: --/PW res: [0x344f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.040914:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000030d4a6f9/0x3234de053ca2518 lrc: 0/0,0 mode: --/PW res: [0x344f8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651531659.040943:0:191990:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x344f7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:1.0:1651531659.040946:0:191990:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e1f4768/0x3234de053ca251f lrc: 3/0,1 mode: --/PW res: [0x344f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531659.040952:0:191990:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531659.040953:0:191990:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531659.040954:0:191990:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e1f4768/0x3234de053ca251f lrc: 3/0,1 mode: PW/PW res: [0x344f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531659.040960:0:191990:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004e1f4768/0x3234de053ca251f lrc: 3/0,1 mode: PW/PW res: [0x344f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531659.040968:0:191990:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e1f4768/0x3234de053ca251f lrc: 3/0,1 mode: PW/PW res: [0x344f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531659.040973:0:191990:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004e1f4768/0x3234de053ca251f lrc: 2/0,0 mode: PW/PW res: [0x344f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.041000:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004e1f4768/0x3234de053ca251f lrc: 2/0,0 mode: PW/PW res: [0x344f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.041003:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004e1f4768 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531659.041004:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004e1f4768/0x3234de053ca251f lrc: 2/0,0 mode: PW/PW res: [0x344f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.041007:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004e1f4768/0x3234de053ca251f lrc: 3/0,0 mode: PW/PW res: [0x344f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.041011:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004e1f4768/0x3234de053ca251f lrc: 1/0,0 mode: --/PW res: [0x344f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.041014:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004e1f4768/0x3234de053ca251f lrc: 0/0,0 mode: --/PW res: [0x344f7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651531659.041048:0:191990:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x344f6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:1.0:1651531659.041052:0:191990:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f253fba8/0x3234de053ca2526 lrc: 3/0,1 mode: --/PW res: [0x344f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531659.041057:0:191990:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531659.041059:0:191990:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531659.041060:0:191990:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f253fba8/0x3234de053ca2526 lrc: 3/0,1 mode: PW/PW res: [0x344f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531659.041066:0:191990:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f253fba8/0x3234de053ca2526 lrc: 3/0,1 mode: PW/PW res: [0x344f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531659.041071:0:191990:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f253fba8/0x3234de053ca2526 lrc: 3/0,1 mode: PW/PW res: [0x344f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531659.041076:0:191990:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f253fba8/0x3234de053ca2526 lrc: 2/0,0 mode: PW/PW res: [0x344f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.041090:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f253fba8/0x3234de053ca2526 lrc: 2/0,0 mode: PW/PW res: [0x344f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.041093:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f253fba8 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531659.041094:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f253fba8/0x3234de053ca2526 lrc: 2/0,0 mode: PW/PW res: [0x344f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.041097:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f253fba8/0x3234de053ca2526 lrc: 3/0,0 mode: PW/PW res: [0x344f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.041100:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f253fba8/0x3234de053ca2526 lrc: 1/0,0 mode: --/PW res: [0x344f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.041104:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f253fba8/0x3234de053ca2526 lrc: 0/0,0 mode: --/PW res: [0x344f6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651531659.041145:0:191990:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x344f5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:1.0:1651531659.041148:0:191990:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000369400b3/0x3234de053ca252d lrc: 3/0,1 mode: --/PW res: [0x344f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531659.041159:0:191990:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531659.041160:0:191990:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531659.041161:0:191990:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000369400b3/0x3234de053ca252d lrc: 3/0,1 mode: PW/PW res: [0x344f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531659.041167:0:191990:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000369400b3/0x3234de053ca252d lrc: 3/0,1 mode: PW/PW res: [0x344f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531659.041172:0:191990:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000369400b3/0x3234de053ca252d lrc: 3/0,1 mode: PW/PW res: [0x344f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531659.041177:0:191990:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000369400b3/0x3234de053ca252d lrc: 2/0,0 mode: PW/PW res: [0x344f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.041190:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000369400b3/0x3234de053ca252d lrc: 2/0,0 mode: PW/PW res: [0x344f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.041193:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000369400b3 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531659.041194:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000369400b3/0x3234de053ca252d lrc: 2/0,0 mode: PW/PW res: [0x344f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.041197:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000369400b3/0x3234de053ca252d lrc: 3/0,0 mode: PW/PW res: [0x344f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.041200:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000369400b3/0x3234de053ca252d lrc: 1/0,0 mode: --/PW res: [0x344f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.041203:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000369400b3/0x3234de053ca252d lrc: 0/0,0 mode: --/PW res: [0x344f5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651531659.041258:0:191990:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x344f4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:1.0:1651531659.041261:0:191990:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b93c49e9/0x3234de053ca2534 lrc: 3/0,1 mode: --/PW res: [0x344f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531659.041267:0:191990:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531659.041268:0:191990:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531659.041269:0:191990:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b93c49e9/0x3234de053ca2534 lrc: 3/0,1 mode: PW/PW res: [0x344f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531659.041275:0:191990:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b93c49e9/0x3234de053ca2534 lrc: 3/0,1 mode: PW/PW res: [0x344f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531659.041280:0:191990:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b93c49e9/0x3234de053ca2534 lrc: 3/0,1 mode: PW/PW res: [0x344f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531659.041290:0:191990:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b93c49e9/0x3234de053ca2534 lrc: 2/0,0 mode: PW/PW res: [0x344f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.041304:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b93c49e9/0x3234de053ca2534 lrc: 2/0,0 mode: PW/PW res: [0x344f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.041307:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b93c49e9 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531659.041308:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b93c49e9/0x3234de053ca2534 lrc: 2/0,0 mode: PW/PW res: [0x344f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.041314:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b93c49e9/0x3234de053ca2534 lrc: 3/0,0 mode: PW/PW res: [0x344f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.041318:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b93c49e9/0x3234de053ca2534 lrc: 1/0,0 mode: --/PW res: [0x344f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.041320:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b93c49e9/0x3234de053ca2534 lrc: 0/0,0 mode: --/PW res: [0x344f4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651531659.041356:0:191990:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x344f3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:1.0:1651531659.041359:0:191990:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000141899af/0x3234de053ca253b lrc: 3/0,1 mode: --/PW res: [0x344f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531659.041366:0:191990:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531659.041367:0:191990:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531659.041368:0:191990:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000141899af/0x3234de053ca253b lrc: 3/0,1 mode: PW/PW res: [0x344f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531659.041374:0:191990:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000141899af/0x3234de053ca253b lrc: 3/0,1 mode: PW/PW res: [0x344f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531659.041380:0:191990:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000141899af/0x3234de053ca253b lrc: 3/0,1 mode: PW/PW res: [0x344f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531659.041385:0:191990:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000141899af/0x3234de053ca253b lrc: 2/0,0 mode: PW/PW res: [0x344f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.041397:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000141899af/0x3234de053ca253b lrc: 2/0,0 mode: PW/PW res: [0x344f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.041400:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000141899af already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531659.041401:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000141899af/0x3234de053ca253b lrc: 2/0,0 mode: PW/PW res: [0x344f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.041404:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000141899af/0x3234de053ca253b lrc: 3/0,0 mode: PW/PW res: [0x344f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.041407:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000141899af/0x3234de053ca253b lrc: 1/0,0 mode: --/PW res: [0x344f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.041410:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000141899af/0x3234de053ca253b lrc: 0/0,0 mode: --/PW res: [0x344f3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651531659.041451:0:191990:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x344f2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:1.0:1651531659.041454:0:191990:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca2542 lrc: 3/0,1 mode: --/PW res: [0x344f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531659.041459:0:191990:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531659.041460:0:191990:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531659.041461:0:191990:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca2542 lrc: 3/0,1 mode: PW/PW res: [0x344f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531659.041469:0:191990:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca2542 lrc: 3/0,1 mode: PW/PW res: [0x344f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531659.041474:0:191990:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca2542 lrc: 3/0,1 mode: PW/PW res: [0x344f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531659.041478:0:191990:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca2542 lrc: 2/0,0 mode: PW/PW res: [0x344f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.041491:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca2542 lrc: 2/0,0 mode: PW/PW res: [0x344f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.041495:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000077fc7eeb already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531659.041496:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca2542 lrc: 2/0,0 mode: PW/PW res: [0x344f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.041499:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca2542 lrc: 3/0,0 mode: PW/PW res: [0x344f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.041502:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca2542 lrc: 1/0,0 mode: --/PW res: [0x344f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.041505:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca2542 lrc: 0/0,0 mode: --/PW res: [0x344f2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651531659.041541:0:191990:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x344f1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:1.0:1651531659.041544:0:191990:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9908e14/0x3234de053ca2549 lrc: 3/0,1 mode: --/PW res: [0x344f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531659.041550:0:191990:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531659.041551:0:191990:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531659.041552:0:191990:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9908e14/0x3234de053ca2549 lrc: 3/0,1 mode: PW/PW res: [0x344f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531659.041558:0:191990:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9908e14/0x3234de053ca2549 lrc: 3/0,1 mode: PW/PW res: [0x344f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531659.041563:0:191990:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9908e14/0x3234de053ca2549 lrc: 3/0,1 mode: PW/PW res: [0x344f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531659.041568:0:191990:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e9908e14/0x3234de053ca2549 lrc: 2/0,0 mode: PW/PW res: [0x344f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.041587:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e9908e14/0x3234de053ca2549 lrc: 2/0,0 mode: PW/PW res: [0x344f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.041590:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e9908e14 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531659.041591:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9908e14/0x3234de053ca2549 lrc: 2/0,0 mode: PW/PW res: [0x344f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.041593:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9908e14/0x3234de053ca2549 lrc: 3/0,0 mode: PW/PW res: [0x344f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.041597:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e9908e14/0x3234de053ca2549 lrc: 1/0,0 mode: --/PW res: [0x344f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.041600:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9908e14/0x3234de053ca2549 lrc: 0/0,0 mode: --/PW res: [0x344f1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651531659.041638:0:191990:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x344f0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:1.0:1651531659.041641:0:191990:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000df4fd81c/0x3234de053ca2550 lrc: 3/0,1 mode: --/PW res: [0x344f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531659.041647:0:191990:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531659.041648:0:191990:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531659.041650:0:191990:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000df4fd81c/0x3234de053ca2550 lrc: 3/0,1 mode: PW/PW res: [0x344f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531659.041655:0:191990:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000df4fd81c/0x3234de053ca2550 lrc: 3/0,1 mode: PW/PW res: [0x344f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531659.041661:0:191990:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000df4fd81c/0x3234de053ca2550 lrc: 3/0,1 mode: PW/PW res: [0x344f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531659.041666:0:191990:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000df4fd81c/0x3234de053ca2550 lrc: 2/0,0 mode: PW/PW res: [0x344f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.041679:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000df4fd81c/0x3234de053ca2550 lrc: 2/0,0 mode: PW/PW res: [0x344f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.041682:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000df4fd81c already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531659.041683:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000df4fd81c/0x3234de053ca2550 lrc: 2/0,0 mode: PW/PW res: [0x344f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.041686:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000df4fd81c/0x3234de053ca2550 lrc: 3/0,0 mode: PW/PW res: [0x344f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.041689:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000df4fd81c/0x3234de053ca2550 lrc: 1/0,0 mode: --/PW res: [0x344f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.041692:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000df4fd81c/0x3234de053ca2550 lrc: 0/0,0 mode: --/PW res: [0x344f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651531659.041728:0:191990:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x344ef:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:1.0:1651531659.041731:0:191990:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003ad4b055/0x3234de053ca2557 lrc: 3/0,1 mode: --/PW res: [0x344ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531659.041737:0:191990:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531659.041738:0:191990:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531659.041739:0:191990:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003ad4b055/0x3234de053ca2557 lrc: 3/0,1 mode: PW/PW res: [0x344ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531659.041745:0:191990:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003ad4b055/0x3234de053ca2557 lrc: 3/0,1 mode: PW/PW res: [0x344ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531659.041753:0:191990:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003ad4b055/0x3234de053ca2557 lrc: 3/0,1 mode: PW/PW res: [0x344ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531659.041757:0:191990:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003ad4b055/0x3234de053ca2557 lrc: 2/0,0 mode: PW/PW res: [0x344ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.041771:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003ad4b055/0x3234de053ca2557 lrc: 2/0,0 mode: PW/PW res: [0x344ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.041774:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003ad4b055 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531659.041775:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003ad4b055/0x3234de053ca2557 lrc: 2/0,0 mode: PW/PW res: [0x344ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.041778:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003ad4b055/0x3234de053ca2557 lrc: 3/0,0 mode: PW/PW res: [0x344ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.041781:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003ad4b055/0x3234de053ca2557 lrc: 1/0,0 mode: --/PW res: [0x344ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.041785:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003ad4b055/0x3234de053ca2557 lrc: 0/0,0 mode: --/PW res: [0x344ef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651531659.041831:0:191990:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x344ee:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:1.0:1651531659.041834:0:191990:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca255e lrc: 3/0,1 mode: --/PW res: [0x344ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531659.041840:0:191990:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531659.041841:0:191990:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531659.041842:0:191990:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca255e lrc: 3/0,1 mode: PW/PW res: [0x344ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531659.041848:0:191990:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca255e lrc: 3/0,1 mode: PW/PW res: [0x344ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531659.041852:0:191990:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca255e lrc: 3/0,1 mode: PW/PW res: [0x344ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531659.041857:0:191990:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca255e lrc: 2/0,0 mode: PW/PW res: [0x344ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.041870:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca255e lrc: 2/0,0 mode: PW/PW res: [0x344ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.041873:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006878f48a already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531659.041874:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca255e lrc: 2/0,0 mode: PW/PW res: [0x344ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.041876:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca255e lrc: 3/0,0 mode: PW/PW res: [0x344ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.041880:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca255e lrc: 1/0,0 mode: --/PW res: [0x344ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.041883:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca255e lrc: 0/0,0 mode: --/PW res: [0x344ee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651531659.041919:0:191990:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x344ed:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:1.0:1651531659.041922:0:191990:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d0d3608/0x3234de053ca2565 lrc: 3/0,1 mode: --/PW res: [0x344ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531659.041933:0:191990:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531659.041934:0:191990:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531659.041936:0:191990:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008d0d3608/0x3234de053ca2565 lrc: 3/0,1 mode: PW/PW res: [0x344ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531659.041941:0:191990:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008d0d3608/0x3234de053ca2565 lrc: 3/0,1 mode: PW/PW res: [0x344ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531659.041946:0:191990:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d0d3608/0x3234de053ca2565 lrc: 3/0,1 mode: PW/PW res: [0x344ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531659.041951:0:191990:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008d0d3608/0x3234de053ca2565 lrc: 2/0,0 mode: PW/PW res: [0x344ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.041963:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008d0d3608/0x3234de053ca2565 lrc: 2/0,0 mode: PW/PW res: [0x344ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.041966:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008d0d3608 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531659.041967:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008d0d3608/0x3234de053ca2565 lrc: 2/0,0 mode: PW/PW res: [0x344ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.041973:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008d0d3608/0x3234de053ca2565 lrc: 3/0,0 mode: PW/PW res: [0x344ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.041977:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008d0d3608/0x3234de053ca2565 lrc: 1/0,0 mode: --/PW res: [0x344ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.041979:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008d0d3608/0x3234de053ca2565 lrc: 0/0,0 mode: --/PW res: [0x344ed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651531659.042025:0:191990:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x344ec:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:1.0:1651531659.042029:0:191990:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000378a069e/0x3234de053ca256c lrc: 3/0,1 mode: --/PW res: [0x344ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531659.042034:0:191990:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531659.042035:0:191990:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531659.042036:0:191990:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000378a069e/0x3234de053ca256c lrc: 3/0,1 mode: PW/PW res: [0x344ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531659.042042:0:191990:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000378a069e/0x3234de053ca256c lrc: 3/0,1 mode: PW/PW res: [0x344ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531659.042047:0:191990:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000378a069e/0x3234de053ca256c lrc: 3/0,1 mode: PW/PW res: [0x344ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531659.042058:0:191990:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000378a069e/0x3234de053ca256c lrc: 2/0,0 mode: PW/PW res: [0x344ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.042071:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000378a069e/0x3234de053ca256c lrc: 2/0,0 mode: PW/PW res: [0x344ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.042074:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000378a069e already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531659.042075:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000378a069e/0x3234de053ca256c lrc: 2/0,0 mode: PW/PW res: [0x344ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.042078:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000378a069e/0x3234de053ca256c lrc: 3/0,0 mode: PW/PW res: [0x344ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.042081:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000378a069e/0x3234de053ca256c lrc: 1/0,0 mode: --/PW res: [0x344ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.042084:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000378a069e/0x3234de053ca256c lrc: 0/0,0 mode: --/PW res: [0x344ec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651531659.042117:0:191990:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x344eb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:1.0:1651531659.042120:0:191990:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ee3405a/0x3234de053ca2573 lrc: 3/0,1 mode: --/PW res: [0x344eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531659.042127:0:191990:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531659.042128:0:191990:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531659.042129:0:191990:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ee3405a/0x3234de053ca2573 lrc: 3/0,1 mode: PW/PW res: [0x344eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531659.042135:0:191990:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001ee3405a/0x3234de053ca2573 lrc: 3/0,1 mode: PW/PW res: [0x344eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531659.042140:0:191990:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ee3405a/0x3234de053ca2573 lrc: 3/0,1 mode: PW/PW res: [0x344eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531659.042145:0:191990:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001ee3405a/0x3234de053ca2573 lrc: 2/0,0 mode: PW/PW res: [0x344eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.042158:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001ee3405a/0x3234de053ca2573 lrc: 2/0,0 mode: PW/PW res: [0x344eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.042162:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001ee3405a already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531659.042163:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001ee3405a/0x3234de053ca2573 lrc: 2/0,0 mode: PW/PW res: [0x344eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.042165:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001ee3405a/0x3234de053ca2573 lrc: 3/0,0 mode: PW/PW res: [0x344eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.042169:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001ee3405a/0x3234de053ca2573 lrc: 1/0,0 mode: --/PW res: [0x344eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.042171:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ee3405a/0x3234de053ca2573 lrc: 0/0,0 mode: --/PW res: [0x344eb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651531659.042215:0:191990:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x344ea:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:1.0:1651531659.042219:0:191990:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea9f3321/0x3234de053ca257a lrc: 3/0,1 mode: --/PW res: [0x344ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531659.042242:0:191990:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531659.042243:0:191990:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531659.042244:0:191990:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea9f3321/0x3234de053ca257a lrc: 3/0,1 mode: PW/PW res: [0x344ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531659.042253:0:191990:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ea9f3321/0x3234de053ca257a lrc: 3/0,1 mode: PW/PW res: [0x344ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531659.042258:0:191990:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea9f3321/0x3234de053ca257a lrc: 3/0,1 mode: PW/PW res: [0x344ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531659.042262:0:191990:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ea9f3321/0x3234de053ca257a lrc: 2/0,0 mode: PW/PW res: [0x344ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.042275:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ea9f3321/0x3234de053ca257a lrc: 2/0,0 mode: PW/PW res: [0x344ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.042279:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ea9f3321 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531659.042280:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea9f3321/0x3234de053ca257a lrc: 2/0,0 mode: PW/PW res: [0x344ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.042282:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea9f3321/0x3234de053ca257a lrc: 3/0,0 mode: PW/PW res: [0x344ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.042286:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ea9f3321/0x3234de053ca257a lrc: 1/0,0 mode: --/PW res: [0x344ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.042289:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ea9f3321/0x3234de053ca257a lrc: 0/0,0 mode: --/PW res: [0x344ea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651531659.042333:0:191990:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x344e9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:1.0:1651531659.042336:0:191990:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bfa41eae/0x3234de053ca2581 lrc: 3/0,1 mode: --/PW res: [0x344e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531659.042342:0:191990:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531659.042343:0:191990:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531659.042345:0:191990:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bfa41eae/0x3234de053ca2581 lrc: 3/0,1 mode: PW/PW res: [0x344e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531659.042351:0:191990:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bfa41eae/0x3234de053ca2581 lrc: 3/0,1 mode: PW/PW res: [0x344e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531659.042357:0:191990:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bfa41eae/0x3234de053ca2581 lrc: 3/0,1 mode: PW/PW res: [0x344e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531659.042361:0:191990:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bfa41eae/0x3234de053ca2581 lrc: 2/0,0 mode: PW/PW res: [0x344e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.042381:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bfa41eae/0x3234de053ca2581 lrc: 2/0,0 mode: PW/PW res: [0x344e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.042384:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000bfa41eae already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531659.042385:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bfa41eae/0x3234de053ca2581 lrc: 2/0,0 mode: PW/PW res: [0x344e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.042388:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bfa41eae/0x3234de053ca2581 lrc: 3/0,0 mode: PW/PW res: [0x344e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.042391:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bfa41eae/0x3234de053ca2581 lrc: 1/0,0 mode: --/PW res: [0x344e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.042394:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bfa41eae/0x3234de053ca2581 lrc: 0/0,0 mode: --/PW res: [0x344e9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651531659.042432:0:191990:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x344e8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:1.0:1651531659.042435:0:191990:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dfdae7d6/0x3234de053ca2588 lrc: 3/0,1 mode: --/PW res: [0x344e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531659.042441:0:191990:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531659.042442:0:191990:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531659.042443:0:191990:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dfdae7d6/0x3234de053ca2588 lrc: 3/0,1 mode: PW/PW res: [0x344e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531659.042449:0:191990:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dfdae7d6/0x3234de053ca2588 lrc: 3/0,1 mode: PW/PW res: [0x344e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531659.042455:0:191990:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dfdae7d6/0x3234de053ca2588 lrc: 3/0,1 mode: PW/PW res: [0x344e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531659.042459:0:191990:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dfdae7d6/0x3234de053ca2588 lrc: 2/0,0 mode: PW/PW res: [0x344e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.042472:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dfdae7d6/0x3234de053ca2588 lrc: 2/0,0 mode: PW/PW res: [0x344e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.042475:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000dfdae7d6 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531659.042476:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dfdae7d6/0x3234de053ca2588 lrc: 2/0,0 mode: PW/PW res: [0x344e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.042479:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dfdae7d6/0x3234de053ca2588 lrc: 3/0,0 mode: PW/PW res: [0x344e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.042482:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dfdae7d6/0x3234de053ca2588 lrc: 1/0,0 mode: --/PW res: [0x344e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.042486:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dfdae7d6/0x3234de053ca2588 lrc: 0/0,0 mode: --/PW res: [0x344e8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651531659.042526:0:191990:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x344e7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:1.0:1651531659.042529:0:191990:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003dec1fa8/0x3234de053ca258f lrc: 3/0,1 mode: --/PW res: [0x344e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531659.042535:0:191990:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531659.042536:0:191990:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531659.042537:0:191990:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003dec1fa8/0x3234de053ca258f lrc: 3/0,1 mode: PW/PW res: [0x344e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531659.042543:0:191990:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003dec1fa8/0x3234de053ca258f lrc: 3/0,1 mode: PW/PW res: [0x344e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531659.042550:0:191990:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003dec1fa8/0x3234de053ca258f lrc: 3/0,1 mode: PW/PW res: [0x344e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531659.042555:0:191990:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003dec1fa8/0x3234de053ca258f lrc: 2/0,0 mode: PW/PW res: [0x344e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.042567:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003dec1fa8/0x3234de053ca258f lrc: 2/0,0 mode: PW/PW res: [0x344e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.042570:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003dec1fa8 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531659.042571:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003dec1fa8/0x3234de053ca258f lrc: 2/0,0 mode: PW/PW res: [0x344e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.042574:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003dec1fa8/0x3234de053ca258f lrc: 3/0,0 mode: PW/PW res: [0x344e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.042578:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003dec1fa8/0x3234de053ca258f lrc: 1/0,0 mode: --/PW res: [0x344e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.042580:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003dec1fa8/0x3234de053ca258f lrc: 0/0,0 mode: --/PW res: [0x344e7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651531659.042616:0:191990:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x344e6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:1.0:1651531659.042620:0:191990:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e3ad07b/0x3234de053ca2596 lrc: 3/0,1 mode: --/PW res: [0x344e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531659.042625:0:191990:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531659.042626:0:191990:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531659.042627:0:191990:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003e3ad07b/0x3234de053ca2596 lrc: 3/0,1 mode: PW/PW res: [0x344e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531659.042633:0:191990:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003e3ad07b/0x3234de053ca2596 lrc: 3/0,1 mode: PW/PW res: [0x344e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531659.042638:0:191990:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e3ad07b/0x3234de053ca2596 lrc: 3/0,1 mode: PW/PW res: [0x344e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531659.042643:0:191990:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003e3ad07b/0x3234de053ca2596 lrc: 2/0,0 mode: PW/PW res: [0x344e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.042656:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003e3ad07b/0x3234de053ca2596 lrc: 2/0,0 mode: PW/PW res: [0x344e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.042659:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003e3ad07b already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531659.042660:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003e3ad07b/0x3234de053ca2596 lrc: 2/0,0 mode: PW/PW res: [0x344e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.042665:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003e3ad07b/0x3234de053ca2596 lrc: 3/0,0 mode: PW/PW res: [0x344e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.042669:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003e3ad07b/0x3234de053ca2596 lrc: 1/0,0 mode: --/PW res: [0x344e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531659.042672:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003e3ad07b/0x3234de053ca2596 lrc: 0/0,0 mode: --/PW res: [0x344e6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00002000:00080000:1.0:1651531659.042686:0:191990:0:(ofd_dev.c:1469:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x0:214245
00000100:00100000:1.0:1651531659.042721:0:191990:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005dd15341 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:318354:x1731745950929472:12345-10.240.43.61@tcp:5:osp-pre-1-0.0 Request processed in 5344us (5432us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531659.042734:0:191990:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 44163
00000100:00100000:0.0:1651531659.042932:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651531659.042961:0:191990:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745950929600
00000100:00100000:1.0:1651531659.042981:0:191990:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 44164
00000100:00100000:1.0:1651531659.042996:0:191990:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cb9f189a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:318354:x1731745950929600:12345-10.240.43.61@tcp:5:osp-pre-1-0.0
00002000:00080000:1.0:1651531659.043012:0:191990:0:(ofd_dev.c:1706:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x0 at 214274
00000100:00100000:1.0:1651531659.044114:0:191990:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cb9f189a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:318354:x1731745950929600:12345-10.240.43.61@tcp:5:osp-pre-1-0.0 Request processed in 1129us (1181us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531659.044120:0:191990:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 44164
00000400:00000080:1.0:1651531660.444750:0:219333:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648
00000001:02000400:1.0:1651531660.444752:0:219333:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 258a: verify i_mutex security behavior when suid attributes is set ========================================================== 22:47:40 (1651531660)
00000100:00100000:0.0:1651531660.475732:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531660.475751:0:191990:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754464956096
00000100:00100000:0.0:1651531660.475769:0:191990:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44165
00000100:00100000:0.0:1651531660.475772:0:191990:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a5d8c030 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:37d7cd70-23c8-4282-b9a2-e45fd1319801+5:438149:x1731754464956096:12345-10.240.43.64@tcp:2:touch.0
00000100:00100000:0.0:1651531660.475874:0:191990:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a5d8c030 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:37d7cd70-23c8-4282-b9a2-e45fd1319801+6:438149:x1731754464956096:12345-10.240.43.64@tcp:2:touch.0 Request processed in 101us (144us total) trans 21474868954 rc 0/0
00000100:00100000:0.0:1651531660.475878:0:191990:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44165
00000100:00100000:0.0:1651531660.479129:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531660.479138:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754464956416
00000100:00100000:0.0:1651531660.479146:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44166
00000100:00100000:0.0:1651531660.479147:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000015411af3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:37d7cd70-23c8-4282-b9a2-e45fd1319801+6:438147:x1731754464956416:12345-10.240.43.64@tcp:101:chmod.0
00010000:00010000:0.0:1651531660.479152:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531660.479161:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e5cdccc8/0x3234de053ca259d lrc: 2/0,0 mode: --/PR res: [0x34502:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db435a72 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00002000:00010000:0.0:1651531660.479174:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34502:0x0] initial LVB size: 0, mtime: 0x62705f8c, atime: 0x62705f8c, ctime: 0x62705f8c, blocks: 0x0
00010000:00010000:0.0:1651531660.479180:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531660.479181:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531660.479185:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e5cdccc8/0x3234de053ca259d lrc: 3/0,0 mode: PR/PR res: [0x34502:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db435a72 expref: 7 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531660.479193:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e5cdccc8/0x3234de053ca259d lrc: 3/0,0 mode: PR/PR res: [0x34502:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db435a72 expref: 7 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531660.479198:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e5cdccc8, rc 0)
00000100:00100000:0.0:1651531660.479208:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000015411af3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:37d7cd70-23c8-4282-b9a2-e45fd1319801+7:438147:x1731754464956416:12345-10.240.43.64@tcp:101:chmod.0 Request processed in 60us (80us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531660.479211:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44166
00000100:00100000:0.0:1651531660.480263:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531660.480270:0:191990:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754464956672
00000100:00100000:0.0:1651531660.480277:0:191990:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44167
00000100:00100000:0.0:1651531660.480279:0:191990:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f646cd75 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:37d7cd70-23c8-4282-b9a2-e45fd1319801+7:438146:x1731754464956672:12345-10.240.43.64@tcp:2:chmod.0
00002000:00010000:0.0:1651531660.480305:0:191990:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x34502:0x0] updating lvb size from disk: 0 -> 0
00002000:00010000:0.0:1651531660.480307:0:191990:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x34502:0x0] updating lvb mtime from disk: 1651531660 -> 1651531660
00002000:00010000:0.0:1651531660.480308:0:191990:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x34502:0x0] updating lvb atime from disk: 1651531660 -> 1651531660
00002000:00010000:0.0:1651531660.480308:0:191990:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x34502:0x0] updating lvb ctime from disk: 1651531660 -> 1651531660
00002000:00010000:0.0:1651531660.480309:0:191990:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x34502:0x0] updating lvb blocks from disk: 0 -> 0
00000100:00100000:0.0:1651531660.480320:0:191990:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f646cd75 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:37d7cd70-23c8-4282-b9a2-e45fd1319801+8:438146:x1731754464956672:12345-10.240.43.64@tcp:2:chmod.0 Request processed in 40us (58us total) trans 21474868955 rc 0/0
00000100:00100000:0.0:1651531660.480322:0:191990:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44167
00000100:00100000:0.0:1651531660.483366:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531660.483374:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754464956928
00000100:00100000:0.0:1651531660.483381:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44168
00000100:00100000:0.0:1651531660.483383:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004ffe7cb4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:37d7cd70-23c8-4282-b9a2-e45fd1319801+8:438147:x1731754464956928:12345-10.240.43.64@tcp:2:chmod.0
00002000:00010000:0.0:1651531660.483404:0:166112:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x34502:0x0] updating lvb size from disk: 0 -> 0
00002000:00010000:0.0:1651531660.483405:0:166112:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x34502:0x0] updating lvb mtime from disk: 1651531660 -> 1651531660
00002000:00010000:0.0:1651531660.483406:0:166112:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x34502:0x0] updating lvb atime from disk: 1651531660 -> 1651531660
00002000:00010000:0.0:1651531660.483407:0:166112:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x34502:0x0] updating lvb ctime from disk: 1651531660 -> 1651531660
00002000:00010000:0.0:1651531660.483407:0:166112:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x34502:0x0] updating lvb blocks from disk: 0 -> 0
00000100:00100000:0.0:1651531660.483418:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004ffe7cb4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:37d7cd70-23c8-4282-b9a2-e45fd1319801+9:438147:x1731754464956928:12345-10.240.43.64@tcp:2:chmod.0 Request processed in 34us (52us total) trans 21474868956 rc 0/0
00000100:00100000:0.0:1651531660.483420:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44168
00000100:00100000:0.0:1651531660.493502:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531660.493509:0:191990:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754464957312
00000100:00100000:0.0:1651531660.493517:0:191990:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44169
00000100:00100000:0.0:1651531660.493518:0:191990:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ec383f97 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:37d7cd70-23c8-4282-b9a2-e45fd1319801+9:642201:x1731754464957312:12345-10.240.43.64@tcp:101:dd.500
00010000:00010000:0.0:1651531660.493522:0:191990:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531660.493526:0:191990:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca25a4 lrc: 2/0,0 mode: --/PW res: [0x34502:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db435a95 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531660.493534:0:191990:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e5cdccc8/0x3234de053ca259d lrc: 2/0,0 mode: PR/PR res: [0x34502:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db435a72 expref: 10 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531660.493537:0:191990:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531660.493538:0:191990:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531660.493539:0:191990:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca25a4 lrc: 4/0,0 mode: --/PW res: [0x34502:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db435a95 expref: 10 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531660.493555:0:191990:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e5cdccc8/0x3234de053ca259d lrc: 3/0,0 mode: PR/PR res: [0x34502:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db435a72 expref: 10 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531660.493560:0:191990:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e5cdccc8/0x3234de053ca259d lrc: 4/0,0 mode: PR/PR res: [0x34502:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db435a72 expref: 10 pid: 166112 timeout: 22469 lvb_type: 1
00000100:00100000:0.0:1651531660.493565:0:191990:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000051619ab4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:191990:1731745997338816:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531660.493584:0:191990:0:(client.c:2492:ptlrpc_set_wait()) set 0000000079e1787a going to sleep for 6 seconds
00000100:00100000:0.0:1651531660.493797:0:191990:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000051619ab4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:191990:1731745997338816:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651531660.493804:0:191990:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca25a4 lrc: 3/0,0 mode: --/PW res: [0x34502:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db435a95 expref: 10 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531660.493810:0:191990:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000968553c1, rc 0)
00000100:00100000:0.0:1651531660.493819:0:191990:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ec383f97 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:37d7cd70-23c8-4282-b9a2-e45fd1319801+10:642201:x1731754464957312:12345-10.240.43.64@tcp:101:dd.500 Request processed in 300us (318us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531660.493822:0:191990:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44169
00000100:00100000:0.0:1651531660.493886:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531660.493895:0:169267:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754464957376
00010000:00010000:0.0:1651531660.493902:0:169267:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e5cdccc8/0x3234de053ca259d lrc: 4/0,0 mode: PR/PR res: [0x34502:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db435a72 expref: 10 pid: 166112 timeout: 22469 lvb_type: 1
00000100:00100000:0.0:1651531660.493917:0:169267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 61
00000100:00100000:0.0:1651531660.493918:0:169267:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000051619ab4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:37d7cd70-23c8-4282-b9a2-e45fd1319801+10:438148:x1731754464957376:12345-10.240.43.64@tcp:103:ldlm_bl_03.0
00010000:00010000:0.0:1651531660.493922:0:169267:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531660.493925:0:169267:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e5cdccc8/0x3234de053ca259d lrc: 4/0,0 mode: PR/PR res: [0x34502:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db435a72 expref: 10 pid: 166112 timeout: 22469 lvb_type: 1
00010000:00010000:0.0:1651531660.493930:0:169267:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e5cdccc8/0x3234de053ca259d lrc: 3/0,0 mode: PR/PR res: [0x34502:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db435a72 expref: 10 pid: 166112 timeout: 22469 lvb_type: 1
00010000:00010000:0.0:1651531660.493937:0:169267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e5cdccc8/0x3234de053ca259d lrc: 0/0,0 mode: --/PR res: [0x34502:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db435a72 expref: 10 pid: 166112 timeout: 22469 lvb_type: 1
00010000:00010000:0.0:1651531660.493941:0:169267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531660.493942:0:169267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531660.493943:0:169267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca25a4 lrc: 2/0,0 mode: PW/PW res: [0x34502:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db435a95 expref: 9 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531660.493946:0:169267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca25a4 lrc: 3/0,0 mode: PW/PW res: [0x34502:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db435a95 expref: 9 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531660.493955:0:169267:0:(ldlm_lockd.c:1067:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca25a4 lrc: 3/0,0 mode: PW/PW res: [0x34502:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db435a95 expref: 9 pid: 191990 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531660.493959:0:169267:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005dd15341 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:169267:1731745997338880:10.240.43.64@tcp:105:
00000100:00100000:0.0:1651531660.493972:0:169267:0:(client.c:2492:ptlrpc_set_wait()) set 0000000079e1787a going to sleep for 6 seconds
00000100:00100000:0.0:1651531660.494209:0:169267:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005dd15341 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:169267:1731745997338880:10.240.43.64@tcp:105:
00010000:00010000:0.0:1651531660.494250:0:169267:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651531660.494259:0:169267:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000051619ab4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:37d7cd70-23c8-4282-b9a2-e45fd1319801+9:438148:x1731754464957376:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 340us (373us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531660.494263:0:169267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 61
00000100:00100000:0.0:1651531660.494284:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531660.494311:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754464957440
00002000:00010000:0.0:1651531660.494318:0:166118:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 214274/0 (0->18446744073709551615)
00002000:00100000:0.0:1651531660.494320:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000005dd15341 with x1731754464957440 ext(0->18446744073709551615)
00002000:00010000:0.0:1651531660.494323:0:166118:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000005dd15341.
00000100:00100000:0.0:1651531660.494332:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249473
00000100:00100000:0.0:1651531660.494334:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005dd15341 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:37d7cd70-23c8-4282-b9a2-e45fd1319801+9:438149:x1731754464957440:12345-10.240.43.64@tcp:10:dd.500
00002000:00010000:0.0:1651531660.494387:0:166118:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x34502:0x0] updating lvb size from disk: 0 -> 0
00002000:00010000:0.0:1651531660.494388:0:166118:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x34502:0x0] updating lvb mtime from disk: 1651531660 -> 1651531660
00002000:00010000:0.0:1651531660.494389:0:166118:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x34502:0x0] updating lvb atime from disk: 1651531660 -> 1651531660
00002000:00010000:0.0:1651531660.494390:0:166118:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x34502:0x0] updating lvb ctime from disk: 1651531660 -> 1651531660
00002000:00010000:0.0:1651531660.494390:0:166118:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x34502:0x0] updating lvb blocks from disk: 0 -> 0
00000100:00100000:0.0:1651531660.494402:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005dd15341 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:37d7cd70-23c8-4282-b9a2-e45fd1319801+10:438149:x1731754464957440:12345-10.240.43.64@tcp:10:dd.500 Request processed in 68us (118us total) trans 21474868957 rc 0/0
00000100:00100000:0.0:1651531660.494405:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249473
00002000:00010000:0.0:1651531660.494407:0:166118:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 214274/0 (0->18446744073709551615)
00002000:00100000:0.0:1651531660.494407:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000005dd15341 with x1731754464957440 ext(0->18446744073709551615)
00002000:00010000:0.0:1651531660.494409:0:166118:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000005dd15341.
00000100:00100000:0.0:1651531660.512148:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651531660.512173:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745950929664
00000100:00100000:1.0:1651531660.512187:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 401
00000100:00100000:1.0:1651531660.512190:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007a05c3e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745950929664:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:1.0:1651531660.512200:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 354733248 pending 0 free 81292156928 avail 77121445888
00000100:00100000:1.0:1651531660.512235:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007a05c3e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745950929664:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 32us (76us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531660.512239:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 401
00000001:00080000:1.0:1651531660.546358:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474868954 is committed
00000001:00100000:1.0:1651531660.546368:0:166098:0:(tgt_lastrcvd.c:537:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID
00000400:00000080:1.0:1651531661.829551:0:219551:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648
00000001:02000400:1.0:1651531661.829553:0:219551:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 258b: verify i_mutex security behavior ==== 22:47:41 (1651531661)
00000400:00000080:1.0:1651531663.175540:0:219769:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648
00000001:02000400:1.0:1651531663.175543:0:219769:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 259: crash at delayed truncate ============ 22:47:42 (1651531662)
00000100:00100000:0.0:1651531663.662355:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651531663.662375:0:191990:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745950929856
00000100:00100000:0.0:1651531663.662396:0:191990:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 44170
00000100:00100000:0.0:1651531663.662399:0:191990:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d44b0d9f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745950929856:12345-10.240.43.61@tcp:6:osp-syn-1-0.0
00002000:00080000:0.0:1651531663.662415:0:191990:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:214274 count 1
00010000:00010000:0.0:1651531663.662429:0:191990:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e5cdccc8/0x3234de053ca25ab lrc: 3/0,1 mode: --/PW res: [0x34502:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531663.662446:0:191990:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca25a4 lrc: 2/0,0 mode: PW/PW res: [0x34502:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db435a95 expref: 8 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531663.662450:0:191990:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531663.662451:0:191990:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531663.662452:0:191990:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e5cdccc8/0x3234de053ca25ab lrc: 4/0,1 mode: --/PW res: [0x34502:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531663.662467:0:191990:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca25a4 lrc: 3/0,0 mode: PW/PW res: [0x34502:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080030020 nid: 10.240.43.64@tcp remote: 0x942f00f5db435a95 expref: 8 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531663.662472:0:191990:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca25a4 lrc: 4/0,0 mode: PW/PW res: [0x34502:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480030020 nid: 10.240.43.64@tcp remote: 0x942f00f5db435a95 expref: 8 pid: 191990 timeout: 22472 lvb_type: 0
00000100:00100000:0.0:1651531663.662479:0:191990:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000380124f4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:191990:1731745997338944:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531663.662507:0:191990:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fadbf296 going to sleep for 6 seconds
00000100:00100000:0.0:1651531663.662881:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531663.662890:0:169267:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754464959808
00010000:00010000:0.0:1651531663.662898:0:169267:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca25a4 lrc: 5/0,0 mode: PW/PW res: [0x34502:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 10.240.43.64@tcp remote: 0x942f00f5db435a95 expref: 9 pid: 191990 timeout: 22472 lvb_type: 0
00000100:00100000:0.0:1651531663.662916:0:169267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 62
00000100:00100000:0.0:1651531663.662920:0:169267:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c65d6bc4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:37d7cd70-23c8-4282-b9a2-e45fd1319801+9:438146:x1731754464959808:12345-10.240.43.64@tcp:103:ldlm_bl_02.0
00010000:00010000:0.0:1651531663.662926:0:169267:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531663.662930:0:169267:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca25a4 lrc: 5/0,0 mode: PW/PW res: [0x34502:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 10.240.43.64@tcp remote: 0x942f00f5db435a95 expref: 9 pid: 191990 timeout: 22472 lvb_type: 0
00010000:00010000:0.0:1651531663.662943:0:169267:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca25a4 lrc: 4/0,0 mode: PW/PW res: [0x34502:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480030020 nid: 10.240.43.64@tcp remote: 0x942f00f5db435a95 expref: 9 pid: 191990 timeout: 22472 lvb_type: 0
00010000:00010000:0.0:1651531663.662956:0:169267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531663.662957:0:169267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531663.662959:0:169267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e5cdccc8/0x3234de053ca25ab lrc: 3/0,1 mode: PW/PW res: [0x34502:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531663.662963:0:169267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e5cdccc8/0x3234de053ca25ab lrc: 4/0,1 mode: PW/PW res: [0x34502:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531663.662969:0:169267:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651531663.662982:0:169267:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c65d6bc4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:37d7cd70-23c8-4282-b9a2-e45fd1319801+9:438146:x1731754464959808:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 62us (103us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531663.662986:0:169267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 62
00010000:00010000:0.0:1651531663.663040:0:191990:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca25a4 lrc: 0/0,0 mode: --/PW res: [0x34502:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480030020 nid: 10.240.43.64@tcp remote: 0x942f00f5db435a95 expref: 8 pid: 191990 timeout: 22472 lvb_type: 0
00000100:00100000:0.0:1651531663.663048:0:191990:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000380124f4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:191990:1731745997338944:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651531663.663055:0:191990:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e5cdccc8/0x3234de053ca25ab lrc: 3/0,1 mode: PW/PW res: [0x34502:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531663.663061:0:191990:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e5cdccc8/0x3234de053ca25ab lrc: 3/0,1 mode: PW/PW res: [0x34502:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531663.663067:0:191990:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e5cdccc8/0x3234de053ca25ab lrc: 3/0,1 mode: PW/PW res: [0x34502:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531663.663073:0:191990:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e5cdccc8/0x3234de053ca25ab lrc: 3/0,1 mode: PW/PW res: [0x34502:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531663.663076:0:191990:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e5cdccc8/0x3234de053ca25ab lrc: 2/0,0 mode: PW/PW res: [0x34502:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531663.663180:0:191990:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d44b0d9f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745950929856:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 781us (830us total) trans 21474868958 rc 0/0
00000100:00100000:0.0:1651531663.663184:0:191990:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 44170
00010000:00010000:0.0:1651531663.663192:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e5cdccc8/0x3234de053ca25ab lrc: 2/0,0 mode: PW/PW res: [0x34502:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531663.663195:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e5cdccc8 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531663.663196:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5cdccc8/0x3234de053ca25ab lrc: 2/0,0 mode: PW/PW res: [0x34502:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531663.663200:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5cdccc8/0x3234de053ca25ab lrc: 3/0,0 mode: PW/PW res: [0x34502:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531663.663205:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e5cdccc8/0x3234de053ca25ab lrc: 1/0,0 mode: --/PW res: [0x34502:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531663.663208:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e5cdccc8/0x3234de053ca25ab lrc: 0/0,0 mode: --/PW res: [0x34502:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531664.509318:0:39100:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000150f2725 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:39100:1731745997339072:10.240.43.61@tcp:400:kworker/u4:1.0
00000100:00100000:0.0:1651531664.509318:0:39099:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000b0b31d1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9063caa-b124-4cb6-99ef-d01a735595c3:39099:1731745997339008:10.240.43.61@tcp:400:kworker/u4:1.0
00000100:00080000:0.0:1651531664.509731:0:39099:0:(recover.c:232:ptlrpc_request_handle_notconn()) import MGC10.240.43.61@tcp of MGS@10.240.43.61@tcp abruptly disconnected: reconnecting
00000100:00080000:0.0:1651531664.509734:0:39099:0:(import.c:85:import_set_state_nolock()) 000000000aba9d44 MGS: changing import state from FULL to DISCONN
00000100:02020000:0.0:1651531664.509737:0:39099:0:(import.c:205:ptlrpc_set_import_discon()) 166-1: MGC10.240.43.61@tcp: Connection to MGS (at 10.240.43.61@tcp) was lost; in progress operations using this service will fail
00000100:00080000:0.0:1651531664.509738:0:39099:0:(import.c:211:ptlrpc_set_import_discon()) import MGS@10.240.43.61@tcp for MGC10.240.43.61@tcp not replayable, auto-deactivating
00000100:00080000:1.0:1651531664.509739:0:39100:0:(recover.c:232:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@10.240.43.61@tcp abruptly disconnected: reconnecting
00000100:00080000:0.0:1651531664.509739:0:39099:0:(import.c:156:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID
00000100:00080000:1.0:1651531664.509741:0:39100:0:(import.c:85:import_set_state_nolock()) 0000000070a36139 lustre-MDT0000_UUID: changing import state from FULL to DISCONN
00000100:00100000:0.0:1651531664.509741:0:39099:0:(client.c:3319:ptlrpc_abort_inflight()) @@@ inflight  req@000000000b0b31d1 x1731745997339008/t0(0) o400->MGC10.240.43.61@tcp@10.240.43.61@tcp:26/25 lens 224/224 e 0 to 0 dl 1651531671 ref 1 fl Rpc:RNQU/0/0 rc 0/-107 job:'kworker/u4:1.0'
00000100:02000400:1.0:1651531664.509743:0:39100:0:(import.c:199:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 10.240.43.61@tcp) was lost; in progress operations using this service will wait for recovery to complete
00000100:00080000:1.0:1651531664.509746:0:39100:0:(import.c:85:import_set_state_nolock()) 0000000070a36139 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
10000000:01000000:0.0:1651531664.509747:0:39099:0:(mgc_request.c:1330:mgc_import_event()) import event 0x808001
00000100:00080000:1.0:1651531664.509748:0:39100:0:(import.c:533:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 10.240.43.61@tcp last attempt 22296
00000100:00080000:0.0:1651531664.509748:0:39099:0:(pinger.c:214:ptlrpc_pinger_ir_down()) IR down
10000000:01000000:0.0:1651531664.509749:0:39099:0:(mgc_request.c:1330:mgc_import_event()) import event 0x808002
00000100:00080000:0.0:1651531664.509749:0:39099:0:(import.c:85:import_set_state_nolock()) 000000000aba9d44 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1651531664.509751:0:39100:0:(import.c:614:import_select_connection()) lustre-MDT0000-lwp-OST0001: import 0000000070a36139 using connection 10.240.43.61@tcp/10.240.43.61@tcp
00000100:00080000:0.0:1651531664.509751:0:39099:0:(import.c:533:import_select_connection()) MGC10.240.43.61@tcp: connect to NID 10.240.43.61@tcp last attempt 22296
00000100:00080000:0.0:1651531664.509753:0:39099:0:(import.c:614:import_select_connection()) MGC10.240.43.61@tcp: import 000000000aba9d44 using connection MGC10.240.43.61@tcp_0/10.240.43.61@tcp
00000100:00100000:1.0:1651531664.509759:0:39100:0:(import.c:806:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000005291b0d3 x1731745997339136/t0(0) o38->lustre-MDT0000-lwp-OST0001@10.240.43.61@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:0.0:1651531664.509760:0:39099:0:(import.c:806:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000380124f4 x1731745997339200/t0(0) o250->MGC10.240.43.61@tcp@10.240.43.61@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:0.0:1651531664.509766:0:39099:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000b0b31d1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9063caa-b124-4cb6-99ef-d01a735595c3:39099:1731745997339008:10.240.43.61@tcp:400:kworker/u4:1.0
00000100:00100000:1.0:1651531664.509770:0:39100:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000150f2725 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:39100:1731745997339072:10.240.43.61@tcp:400:kworker/u4:1.0
00000100:00100000:0.0:1651531664.509782:0:39098:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005291b0d3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:39098:1731745997339136:10.240.43.61@tcp:38:ptlrpcd_00_01.0
00000100:00100000:0.0:1651531664.509795:0:39098:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000380124f4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c9063caa-b124-4cb6-99ef-d01a735595c3:39098:1731745997339200:10.240.43.61@tcp:250:ptlrpcd_00_00.0
00000100:00080000:0.0:1651531664.510282:0:39098:0:(import.c:1073:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 16
00000100:00080000:0.0:1651531664.511997:0:39098:0:(import.c:1279:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover  req@000000005291b0d3 x1731745997339136/t0(0) o38->lustre-MDT0000-lwp-OST0001@10.240.43.61@tcp:12/10 lens 520/416 e 0 to 0 dl 1651531670 ref 1 fl Interpret:RNQU/0/0 rc 0/0 job:'ptlrpcd_00_01.0'
00000100:00080000:0.0:1651531664.512001:0:39098:0:(import.c:85:import_set_state_nolock()) 0000000070a36139 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER
00000100:00080000:0.0:1651531664.512003:0:39098:0:(import.c:85:import_set_state_nolock()) 0000000070a36139 lustre-MDT0000_UUID: changing import state from RECOVER to FULL
00000100:02000000:0.0:1651531664.512005:0:39098:0:(import.c:1642:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 10.240.43.61@tcp (at 10.240.43.61@tcp)
00000100:00100000:0.0:1651531664.512008:0:39098:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005291b0d3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:39098:1731745997339136:10.240.43.61@tcp:38:ptlrpcd_00_01.0
00000100:00080000:0.0:1651531664.512014:0:39098:0:(import.c:1073:ptlrpc_connect_interpret()) MGC10.240.43.61@tcp: connect to target with instance 0
10000000:01000000:0.0:1651531664.512016:0:39098:0:(mgc_request.c:1330:mgc_import_event()) import event 0x808005
00000100:02000400:0.0:1651531664.512017:0:39098:0:(import.c:1233:ptlrpc_connect_interpret()) Evicted from MGS (at 10.240.43.61@tcp) after server handle changed from 0x7e7b1585546a12c5 to 0x7e7b1585546a16ed
00000100:00080000:0.0:1651531664.512018:0:39098:0:(import.c:85:import_set_state_nolock()) 000000000aba9d44 MGS: changing import state from CONNECTING to EVICTED
00000100:00080000:0.0:1651531664.512020:0:39098:0:(import.c:1572:ptlrpc_import_recovery_state_machine()) evicted from MGS@10.240.43.61@tcp; invalidating
00000100:00100000:0.0:1651531664.512089:0:39098:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000380124f4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c9063caa-b124-4cb6-99ef-d01a735595c3:39098:1731745997339200:10.240.43.61@tcp:250:ptlrpcd_00_00.0
00000100:00080000:0.0:1651531664.512097:0:219773:0:(import.c:1512:ptlrpc_invalidate_import_thread()) thread invalidate import MGC10.240.43.61@tcp to MGS@10.240.43.61@tcp
00000100:00100000:0.0:1651531664.512098:0:219773:0:(import.c:338:ptlrpc_invalidate_import()) Sleeping 100s for inflight to error out
10000000:01000000:0.0:1651531664.512099:0:219773:0:(mgc_request.c:1330:mgc_import_event()) import event 0x808003
00010000:00010000:0.0:1651531664.512105:0:219773:0:(ldlm_request.c:1234:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC10.240.43.61@tcp lock: 000000008abee82b/0x3234de053ca24c4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x7e7b1585546a12e1 expref: -99 pid: 166108 timeout: 0 lvb_type: 0
10000000:00010000:0.0:1651531664.512111:0:219773:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC10.240.43.61@tcp lock: 000000008abee82b/0x3234de053ca24c4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x7e7b1585546a12e1 expref: -99 pid: 166108 timeout: 0 lvb_type: 0
10000000:01000000:0.0:1651531664.512113:0:219773:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap)
00010000:00010000:0.0:1651531664.512118:0:219773:0:(ldlm_request.c:1250:ldlm_cli_cancel_local()) not sending request (at caller's instruction)
00010000:00010000:0.0:1651531664.512121:0:219773:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC10.240.43.61@tcp lock: 000000008abee82b/0x3234de053ca24c4 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x7e7b1585546a12e1 expref: -99 pid: 166108 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531664.512126:0:219773:0:(ldlm_request.c:1234:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC10.240.43.61@tcp lock: 00000000e9b84540/0x3234de053ca24af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x7e7b1585546a12cc expref: -99 pid: 166108 timeout: 0 lvb_type: 0
10000000:00010000:0.0:1651531664.512128:0:219773:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC10.240.43.61@tcp lock: 00000000e9b84540/0x3234de053ca24af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x7e7b1585546a12cc expref: -99 pid: 166108 timeout: 0 lvb_type: 0
10000000:01000000:0.0:1651531664.512130:0:219773:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre)
00010000:00010000:0.0:1651531664.512131:0:219773:0:(ldlm_request.c:1250:ldlm_cli_cancel_local()) not sending request (at caller's instruction)
00010000:00010000:0.0:1651531664.512134:0:219773:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC10.240.43.61@tcp lock: 00000000e9b84540/0x3234de053ca24af lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x7e7b1585546a12cc expref: -99 pid: 166108 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531664.512137:0:219773:0:(ldlm_request.c:1234:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC10.240.43.61@tcp lock: 00000000ab087537/0x3234de053ca24b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x7e7b1585546a12d3 expref: -99 pid: 166108 timeout: 0 lvb_type: 0
10000000:00010000:0.0:1651531664.512139:0:219773:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC10.240.43.61@tcp lock: 00000000ab087537/0x3234de053ca24b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x7e7b1585546a12d3 expref: -99 pid: 166108 timeout: 0 lvb_type: 0
10000000:01000000:0.0:1651531664.512141:0:219773:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre)
00010000:00010000:0.0:1651531664.512142:0:219773:0:(ldlm_request.c:1250:ldlm_cli_cancel_local()) not sending request (at caller's instruction)
00010000:00010000:0.0:1651531664.512143:0:219773:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC10.240.43.61@tcp lock: 00000000ab087537/0x3234de053ca24b6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x7e7b1585546a12d3 expref: -99 pid: 166108 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531664.512145:0:219773:0:(ldlm_request.c:1234:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC10.240.43.61@tcp lock: 00000000bc1fa390/0x3234de053ca24cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x7e7b1585546a12e8 expref: -99 pid: 166108 timeout: 0 lvb_type: 0
10000000:00010000:0.0:1651531664.512147:0:219773:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC10.240.43.61@tcp lock: 00000000bc1fa390/0x3234de053ca24cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x7e7b1585546a12e8 expref: -99 pid: 166108 timeout: 0 lvb_type: 0
10000000:01000000:0.0:1651531664.512149:0:219773:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre)
00010000:00010000:0.0:1651531664.512150:0:219773:0:(ldlm_request.c:1250:ldlm_cli_cancel_local()) not sending request (at caller's instruction)
00010000:00010000:0.0:1651531664.512151:0:219773:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC10.240.43.61@tcp lock: 00000000bc1fa390/0x3234de053ca24cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x7e7b1585546a12e8 expref: -99 pid: 166108 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531664.512154:0:219773:0:(ldlm_request.c:1234:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC10.240.43.61@tcp lock: 0000000000dcc150/0x3234de053ca24bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x7e7b1585546a12da expref: -99 pid: 166108 timeout: 0 lvb_type: 0
10000000:00010000:0.0:1651531664.512156:0:219773:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC10.240.43.61@tcp lock: 0000000000dcc150/0x3234de053ca24bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x7e7b1585546a12da expref: -99 pid: 166108 timeout: 0 lvb_type: 0
10000000:01000000:0.0:1651531664.512158:0:219773:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params)
00010000:00010000:0.0:1651531664.512159:0:219773:0:(ldlm_request.c:1250:ldlm_cli_cancel_local()) not sending request (at caller's instruction)
00010000:00010000:0.0:1651531664.512171:0:219773:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC10.240.43.61@tcp lock: 0000000000dcc150/0x3234de053ca24bd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x7e7b1585546a12da expref: -99 pid: 166108 timeout: 0 lvb_type: 0
00000100:00080000:0.0:1651531664.512176:0:219773:0:(import.c:85:import_set_state_nolock()) 000000000aba9d44 MGS: changing import state from EVICTED to RECOVER
00000100:00080000:0.0:1651531664.512177:0:219773:0:(import.c:85:import_set_state_nolock()) 000000000aba9d44 MGS: changing import state from RECOVER to FULL
10000000:01000000:0.0:1651531664.512178:0:219773:0:(mgc_request.c:1330:mgc_import_event()) import event 0x808004
00000100:00080000:0.0:1651531664.512179:0:219773:0:(pinger.c:207:ptlrpc_pinger_ir_up()) IR up
00000100:02000000:0.0:1651531664.512180:0:219773:0:(import.c:1642:ptlrpc_import_recovery_state_machine()) MGC10.240.43.61@tcp: Connection restored to 10.240.43.61@tcp (at 10.240.43.61@tcp)
00000100:00100000:0.0:1651531665.632146:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651531665.632174:0:182071:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745950929984
00000100:00100000:1.0:1651531665.632194:0:182071:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 402
00000100:00100000:1.0:1651531665.632196:0:182071:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000380124f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745950929984:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:1.0:1651531665.632212:0:182071:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 354733248 pending 0 free 81292156928 avail 77121445888
00000100:00100000:1.0:1651531665.632249:0:182071:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000380124f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745950929984:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 52us (105us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531665.632253:0:182071:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 402
10000000:01000000:0.0:1651531666.045267:0:166108:0:(mgc_request.c:609:do_requeue()) updating log lustre-client
10000000:01000000:0.0:1651531666.045269:0:166108:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff94e0d279b000 from 263
10000000:01000000:0.0:1651531666.045271:0:166108:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c)
00010000:00010000:0.0:1651531666.045283:0:166108:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC10.240.43.61@tcp lock: 0000000000dcc150/0x3234de053ca25b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 166108 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531666.045288:0:166108:0:(ldlm_request.c:1028:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC10.240.43.61@tcp lock: 0000000000dcc150/0x3234de053ca25b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 166108 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531666.045292:0:166108:0:(ldlm_request.c:1116:ldlm_cli_enqueue()) ### sending request ns: MGC10.240.43.61@tcp lock: 0000000000dcc150/0x3234de053ca25b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 166108 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531666.045300:0:166108:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000065be21ea pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997339264:10.240.43.61@tcp:101:ll_cfg_requeue.0
00000100:00100000:0.0:1651531666.045315:0:166108:0:(client.c:2492:ptlrpc_set_wait()) set 000000008ce9bece going to sleep for 6 seconds
00000100:00100000:0.0:1651531666.045594:0:166108:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000065be21ea pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997339264:10.240.43.61@tcp:101:ll_cfg_requeue.0
00010000:00010000:0.0:1651531666.045601:0:166108:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC10.240.43.61@tcp lock: 0000000000dcc150/0x3234de053ca25b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b1585546a16fb expref: -99 pid: 166108 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531666.045605:0:166108:0:(ldlm_request.c:798:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC10.240.43.61@tcp lock: 0000000000dcc150/0x3234de053ca25b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e7b1585546a16fb expref: -99 pid: 166108 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531666.045629:0:166108:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000065be21ea pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997339328:10.240.43.61@tcp:501:ll_cfg_requeue.0
00000100:00100000:0.0:1651531666.045653:0:166108:0:(client.c:2492:ptlrpc_set_wait()) set 000000008ce9bece going to sleep for 6 seconds
00000100:00100000:0.0:1651531666.045922:0:166108:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000065be21ea pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997339328:10.240.43.61@tcp:501:ll_cfg_requeue.0
00000100:00100000:0.0:1651531666.045934:0:166108:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000065be21ea pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997339392:10.240.43.61@tcp:503:ll_cfg_requeue.0
00000100:00100000:0.0:1651531666.045949:0:166108:0:(client.c:2492:ptlrpc_set_wait()) set 000000008ce9bece going to sleep for 6 seconds
00000100:00100000:0.0:1651531666.046231:0:166108:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000065be21ea pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997339392:10.240.43.61@tcp:503:ll_cfg_requeue.0
00000040:00080000:0.0:1651531666.046500:0:219774:0:(llog.c:768:llog_process_thread()) stop processing plain 0x3:10:0 index 64768 count 258
00000020:01000000:0.0:1651531666.046529:0:166108:0:(obd_config.c:2042:class_config_parse_llog()) Processed log lustre-client gen 263-262 (rc=0)
10000000:01000000:0.0:1651531666.046535:0:166108:0:(mgc_request.c:2136:mgc_process_log()) MGC10.240.43.61@tcp: configuration from log 'lustre-client' succeeded (0).
00010000:00010000:0.0:1651531666.046537:0:166108:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC10.240.43.61@tcp lock: 0000000000dcc150/0x3234de053ca25b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b1585546a16fb expref: -99 pid: 166108 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531666.046541:0:166108:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC10.240.43.61@tcp lock: 0000000000dcc150/0x3234de053ca25b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b1585546a16fb expref: -99 pid: 166108 timeout: 0 lvb_type: 0
10000000:01000000:0.0:1651531666.046545:0:166108:0:(mgc_request.c:609:do_requeue()) updating log lustre-OST0001
10000000:01000000:0.0:1651531666.046545:0:166108:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 29
10000000:01000000:0.0:1651531666.046546:0:166108:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c)
00010000:00010000:0.0:1651531666.046552:0:166108:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC10.240.43.61@tcp lock: 00000000bc1fa390/0x3234de053ca25b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 166108 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531666.046555:0:166108:0:(ldlm_request.c:1028:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC10.240.43.61@tcp lock: 00000000bc1fa390/0x3234de053ca25b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 166108 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531666.046558:0:166108:0:(ldlm_request.c:1116:ldlm_cli_enqueue()) ### sending request ns: MGC10.240.43.61@tcp lock: 00000000bc1fa390/0x3234de053ca25b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 166108 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531666.046563:0:166108:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000065be21ea pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997339456:10.240.43.61@tcp:101:ll_cfg_requeue.0
00000100:00100000:0.0:1651531666.046574:0:166108:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fadbf296 going to sleep for 6 seconds
00000100:00100000:0.0:1651531666.046808:0:166108:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000065be21ea pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997339456:10.240.43.61@tcp:101:ll_cfg_requeue.0
00010000:00010000:0.0:1651531666.046813:0:166108:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC10.240.43.61@tcp lock: 00000000bc1fa390/0x3234de053ca25b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b1585546a1702 expref: -99 pid: 166108 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531666.046816:0:166108:0:(ldlm_request.c:798:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC10.240.43.61@tcp lock: 00000000bc1fa390/0x3234de053ca25b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e7b1585546a1702 expref: -99 pid: 166108 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531666.046831:0:166108:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000065be21ea pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997339520:10.240.43.61@tcp:501:ll_cfg_requeue.0
00000100:00100000:0.0:1651531666.046841:0:166108:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fadbf296 going to sleep for 6 seconds
00000100:00100000:0.0:1651531666.047071:0:166108:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000065be21ea pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997339520:10.240.43.61@tcp:501:ll_cfg_requeue.0
00000100:00100000:0.0:1651531666.047080:0:166108:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000065be21ea pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997339584:10.240.43.61@tcp:503:ll_cfg_requeue.0
00000100:00100000:0.0:1651531666.047092:0:166108:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fadbf296 going to sleep for 6 seconds
00000100:00100000:0.0:1651531666.047559:0:166108:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000065be21ea pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997339584:10.240.43.61@tcp:503:ll_cfg_requeue.0
00000040:00080000:0.0:1651531666.047816:0:219775:0:(llog.c:768:llog_process_thread()) stop processing plain 0x9:10:0 index 64768 count 29
00000020:01000000:0.0:1651531666.047843:0:166108:0:(obd_config.c:2042:class_config_parse_llog()) Processed log lustre-OST0001 gen 29-28 (rc=0)
10000000:01000000:0.0:1651531666.047848:0:166108:0:(mgc_request.c:2136:mgc_process_log()) MGC10.240.43.61@tcp: configuration from log 'lustre-OST0001' succeeded (0).
00010000:00010000:0.0:1651531666.047850:0:166108:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC10.240.43.61@tcp lock: 00000000bc1fa390/0x3234de053ca25b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b1585546a1702 expref: -99 pid: 166108 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531666.047854:0:166108:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC10.240.43.61@tcp lock: 00000000bc1fa390/0x3234de053ca25b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b1585546a1702 expref: -99 pid: 166108 timeout: 0 lvb_type: 0
10000000:01000000:0.0:1651531666.047857:0:166108:0:(mgc_request.c:609:do_requeue()) updating log params
10000000:01000000:0.0:1651531666.047857:0:166108:0:(mgc_request.c:2064:mgc_process_log()) Process log params-ffff94e0d279b000 from 19
10000000:01000000:0.0:1651531666.047858:0:166108:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for params (res 0x736d61726170)
00010000:00010000:0.0:1651531666.047864:0:166108:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC10.240.43.61@tcp lock: 00000000ab087537/0x3234de053ca25c0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 166108 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531666.047870:0:166108:0:(ldlm_request.c:1028:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC10.240.43.61@tcp lock: 00000000ab087537/0x3234de053ca25c0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 166108 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531666.047873:0:166108:0:(ldlm_request.c:1116:ldlm_cli_enqueue()) ### sending request ns: MGC10.240.43.61@tcp lock: 00000000ab087537/0x3234de053ca25c0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 166108 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531666.047878:0:166108:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000065be21ea pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997339648:10.240.43.61@tcp:101:ll_cfg_requeue.0
00000100:00100000:0.0:1651531666.047889:0:166108:0:(client.c:2492:ptlrpc_set_wait()) set 000000007ac4e30e going to sleep for 6 seconds
00000100:00100000:0.0:1651531666.048117:0:166108:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000065be21ea pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997339648:10.240.43.61@tcp:101:ll_cfg_requeue.0
00010000:00010000:0.0:1651531666.048121:0:166108:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC10.240.43.61@tcp lock: 00000000ab087537/0x3234de053ca25c0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b1585546a1709 expref: -99 pid: 166108 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531666.048125:0:166108:0:(ldlm_request.c:798:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC10.240.43.61@tcp lock: 00000000ab087537/0x3234de053ca25c0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e7b1585546a1709 expref: -99 pid: 166108 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531666.048138:0:166108:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000065be21ea pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997339712:10.240.43.61@tcp:501:ll_cfg_requeue.0
00000100:00100000:0.0:1651531666.048148:0:166108:0:(client.c:2492:ptlrpc_set_wait()) set 000000007ac4e30e going to sleep for 6 seconds
00000100:00100000:0.0:1651531666.048339:0:166108:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000065be21ea pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997339712:10.240.43.61@tcp:501:ll_cfg_requeue.0
00000100:00100000:0.0:1651531666.048348:0:166108:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000065be21ea pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997339776:10.240.43.61@tcp:503:ll_cfg_requeue.0
00000100:00100000:0.0:1651531666.048360:0:166108:0:(client.c:2492:ptlrpc_set_wait()) set 000000007ac4e30e going to sleep for 6 seconds
00000100:00100000:0.0:1651531666.048567:0:166108:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000065be21ea pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997339776:10.240.43.61@tcp:503:ll_cfg_requeue.0
00000040:00080000:1.0:1651531666.049096:0:219776:0:(llog.c:768:llog_process_thread()) stop processing plain 0x2:10:0 index 64768 count 19
00000020:01000000:0.0:1651531666.049118:0:166108:0:(obd_config.c:2042:class_config_parse_llog()) Processed log params gen 19-18 (rc=0)
10000000:01000000:0.0:1651531666.049125:0:166108:0:(mgc_request.c:2136:mgc_process_log()) MGC10.240.43.61@tcp: configuration from log 'params' succeeded (0).
00010000:00010000:0.0:1651531666.049127:0:166108:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC10.240.43.61@tcp lock: 00000000ab087537/0x3234de053ca25c0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b1585546a1709 expref: -99 pid: 166108 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531666.049132:0:166108:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC10.240.43.61@tcp lock: 00000000ab087537/0x3234de053ca25c0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b1585546a1709 expref: -99 pid: 166108 timeout: 0 lvb_type: 0
10000000:01000000:0.0:1651531666.049135:0:166108:0:(mgc_request.c:609:do_requeue()) updating log nodemap
10000000:01000000:0.0:1651531666.049135:0:166108:0:(mgc_request.c:2064:mgc_process_log()) Process log nodemap-ffff94e0b53b8000 from 1
10000000:01000000:0.0:1651531666.049136:0:166108:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e)
00010000:00010000:0.0:1651531666.049141:0:166108:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC10.240.43.61@tcp lock: 00000000e9b84540/0x3234de053ca25c7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 166108 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531666.049144:0:166108:0:(ldlm_request.c:1028:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC10.240.43.61@tcp lock: 00000000e9b84540/0x3234de053ca25c7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 166108 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531666.049147:0:166108:0:(ldlm_request.c:1116:ldlm_cli_enqueue()) ### sending request ns: MGC10.240.43.61@tcp lock: 00000000e9b84540/0x3234de053ca25c7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 166108 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531666.049152:0:166108:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000065be21ea pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997339840:10.240.43.61@tcp:101:ll_cfg_requeue.0
00000100:00100000:0.0:1651531666.049163:0:166108:0:(client.c:2492:ptlrpc_set_wait()) set 000000007ac4e30e going to sleep for 6 seconds
00000100:00100000:0.0:1651531666.049371:0:166108:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000065be21ea pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997339840:10.240.43.61@tcp:101:ll_cfg_requeue.0
00010000:00010000:0.0:1651531666.049375:0:166108:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC10.240.43.61@tcp lock: 00000000e9b84540/0x3234de053ca25c7 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b1585546a1710 expref: -99 pid: 166108 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531666.049379:0:166108:0:(ldlm_request.c:798:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC10.240.43.61@tcp lock: 00000000e9b84540/0x3234de053ca25c7 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e7b1585546a1710 expref: -99 pid: 166108 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531666.049445:0:166108:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000065be21ea pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997339904:10.240.43.61@tcp:256:ll_cfg_requeue.0
00000100:00100000:0.0:1651531666.049458:0:166108:0:(client.c:2492:ptlrpc_set_wait()) set 000000008ce9bece going to sleep for 6 seconds
00000100:00100000:0.0:1651531666.049903:0:166108:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000065be21ea pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997339904:10.240.43.61@tcp:256:ll_cfg_requeue.0
00080000:10000000:0.0:1651531666.050393:0:166108:0:(osd_handler.c:5198:osd_index_try()) lustre-OST0001: index object [0x200000003:0x19:0x0] (8/32) registered
10000000:01000000:0.0:1651531666.050473:0:166108:0:(mgc_request.c:2136:mgc_process_log()) MGC10.240.43.61@tcp: configuration from log 'nodemap' succeeded (0).
00010000:00010000:0.0:1651531666.050476:0:166108:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC10.240.43.61@tcp lock: 00000000e9b84540/0x3234de053ca25c7 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b1585546a1710 expref: -99 pid: 166108 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531666.050482:0:166108:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC10.240.43.61@tcp lock: 00000000e9b84540/0x3234de053ca25c7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b1585546a1710 expref: -99 pid: 166108 timeout: 0 lvb_type: 0
10000000:01000000:0.0:1651531666.050487:0:166108:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc
10000000:01000000:0.0:1651531666.050488:0:166108:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff94e0b53b8000 from 1
10000000:01000000:0.0:1651531666.050490:0:166108:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c)
00010000:00010000:0.0:1651531666.050497:0:166108:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC10.240.43.61@tcp lock: 000000008abee82b/0x3234de053ca25ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 166108 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531666.050502:0:166108:0:(ldlm_request.c:1028:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC10.240.43.61@tcp lock: 000000008abee82b/0x3234de053ca25ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 166108 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531666.050506:0:166108:0:(ldlm_request.c:1116:ldlm_cli_enqueue()) ### sending request ns: MGC10.240.43.61@tcp lock: 000000008abee82b/0x3234de053ca25ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 166108 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531666.050514:0:166108:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000065be21ea pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997339968:10.240.43.61@tcp:101:ll_cfg_requeue.0
00000100:00100000:0.0:1651531666.050531:0:166108:0:(client.c:2492:ptlrpc_set_wait()) set 000000008ce9bece going to sleep for 6 seconds
00000100:00100000:0.0:1651531666.050747:0:166108:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000065be21ea pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997339968:10.240.43.61@tcp:101:ll_cfg_requeue.0
00010000:00010000:0.0:1651531666.050752:0:166108:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC10.240.43.61@tcp lock: 000000008abee82b/0x3234de053ca25ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b1585546a1717 expref: -99 pid: 166108 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531666.050755:0:166108:0:(ldlm_request.c:798:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC10.240.43.61@tcp lock: 000000008abee82b/0x3234de053ca25ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e7b1585546a1717 expref: -99 pid: 166108 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531666.050770:0:166108:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000065be21ea pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997340032:10.240.43.61@tcp:501:ll_cfg_requeue.0
00000100:00100000:0.0:1651531666.050781:0:166108:0:(client.c:2492:ptlrpc_set_wait()) set 000000008ce9bece going to sleep for 6 seconds
00000100:00100000:0.0:1651531666.050956:0:166108:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000065be21ea pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997340032:10.240.43.61@tcp:501:ll_cfg_requeue.0
10000000:01000000:0.0:1651531666.050964:0:166108:0:(mgc_request.c:2136:mgc_process_log()) MGC10.240.43.61@tcp: configuration from log 'lustre-sptlrpc' failed (-2).
00010000:00010000:0.0:1651531666.050965:0:166108:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC10.240.43.61@tcp lock: 000000008abee82b/0x3234de053ca25ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b1585546a1717 expref: -99 pid: 166108 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531666.050969:0:166108:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC10.240.43.61@tcp lock: 000000008abee82b/0x3234de053ca25ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b1585546a1717 expref: -99 pid: 166108 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651531666.152881:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474868958 is committed
00000001:00080000:1.0:1651531666.152884:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474868957 is committed
00000100:00100000:0.0:1651531669.185072:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531669.185092:0:191990:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754464960064
00000100:00100000:0.0:1651531669.185114:0:191990:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 56
00000100:00100000:0.0:1651531669.185117:0:191990:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000065be21ea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:37d7cd70-23c8-4282-b9a2-e45fd1319801+5:438148:x1731754464960064:12345-10.240.43.64@tcp:400:kworker/u4:0.0
00000100:00100000:0.0:1651531669.185150:0:191990:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000065be21ea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:37d7cd70-23c8-4282-b9a2-e45fd1319801+5:438148:x1731754464960064:12345-10.240.43.64@tcp:400:kworker/u4:0.0 Request processed in 33us (84us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531669.185154:0:191990:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 56
00000100:00100000:0.0:1651531670.752218:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651531670.752261:0:182071:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745950930048
00000100:00100000:1.0:1651531670.752290:0:182071:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 403
00000100:00100000:1.0:1651531670.752293:0:182071:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002bf85ab5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745950930048:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:1.0:1651531670.752312:0:182071:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 354733248 pending 0 free 81292156928 avail 77121445888
00000100:00100000:1.0:1651531670.752349:0:182071:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002bf85ab5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745950930048:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 55us (134us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531670.752353:0:182071:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 403
00000100:00100000:0.0:1651531675.872143:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651531675.872175:0:182071:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745950930304
00000100:00100000:1.0:1651531675.872200:0:182071:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 404
00000100:00100000:1.0:1651531675.872203:0:182071:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cfeac242 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745950930304:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:1.0:1651531675.872220:0:182071:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 354733248 pending 0 free 81292156928 avail 77121445888
00000100:00100000:1.0:1651531675.872261:0:182071:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cfeac242 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745950930304:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 58us (121us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531675.872265:0:182071:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 404
00000100:00100000:0.0:1651531680.992131:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651531680.992175:0:182071:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745950931008
00000100:00100000:1.0:1651531680.992199:0:182071:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 405
00000100:00100000:1.0:1651531680.992201:0:182071:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000487b2caa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745950931008:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:1.0:1651531680.992215:0:182071:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 354733248 pending 0 free 81292156928 avail 77121445888
00000100:00100000:1.0:1651531680.992256:0:182071:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000487b2caa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745950931008:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 53us (127us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531680.992259:0:182071:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 405
00000400:00000080:1.0:1651531684.098526:0:220045:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648
00000001:02000400:1.0:1651531684.098528:0:220045:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 260: Check mdc_close fail ================= 22:48:03 (1651531683)
00000100:00100000:0.0:1651531684.124286:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531684.124304:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754464963392
00000100:00100000:0.0:1651531684.124323:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44171
00000100:00100000:0.0:1651531684.124326:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ecb6b3b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:37d7cd70-23c8-4282-b9a2-e45fd1319801+5:438149:x1731754464963392:12345-10.240.43.64@tcp:2:touch.0
00000100:00100000:0.0:1651531684.124419:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ecb6b3b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:37d7cd70-23c8-4282-b9a2-e45fd1319801+6:438149:x1731754464963392:12345-10.240.43.64@tcp:2:touch.0 Request processed in 93us (136us total) trans 21474868959 rc 0/0
00000100:00100000:0.0:1651531684.124423:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44171
00000400:00000080:0.0:1651531685.427797:0:220263:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648
00000001:02000400:0.0:1651531685.427799:0:220263:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 270a: DoM: basic functionality tests ====== 22:48:05 (1651531685)
00000100:00100000:0.0:1651531686.112880:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651531686.112920:0:182071:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745950931392
00000100:00100000:1.0:1651531686.112949:0:182071:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 406
00000100:00100000:1.0:1651531686.112952:0:182071:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000041fd707a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745950931392:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:1.0:1651531686.112970:0:182071:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 354733248 pending 0 free 81292156928 avail 77121445888
00000100:00100000:1.0:1651531686.113011:0:182071:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000041fd707a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745950931392:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 50us (127us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531686.113020:0:182071:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 406
00000100:00100000:0.0:1651531687.746989:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531687.747016:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754464972928
00000100:00100000:0.0:1651531687.747050:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249474
00000100:00100000:0.0:1651531687.747053:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000021908e31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:37d7cd70-23c8-4282-b9a2-e45fd1319801+6:438148:x1731754464972928:12345-10.240.43.64@tcp:4:dd.0
00002000:00010000:0.0:1651531687.747078:0:166118:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34504:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:0.0:1651531687.747082:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e5cdccc8/0x3234de053ca25d5 lrc: 3/0,1 mode: --/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531687.747089:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531687.747090:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531687.747092:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e5cdccc8/0x3234de053ca25d5 lrc: 3/0,1 mode: PW/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1048576->1114111] (req 1048576->1114111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531687.747099:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e5cdccc8/0x3234de053ca25d5 lrc: 3/0,1 mode: PW/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1048576->1114111] (req 1048576->1114111) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651531687.770436:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474868960 is committed
00002000:00010000:0.0:1651531687.770473:0:166118:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x34504:0x0] updating lvb size from disk: 0 -> 1114112
00002000:00010000:0.0:1651531687.770475:0:166118:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x34504:0x0] updating lvb mtime from disk: 0 -> 1651531687
00002000:00010000:0.0:1651531687.770476:0:166118:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x34504:0x0] updating lvb ctime from disk: 0 -> 1651531687
00002000:00010000:0.0:1651531687.770477:0:166118:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x34504:0x0] updating lvb blocks from disk: 0 -> 128
00010000:00010000:0.0:1651531687.770481:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e5cdccc8/0x3234de053ca25d5 lrc: 3/0,1 mode: PW/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1048576->1114111] (req 1048576->1114111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531687.770485:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e5cdccc8/0x3234de053ca25d5 lrc: 2/0,0 mode: PW/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1048576->1114111] (req 1048576->1114111) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531687.770513:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000021908e31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:37d7cd70-23c8-4282-b9a2-e45fd1319801+5:438148:x1731754464972928:12345-10.240.43.64@tcp:4:dd.0 Request processed in 23459us (23528us total) trans 21474868960 rc 0/0
00000100:00100000:0.0:1651531687.770517:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249474
00010000:00010000:0.0:1651531687.770526:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e5cdccc8/0x3234de053ca25d5 lrc: 2/0,0 mode: PW/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1048576->1114111] (req 1048576->1114111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531687.770530:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e5cdccc8 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531687.770532:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5cdccc8/0x3234de053ca25d5 lrc: 2/0,0 mode: PW/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1048576->1114111] (req 1048576->1114111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531687.770535:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5cdccc8/0x3234de053ca25d5 lrc: 3/0,0 mode: PW/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1048576->1114111] (req 1048576->1114111) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531687.770542:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e5cdccc8/0x3234de053ca25d5 lrc: 1/0,0 mode: --/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1048576->1114111] (req 1048576->1114111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531687.770545:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e5cdccc8/0x3234de053ca25d5 lrc: 0/0,0 mode: --/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1048576->1114111] (req 1048576->1114111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531687.770906:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531687.770914:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754464973056
00000100:00100000:0.0:1651531687.770931:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249475
00000100:00100000:0.0:1651531687.770933:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bcdb3319 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:37d7cd70-23c8-4282-b9a2-e45fd1319801+5:438148:x1731754464973056:12345-10.240.43.64@tcp:4:dd.0
00002000:00010000:0.0:1651531687.770942:0:166118:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34504:0x0] initial LVB size: 1114112, mtime: 0x62705fa7, atime: 0x0, ctime: 0x62705fa7, blocks: 0x80
00010000:00010000:0.0:1651531687.770944:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca25dc lrc: 3/0,1 mode: --/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531687.770950:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531687.770951:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531687.770952:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca25dc lrc: 3/0,1 mode: PW/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1114112->1179647] (req 1114112->1179647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531687.770956:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca25dc lrc: 3/0,1 mode: PW/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1114112->1179647] (req 1114112->1179647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651531687.794972:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474868961 is committed
00002000:00010000:0.0:1651531687.795012:0:166118:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x34504:0x0] updating lvb size from disk: 1114112 -> 1179648
00002000:00010000:0.0:1651531687.795014:0:166118:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x34504:0x0] updating lvb blocks from disk: 128 -> 256
00010000:00010000:0.0:1651531687.795017:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca25dc lrc: 3/0,1 mode: PW/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1114112->1179647] (req 1114112->1179647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531687.795021:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca25dc lrc: 2/0,0 mode: PW/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1114112->1179647] (req 1114112->1179647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531687.795039:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bcdb3319 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:37d7cd70-23c8-4282-b9a2-e45fd1319801+5:438148:x1731754464973056:12345-10.240.43.64@tcp:4:dd.0 Request processed in 24105us (24133us total) trans 21474868961 rc 0/0
00000100:00100000:0.0:1651531687.795042:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249475
00010000:00010000:0.0:1651531687.795050:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca25dc lrc: 2/0,0 mode: PW/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1114112->1179647] (req 1114112->1179647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531687.795053:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000968553c1 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531687.795054:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca25dc lrc: 2/0,0 mode: PW/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1114112->1179647] (req 1114112->1179647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531687.795057:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca25dc lrc: 3/0,0 mode: PW/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1114112->1179647] (req 1114112->1179647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531687.795064:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca25dc lrc: 1/0,0 mode: --/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1114112->1179647] (req 1114112->1179647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531687.795067:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca25dc lrc: 0/0,0 mode: --/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1114112->1179647] (req 1114112->1179647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531687.795411:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531687.795418:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754464973184
00000100:00100000:0.0:1651531687.795435:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249476
00000100:00100000:0.0:1651531687.795437:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009cbd7c1d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:37d7cd70-23c8-4282-b9a2-e45fd1319801+5:438148:x1731754464973184:12345-10.240.43.64@tcp:4:dd.0
00002000:00010000:0.0:1651531687.795446:0:166118:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34504:0x0] initial LVB size: 1179648, mtime: 0x62705fa7, atime: 0x0, ctime: 0x62705fa7, blocks: 0x100
00010000:00010000:0.0:1651531687.795449:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e5cdccc8/0x3234de053ca25e3 lrc: 3/0,1 mode: --/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531687.795453:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531687.795453:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531687.795454:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e5cdccc8/0x3234de053ca25e3 lrc: 3/0,1 mode: PW/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1179648->1245183] (req 1179648->1245183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531687.795458:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e5cdccc8/0x3234de053ca25e3 lrc: 3/0,1 mode: PW/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1179648->1245183] (req 1179648->1245183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651531687.819476:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474868962 is committed
00002000:00010000:0.0:1651531687.819507:0:166118:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x34504:0x0] updating lvb size from disk: 1179648 -> 1245184
00002000:00010000:0.0:1651531687.819509:0:166118:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x34504:0x0] updating lvb blocks from disk: 256 -> 384
00010000:00010000:0.0:1651531687.819511:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e5cdccc8/0x3234de053ca25e3 lrc: 3/0,1 mode: PW/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1179648->1245183] (req 1179648->1245183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531687.819519:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e5cdccc8/0x3234de053ca25e3 lrc: 2/0,0 mode: PW/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1179648->1245183] (req 1179648->1245183) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531687.819540:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009cbd7c1d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:37d7cd70-23c8-4282-b9a2-e45fd1319801+5:438148:x1731754464973184:12345-10.240.43.64@tcp:4:dd.0 Request processed in 24102us (24130us total) trans 21474868962 rc 0/0
00010000:00010000:1.0:1651531687.819542:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e5cdccc8/0x3234de053ca25e3 lrc: 2/0,0 mode: PW/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1179648->1245183] (req 1179648->1245183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531687.819543:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249476
00010000:00010000:1.0:1651531687.819549:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e5cdccc8 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531687.819550:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5cdccc8/0x3234de053ca25e3 lrc: 2/0,0 mode: PW/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1179648->1245183] (req 1179648->1245183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531687.819554:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5cdccc8/0x3234de053ca25e3 lrc: 3/0,0 mode: PW/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1179648->1245183] (req 1179648->1245183) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531687.819560:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e5cdccc8/0x3234de053ca25e3 lrc: 1/0,0 mode: --/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1179648->1245183] (req 1179648->1245183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531687.819563:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e5cdccc8/0x3234de053ca25e3 lrc: 0/0,0 mode: --/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1179648->1245183] (req 1179648->1245183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531687.820267:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531687.820276:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754464973312
00000100:00100000:1.0:1651531687.820291:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249477
00000100:00100000:1.0:1651531687.820294:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000150f2725 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:37d7cd70-23c8-4282-b9a2-e45fd1319801+5:438149:x1731754464973312:12345-10.240.43.64@tcp:4:dd.0
00002000:00010000:1.0:1651531687.820305:0:216321:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34504:0x0] initial LVB size: 1245184, mtime: 0x62705fa7, atime: 0x0, ctime: 0x62705fa7, blocks: 0x180
00010000:00010000:1.0:1651531687.820308:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e3ad07b/0x3234de053ca25ea lrc: 3/0,1 mode: --/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531687.820316:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531687.820317:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531687.820318:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003e3ad07b/0x3234de053ca25ea lrc: 3/0,1 mode: PW/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1245184->1310719] (req 1245184->1310719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531687.820322:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003e3ad07b/0x3234de053ca25ea lrc: 3/0,1 mode: PW/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1245184->1310719] (req 1245184->1310719) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651531687.859381:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474868963 is committed
00002000:00010000:1.0:1651531687.859395:0:216321:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x34504:0x0] updating lvb size from disk: 1245184 -> 1310720
00002000:00010000:1.0:1651531687.859397:0:216321:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x34504:0x0] updating lvb blocks from disk: 384 -> 512
00010000:00010000:1.0:1651531687.859399:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e3ad07b/0x3234de053ca25ea lrc: 3/0,1 mode: PW/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1245184->1310719] (req 1245184->1310719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531687.859403:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003e3ad07b/0x3234de053ca25ea lrc: 2/0,0 mode: PW/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1245184->1310719] (req 1245184->1310719) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531687.859427:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000150f2725 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:37d7cd70-23c8-4282-b9a2-e45fd1319801+5:438149:x1731754464973312:12345-10.240.43.64@tcp:4:dd.0 Request processed in 39132us (39161us total) trans 21474868963 rc 0/0
00010000:00010000:0.0:1651531687.859428:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003e3ad07b/0x3234de053ca25ea lrc: 2/0,0 mode: PW/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1245184->1310719] (req 1245184->1310719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531687.859430:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249477
00010000:00010000:0.0:1651531687.859433:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003e3ad07b already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531687.859435:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003e3ad07b/0x3234de053ca25ea lrc: 2/0,0 mode: PW/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1245184->1310719] (req 1245184->1310719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531687.859438:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003e3ad07b/0x3234de053ca25ea lrc: 3/0,0 mode: PW/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1245184->1310719] (req 1245184->1310719) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531687.859444:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003e3ad07b/0x3234de053ca25ea lrc: 1/0,0 mode: --/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1245184->1310719] (req 1245184->1310719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531687.859447:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003e3ad07b/0x3234de053ca25ea lrc: 0/0,0 mode: --/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1245184->1310719] (req 1245184->1310719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531687.859779:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531687.859787:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754464973440
00000100:00100000:1.0:1651531687.859803:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249478
00000100:00100000:1.0:1651531687.859805:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ee188064 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:37d7cd70-23c8-4282-b9a2-e45fd1319801+5:438148:x1731754464973440:12345-10.240.43.64@tcp:4:dd.0
00002000:00010000:1.0:1651531687.859813:0:216321:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34504:0x0] initial LVB size: 1310720, mtime: 0x62705fa7, atime: 0x0, ctime: 0x62705fa7, blocks: 0x200
00010000:00010000:1.0:1651531687.859816:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003dec1fa8/0x3234de053ca25f1 lrc: 3/0,1 mode: --/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531687.859821:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531687.859822:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531687.859823:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003dec1fa8/0x3234de053ca25f1 lrc: 3/0,1 mode: PW/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1310720->1376255] (req 1310720->1376255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531687.859827:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003dec1fa8/0x3234de053ca25f1 lrc: 3/0,1 mode: PW/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1310720->1376255] (req 1310720->1376255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651531687.892234:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474868964 is committed
00002000:00010000:1.0:1651531687.892249:0:216321:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x34504:0x0] updating lvb size from disk: 1310720 -> 1376256
00002000:00010000:1.0:1651531687.892250:0:216321:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x34504:0x0] updating lvb blocks from disk: 512 -> 640
00010000:00010000:1.0:1651531687.892253:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003dec1fa8/0x3234de053ca25f1 lrc: 3/0,1 mode: PW/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1310720->1376255] (req 1310720->1376255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531687.892256:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003dec1fa8/0x3234de053ca25f1 lrc: 2/0,0 mode: PW/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1310720->1376255] (req 1310720->1376255) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531687.892280:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ee188064 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:37d7cd70-23c8-4282-b9a2-e45fd1319801+5:438148:x1731754464973440:12345-10.240.43.64@tcp:4:dd.0 Request processed in 32474us (32501us total) trans 21474868964 rc 0/0
00010000:00010000:0.0:1651531687.892281:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003dec1fa8/0x3234de053ca25f1 lrc: 2/0,0 mode: PW/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1310720->1376255] (req 1310720->1376255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531687.892283:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249478
00010000:00010000:0.0:1651531687.892286:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003dec1fa8 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531687.892287:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003dec1fa8/0x3234de053ca25f1 lrc: 2/0,0 mode: PW/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1310720->1376255] (req 1310720->1376255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531687.892292:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003dec1fa8/0x3234de053ca25f1 lrc: 3/0,0 mode: PW/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1310720->1376255] (req 1310720->1376255) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531687.892297:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003dec1fa8/0x3234de053ca25f1 lrc: 1/0,0 mode: --/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1310720->1376255] (req 1310720->1376255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531687.892300:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003dec1fa8/0x3234de053ca25f1 lrc: 0/0,0 mode: --/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1310720->1376255] (req 1310720->1376255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531687.892631:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531687.892639:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754464973568
00000100:00100000:1.0:1651531687.892654:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249479
00000100:00100000:1.0:1651531687.892656:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b2e6a34f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:37d7cd70-23c8-4282-b9a2-e45fd1319801+5:438149:x1731754464973568:12345-10.240.43.64@tcp:4:dd.0
00002000:00010000:1.0:1651531687.892665:0:216321:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34504:0x0] initial LVB size: 1376256, mtime: 0x62705fa7, atime: 0x0, ctime: 0x62705fa7, blocks: 0x280
00010000:00010000:1.0:1651531687.892667:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dfdae7d6/0x3234de053ca25f8 lrc: 3/0,1 mode: --/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531687.892673:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531687.892673:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531687.892674:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dfdae7d6/0x3234de053ca25f8 lrc: 3/0,1 mode: PW/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1376256->1441791] (req 1376256->1441791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531687.892678:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dfdae7d6/0x3234de053ca25f8 lrc: 3/0,1 mode: PW/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1376256->1441791] (req 1376256->1441791) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651531687.916731:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474868965 is committed
00002000:00010000:1.0:1651531687.916745:0:216321:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x34504:0x0] updating lvb size from disk: 1376256 -> 1441792
00002000:00010000:1.0:1651531687.916746:0:216321:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x34504:0x0] updating lvb blocks from disk: 640 -> 768
00010000:00010000:1.0:1651531687.916748:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dfdae7d6/0x3234de053ca25f8 lrc: 3/0,1 mode: PW/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1376256->1441791] (req 1376256->1441791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531687.916752:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dfdae7d6/0x3234de053ca25f8 lrc: 2/0,0 mode: PW/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1376256->1441791] (req 1376256->1441791) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531687.916768:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b2e6a34f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:37d7cd70-23c8-4282-b9a2-e45fd1319801+5:438149:x1731754464973568:12345-10.240.43.64@tcp:4:dd.0 Request processed in 24111us (24138us total) trans 21474868965 rc 0/0
00000100:00100000:1.0:1651531687.916771:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249479
00010000:00010000:1.0:1651531687.916778:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dfdae7d6/0x3234de053ca25f8 lrc: 2/0,0 mode: PW/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1376256->1441791] (req 1376256->1441791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531687.916782:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000dfdae7d6 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531687.916783:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dfdae7d6/0x3234de053ca25f8 lrc: 2/0,0 mode: PW/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1376256->1441791] (req 1376256->1441791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531687.916789:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dfdae7d6/0x3234de053ca25f8 lrc: 3/0,0 mode: PW/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1376256->1441791] (req 1376256->1441791) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531687.916795:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dfdae7d6/0x3234de053ca25f8 lrc: 1/0,0 mode: --/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1376256->1441791] (req 1376256->1441791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531687.916797:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dfdae7d6/0x3234de053ca25f8 lrc: 0/0,0 mode: --/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1376256->1441791] (req 1376256->1441791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531687.917148:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531687.917156:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754464973696
00000100:00100000:1.0:1651531687.917173:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249480
00000100:00100000:1.0:1651531687.917175:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b08f1c9b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:37d7cd70-23c8-4282-b9a2-e45fd1319801+5:438148:x1731754464973696:12345-10.240.43.64@tcp:4:dd.0
00002000:00010000:1.0:1651531687.917184:0:216321:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34504:0x0] initial LVB size: 1441792, mtime: 0x62705fa7, atime: 0x0, ctime: 0x62705fa7, blocks: 0x300
00010000:00010000:1.0:1651531687.917186:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bfa41eae/0x3234de053ca25ff lrc: 3/0,1 mode: --/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531687.917190:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531687.917191:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531687.917192:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bfa41eae/0x3234de053ca25ff lrc: 3/0,1 mode: PW/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1441792->1507327] (req 1441792->1507327) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531687.917195:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bfa41eae/0x3234de053ca25ff lrc: 3/0,1 mode: PW/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1441792->1507327] (req 1441792->1507327) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651531687.941275:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474868966 is committed
00002000:00010000:1.0:1651531687.941289:0:216321:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x34504:0x0] updating lvb size from disk: 1441792 -> 1507328
00002000:00010000:1.0:1651531687.941291:0:216321:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x34504:0x0] updating lvb blocks from disk: 768 -> 896
00010000:00010000:1.0:1651531687.941294:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bfa41eae/0x3234de053ca25ff lrc: 3/0,1 mode: PW/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1441792->1507327] (req 1441792->1507327) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531687.941297:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bfa41eae/0x3234de053ca25ff lrc: 2/0,0 mode: PW/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1441792->1507327] (req 1441792->1507327) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531687.941320:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b08f1c9b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:37d7cd70-23c8-4282-b9a2-e45fd1319801+5:438148:x1731754464973696:12345-10.240.43.64@tcp:4:dd.0 Request processed in 24144us (24172us total) trans 21474868966 rc 0/0
00010000:00010000:0.0:1651531687.941321:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bfa41eae/0x3234de053ca25ff lrc: 2/0,0 mode: PW/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1441792->1507327] (req 1441792->1507327) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531687.941323:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249480
00010000:00010000:0.0:1651531687.941325:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000bfa41eae already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531687.941326:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bfa41eae/0x3234de053ca25ff lrc: 2/0,0 mode: PW/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1441792->1507327] (req 1441792->1507327) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531687.941329:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bfa41eae/0x3234de053ca25ff lrc: 3/0,0 mode: PW/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1441792->1507327] (req 1441792->1507327) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531687.941334:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bfa41eae/0x3234de053ca25ff lrc: 1/0,0 mode: --/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1441792->1507327] (req 1441792->1507327) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531687.941337:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bfa41eae/0x3234de053ca25ff lrc: 0/0,0 mode: --/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1441792->1507327] (req 1441792->1507327) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531687.941665:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531687.941674:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754464973824
00000100:00100000:1.0:1651531687.941689:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249481
00000100:00100000:1.0:1651531687.941691:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000320c8a1d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:37d7cd70-23c8-4282-b9a2-e45fd1319801+5:438148:x1731754464973824:12345-10.240.43.64@tcp:4:dd.0
00002000:00010000:1.0:1651531687.941708:0:216321:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34504:0x0] initial LVB size: 1507328, mtime: 0x62705fa7, atime: 0x0, ctime: 0x62705fa7, blocks: 0x380
00010000:00010000:1.0:1651531687.941710:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dfdae7d6/0x3234de053ca2606 lrc: 3/0,1 mode: --/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531687.941714:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531687.941715:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531687.941716:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dfdae7d6/0x3234de053ca2606 lrc: 3/0,1 mode: PW/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1507328->1572863] (req 1507328->1572863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531687.941720:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dfdae7d6/0x3234de053ca2606 lrc: 3/0,1 mode: PW/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1507328->1572863] (req 1507328->1572863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651531687.965836:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474868967 is committed
00002000:00010000:1.0:1651531687.965850:0:216321:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x34504:0x0] updating lvb size from disk: 1507328 -> 1572864
00002000:00010000:1.0:1651531687.965853:0:216321:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x34504:0x0] updating lvb blocks from disk: 896 -> 1024
00010000:00010000:1.0:1651531687.965855:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dfdae7d6/0x3234de053ca2606 lrc: 3/0,1 mode: PW/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1507328->1572863] (req 1507328->1572863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531687.965858:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dfdae7d6/0x3234de053ca2606 lrc: 2/0,0 mode: PW/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1507328->1572863] (req 1507328->1572863) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531687.965881:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000320c8a1d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:37d7cd70-23c8-4282-b9a2-e45fd1319801+5:438148:x1731754464973824:12345-10.240.43.64@tcp:4:dd.0 Request processed in 24188us (24215us total) trans 21474868967 rc 0/0
00010000:00010000:0.0:1651531687.965882:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dfdae7d6/0x3234de053ca2606 lrc: 2/0,0 mode: PW/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1507328->1572863] (req 1507328->1572863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531687.965884:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249481
00010000:00010000:0.0:1651531687.965891:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000dfdae7d6 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531687.965892:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dfdae7d6/0x3234de053ca2606 lrc: 2/0,0 mode: PW/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1507328->1572863] (req 1507328->1572863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531687.965895:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dfdae7d6/0x3234de053ca2606 lrc: 3/0,0 mode: PW/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1507328->1572863] (req 1507328->1572863) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531687.965900:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dfdae7d6/0x3234de053ca2606 lrc: 1/0,0 mode: --/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1507328->1572863] (req 1507328->1572863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531687.965903:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dfdae7d6/0x3234de053ca2606 lrc: 0/0,0 mode: --/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1507328->1572863] (req 1507328->1572863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531687.966246:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531687.966255:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754464973952
00000100:00100000:1.0:1651531687.966271:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249482
00000100:00100000:1.0:1651531687.966273:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000050655fde pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:37d7cd70-23c8-4282-b9a2-e45fd1319801+5:438149:x1731754464973952:12345-10.240.43.64@tcp:4:dd.0
00002000:00010000:1.0:1651531687.966282:0:216321:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34504:0x0] initial LVB size: 1572864, mtime: 0x62705fa7, atime: 0x0, ctime: 0x62705fa7, blocks: 0x400
00010000:00010000:1.0:1651531687.966284:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea9f3321/0x3234de053ca260d lrc: 3/0,1 mode: --/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531687.966288:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531687.966289:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531687.966290:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea9f3321/0x3234de053ca260d lrc: 3/0,1 mode: PW/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1572864->1638399] (req 1572864->1638399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531687.966294:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ea9f3321/0x3234de053ca260d lrc: 3/0,1 mode: PW/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1572864->1638399] (req 1572864->1638399) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651531687.989084:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474868968 is committed
00002000:00010000:1.0:1651531687.989098:0:216321:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x34504:0x0] updating lvb size from disk: 1572864 -> 1638400
00002000:00010000:1.0:1651531687.989101:0:216321:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x34504:0x0] updating lvb blocks from disk: 1024 -> 1152
00010000:00010000:1.0:1651531687.989103:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea9f3321/0x3234de053ca260d lrc: 3/0,1 mode: PW/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1572864->1638399] (req 1572864->1638399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531687.989107:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ea9f3321/0x3234de053ca260d lrc: 2/0,0 mode: PW/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1572864->1638399] (req 1572864->1638399) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531687.989123:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000050655fde pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:37d7cd70-23c8-4282-b9a2-e45fd1319801+5:438149:x1731754464973952:12345-10.240.43.64@tcp:4:dd.0 Request processed in 22850us (22878us total) trans 21474868968 rc 0/0
00000100:00100000:1.0:1651531687.989127:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249482
00010000:00010000:1.0:1651531687.989133:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ea9f3321/0x3234de053ca260d lrc: 2/0,0 mode: PW/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1572864->1638399] (req 1572864->1638399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531687.989136:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ea9f3321 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531687.989138:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea9f3321/0x3234de053ca260d lrc: 2/0,0 mode: PW/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1572864->1638399] (req 1572864->1638399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531687.989140:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea9f3321/0x3234de053ca260d lrc: 3/0,0 mode: PW/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1572864->1638399] (req 1572864->1638399) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531687.989145:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ea9f3321/0x3234de053ca260d lrc: 1/0,0 mode: --/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1572864->1638399] (req 1572864->1638399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531687.989148:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ea9f3321/0x3234de053ca260d lrc: 0/0,0 mode: --/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1572864->1638399] (req 1572864->1638399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531687.989482:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531687.989490:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754464974080
00000100:00100000:1.0:1651531687.989507:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249483
00000100:00100000:1.0:1651531687.989510:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c768894d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:37d7cd70-23c8-4282-b9a2-e45fd1319801+5:438148:x1731754464974080:12345-10.240.43.64@tcp:4:dd.0
00002000:00010000:1.0:1651531687.989519:0:216321:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34504:0x0] initial LVB size: 1638400, mtime: 0x62705fa7, atime: 0x0, ctime: 0x62705fa7, blocks: 0x480
00010000:00010000:1.0:1651531687.989521:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ee3405a/0x3234de053ca2614 lrc: 3/0,1 mode: --/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531687.989525:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531687.989526:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531687.989527:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ee3405a/0x3234de053ca2614 lrc: 3/0,1 mode: PW/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1638400->1703935] (req 1638400->1703935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531687.989530:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001ee3405a/0x3234de053ca2614 lrc: 3/0,1 mode: PW/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1638400->1703935] (req 1638400->1703935) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651531688.013602:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474868969 is committed
00002000:00010000:1.0:1651531688.013617:0:216321:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x34504:0x0] updating lvb size from disk: 1638400 -> 1703936
00002000:00010000:1.0:1651531688.013618:0:216321:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x34504:0x0] updating lvb blocks from disk: 1152 -> 1280
00010000:00010000:1.0:1651531688.013621:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ee3405a/0x3234de053ca2614 lrc: 3/0,1 mode: PW/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1638400->1703935] (req 1638400->1703935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531688.013625:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001ee3405a/0x3234de053ca2614 lrc: 2/0,0 mode: PW/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1638400->1703935] (req 1638400->1703935) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531688.013649:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c768894d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:37d7cd70-23c8-4282-b9a2-e45fd1319801+5:438148:x1731754464974080:12345-10.240.43.64@tcp:4:dd.0 Request processed in 24137us (24166us total) trans 21474868969 rc 0/0
00010000:00010000:0.0:1651531688.013649:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001ee3405a/0x3234de053ca2614 lrc: 2/0,0 mode: PW/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1638400->1703935] (req 1638400->1703935) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531688.013652:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249483
00010000:00010000:0.0:1651531688.013654:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001ee3405a already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531688.013655:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001ee3405a/0x3234de053ca2614 lrc: 2/0,0 mode: PW/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1638400->1703935] (req 1638400->1703935) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531688.013658:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001ee3405a/0x3234de053ca2614 lrc: 3/0,0 mode: PW/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1638400->1703935] (req 1638400->1703935) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531688.013663:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001ee3405a/0x3234de053ca2614 lrc: 1/0,0 mode: --/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1638400->1703935] (req 1638400->1703935) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531688.013666:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ee3405a/0x3234de053ca2614 lrc: 0/0,0 mode: --/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1638400->1703935] (req 1638400->1703935) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531688.014001:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531688.014019:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754464974208
00000100:00100000:1.0:1651531688.014034:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249484
00000100:00100000:1.0:1651531688.014038:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c2f581c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:37d7cd70-23c8-4282-b9a2-e45fd1319801+5:438149:x1731754464974208:12345-10.240.43.64@tcp:4:dd.0
00002000:00010000:1.0:1651531688.014046:0:216321:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34504:0x0] initial LVB size: 1703936, mtime: 0x62705fa7, atime: 0x0, ctime: 0x62705fa7, blocks: 0x500
00010000:00010000:1.0:1651531688.014048:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea9f3321/0x3234de053ca261b lrc: 3/0,1 mode: --/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531688.014052:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531688.014053:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531688.014054:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea9f3321/0x3234de053ca261b lrc: 3/0,1 mode: PW/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1703936->1769471] (req 1703936->1769471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531688.014058:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ea9f3321/0x3234de053ca261b lrc: 3/0,1 mode: PW/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1703936->1769471] (req 1703936->1769471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651531688.038084:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474868970 is committed
00002000:00010000:1.0:1651531688.038098:0:216321:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x34504:0x0] updating lvb size from disk: 1703936 -> 1769472
00002000:00010000:1.0:1651531688.038099:0:216321:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x34504:0x0] updating lvb mtime from disk: 1651531687 -> 1651531688
00002000:00010000:1.0:1651531688.038100:0:216321:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x34504:0x0] updating lvb ctime from disk: 1651531687 -> 1651531688
00002000:00010000:1.0:1651531688.038101:0:216321:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x34504:0x0] updating lvb blocks from disk: 1280 -> 1408
00010000:00010000:1.0:1651531688.038104:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea9f3321/0x3234de053ca261b lrc: 3/0,1 mode: PW/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1703936->1769471] (req 1703936->1769471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531688.038107:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ea9f3321/0x3234de053ca261b lrc: 2/0,0 mode: PW/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1703936->1769471] (req 1703936->1769471) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531688.038129:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c2f581c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:37d7cd70-23c8-4282-b9a2-e45fd1319801+5:438149:x1731754464974208:12345-10.240.43.64@tcp:4:dd.0 Request processed in 24091us (24128us total) trans 21474868970 rc 0/0
00010000:00010000:0.0:1651531688.038130:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ea9f3321/0x3234de053ca261b lrc: 2/0,0 mode: PW/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1703936->1769471] (req 1703936->1769471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531688.038132:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249484
00010000:00010000:0.0:1651531688.038134:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ea9f3321 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531688.038135:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea9f3321/0x3234de053ca261b lrc: 2/0,0 mode: PW/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1703936->1769471] (req 1703936->1769471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531688.038138:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea9f3321/0x3234de053ca261b lrc: 3/0,0 mode: PW/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1703936->1769471] (req 1703936->1769471) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531688.038143:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ea9f3321/0x3234de053ca261b lrc: 1/0,0 mode: --/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1703936->1769471] (req 1703936->1769471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531688.038146:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ea9f3321/0x3234de053ca261b lrc: 0/0,0 mode: --/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1703936->1769471] (req 1703936->1769471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531688.038467:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531688.038477:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754464974336
00000100:00100000:1.0:1651531688.038491:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249485
00000100:00100000:1.0:1651531688.038493:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ea61ba33 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:37d7cd70-23c8-4282-b9a2-e45fd1319801+5:438148:x1731754464974336:12345-10.240.43.64@tcp:4:dd.0
00002000:00010000:1.0:1651531688.038502:0:216321:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34504:0x0] initial LVB size: 1769472, mtime: 0x62705fa8, atime: 0x0, ctime: 0x62705fa8, blocks: 0x580
00010000:00010000:1.0:1651531688.038504:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000378a069e/0x3234de053ca2622 lrc: 3/0,1 mode: --/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531688.038508:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531688.038509:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531688.038510:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000378a069e/0x3234de053ca2622 lrc: 3/0,1 mode: PW/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1769472->1835007] (req 1769472->1835007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531688.038514:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000378a069e/0x3234de053ca2622 lrc: 3/0,1 mode: PW/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1769472->1835007] (req 1769472->1835007) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651531688.062644:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474868971 is committed
00002000:00010000:1.0:1651531688.062659:0:216321:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x34504:0x0] updating lvb size from disk: 1769472 -> 1835008
00002000:00010000:1.0:1651531688.062660:0:216321:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x34504:0x0] updating lvb blocks from disk: 1408 -> 1536
00010000:00010000:1.0:1651531688.062663:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000378a069e/0x3234de053ca2622 lrc: 3/0,1 mode: PW/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1769472->1835007] (req 1769472->1835007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531688.062666:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000378a069e/0x3234de053ca2622 lrc: 2/0,0 mode: PW/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1769472->1835007] (req 1769472->1835007) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531688.062683:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ea61ba33 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:37d7cd70-23c8-4282-b9a2-e45fd1319801+5:438148:x1731754464974336:12345-10.240.43.64@tcp:4:dd.0 Request processed in 24189us (24216us total) trans 21474868971 rc 0/0
00000100:00100000:1.0:1651531688.062686:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249485
00010000:00010000:1.0:1651531688.062693:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000378a069e/0x3234de053ca2622 lrc: 2/0,0 mode: PW/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1769472->1835007] (req 1769472->1835007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531688.062698:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000378a069e already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531688.062699:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000378a069e/0x3234de053ca2622 lrc: 2/0,0 mode: PW/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1769472->1835007] (req 1769472->1835007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531688.062702:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000378a069e/0x3234de053ca2622 lrc: 3/0,0 mode: PW/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1769472->1835007] (req 1769472->1835007) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531688.062707:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000378a069e/0x3234de053ca2622 lrc: 1/0,0 mode: --/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1769472->1835007] (req 1769472->1835007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531688.062710:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000378a069e/0x3234de053ca2622 lrc: 0/0,0 mode: --/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1769472->1835007] (req 1769472->1835007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531688.063044:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531688.063052:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754464974464
00000100:00100000:1.0:1651531688.063069:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249486
00000100:00100000:1.0:1651531688.063071:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005291b0d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:37d7cd70-23c8-4282-b9a2-e45fd1319801+5:438149:x1731754464974464:12345-10.240.43.64@tcp:4:dd.0
00002000:00010000:1.0:1651531688.063080:0:216321:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34504:0x0] initial LVB size: 1835008, mtime: 0x62705fa8, atime: 0x0, ctime: 0x62705fa8, blocks: 0x600
00010000:00010000:1.0:1651531688.063082:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d0d3608/0x3234de053ca2629 lrc: 3/0,1 mode: --/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531688.063086:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531688.063086:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531688.063088:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008d0d3608/0x3234de053ca2629 lrc: 3/0,1 mode: PW/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1835008->1900543] (req 1835008->1900543) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531688.063091:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008d0d3608/0x3234de053ca2629 lrc: 3/0,1 mode: PW/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1835008->1900543] (req 1835008->1900543) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651531688.087220:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474868972 is committed
00002000:00010000:1.0:1651531688.087242:0:216321:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x34504:0x0] updating lvb size from disk: 1835008 -> 1900544
00002000:00010000:1.0:1651531688.087243:0:216321:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x34504:0x0] updating lvb blocks from disk: 1536 -> 1664
00010000:00010000:1.0:1651531688.087246:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d0d3608/0x3234de053ca2629 lrc: 3/0,1 mode: PW/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1835008->1900543] (req 1835008->1900543) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531688.087249:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008d0d3608/0x3234de053ca2629 lrc: 2/0,0 mode: PW/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1835008->1900543] (req 1835008->1900543) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531688.087271:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005291b0d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:37d7cd70-23c8-4282-b9a2-e45fd1319801+5:438149:x1731754464974464:12345-10.240.43.64@tcp:4:dd.0 Request processed in 24200us (24227us total) trans 21474868972 rc 0/0
00010000:00010000:0.0:1651531688.087274:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008d0d3608/0x3234de053ca2629 lrc: 2/0,0 mode: PW/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1835008->1900543] (req 1835008->1900543) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531688.087275:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249486
00010000:00010000:0.0:1651531688.087279:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008d0d3608 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531688.087280:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008d0d3608/0x3234de053ca2629 lrc: 2/0,0 mode: PW/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1835008->1900543] (req 1835008->1900543) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531688.087283:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008d0d3608/0x3234de053ca2629 lrc: 3/0,0 mode: PW/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1835008->1900543] (req 1835008->1900543) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531688.087288:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008d0d3608/0x3234de053ca2629 lrc: 1/0,0 mode: --/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1835008->1900543] (req 1835008->1900543) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531688.087293:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008d0d3608/0x3234de053ca2629 lrc: 0/0,0 mode: --/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1835008->1900543] (req 1835008->1900543) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531688.087613:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531688.087621:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754464974592
00000100:00100000:1.0:1651531688.087636:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249487
00000100:00100000:1.0:1651531688.087638:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000b0b31d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:37d7cd70-23c8-4282-b9a2-e45fd1319801+5:438148:x1731754464974592:12345-10.240.43.64@tcp:4:dd.0
00002000:00010000:1.0:1651531688.087647:0:216321:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34504:0x0] initial LVB size: 1900544, mtime: 0x62705fa8, atime: 0x0, ctime: 0x62705fa8, blocks: 0x680
00010000:00010000:1.0:1651531688.087649:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000378a069e/0x3234de053ca2630 lrc: 3/0,1 mode: --/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531688.087653:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531688.087654:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531688.087655:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000378a069e/0x3234de053ca2630 lrc: 3/0,1 mode: PW/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1900544->1966079] (req 1900544->1966079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531688.087659:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000378a069e/0x3234de053ca2630 lrc: 3/0,1 mode: PW/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1900544->1966079] (req 1900544->1966079) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651531688.110422:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474868973 is committed
00002000:00010000:1.0:1651531688.110436:0:216321:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x34504:0x0] updating lvb size from disk: 1900544 -> 1966080
00002000:00010000:1.0:1651531688.110438:0:216321:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x34504:0x0] updating lvb blocks from disk: 1664 -> 1792
00010000:00010000:1.0:1651531688.110440:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000378a069e/0x3234de053ca2630 lrc: 3/0,1 mode: PW/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1900544->1966079] (req 1900544->1966079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531688.110444:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000378a069e/0x3234de053ca2630 lrc: 2/0,0 mode: PW/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1900544->1966079] (req 1900544->1966079) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531688.110467:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000b0b31d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:37d7cd70-23c8-4282-b9a2-e45fd1319801+5:438148:x1731754464974592:12345-10.240.43.64@tcp:4:dd.0 Request processed in 22827us (22854us total) trans 21474868973 rc 0/0
00000100:00100000:1.0:1651531688.110470:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249487
00010000:00010000:0.0:1651531688.110470:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000378a069e/0x3234de053ca2630 lrc: 2/0,0 mode: PW/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1900544->1966079] (req 1900544->1966079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531688.110474:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000378a069e already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531688.110475:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000378a069e/0x3234de053ca2630 lrc: 2/0,0 mode: PW/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1900544->1966079] (req 1900544->1966079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531688.110479:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000378a069e/0x3234de053ca2630 lrc: 3/0,0 mode: PW/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1900544->1966079] (req 1900544->1966079) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531688.110484:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000378a069e/0x3234de053ca2630 lrc: 1/0,0 mode: --/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1900544->1966079] (req 1900544->1966079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531688.110487:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000378a069e/0x3234de053ca2630 lrc: 0/0,0 mode: --/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1900544->1966079] (req 1900544->1966079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531688.110895:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531688.110904:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754464974720
00000100:00100000:1.0:1651531688.110919:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249488
00000100:00100000:1.0:1651531688.110921:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006aea599a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:37d7cd70-23c8-4282-b9a2-e45fd1319801+5:438148:x1731754464974720:12345-10.240.43.64@tcp:4:dd.0
00002000:00010000:1.0:1651531688.110930:0:216321:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34504:0x0] initial LVB size: 1966080, mtime: 0x62705fa8, atime: 0x0, ctime: 0x62705fa8, blocks: 0x700
00010000:00010000:1.0:1651531688.110932:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca2637 lrc: 3/0,1 mode: --/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531688.110936:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531688.110937:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531688.110938:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca2637 lrc: 3/0,1 mode: PW/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1966080->2031615] (req 1966080->2031615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531688.110942:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca2637 lrc: 3/0,1 mode: PW/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1966080->2031615] (req 1966080->2031615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651531688.134961:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474868974 is committed
00002000:00010000:1.0:1651531688.134974:0:216321:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x34504:0x0] updating lvb size from disk: 1966080 -> 2031616
00002000:00010000:1.0:1651531688.134975:0:216321:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x34504:0x0] updating lvb blocks from disk: 1792 -> 1920
00010000:00010000:1.0:1651531688.134978:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca2637 lrc: 3/0,1 mode: PW/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1966080->2031615] (req 1966080->2031615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531688.134981:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca2637 lrc: 2/0,0 mode: PW/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1966080->2031615] (req 1966080->2031615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531688.134998:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006aea599a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:37d7cd70-23c8-4282-b9a2-e45fd1319801+5:438148:x1731754464974720:12345-10.240.43.64@tcp:4:dd.0 Request processed in 24076us (24103us total) trans 21474868974 rc 0/0
00000100:00100000:1.0:1651531688.135001:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249488
00010000:00010000:1.0:1651531688.135021:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca2637 lrc: 2/0,0 mode: PW/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1966080->2031615] (req 1966080->2031615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531688.135024:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006878f48a already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531688.135026:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca2637 lrc: 2/0,0 mode: PW/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1966080->2031615] (req 1966080->2031615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531688.135029:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca2637 lrc: 3/0,0 mode: PW/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1966080->2031615] (req 1966080->2031615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531688.135034:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca2637 lrc: 1/0,0 mode: --/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1966080->2031615] (req 1966080->2031615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531688.135036:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca2637 lrc: 0/0,0 mode: --/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [1966080->2031615] (req 1966080->2031615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531688.172646:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531688.172672:0:191990:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754464975424
00000100:00100000:0.0:1651531688.172686:0:191990:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44172
00000100:00100000:0.0:1651531688.172688:0:191990:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000427633c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:37d7cd70-23c8-4282-b9a2-e45fd1319801+5:438146:x1731754464975424:12345-10.240.43.64@tcp:101:cmp.0
00010000:00010000:0.0:1651531688.172692:0:191990:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531688.172698:0:191990:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca263e lrc: 2/0,0 mode: --/PR res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db435c55 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00002000:00010000:0.0:1651531688.172704:0:191990:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34504:0x0] initial LVB size: 2031616, mtime: 0x62705fa8, atime: 0x0, ctime: 0x62705fa8, blocks: 0x780
00010000:00010000:0.0:1651531688.172711:0:191990:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531688.172712:0:191990:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531688.172716:0:191990:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca263e lrc: 3/0,0 mode: PR/PR res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db435c55 expref: 6 pid: 191990 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531688.172722:0:191990:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca263e lrc: 3/0,0 mode: PR/PR res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db435c55 expref: 6 pid: 191990 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531688.172726:0:191990:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000968553c1, rc 0)
00000100:00100000:0.0:1651531688.172743:0:191990:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000427633c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:37d7cd70-23c8-4282-b9a2-e45fd1319801+6:438146:x1731754464975424:12345-10.240.43.64@tcp:101:cmp.0 Request processed in 55us (98us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531688.172746:0:191990:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44172
00000100:00100000:1.0:1651531688.176601:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531688.176610:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754464975680
00002000:00100000:1.0:1651531688.176619:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x34504:0x0] (1048576->4194303)  req@00000000a899ddab x1731754464975680/t0(0) o3->37d7cd70-23c8-4282-b9a2-e45fd1319801@10.240.43.64@tcp:186/0 lens 488/0 e 0 to 0 dl 1651531731 ref 1 fl New:/0/ffffffff rc 0/-1 job:'cmp.0'
00002000:00100000:1.0:1651531688.176624:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000a899ddab with x1731754464975680 ext(1048576->4194303)
00002000:00010000:1.0:1651531688.176625:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000a899ddab
00000100:00100000:1.0:1651531688.176636:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249489
00000100:00100000:1.0:1651531688.176637:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a899ddab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:37d7cd70-23c8-4282-b9a2-e45fd1319801+6:438147:x1731754464975680:12345-10.240.43.64@tcp:3:cmp.0
00000100:00100000:1.0:1651531688.178497:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a899ddab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:37d7cd70-23c8-4282-b9a2-e45fd1319801+6:438147:x1731754464975680:12345-10.240.43.64@tcp:3:cmp.0 Request processed in 1857us (1895us total) trans 0 rc 983040/983040
00000100:00100000:1.0:1651531688.178501:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249489
00002000:00100000:1.0:1651531688.178504:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x34504:0x0] (1048576->4194303)  req@00000000a899ddab x1731754464975680/t0(0) o3->37d7cd70-23c8-4282-b9a2-e45fd1319801@10.240.43.64@tcp:186/0 lens 488/440 e 0 to 0 dl 1651531731 ref 1 fl Complete:/0/0 rc 983040/983040 job:'cmp.0'
00002000:00100000:1.0:1651531688.178508:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000a899ddab with x1731754464975680 ext(1048576->4194303)
00002000:00010000:1.0:1651531688.178510:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000a899ddab
00000400:00000080:0.0:1651531689.506863:0:220481:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648
00000001:02000400:0.0:1651531689.506866:0:220481:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 270b: DoM: maximum size overflow checks for DoM-only file ========================================================== 22:48:09 (1651531689)
00000100:00100000:1.0:1651531689.597300:0:39100:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000329eeeee pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:39100:1731745997340160:10.240.43.61@tcp:400:kworker/u4:1.0
00000100:00100000:0.0:1651531689.597302:0:39099:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000033696ffa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9063caa-b124-4cb6-99ef-d01a735595c3:39099:1731745997340096:10.240.43.61@tcp:400:kworker/u4:1.0
00000100:00100000:0.0:1651531689.597652:0:39099:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000033696ffa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9063caa-b124-4cb6-99ef-d01a735595c3:39099:1731745997340096:10.240.43.61@tcp:400:kworker/u4:1.0
00000100:00100000:1.0:1651531689.597653:0:39100:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000329eeeee pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:39100:1731745997340160:10.240.43.61@tcp:400:kworker/u4:1.0
00000400:00000080:0.0:1651531690.858169:0:220699:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648
00000001:02000400:0.0:1651531690.858171:0:220699:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 270c: DoM: DoM EA inheritance tests ======= 22:48:10 (1651531690)
00000100:00100000:1.0:1651531691.232194:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651531691.232213:0:182071:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745950932224
00000100:00100000:1.0:1651531691.232247:0:182071:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 407
00000100:00100000:1.0:1651531691.232250:0:182071:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000329eeeee pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745950932224:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:1.0:1651531691.232268:0:182071:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 353352896 pending 0 free 81291173888 avail 77120462848
00000100:00100000:1.0:1651531691.232293:0:182071:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000329eeeee pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745950932224:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 42us (101us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531691.232296:0:182071:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 407
00000400:00000080:0.0:1651531692.234087:0:220918:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648
00000001:02000400:0.0:1651531692.234090:0:220918:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 270d: DoM: change striping from DoM to RAID0 ========================================================== 22:48:11 (1651531691)
00000100:00100000:1.0:1651531693.307033:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651531693.307065:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745950932352
00000100:00100000:0.0:1651531693.307087:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 44173
00000100:00100000:0.0:1651531693.307090:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b10bc064 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745950932352:12345-10.240.43.61@tcp:6:osp-syn-1-0.0
00002000:00080000:0.0:1651531693.307105:0:166112:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:214276 count 1
00010000:00010000:0.0:1651531693.307119:0:166112:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2645 lrc: 3/0,1 mode: --/PW res: [0x34504:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531693.307131:0:166112:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca263e lrc: 2/0,0 mode: PR/PR res: [0x34504:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db435c55 expref: 5 pid: 191990 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531693.307135:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531693.307136:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531693.307137:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2645 lrc: 4/0,1 mode: --/PW res: [0x34504:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531693.307151:0:166112:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca263e lrc: 3/0,0 mode: PR/PR res: [0x34504:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db435c55 expref: 5 pid: 191990 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531693.307157:0:166112:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca263e lrc: 4/0,0 mode: PR/PR res: [0x34504:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db435c55 expref: 5 pid: 191990 timeout: 22501 lvb_type: 1
00000100:00100000:0.0:1651531693.307163:0:166112:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000021908e31 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:166112:1731745997340224:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531693.307196:0:166112:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f14111ff going to sleep for 6 seconds
00000100:00100000:1.0:1651531693.309004:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531693.309028:0:169267:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754464983616
00000100:00100000:0.0:1651531693.309028:0:166112:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000021908e31 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:166112:1731745997340224:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651531693.309035:0:166112:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2645 lrc: 3/0,1 mode: --/PW res: [0x34504:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531693.309039:0:169267:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca263e lrc: 4/0,0 mode: PR/PR res: [0x34504:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db435c55 expref: 6 pid: 191990 timeout: 22501 lvb_type: 1
00000100:00100000:1.0:1651531693.309052:0:169267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 63
00000100:00100000:1.0:1651531693.309054:0:169267:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f3a0807 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:37d7cd70-23c8-4282-b9a2-e45fd1319801+6:438147:x1731754464983616:12345-10.240.43.64@tcp:103:ldlm_bl_01.0
00010000:00010000:1.0:1651531693.309058:0:169267:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1651531693.309060:0:169267:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca263e lrc: 4/0,0 mode: PR/PR res: [0x34504:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db435c55 expref: 6 pid: 191990 timeout: 22501 lvb_type: 1
00010000:00010000:1.0:1651531693.309065:0:169267:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca263e lrc: 3/0,0 mode: PR/PR res: [0x34504:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db435c55 expref: 6 pid: 191990 timeout: 22501 lvb_type: 1
00010000:00010000:1.0:1651531693.309076:0:169267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca263e lrc: 0/0,0 mode: --/PR res: [0x34504:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db435c55 expref: 6 pid: 191990 timeout: 22501 lvb_type: 1
00010000:00010000:1.0:1651531693.309081:0:169267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531693.309081:0:169267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531693.309083:0:169267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2645 lrc: 3/0,1 mode: PW/PW res: [0x34504:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531693.309090:0:169267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2645 lrc: 4/0,1 mode: PW/PW res: [0x34504:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531693.309103:0:169267:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1651531693.309114:0:166112:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2645 lrc: 3/0,1 mode: PW/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531693.309116:0:169267:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f3a0807 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:37d7cd70-23c8-4282-b9a2-e45fd1319801+5:438147:x1731754464983616:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 61us (113us total) trans 0 rc 0/0
00010000:00010000:0.0:1651531693.309118:0:166112:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2645 lrc: 3/0,1 mode: PW/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531693.309119:0:169267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 63
00010000:00010000:0.0:1651531693.309125:0:166112:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2645 lrc: 3/0,1 mode: PW/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531693.309128:0:166112:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2645 lrc: 2/0,0 mode: PW/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531693.309165:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2645 lrc: 2/0,0 mode: PW/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531693.309169:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a8889a80 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531693.309171:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2645 lrc: 2/0,0 mode: PW/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531693.309175:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2645 lrc: 3/0,0 mode: PW/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531693.309180:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2645 lrc: 1/0,0 mode: --/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531693.309183:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2645 lrc: 0/0,0 mode: --/PW res: [0x34504:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531693.309572:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b10bc064 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745950932352:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 2481us (2541us total) trans 21474868975 rc 0/0
00000100:00100000:0.0:1651531693.309576:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 44173
00000400:00000080:1.0:1651531693.587833:0:221136:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648
00000001:02000400:1.0:1651531693.587835:0:221136:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 270e: DoM: lfs find with DoM files test === 22:48:13 (1651531693)
00000400:00000080:1.0:1651531695.020763:0:221354:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648
00000001:02000400:1.0:1651531695.020766:0:221354:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 270f: DoM: maximum DoM stripe size checks ========================================================== 22:48:14 (1651531694)
00000100:00100000:1.0:1651531696.020249:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531696.020281:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754465003712
00000100:00100000:0.0:1651531696.020305:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44174
00000100:00100000:0.0:1651531696.020307:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008b42dfe9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:37d7cd70-23c8-4282-b9a2-e45fd1319801+5:438149:x1731754465003712:12345-10.240.43.64@tcp:101:rm.0
00010000:00010000:0.0:1651531696.020317:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531696.020329:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca264c lrc: 2/0,0 mode: --/PR res: [0x34505:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db435ed9 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00002000:00010000:0.0:1651531696.020342:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34505:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:0.0:1651531696.020352:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531696.020353:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531696.020358:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca264c lrc: 3/0,0 mode: PR/PR res: [0x34505:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db435ed9 expref: 6 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531696.020366:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca264c lrc: 3/0,0 mode: PR/PR res: [0x34505:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db435ed9 expref: 6 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531696.020372:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d44eb74d, rc 0)
00000100:00100000:0.0:1651531696.020406:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008b42dfe9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:37d7cd70-23c8-4282-b9a2-e45fd1319801+6:438149:x1731754465003712:12345-10.240.43.64@tcp:101:rm.0 Request processed in 98us (162us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531696.020410:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44174
00000100:00100000:1.0:1651531696.352247:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651531696.352267:0:182071:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745950932672
00000100:00100000:1.0:1651531696.352292:0:182071:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 408
00000100:00100000:1.0:1651531696.352295:0:182071:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b97e3b28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745950932672:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:1.0:1651531696.352313:0:182071:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 353352896 pending 0 free 81292156928 avail 77121445888
00000100:00100000:1.0:1651531696.352339:0:182071:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b97e3b28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745950932672:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 44us (97us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531696.352343:0:182071:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 408
00000400:00000080:1.0:1651531698.691644:0:221572:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648
00000001:02000400:1.0:1651531698.691646:0:221572:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 270g: DoM: default DoM stripe size depends on free space ========================================================== 22:48:18 (1651531698)
00000100:00100000:1.0:1651531698.747261:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651531698.747288:0:191990:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745950932928
00000100:00100000:0.0:1651531698.747311:0:191990:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 44175
00000100:00100000:0.0:1651531698.747313:0:191990:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000099b6616a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745950932928:12345-10.240.43.61@tcp:6:osp-syn-1-0.0
00002000:00080000:0.0:1651531698.747329:0:191990:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:214277 count 1
00010000:00010000:0.0:1651531698.747344:0:191990:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca2653 lrc: 3/0,1 mode: --/PW res: [0x34505:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531698.747354:0:191990:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca264c lrc: 2/0,0 mode: PR/PR res: [0x34505:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db435ed9 expref: 5 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531698.747358:0:191990:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531698.747359:0:191990:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531698.747360:0:191990:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca2653 lrc: 4/0,1 mode: --/PW res: [0x34505:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531698.747374:0:191990:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca264c lrc: 3/0,0 mode: PR/PR res: [0x34505:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db435ed9 expref: 5 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531698.747380:0:191990:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca264c lrc: 4/0,0 mode: PR/PR res: [0x34505:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db435ed9 expref: 5 pid: 166112 timeout: 22507 lvb_type: 1
00000100:00100000:0.0:1651531698.747386:0:191990:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000021908e31 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:191990:1731745997340288:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531698.747422:0:191990:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ed9ce67f going to sleep for 6 seconds
00000100:00100000:0.0:1651531698.747693:0:191990:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000021908e31 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:191990:1731745997340288:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651531698.747704:0:191990:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca2653 lrc: 3/0,1 mode: --/PW res: [0x34505:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531698.747761:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531698.747780:0:166103:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754465006592
00010000:00010000:1.0:1651531698.747791:0:166103:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca264c lrc: 4/0,0 mode: PR/PR res: [0x34505:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db435ed9 expref: 6 pid: 166112 timeout: 22507 lvb_type: 1
00000100:00100000:1.0:1651531698.747804:0:166103:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 64
00000100:00100000:1.0:1651531698.747806:0:166103:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000073d3f68d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:37d7cd70-23c8-4282-b9a2-e45fd1319801+6:438148:x1731754465006592:12345-10.240.43.64@tcp:103:ldlm_bl_02.0
00010000:00010000:1.0:1651531698.747810:0:166103:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1651531698.747812:0:166103:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca264c lrc: 4/0,0 mode: PR/PR res: [0x34505:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db435ed9 expref: 6 pid: 166112 timeout: 22507 lvb_type: 1
00010000:00010000:1.0:1651531698.747817:0:166103:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca264c lrc: 3/0,0 mode: PR/PR res: [0x34505:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db435ed9 expref: 6 pid: 166112 timeout: 22507 lvb_type: 1
00010000:00010000:1.0:1651531698.747832:0:166103:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca264c lrc: 0/0,0 mode: --/PR res: [0x34505:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db435ed9 expref: 6 pid: 166112 timeout: 22507 lvb_type: 1
00010000:00010000:1.0:1651531698.747837:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531698.747838:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531698.747839:0:166103:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca2653 lrc: 3/0,1 mode: PW/PW res: [0x34505:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531698.747843:0:166103:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca2653 lrc: 4/0,1 mode: PW/PW res: [0x34505:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531698.747857:0:166103:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1651531698.747865:0:191990:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca2653 lrc: 3/0,1 mode: PW/PW res: [0x34505:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531698.747869:0:191990:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca2653 lrc: 3/0,1 mode: PW/PW res: [0x34505:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531698.747870:0:166103:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000073d3f68d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:37d7cd70-23c8-4282-b9a2-e45fd1319801+5:438148:x1731754465006592:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 64us (109us total) trans 0 rc 0/0
00010000:00010000:0.0:1651531698.747873:0:191990:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca2653 lrc: 3/0,1 mode: PW/PW res: [0x34505:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531698.747874:0:166103:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 64
00010000:00010000:0.0:1651531698.747876:0:191990:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca2653 lrc: 2/0,0 mode: PW/PW res: [0x34505:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531698.747921:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca2653 lrc: 2/0,0 mode: PW/PW res: [0x34505:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531698.747925:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b4c8742a already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531698.747927:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca2653 lrc: 2/0,0 mode: PW/PW res: [0x34505:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531698.747931:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca2653 lrc: 3/0,0 mode: PW/PW res: [0x34505:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531698.747941:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca2653 lrc: 1/0,0 mode: --/PW res: [0x34505:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531698.747949:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca2653 lrc: 0/0,0 mode: --/PW res: [0x34505:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531698.747983:0:191990:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000099b6616a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745950932928:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 669us (725us total) trans 21474868976 rc 0/0
00000100:00100000:0.0:1651531698.747987:0:191990:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 44175
00000001:00080000:1.0:1651531698.795279:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474868976 is committed
00000100:00100000:1.0:1651531701.473112:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651531701.473132:0:182071:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745950933312
00000100:00100000:1.0:1651531701.473160:0:182071:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 409
00000100:00100000:1.0:1651531701.473162:0:182071:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002ae2aeac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745950933312:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:1.0:1651531701.473180:0:182071:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 353352896 pending 0 free 81292156928 avail 77121445888
00000100:00100000:1.0:1651531701.473207:0:182071:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002ae2aeac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745950933312:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 44us (100us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531701.473211:0:182071:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 409
00000400:00000080:1.0:1651531704.412590:0:221790:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648
00000001:02000400:1.0:1651531704.412593:0:221790:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 270h: DoM: DoM stripe removal when disabled on server ========================================================== 22:48:24 (1651531704)
00000100:00100000:1.0:1651531704.647139:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531704.647173:0:191990:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754465016320
00000100:00100000:0.0:1651531704.647198:0:191990:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44176
00000100:00100000:0.0:1651531704.647201:0:191990:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a20162bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:37d7cd70-23c8-4282-b9a2-e45fd1319801+5:438149:x1731754465016320:12345-10.240.43.64@tcp:101:lfs.0
00010000:00010000:0.0:1651531704.647211:0:191990:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531704.647238:0:191990:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca265a lrc: 2/0,0 mode: --/PR res: [0x34506:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4360a0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00002000:00010000:0.0:1651531704.647252:0:191990:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34506:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:0.0:1651531704.647261:0:191990:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531704.647266:0:191990:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531704.647272:0:191990:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca265a lrc: 3/0,0 mode: PR/PR res: [0x34506:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4360a0 expref: 6 pid: 191990 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531704.647281:0:191990:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca265a lrc: 3/0,0 mode: PR/PR res: [0x34506:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4360a0 expref: 6 pid: 191990 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531704.647287:0:191990:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c2b76533, rc 0)
00000100:00100000:0.0:1651531704.647316:0:191990:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a20162bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:37d7cd70-23c8-4282-b9a2-e45fd1319801+6:438149:x1731754465016320:12345-10.240.43.64@tcp:101:lfs.0 Request processed in 114us (181us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531704.647320:0:191990:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44176
00000100:00100000:1.0:1651531704.648590:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531704.648613:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754465016576
00000100:00100000:0.0:1651531704.648622:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44177
00000100:00100000:0.0:1651531704.648624:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d76314b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:37d7cd70-23c8-4282-b9a2-e45fd1319801+6:438148:x1731754465016576:12345-10.240.43.64@tcp:1:lfs.0
00010000:00010000:0.0:1651531704.648636:0:166112:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca2661 lrc: 3/1,0 mode: --/PR res: [0x34506:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531704.648641:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531704.648642:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531704.648643:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca2661 lrc: 3/1,0 mode: PR/PR res: [0x34506:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531704.648648:0:166112:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca2661 lrc: 3/1,0 mode: PR/PR res: [0x34506:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531704.648656:0:166112:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca2661 lrc: 3/1,0 mode: PR/PR res: [0x34506:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531704.648659:0:166112:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca2661 lrc: 2/0,0 mode: PR/PR res: [0x34506:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531704.648687:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d76314b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:37d7cd70-23c8-4282-b9a2-e45fd1319801+6:438148:x1731754465016576:12345-10.240.43.64@tcp:1:lfs.0 Request processed in 62us (97us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531704.648690:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44177
00010000:00010000:0.0:1651531704.648699:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca2661 lrc: 2/0,0 mode: PR/PR res: [0x34506:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531704.648703:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008558d1b3 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531704.648704:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca2661 lrc: 2/0,0 mode: PR/PR res: [0x34506:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531704.648708:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca2661 lrc: 3/0,0 mode: PR/PR res: [0x34506:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531704.648713:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca2661 lrc: 1/0,0 mode: --/PR res: [0x34506:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531704.648716:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca2661 lrc: 0/0,0 mode: --/PR res: [0x34506:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531704.649374:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531704.649386:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754465016704
00002000:00100000:1.0:1651531704.649399:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x34506:0x0] (0->4095)  req@0000000033696ffa x1731754465016704/t0(0) o3->37d7cd70-23c8-4282-b9a2-e45fd1319801@10.240.43.64@tcp:202/0 lens 488/0 e 0 to 0 dl 1651531747 ref 1 fl New:/0/ffffffff rc 0/-1 job:'lfs.0'
00002000:00100000:1.0:1651531704.649404:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000033696ffa with x1731754465016704 ext(0->4095)
00002000:00010000:1.0:1651531704.649406:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000033696ffa
00000100:00100000:1.0:1651531704.649418:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249490
00000100:00100000:1.0:1651531704.649421:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000033696ffa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:37d7cd70-23c8-4282-b9a2-e45fd1319801+6:438149:x1731754465016704:12345-10.240.43.64@tcp:3:lfs.0
00000100:00100000:1.0:1651531704.649468:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000033696ffa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:37d7cd70-23c8-4282-b9a2-e45fd1319801+6:438149:x1731754465016704:12345-10.240.43.64@tcp:3:lfs.0 Request processed in 46us (94us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531704.649471:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249490
00002000:00100000:1.0:1651531704.649473:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x34506:0x0] (0->4095)  req@0000000033696ffa x1731754465016704/t0(0) o3->37d7cd70-23c8-4282-b9a2-e45fd1319801@10.240.43.64@tcp:202/0 lens 488/440 e 0 to 0 dl 1651531747 ref 1 fl Complete:/0/0 rc 0/0 job:'lfs.0'
00002000:00100000:1.0:1651531704.649477:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000033696ffa with x1731754465016704 ext(0->4095)
00002000:00010000:1.0:1651531704.649478:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000033696ffa
00000100:00100000:1.0:1651531704.684849:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531704.684859:0:191990:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754465016960
00000100:00100000:1.0:1651531704.684873:0:191990:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44178
00000100:00100000:1.0:1651531704.684875:0:191990:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006c46ca95 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:37d7cd70-23c8-4282-b9a2-e45fd1319801+6:438148:x1731754465016960:12345-10.240.43.64@tcp:1:lfs.0
00010000:00010000:1.0:1651531704.684885:0:191990:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca2668 lrc: 3/1,0 mode: --/PR res: [0x34506:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531704.684891:0:191990:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531704.684892:0:191990:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531704.684893:0:191990:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca2668 lrc: 3/1,0 mode: PR/PR res: [0x34506:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531704.684898:0:191990:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca2668 lrc: 3/1,0 mode: PR/PR res: [0x34506:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531704.684904:0:191990:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca2668 lrc: 3/1,0 mode: PR/PR res: [0x34506:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531704.684907:0:191990:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca2668 lrc: 2/0,0 mode: PR/PR res: [0x34506:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531704.684930:0:191990:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006c46ca95 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:37d7cd70-23c8-4282-b9a2-e45fd1319801+6:438148:x1731754465016960:12345-10.240.43.64@tcp:1:lfs.0 Request processed in 54us (82us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531704.684933:0:191990:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44178
00010000:00010000:1.0:1651531704.684940:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca2668 lrc: 2/0,0 mode: PR/PR res: [0x34506:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531704.684944:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006878f48a already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531704.684945:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca2668 lrc: 2/0,0 mode: PR/PR res: [0x34506:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531704.684948:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca2668 lrc: 3/0,0 mode: PR/PR res: [0x34506:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531704.684952:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca2668 lrc: 1/0,0 mode: --/PR res: [0x34506:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531704.684955:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca2668 lrc: 0/0,0 mode: --/PR res: [0x34506:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531704.686276:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531704.686284:0:191990:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754465017344
00000100:00100000:1.0:1651531704.686298:0:191990:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44179
00000100:00100000:1.0:1651531704.686300:0:191990:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cc11a3b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:37d7cd70-23c8-4282-b9a2-e45fd1319801+6:438148:x1731754465017344:12345-10.240.43.64@tcp:2:lfs.0
00002000:00010000:1.0:1651531704.686359:0:191990:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x34506:0x0] updating lvb size from disk: 0 -> 0
00002000:00010000:1.0:1651531704.686360:0:191990:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x34506:0x0] updating lvb mtime from disk: 0 -> 1651531704
00002000:00010000:1.0:1651531704.686361:0:191990:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x34506:0x0] updating lvb atime from disk: 0 -> 1651531704
00002000:00010000:1.0:1651531704.686364:0:191990:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x34506:0x0] updating lvb ctime from disk: 0 -> 1651531704
00002000:00010000:1.0:1651531704.686364:0:191990:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x34506:0x0] updating lvb blocks from disk: 0 -> 0
00000100:00100000:1.0:1651531704.686377:0:191990:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cc11a3b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:37d7cd70-23c8-4282-b9a2-e45fd1319801+7:438148:x1731754465017344:12345-10.240.43.64@tcp:2:lfs.0 Request processed in 76us (101us total) trans 21474868977 rc 0/0
00000100:00100000:1.0:1651531704.686380:0:191990:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44179
00000100:00100000:1.0:1651531704.687716:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651531704.687739:0:192975:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745950934080
00000100:00100000:1.0:1651531704.687766:0:192975:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 12
00000100:00100000:1.0:1651531704.687768:0:192975:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000af8c81a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:318333:x1731745950934080:12345-10.240.43.61@tcp:1000:mdt_rdpg00_001.0
00000100:00100000:1.0:1651531704.687814:0:192975:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000af8c81a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:318333:x1731745950934080:12345-10.240.43.61@tcp:1000:mdt_rdpg00_001.0 Request processed in 46us (99us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531704.687822:0:192975:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 12
00000100:00100000:1.0:1651531704.688132:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651531704.688149:0:166122:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745950934144
00000100:00100000:1.0:1651531704.688173:0:166122:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 13
00000100:00100000:1.0:1651531704.688174:0:166122:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000c6a8838 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:318333:x1731745950934144:12345-10.240.43.61@tcp:1000:mdt_rdpg00_001.0
00000100:00100000:1.0:1651531704.688221:0:166122:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000c6a8838 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:318333:x1731745950934144:12345-10.240.43.61@tcp:1000:mdt_rdpg00_001.0 Request processed in 45us (89us total) trans 21474868978 rc 0/0
00000100:00100000:1.0:1651531704.688241:0:166122:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 13
00000400:00000080:0.0:1651531706.368565:0:222008:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648
00000001:02000400:0.0:1651531706.368567:0:222008:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 270i: DoM: setting invalid DoM striping should fail ========================================================== 22:48:26 (1651531706)
00000100:00100000:0.0:1651531706.593285:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651531706.593310:0:182071:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745950934400
00000100:00100000:0.0:1651531706.593330:0:182071:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 410
00000100:00100000:0.0:1651531706.593333:0:182071:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000021908e31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745950934400:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:0.0:1651531706.593353:0:182071:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 353352896 pending 0 free 81292156928 avail 77121445888
00000100:00100000:0.0:1651531706.593380:0:182071:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000021908e31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745950934400:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 46us (98us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531706.593384:0:182071:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 410
00000400:00000080:0.0:1651531707.690802:0:222226:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648
00000001:02000400:0.0:1651531707.690804:0:222226:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 271a: DoM: data is cached for read after write ========================================================== 22:48:27 (1651531707)
00000400:00000080:1.0:1651531709.046002:0:222444:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648
00000001:02000400:1.0:1651531709.046005:0:222444:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 271b: DoM: no glimpse RPC for stat (DoM only file) ========================================================== 22:48:28 (1651531708)
00000001:00080000:1.0:1651531710.118241:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474868978 is committed
00000001:00080000:1.0:1651531710.118246:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474868977 is committed
00000100:00100000:0.0:1651531710.204193:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651531710.204232:0:191990:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745950934720
00000100:00100000:1.0:1651531710.204256:0:191990:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 44180
00000100:00100000:1.0:1651531710.204259:0:191990:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bcdb3319 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745950934720:12345-10.240.43.61@tcp:2:osp-syn-1-0.0
00002000:00010000:1.0:1651531710.204326:0:191990:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x34506:0x0] updating lvb size from disk: 0 -> 0
00002000:00010000:1.0:1651531710.204327:0:191990:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x34506:0x0] updating lvb mtime from disk: 1651531704 -> 1651531704
00002000:00010000:1.0:1651531710.204328:0:191990:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x34506:0x0] updating lvb atime from disk: 1651531704 -> 1651531704
00002000:00010000:1.0:1651531710.204329:0:191990:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x34506:0x0] updating lvb ctime from disk: 1651531704 -> 1651531704
00002000:00010000:1.0:1651531710.204330:0:191990:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x34506:0x0] updating lvb blocks from disk: 0 -> 0
00000100:00100000:1.0:1651531710.204360:0:191990:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bcdb3319 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745950934720:12345-10.240.43.61@tcp:2:osp-syn-1-0.0 Request processed in 100us (169us total) trans 21474868979 rc 0/0
00000100:00100000:1.0:1651531710.204364:0:191990:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 44180
00000400:00000080:0.0:1651531710.404828:0:222662:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648
00000001:02000400:0.0:1651531710.404830:0:222662:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 271ba: DoM: no glimpse RPC for stat (combined file) ========================================================== 22:48:30 (1651531710)
00000100:00100000:0.0:1651531711.686276:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531711.686307:0:191990:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754465027264
00000100:00100000:1.0:1651531711.686333:0:191990:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 57
00000100:00100000:1.0:1651531711.686335:0:191990:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d09aeb66 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:37d7cd70-23c8-4282-b9a2-e45fd1319801+6:438149:x1731754465027264:12345-10.240.43.64@tcp:400:kworker/u4:2.0
00000100:00100000:1.0:1651531711.686372:0:191990:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d09aeb66 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:37d7cd70-23c8-4282-b9a2-e45fd1319801+6:438149:x1731754465027264:12345-10.240.43.64@tcp:400:kworker/u4:2.0 Request processed in 36us (100us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531711.686376:0:191990:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 57
00000100:00100000:1.0:1651531711.713185:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651531711.713199:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745950935104
00000100:00100000:1.0:1651531711.713217:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 411
00000100:00100000:1.0:1651531711.713219:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003158b8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745950935104:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:1.0:1651531711.713249:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 353352896 pending 0 free 81292156928 avail 77121445888
00000100:00100000:1.0:1651531711.713269:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003158b8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745950935104:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 49us (85us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531711.713272:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 411
00000400:00000080:0.0:1651531711.793977:0:222881:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648
00000001:02000400:0.0:1651531711.793979:0:222881:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 271c: DoM: IO lock at open saves enqueue RPCs ========================================================== 22:48:31 (1651531711)
00000100:00100000:1.0:1651531714.685290:0:39100:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000e33e11e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:39100:1731745997340416:10.240.43.61@tcp:400:kworker/u4:1.0
00000100:00100000:0.0:1651531714.685295:0:39099:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000047c291a9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9063caa-b124-4cb6-99ef-d01a735595c3:39099:1731745997340352:10.240.43.61@tcp:400:kworker/u4:1.0
00000100:00100000:1.0:1651531714.685639:0:39100:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000e33e11e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:39100:1731745997340416:10.240.43.61@tcp:400:kworker/u4:1.0
00000100:00100000:0.0:1651531714.685639:0:39099:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000047c291a9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9063caa-b124-4cb6-99ef-d01a735595c3:39099:1731745997340352:10.240.43.61@tcp:400:kworker/u4:1.0
00000001:00080000:1.0:1651531716.249415:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474868979 is committed
00000100:00100000:1.0:1651531716.832406:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651531716.832454:0:182071:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745950999296
00000100:00100000:1.0:1651531716.832475:0:182071:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 412
00000100:00100000:1.0:1651531716.832478:0:182071:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000e33e11e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745950999296:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:1.0:1651531716.832495:0:182071:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 353352896 pending 0 free 81292156928 avail 77121445888
00000100:00100000:1.0:1651531716.832521:0:182071:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000e33e11e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745950999296:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 43us (118us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531716.832525:0:182071:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 412
00000400:00000080:1.0:1651531721.842619:0:223531:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648
00000001:02000400:1.0:1651531721.842622:0:223531:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 271d: DoM: read on open (1K file in reply buffer) ========================================================== 22:48:41 (1651531721)
00000100:00100000:1.0:1651531721.952201:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651531721.952218:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951126336
00000100:00100000:1.0:1651531721.952255:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 413
00000100:00100000:1.0:1651531721.952258:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001743f524 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951126336:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:1.0:1651531721.952275:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 353352896 pending 0 free 81292156928 avail 77121445888
00000100:00100000:1.0:1651531721.952299:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001743f524 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951126336:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 41us (102us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531721.952303:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 413
00000400:00000080:0.0:1651531723.304986:0:223749:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648
00000001:02000400:0.0:1651531723.304989:0:223749:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 271f: DoM: read on open (200K file and read tail) ========================================================== 22:48:43 (1651531723)
00000400:00000080:1.0:1651531724.749999:0:223967:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648
00000001:02000400:1.0:1651531724.750001:0:223967:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 271g: Discard DoM data vs client flush race ========================================================== 22:48:44 (1651531724)
00000100:00100000:0.0:1651531727.072343:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651531727.072367:0:182071:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951126912
00000100:00100000:0.0:1651531727.072389:0:182071:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 414
00000100:00100000:0.0:1651531727.072392:0:182071:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b15861ad pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951126912:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:0.0:1651531727.072409:0:182071:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 353352896 pending 0 free 81292156928 avail 77121445888
00000100:00100000:0.0:1651531727.072436:0:182071:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b15861ad pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951126912:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 44us (97us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531727.072442:0:182071:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 414
00000400:00000080:0.0:1651531727.092880:0:224185:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648
00000001:02000400:0.0:1651531727.092882:0:224185:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 272a: DoM migration: new layout with the same DOM component ========================================================== 22:48:46 (1651531726)
00000100:00100000:0.0:1651531727.131591:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531727.131616:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466766336
00000100:00100000:1.0:1651531727.131637:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44181
00000100:00100000:1.0:1651531727.131639:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f47fde78 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:37d7cd70-23c8-4282-b9a2-e45fd1319801+6:656098:x1731754466766336:12345-10.240.43.64@tcp:101:dd.0
00010000:00010000:1.0:1651531727.131649:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531727.131661:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca266f lrc: 2/0,0 mode: --/PW res: [0x34509:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4422cb expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651531727.131672:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34509:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:1.0:1651531727.131682:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531727.131683:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531727.131688:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca266f lrc: 3/0,0 mode: PW/PW res: [0x34509:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 262144->524287) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4422cb expref: 7 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531727.131694:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca266f lrc: 3/0,0 mode: PW/PW res: [0x34509:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 262144->524287) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4422cb expref: 7 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531727.131700:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006878f48a, rc 0)
00000100:00100000:1.0:1651531727.131730:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f47fde78 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:37d7cd70-23c8-4282-b9a2-e45fd1319801+7:656098:x1731754466766336:12345-10.240.43.64@tcp:101:dd.0 Request processed in 90us (142us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531727.131734:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44181
00000100:00100000:0.0:1651531727.146587:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531727.146609:0:191990:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466767744
00000100:00100000:1.0:1651531727.146619:0:191990:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44182
00000100:00100000:1.0:1651531727.146621:0:191990:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000380124f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:37d7cd70-23c8-4282-b9a2-e45fd1319801+7:438148:x1731754466767744:12345-10.240.43.64@tcp:1:lfs.0
00010000:00010000:1.0:1651531727.146632:0:191990:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000003ad4b055/0x3234de053ca2676 lrc: 3/1,0 mode: --/PR res: [0x34509:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531727.146638:0:191990:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca266f lrc: 2/0,0 mode: PW/PW res: [0x34509:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 262144->524287) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4422cb expref: 7 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531727.146642:0:191990:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531727.146642:0:191990:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531727.146643:0:191990:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003ad4b055/0x3234de053ca2676 lrc: 4/1,0 mode: --/PR res: [0x34509:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531727.146657:0:191990:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca266f lrc: 3/0,0 mode: PW/PW res: [0x34509:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 262144->524287) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4422cb expref: 7 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531727.146662:0:191990:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca266f lrc: 4/0,0 mode: PW/PW res: [0x34509:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 262144->524287) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4422cb expref: 7 pid: 166112 timeout: 22535 lvb_type: 0
00000100:00100000:1.0:1651531727.146668:0:191990:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000094d62d64 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:191990:1731745997340480:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531727.146693:0:191990:0:(client.c:2492:ptlrpc_set_wait()) set 0000000063465b92 going to sleep for 6 seconds
00000100:00100000:1.0:1651531727.146946:0:191990:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000094d62d64 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:191990:1731745997340480:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651531727.146953:0:191990:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003ad4b055/0x3234de053ca2676 lrc: 3/1,0 mode: --/PR res: [0x34509:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531727.147098:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531727.147114:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466767872
00002000:00100000:1.0:1651531727.147125:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x34509:0x0] (262144->524287)  req@000000002bf85ab5 x1731754466767872/t0(0) o4->37d7cd70-23c8-4282-b9a2-e45fd1319801@10.240.43.64@tcp:225/0 lens 488/0 e 0 to 0 dl 1651531770 ref 1 fl New:/0/ffffffff rc 0/-1 job:'md5sum.0'
00002000:00100000:1.0:1651531727.147130:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000002bf85ab5 with x1731754466767872 ext(262144->524287)
00010000:00010000:1.0:1651531727.147133:0:216321:0:(ldlm_lockd.c:599:ldlm_refresh_waiting_lock()) ### refreshed to 118s ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca266f lrc: 4/0,0 mode: PW/PW res: [0x34509:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 262144->524287) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4422cb expref: 8 pid: 166112 timeout: 22535 lvb_type: 0
00002000:00010000:1.0:1651531727.147136:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req 000000002bf85ab5
00000100:00100000:1.0:1651531727.147145:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 4
00000100:00100000:1.0:1651531727.147147:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002bf85ab5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:37d7cd70-23c8-4282-b9a2-e45fd1319801+8:438149:x1731754466767872:12345-10.240.43.64@tcp:4:md5sum.0
00000100:00100000:1.0:1651531727.148341:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002bf85ab5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:37d7cd70-23c8-4282-b9a2-e45fd1319801+10:438149:x1731754466767872:12345-10.240.43.64@tcp:4:md5sum.0 Request processed in 1192us (1243us total) trans 21474868980 rc 0/0
00000100:00100000:1.0:1651531727.148352:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 4
00002000:00100000:1.0:1651531727.148356:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x34509:0x0] (262144->524287)  req@000000002bf85ab5 x1731754466767872/t21474868980(0) o4->37d7cd70-23c8-4282-b9a2-e45fd1319801@10.240.43.64@tcp:225/0 lens 488/448 e 0 to 0 dl 1651531770 ref 1 fl Complete:H/0/0 rc 0/0 job:'md5sum.0'
00002000:00100000:1.0:1651531727.148360:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000002bf85ab5 with x1731754466767872 ext(262144->524287)
00010000:00010000:1.0:1651531727.148364:0:216321:0:(ldlm_lockd.c:599:ldlm_refresh_waiting_lock()) ### refreshed to 118s ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca266f lrc: 4/0,0 mode: PW/PW res: [0x34509:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 262144->524287) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4422cb expref: 10 pid: 166112 timeout: 22535 lvb_type: 0
00002000:00010000:1.0:1651531727.148369:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req 000000002bf85ab5
00000100:00100000:0.0:1651531727.148758:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531727.148783:0:169267:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466767936
00010000:00010000:1.0:1651531727.148791:0:169267:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca266f lrc: 4/0,0 mode: PW/PW res: [0x34509:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 262144->524287) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4422cb expref: 10 pid: 166112 timeout: 22535 lvb_type: 0
00000100:00100000:1.0:1651531727.148801:0:169267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 65
00000100:00100000:1.0:1651531727.148803:0:169267:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000066c66095 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:37d7cd70-23c8-4282-b9a2-e45fd1319801+10:438148:x1731754466767936:12345-10.240.43.64@tcp:103:ldlm_bl_02.0
00010000:00010000:1.0:1651531727.148807:0:169267:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00002000:00010000:1.0:1651531727.148811:0:169267:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x34509:0x0] updating lvb size from disk: 0 -> 524288
00002000:00010000:1.0:1651531727.148812:0:169267:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x34509:0x0] updating lvb mtime from disk: 0 -> 1651531727
00002000:00010000:1.0:1651531727.148813:0:169267:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x34509:0x0] updating lvb atime from disk: 0 -> 1651531727
00002000:00010000:1.0:1651531727.148814:0:169267:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x34509:0x0] updating lvb ctime from disk: 0 -> 1651531727
00002000:00010000:1.0:1651531727.148815:0:169267:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x34509:0x0] updating lvb blocks from disk: 0 -> 512
00010000:00010000:1.0:1651531727.148816:0:169267:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca266f lrc: 4/0,0 mode: PW/PW res: [0x34509:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 262144->524287) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4422cb expref: 10 pid: 166112 timeout: 22535 lvb_type: 0
00010000:00010000:1.0:1651531727.148821:0:169267:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca266f lrc: 3/0,0 mode: PW/PW res: [0x34509:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 262144->524287) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4422cb expref: 10 pid: 166112 timeout: 22535 lvb_type: 0
00010000:00010000:1.0:1651531727.148832:0:169267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca266f lrc: 0/0,0 mode: --/PW res: [0x34509:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 262144->524287) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4422cb expref: 10 pid: 166112 timeout: 22535 lvb_type: 0
00010000:00010000:1.0:1651531727.148836:0:169267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531727.148837:0:169267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531727.148838:0:169267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003ad4b055/0x3234de053ca2676 lrc: 3/1,0 mode: PR/PR res: [0x34509:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531727.148841:0:169267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003ad4b055/0x3234de053ca2676 lrc: 4/1,0 mode: PR/PR res: [0x34509:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531727.148849:0:169267:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1651531727.148865:0:169267:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000066c66095 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:37d7cd70-23c8-4282-b9a2-e45fd1319801+9:438148:x1731754466767936:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 61us (108us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531727.148868:0:169267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 65
00010000:00010000:1.0:1651531727.148888:0:191990:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003ad4b055/0x3234de053ca2676 lrc: 3/1,0 mode: PR/PR res: [0x34509:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531727.148892:0:191990:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003ad4b055/0x3234de053ca2676 lrc: 3/1,0 mode: PR/PR res: [0x34509:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531727.148898:0:191990:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000003ad4b055/0x3234de053ca2676 lrc: 3/1,0 mode: PR/PR res: [0x34509:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531727.148910:0:191990:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003ad4b055/0x3234de053ca2676 lrc: 2/0,0 mode: PR/PR res: [0x34509:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531727.148935:0:191990:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000380124f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:37d7cd70-23c8-4282-b9a2-e45fd1319801+8:438148:x1731754466767744:12345-10.240.43.64@tcp:1:lfs.0 Request processed in 2313us (2349us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531727.148938:0:191990:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44182
00010000:00010000:0.0:1651531727.148943:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003ad4b055/0x3234de053ca2676 lrc: 2/0,0 mode: PR/PR res: [0x34509:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531727.148948:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003ad4b055 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531727.148950:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003ad4b055/0x3234de053ca2676 lrc: 2/0,0 mode: PR/PR res: [0x34509:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531727.148954:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003ad4b055/0x3234de053ca2676 lrc: 3/0,0 mode: PR/PR res: [0x34509:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531727.148960:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003ad4b055/0x3234de053ca2676 lrc: 1/0,0 mode: --/PR res: [0x34509:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531727.148963:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003ad4b055/0x3234de053ca2676 lrc: 0/0,0 mode: --/PR res: [0x34509:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531727.150308:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531727.150325:0:191990:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466768384
00000100:00100000:1.0:1651531727.150333:0:191990:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44183
00000100:00100000:1.0:1651531727.150335:0:191990:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cfeac242 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:37d7cd70-23c8-4282-b9a2-e45fd1319801+8:656100:x1731754466768384:12345-10.240.43.64@tcp:101:lfs.0
00010000:00010000:1.0:1651531727.150339:0:191990:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531727.150343:0:191990:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000df4fd81c/0x3234de053ca267d lrc: 2/0,0 mode: --/GROUP res: [0x34509:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db442318 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651531727.150348:0:191990:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34509:0x0] initial LVB size: 524288, mtime: 0x62705fcf, atime: 0x62705fcf, ctime: 0x62705fcf, blocks: 0x200
00010000:00010000:1.0:1651531727.150353:0:191990:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531727.150353:0:191990:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531727.150356:0:191990:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000df4fd81c/0x3234de053ca267d lrc: 3/0,0 mode: GROUP/GROUP res: [0x34509:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 262144->18446744073709551615) gid 1202629930 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db442318 expref: 9 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531727.150360:0:191990:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000df4fd81c/0x3234de053ca267d lrc: 3/0,0 mode: GROUP/GROUP res: [0x34509:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 262144->18446744073709551615) gid 1202629930 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db442318 expref: 9 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531727.150364:0:191990:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000df4fd81c, rc 0)
00000100:00100000:1.0:1651531727.150381:0:191990:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cfeac242 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:37d7cd70-23c8-4282-b9a2-e45fd1319801+9:656100:x1731754466768384:12345-10.240.43.64@tcp:101:lfs.0 Request processed in 45us (74us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531727.150384:0:191990:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44183
00000100:00100000:0.0:1651531727.151064:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531727.151081:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466768576
00000100:00100000:1.0:1651531727.151089:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44184
00000100:00100000:1.0:1651531727.151092:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000487b2caa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:37d7cd70-23c8-4282-b9a2-e45fd1319801+9:438148:x1731754466768576:12345-10.240.43.64@tcp:101:lfs.0
00010000:00010000:1.0:1651531727.151095:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531727.151099:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9908e14/0x3234de053ca2684 lrc: 2/0,0 mode: --/PR res: [0x34509:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44232d expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531727.151121:0:166112:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000094d62d64 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:166112:1731745997340544:10.240.43.64@tcp:106:
00000100:00100000:1.0:1651531727.151140:0:166112:0:(client.c:2492:ptlrpc_set_wait()) set 0000000063465b92 going to sleep for 6 seconds
00000100:00100000:1.0:1651531727.151335:0:166112:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000094d62d64 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:166112:1731745997340544:10.240.43.64@tcp:106:
00010000:00010000:1.0:1651531727.151341:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e9908e14/0x3234de053ca2684 lrc: 1/0,0 mode: --/PR res: [0x34509:0x0:0x0].0x0 rrc: 3 type: EXT [262144->18446744073709551615] (req 262144->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44232d expref: 10 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531727.151346:0:166112:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9908e14/0x3234de053ca2684 lrc: 0/0,0 mode: --/PR res: [0x34509:0x0:0x0].0x0 rrc: 3 type: EXT [262144->18446744073709551615] (req 262144->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44232d expref: 10 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531727.151350:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e9908e14, rc 0)
00000100:00100000:1.0:1651531727.151364:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000487b2caa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:37d7cd70-23c8-4282-b9a2-e45fd1319801+9:438148:x1731754466768576:12345-10.240.43.64@tcp:101:lfs.0 Request processed in 271us (301us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531727.151367:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44184
00000100:00100000:0.0:1651531727.151637:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531727.151655:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466768704
00000100:00100000:1.0:1651531727.151663:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44185
00000100:00100000:1.0:1651531727.151664:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000041fd707a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:37d7cd70-23c8-4282-b9a2-e45fd1319801+9:438149:x1731754466768704:12345-10.240.43.64@tcp:101:lfs.0
00010000:00010000:1.0:1651531727.151668:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531727.151671:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca268b lrc: 2/0,0 mode: --/PR res: [0x34509:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44233b expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531727.151681:0:166112:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000094d62d64 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:166112:1731745997340608:10.240.43.64@tcp:106:
00000100:00100000:1.0:1651531727.151700:0:166112:0:(client.c:2492:ptlrpc_set_wait()) set 0000000063465b92 going to sleep for 6 seconds
00000100:00100000:1.0:1651531727.151894:0:166112:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000094d62d64 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:166112:1731745997340608:10.240.43.64@tcp:106:
00010000:00010000:1.0:1651531727.151899:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca268b lrc: 1/0,0 mode: --/PR res: [0x34509:0x0:0x0].0x0 rrc: 3 type: EXT [262144->18446744073709551615] (req 262144->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44233b expref: 10 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531727.151904:0:166112:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca268b lrc: 0/0,0 mode: --/PR res: [0x34509:0x0:0x0].0x0 rrc: 3 type: EXT [262144->18446744073709551615] (req 262144->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44233b expref: 10 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531727.151907:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000077fc7eeb, rc 0)
00000100:00100000:1.0:1651531727.151923:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000041fd707a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:37d7cd70-23c8-4282-b9a2-e45fd1319801+9:438149:x1731754466768704:12345-10.240.43.64@tcp:101:lfs.0 Request processed in 258us (286us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531727.151926:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44185
00000100:00100000:0.0:1651531727.152241:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531727.152259:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466768832
00000100:00100000:1.0:1651531727.152267:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44186
00000100:00100000:1.0:1651531727.152269:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000021908e31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:37d7cd70-23c8-4282-b9a2-e45fd1319801+9:438148:x1731754466768832:12345-10.240.43.64@tcp:23:lfs.0
00000100:00100000:1.0:1651531727.152310:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000021908e31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:37d7cd70-23c8-4282-b9a2-e45fd1319801+9:438148:x1731754466768832:12345-10.240.43.64@tcp:23:lfs.0 Request processed in 40us (69us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531727.152313:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44186
00000100:00100000:0.0:1651531727.256179:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531727.256214:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466769344
00002000:00100000:1.0:1651531727.256235:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x34509:0x0] (262144->524287)  req@00000000c65d6bc4 x1731754466769344/t0(0) o3->37d7cd70-23c8-4282-b9a2-e45fd1319801@10.240.43.64@tcp:192/0 lens 488/0 e 0 to 0 dl 1651531737 ref 1 fl New:/0/ffffffff rc 0/-1 job:'lfs.0'
00002000:00100000:1.0:1651531727.256240:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000c65d6bc4 with x1731754466769344 ext(262144->524287)
00002000:00010000:1.0:1651531727.256241:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000c65d6bc4
00000100:00100000:1.0:1651531727.256253:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249491
00000100:00100000:1.0:1651531727.256255:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c65d6bc4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:37d7cd70-23c8-4282-b9a2-e45fd1319801+9:438149:x1731754466769344:12345-10.240.43.64@tcp:3:lfs.0
00000100:00100000:1.0:1651531727.256877:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c65d6bc4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:37d7cd70-23c8-4282-b9a2-e45fd1319801+9:438149:x1731754466769344:12345-10.240.43.64@tcp:3:lfs.0 Request processed in 621us (698us total) trans 0 rc 262144/262144
00000100:00100000:1.0:1651531727.256881:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249491
00002000:00100000:1.0:1651531727.256883:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x34509:0x0] (262144->524287)  req@00000000c65d6bc4 x1731754466769344/t0(0) o3->37d7cd70-23c8-4282-b9a2-e45fd1319801@10.240.43.64@tcp:192/0 lens 488/440 e 0 to 0 dl 1651531737 ref 1 fl Complete:/0/0 rc 262144/262144 job:'lfs.0'
00002000:00100000:1.0:1651531727.256887:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000c65d6bc4 with x1731754466769344 ext(262144->524287)
00002000:00010000:1.0:1651531727.256889:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000c65d6bc4
00000100:00100000:0.0:1651531727.257799:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531727.257833:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466769600
00000100:00100000:1.0:1651531727.257850:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249492
00000100:00100000:1.0:1651531727.257852:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bedaf1f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:37d7cd70-23c8-4282-b9a2-e45fd1319801+9:438149:x1731754466769600:12345-10.240.43.64@tcp:4:lfs.0
00002000:00010000:1.0:1651531727.257863:0:216321:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x3450a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:1.0:1651531727.257866:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca2692 lrc: 3/0,1 mode: --/PW res: [0x3450a:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531727.257870:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531727.257871:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531727.257872:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca2692 lrc: 3/0,1 mode: PW/PW res: [0x3450a:0x0:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531727.257876:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca2692 lrc: 3/0,1 mode: PW/PW res: [0x3450a:0x0:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651531727.321821:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474868981 is committed
00002000:00010000:1.0:1651531727.321840:0:216321:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x3450a:0x0] updating lvb size from disk: 0 -> 262144
00002000:00010000:1.0:1651531727.321841:0:216321:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x3450a:0x0] updating lvb mtime from disk: 0 -> 1651531727
00002000:00010000:1.0:1651531727.321842:0:216321:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x3450a:0x0] updating lvb ctime from disk: 0 -> 1651531727
00002000:00010000:1.0:1651531727.321843:0:216321:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x3450a:0x0] updating lvb blocks from disk: 0 -> 512
00010000:00010000:1.0:1651531727.321847:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca2692 lrc: 3/0,1 mode: PW/PW res: [0x3450a:0x0:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531727.321851:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca2692 lrc: 2/0,0 mode: PW/PW res: [0x3450a:0x0:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531727.321876:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bedaf1f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:37d7cd70-23c8-4282-b9a2-e45fd1319801+7:438149:x1731754466769600:12345-10.240.43.64@tcp:4:lfs.0 Request processed in 64023us (64077us total) trans 21474868981 rc 0/0
00000100:00100000:1.0:1651531727.321880:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249492
00010000:00010000:1.0:1651531727.321888:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca2692 lrc: 2/0,0 mode: PW/PW res: [0x3450a:0x0:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531727.321892:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000077fc7eeb already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531727.321893:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca2692 lrc: 2/0,0 mode: PW/PW res: [0x3450a:0x0:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531727.321896:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca2692 lrc: 3/0,0 mode: PW/PW res: [0x3450a:0x0:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531727.321901:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca2692 lrc: 1/0,0 mode: --/PW res: [0x3450a:0x0:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531727.321904:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca2692 lrc: 0/0,0 mode: --/PW res: [0x3450a:0x0:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531727.322265:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531727.322284:0:191990:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466769728
00000100:00100000:1.0:1651531727.322293:0:191990:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44187
00000100:00100000:1.0:1651531727.322295:0:191990:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000094cfb6b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:37d7cd70-23c8-4282-b9a2-e45fd1319801+7:438148:x1731754466769728:12345-10.240.43.64@tcp:101:lfs.0
00010000:00010000:1.0:1651531727.322299:0:191990:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531727.322304:0:191990:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9908e14/0x3234de053ca2699 lrc: 2/0,0 mode: --/PR res: [0x34509:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db442357 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531727.322317:0:191990:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000094d62d64 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:191990:1731745997340672:10.240.43.64@tcp:106:
00000100:00100000:1.0:1651531727.322338:0:191990:0:(client.c:2492:ptlrpc_set_wait()) set 0000000063465b92 going to sleep for 6 seconds
00000100:00100000:1.0:1651531727.322589:0:191990:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000094d62d64 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:191990:1731745997340672:10.240.43.64@tcp:106:
00010000:00010000:1.0:1651531727.322595:0:191990:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e9908e14/0x3234de053ca2699 lrc: 1/0,0 mode: --/PR res: [0x34509:0x0:0x0].0x0 rrc: 3 type: EXT [262144->18446744073709551615] (req 262144->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db442357 expref: 8 pid: 191990 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531727.322600:0:191990:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9908e14/0x3234de053ca2699 lrc: 0/0,0 mode: --/PR res: [0x34509:0x0:0x0].0x0 rrc: 3 type: EXT [262144->18446744073709551615] (req 262144->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db442357 expref: 8 pid: 191990 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531727.322603:0:191990:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e9908e14, rc 0)
00000100:00100000:1.0:1651531727.322619:0:191990:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000094cfb6b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:37d7cd70-23c8-4282-b9a2-e45fd1319801+7:438148:x1731754466769728:12345-10.240.43.64@tcp:101:lfs.0 Request processed in 323us (355us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531727.322622:0:191990:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44187
00000100:00100000:0.0:1651531727.323234:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531727.323248:0:191990:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466769984
00000100:00100000:1.0:1651531727.323256:0:191990:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44188
00000100:00100000:1.0:1651531727.323258:0:191990:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009414203c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:37d7cd70-23c8-4282-b9a2-e45fd1319801+7:438149:x1731754466769984:12345-10.240.43.64@tcp:16:lfs.0
00000100:00100000:1.0:1651531727.323282:0:191990:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009414203c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:37d7cd70-23c8-4282-b9a2-e45fd1319801+7:438149:x1731754466769984:12345-10.240.43.64@tcp:16:lfs.0 Request processed in 23us (49us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531727.323285:0:191990:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44188
00000100:00100000:0.0:1651531727.324382:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531727.324398:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466770304
00000100:00100000:1.0:1651531727.324405:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44189
00000100:00100000:1.0:1651531727.324407:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dfff0362 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:37d7cd70-23c8-4282-b9a2-e45fd1319801+7:438148:x1731754466770304:12345-10.240.43.64@tcp:2:lfs.0
00000100:00100000:1.0:1651531727.324451:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dfff0362 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:37d7cd70-23c8-4282-b9a2-e45fd1319801+8:438148:x1731754466770304:12345-10.240.43.64@tcp:2:lfs.0 Request processed in 43us (70us total) trans 21474868982 rc 0/0
00000100:00100000:1.0:1651531727.324455:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44189
00000100:00100000:0.0:1651531727.325422:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531727.325438:0:191990:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466770624
00000100:00100000:1.0:1651531727.325446:0:191990:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44190
00000100:00100000:1.0:1651531727.325447:0:191990:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c6960eaf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:37d7cd70-23c8-4282-b9a2-e45fd1319801+8:438149:x1731754466770624:12345-10.240.43.64@tcp:1:lfs.0
00000100:00100000:1.0:1651531727.325470:0:191990:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c6960eaf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:37d7cd70-23c8-4282-b9a2-e45fd1319801+8:438149:x1731754466770624:12345-10.240.43.64@tcp:1:lfs.0 Request processed in 22us (48us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531727.325473:0:191990:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44190
00000100:00100000:0.0:1651531727.325962:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651531727.325981:0:192975:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951127552
00000100:00100000:1.0:1651531727.325990:0:192975:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 14
00000100:00100000:1.0:1651531727.325992:0:192975:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000912d6060 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:318329:x1731745951127552:12345-10.240.43.61@tcp:1000:mdt00_000.0
00000100:00100000:1.0:1651531727.326019:0:192975:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000912d6060 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:318329:x1731745951127552:12345-10.240.43.61@tcp:1000:mdt00_000.0 Request processed in 26us (57us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531727.326022:0:192975:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 14
00000100:00100000:0.0:1651531727.326297:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651531727.326318:0:166122:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951127616
00000100:00100000:1.0:1651531727.326326:0:166122:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 15
00000100:00100000:1.0:1651531727.326328:0:166122:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003994fc0c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:318329:x1731745951127616:12345-10.240.43.61@tcp:1000:mdt00_000.0
00000100:00100000:1.0:1651531727.326366:0:166122:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003994fc0c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:318329:x1731745951127616:12345-10.240.43.61@tcp:1000:mdt00_000.0 Request processed in 37us (70us total) trans 21474868983 rc 0/0
00000100:00100000:1.0:1651531727.326369:0:166122:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 15
00000100:00100000:0.0:1651531727.326873:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651531727.326890:0:192975:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951127744
00000100:00100000:1.0:1651531727.326897:0:192975:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 16
00000100:00100000:1.0:1651531727.326899:0:192975:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc0ce684 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:318329:x1731745951127744:12345-10.240.43.61@tcp:1000:mdt00_000.0
00000100:00100000:1.0:1651531727.326926:0:192975:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc0ce684 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:318329:x1731745951127744:12345-10.240.43.61@tcp:1000:mdt00_000.0 Request processed in 27us (54us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531727.326929:0:192975:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 16
00000100:00100000:0.0:1651531727.327514:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651531727.327536:0:166122:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951127808
00000100:00100000:1.0:1651531727.327543:0:166122:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 17
00000100:00100000:1.0:1651531727.327545:0:166122:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f48b2514 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:318329:x1731745951127808:12345-10.240.43.61@tcp:1000:mdt00_000.0
00000100:00100000:1.0:1651531727.327578:0:166122:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f48b2514 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:318329:x1731745951127808:12345-10.240.43.61@tcp:1000:mdt00_000.0 Request processed in 31us (64us total) trans 21474868984 rc 0/0
00000100:00100000:1.0:1651531727.327581:0:166122:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 17
00000100:00100000:0.0:1651531727.328331:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531727.328348:0:166103:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466770816
00000100:00100000:1.0:1651531727.328359:0:166103:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11085
00000100:00100000:1.0:1651531727.328360:0:166103:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000074640db2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:37d7cd70-23c8-4282-b9a2-e45fd1319801+8:438149:x1731754466770816:12345-10.240.43.64@tcp:103:lfs.0
00010000:00010000:1.0:1651531727.328364:0:166103:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1651531727.328371:0:166103:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000df4fd81c/0x3234de053ca267d lrc: 0/0,0 mode: --/GROUP res: [0x34509:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 262144->18446744073709551615) gid 1202629930 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db442318 expref: 8 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531727.328376:0:166103:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1651531727.328392:0:166103:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000074640db2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:37d7cd70-23c8-4282-b9a2-e45fd1319801+7:438149:x1731754466770816:12345-10.240.43.64@tcp:103:lfs.0 Request processed in 31us (61us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531727.328395:0:166103:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11085
00000100:00100000:0.0:1651531727.333155:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531727.333172:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466771392
00000100:00100000:1.0:1651531727.333180:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44191
00000100:00100000:1.0:1651531727.333182:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000232e8d19 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:37d7cd70-23c8-4282-b9a2-e45fd1319801+7:438149:x1731754466771392:12345-10.240.43.64@tcp:101:md5sum.0
00010000:00010000:1.0:1651531727.333185:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531727.333190:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9908e14/0x3234de053ca26a0 lrc: 2/0,0 mode: --/PR res: [0x3450a:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44237a expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651531727.333195:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x3450a:0x0] initial LVB size: 262144, mtime: 0x62705fcf, atime: 0x62705fcf, ctime: 0x62705fcf, blocks: 0x200
00010000:00010000:1.0:1651531727.333200:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531727.333200:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531727.333202:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9908e14/0x3234de053ca26a0 lrc: 3/0,0 mode: PR/PR res: [0x3450a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44237a expref: 8 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531727.333207:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e9908e14/0x3234de053ca26a0 lrc: 3/0,0 mode: PR/PR res: [0x3450a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44237a expref: 8 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531727.333211:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e9908e14, rc 0)
00000100:00100000:1.0:1651531727.333238:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000232e8d19 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:37d7cd70-23c8-4282-b9a2-e45fd1319801+8:438149:x1731754466771392:12345-10.240.43.64@tcp:101:md5sum.0 Request processed in 56us (83us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531727.333241:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44191
00000100:00100000:0.0:1651531727.334510:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531727.334527:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466771776
00002000:00100000:1.0:1651531727.334535:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x3450a:0x0] (0->262143)  req@0000000029096870 x1731754466771776/t0(0) o3->37d7cd70-23c8-4282-b9a2-e45fd1319801@10.240.43.64@tcp:192/0 lens 488/0 e 0 to 0 dl 1651531737 ref 1 fl New:/0/ffffffff rc 0/-1 job:'md5sum.0'
00002000:00100000:1.0:1651531727.334539:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000029096870 with x1731754466771776 ext(0->262143)
00002000:00010000:1.0:1651531727.334541:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000029096870
00000100:00100000:1.0:1651531727.334551:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249493
00000100:00100000:1.0:1651531727.334553:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029096870 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:37d7cd70-23c8-4282-b9a2-e45fd1319801+8:438149:x1731754466771776:12345-10.240.43.64@tcp:3:md5sum.0
00000100:00100000:1.0:1651531727.335054:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029096870 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:37d7cd70-23c8-4282-b9a2-e45fd1319801+8:438149:x1731754466771776:12345-10.240.43.64@tcp:3:md5sum.0 Request processed in 500us (544us total) trans 0 rc 262144/262144
00000100:00100000:1.0:1651531727.335058:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249493
00002000:00100000:1.0:1651531727.335061:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x3450a:0x0] (0->262143)  req@0000000029096870 x1731754466771776/t0(0) o3->37d7cd70-23c8-4282-b9a2-e45fd1319801@10.240.43.64@tcp:192/0 lens 488/440 e 0 to 0 dl 1651531737 ref 1 fl Complete:/0/0 rc 262144/262144 job:'md5sum.0'
00002000:00100000:1.0:1651531727.335065:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000029096870 with x1731754466771776 ext(0->262143)
00002000:00010000:1.0:1651531727.335067:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000029096870
00000400:00000080:0.0:1651531728.631793:0:224403:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648
00000001:02000400:0.0:1651531728.631795:0:224403:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 272b: DoM migration: DOM file to the OST-striped file (plain) ========================================================== 22:48:48 (1651531728)
00000100:00100000:0.0:1651531729.111262:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531729.111293:0:191990:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466776320
00000100:00100000:1.0:1651531729.111320:0:191990:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44192
00000100:00100000:1.0:1651531729.111322:0:191990:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002eb188c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:37d7cd70-23c8-4282-b9a2-e45fd1319801+8:438149:x1731754466776320:12345-10.240.43.64@tcp:101:lfs.0
00010000:00010000:1.0:1651531729.111332:0:191990:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531729.111344:0:191990:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000df4fd81c/0x3234de053ca26a7 lrc: 2/0,0 mode: --/PR res: [0x3450b:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db442437 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651531729.111358:0:191990:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x3450b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:1.0:1651531729.111367:0:191990:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531729.111368:0:191990:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531729.111373:0:191990:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000df4fd81c/0x3234de053ca26a7 lrc: 3/0,0 mode: PR/PR res: [0x3450b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db442437 expref: 9 pid: 191990 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531729.111381:0:191990:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000df4fd81c/0x3234de053ca26a7 lrc: 3/0,0 mode: PR/PR res: [0x3450b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db442437 expref: 9 pid: 191990 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531729.111387:0:191990:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000df4fd81c, rc 0)
00000100:00100000:1.0:1651531729.111418:0:191990:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002eb188c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:37d7cd70-23c8-4282-b9a2-e45fd1319801+9:438149:x1731754466776320:12345-10.240.43.64@tcp:101:lfs.0 Request processed in 95us (160us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531729.111422:0:191990:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44192
00000100:00100000:0.0:1651531729.276944:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531729.276970:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466778048
00000100:00100000:1.0:1651531729.276992:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249494
00000100:00100000:1.0:1651531729.276994:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003b40261e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:37d7cd70-23c8-4282-b9a2-e45fd1319801+9:438147:x1731754466778048:12345-10.240.43.64@tcp:4:lfs.0
00010000:00010000:1.0:1651531729.277008:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca26ae lrc: 3/0,1 mode: --/PW res: [0x3450b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531729.277015:0:216321:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000df4fd81c/0x3234de053ca26a7 lrc: 2/0,0 mode: PR/PR res: [0x3450b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db442437 expref: 9 pid: 191990 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531729.277019:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531729.277019:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531729.277020:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca26ae lrc: 4/0,1 mode: --/PW res: [0x3450b:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531729.277044:0:216321:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000df4fd81c/0x3234de053ca26a7 lrc: 3/0,0 mode: PR/PR res: [0x3450b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db442437 expref: 9 pid: 191990 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531729.277050:0:216321:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000df4fd81c/0x3234de053ca26a7 lrc: 4/0,0 mode: PR/PR res: [0x3450b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db442437 expref: 9 pid: 191990 timeout: 22537 lvb_type: 1
00000100:00100000:1.0:1651531729.277056:0:216321:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000094d62d64 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997340736:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531729.277080:0:216321:0:(client.c:2492:ptlrpc_set_wait()) set 0000000073aaa033 going to sleep for 6 seconds
00000100:00100000:1.0:1651531729.277339:0:216321:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000094d62d64 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997340736:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651531729.277346:0:216321:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca26ae lrc: 3/0,1 mode: --/PW res: [0x3450b:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531729.277392:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531729.277414:0:169267:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466778112
00010000:00010000:1.0:1651531729.277421:0:169267:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000df4fd81c/0x3234de053ca26a7 lrc: 4/0,0 mode: PR/PR res: [0x3450b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db442437 expref: 10 pid: 191990 timeout: 22537 lvb_type: 1
00000100:00100000:1.0:1651531729.277436:0:169267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 66
00000100:00100000:1.0:1651531729.277438:0:169267:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007a693f14 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:37d7cd70-23c8-4282-b9a2-e45fd1319801+10:438149:x1731754466778112:12345-10.240.43.64@tcp:103:ldlm_bl_02.0
00010000:00010000:1.0:1651531729.277441:0:169267:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1651531729.277446:0:169267:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000df4fd81c/0x3234de053ca26a7 lrc: 4/0,0 mode: PR/PR res: [0x3450b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db442437 expref: 10 pid: 191990 timeout: 22537 lvb_type: 1
00010000:00010000:1.0:1651531729.277451:0:169267:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000df4fd81c/0x3234de053ca26a7 lrc: 3/0,0 mode: PR/PR res: [0x3450b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db442437 expref: 10 pid: 191990 timeout: 22537 lvb_type: 1
00010000:00010000:1.0:1651531729.277458:0:169267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000df4fd81c/0x3234de053ca26a7 lrc: 0/0,0 mode: --/PR res: [0x3450b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db442437 expref: 10 pid: 191990 timeout: 22537 lvb_type: 1
00010000:00010000:1.0:1651531729.277462:0:169267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531729.277463:0:169267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531729.277464:0:169267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca26ae lrc: 3/0,1 mode: PW/PW res: [0x3450b:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531729.277467:0:169267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca26ae lrc: 4/0,1 mode: PW/PW res: [0x3450b:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531729.277474:0:169267:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1651531729.277487:0:169267:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007a693f14 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:37d7cd70-23c8-4282-b9a2-e45fd1319801+9:438149:x1731754466778112:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 49us (96us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531729.277490:0:169267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 66
00010000:00010000:1.0:1651531729.277499:0:216321:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca26ae lrc: 3/0,1 mode: PW/PW res: [0x3450b:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531729.277507:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca26ae lrc: 3/0,1 mode: PW/PW res: [0x3450b:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651531729.349769:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474868985 is committed
00000001:00080000:1.0:1651531729.349773:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474868984 is committed
00002000:00010000:1.0:1651531729.349800:0:216321:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x3450b:0x0] updating lvb size from disk: 0 -> 1048576
00002000:00010000:1.0:1651531729.349801:0:216321:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x3450b:0x0] updating lvb mtime from disk: 0 -> 1651531729
00002000:00010000:1.0:1651531729.349803:0:216321:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x3450b:0x0] updating lvb ctime from disk: 0 -> 1651531729
00002000:00010000:1.0:1651531729.349803:0:216321:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x3450b:0x0] updating lvb blocks from disk: 0 -> 2048
00010000:00010000:1.0:1651531729.349807:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca26ae lrc: 3/0,1 mode: PW/PW res: [0x3450b:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531729.349812:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca26ae lrc: 2/0,0 mode: PW/PW res: [0x3450b:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531729.349839:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003b40261e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:37d7cd70-23c8-4282-b9a2-e45fd1319801+7:438147:x1731754466778048:12345-10.240.43.64@tcp:4:lfs.0 Request processed in 72844us (72895us total) trans 21474868985 rc 0/0
00000100:00100000:1.0:1651531729.349843:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249494
00010000:00010000:1.0:1651531729.349852:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca26ae lrc: 2/0,0 mode: PW/PW res: [0x3450b:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531729.349856:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000077fc7eeb already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531729.349858:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca26ae lrc: 2/0,0 mode: PW/PW res: [0x3450b:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531729.349861:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca26ae lrc: 3/0,0 mode: PW/PW res: [0x3450b:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531729.349873:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca26ae lrc: 1/0,0 mode: --/PW res: [0x3450b:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531729.349886:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca26ae lrc: 0/0,0 mode: --/PW res: [0x3450b:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531729.465975:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651531729.466002:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951128320
00000100:00100000:1.0:1651531729.466015:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 44193
00000100:00100000:1.0:1651531729.466017:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e589436f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951128320:12345-10.240.43.61@tcp:6:osp-syn-1-0.0
00002000:00080000:1.0:1651531729.466025:0:166112:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:214281 count 1
00002000:00010000:1.0:1651531729.466046:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34509:0x0] initial LVB size: 524288, mtime: 0x62705fcf, atime: 0x62705fcf, ctime: 0x62705fcf, blocks: 0x200
00010000:00010000:1.0:1651531729.466048:0:166112:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca26b5 lrc: 3/0,1 mode: --/PW res: [0x34509:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531729.466053:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531729.466054:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531729.466055:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca26b5 lrc: 3/0,1 mode: PW/PW res: [0x34509:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531729.466059:0:166112:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca26b5 lrc: 3/0,1 mode: PW/PW res: [0x34509:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531729.466063:0:166112:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca26b5 lrc: 3/0,1 mode: PW/PW res: [0x34509:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531729.466065:0:166112:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca26b5 lrc: 2/0,0 mode: PW/PW res: [0x34509:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531729.466198:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e589436f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745951128320:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 180us (223us total) trans 21474868986 rc 0/0
00000100:00100000:1.0:1651531729.466202:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 44193
00010000:00010000:1.0:1651531729.466210:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca26b5 lrc: 2/0,0 mode: PW/PW res: [0x34509:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531729.466214:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000077fc7eeb already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531729.466215:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca26b5 lrc: 2/0,0 mode: PW/PW res: [0x34509:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531729.466218:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca26b5 lrc: 3/0,0 mode: PW/PW res: [0x34509:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531729.466256:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca26b5 lrc: 1/0,0 mode: --/PW res: [0x34509:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531729.466259:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca26b5 lrc: 0/0,0 mode: --/PW res: [0x34509:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531729.466321:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531729.466331:0:191990:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466778432
00000100:00100000:0.0:1651531729.466348:0:191990:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44194
00000100:00100000:0.0:1651531729.466350:0:191990:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a19b10fa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:37d7cd70-23c8-4282-b9a2-e45fd1319801+7:438149:x1731754466778432:12345-10.240.43.64@tcp:16:lfs.0
00000100:00100000:0.0:1651531729.466375:0:191990:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a19b10fa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:37d7cd70-23c8-4282-b9a2-e45fd1319801+7:438149:x1731754466778432:12345-10.240.43.64@tcp:16:lfs.0 Request processed in 24us (55us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531729.466378:0:191990:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44194
00000100:00100000:0.0:1651531729.467435:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531729.467444:0:191990:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466778688
00000100:00100000:0.0:1651531729.467457:0:191990:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44195
00000100:00100000:0.0:1651531729.467459:0:191990:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006430b767 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:37d7cd70-23c8-4282-b9a2-e45fd1319801+7:656718:x1731754466778688:12345-10.240.43.64@tcp:101:lfs.0
00010000:00010000:0.0:1651531729.467463:0:191990:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531729.467469:0:191990:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca26bc lrc: 2/0,0 mode: --/PW res: [0x3450b:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db442492 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00002000:00010000:0.0:1651531729.467476:0:191990:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x3450b:0x0] initial LVB size: 1048576, mtime: 0x62705fd1, atime: 0x0, ctime: 0x62705fd1, blocks: 0x800
00010000:00010000:0.0:1651531729.467481:0:191990:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531729.467482:0:191990:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531729.467484:0:191990:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca26bc lrc: 3/0,0 mode: PW/PW res: [0x3450b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db442492 expref: 8 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531729.467489:0:191990:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca26bc lrc: 3/0,0 mode: PW/PW res: [0x3450b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db442492 expref: 8 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531729.467493:0:191990:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008558d1b3, rc 0)
00000100:00100000:0.0:1651531729.467504:0:191990:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006430b767 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:37d7cd70-23c8-4282-b9a2-e45fd1319801+8:656718:x1731754466778688:12345-10.240.43.64@tcp:101:lfs.0 Request processed in 45us (70us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531729.467507:0:191990:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44195
00000100:00100000:0.0:1651531729.467765:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531729.467773:0:191990:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466778816
00000100:00100000:0.0:1651531729.467785:0:191990:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44196
00000100:00100000:0.0:1651531729.467787:0:191990:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000091a5f763 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:37d7cd70-23c8-4282-b9a2-e45fd1319801+8:438149:x1731754466778816:12345-10.240.43.64@tcp:2:lfs.0
00002000:00010000:0.0:1651531729.467820:0:191990:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x3450b:0x0] updating lvb size from disk: 1048576 -> 1048576
00002000:00010000:0.0:1651531729.467821:0:191990:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x3450b:0x0] updating lvb mtime from disk: 1651531729 -> 1651531728
00002000:00010000:0.0:1651531729.467822:0:191990:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x3450b:0x0] updating lvb atime from disk: 0 -> 1651531728
00002000:00010000:0.0:1651531729.467825:0:191990:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x3450b:0x0] updating lvb ctime from disk: 1651531729 -> 1651531729
00002000:00010000:0.0:1651531729.467826:0:191990:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x3450b:0x0] updating lvb blocks from disk: 2048 -> 2048
00000100:00100000:0.0:1651531729.467837:0:191990:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000091a5f763 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:37d7cd70-23c8-4282-b9a2-e45fd1319801+9:438149:x1731754466778816:12345-10.240.43.64@tcp:2:lfs.0 Request processed in 49us (73us total) trans 21474868987 rc 0/0
00000100:00100000:0.0:1651531729.467841:0:191990:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44196
00000100:00100000:0.0:1651531729.470289:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651531729.470308:0:192975:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951128640
00000100:00100000:1.0:1651531729.470319:0:192975:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 18
00000100:00100000:1.0:1651531729.470321:0:192975:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001a84ab10 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:318329:x1731745951128640:12345-10.240.43.61@tcp:1000:mdt00_000.0
00000100:00100000:1.0:1651531729.470350:0:192975:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001a84ab10 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:318329:x1731745951128640:12345-10.240.43.61@tcp:1000:mdt00_000.0 Request processed in 28us (61us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531729.470353:0:192975:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 18
00000100:00100000:0.0:1651531729.470576:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651531729.470597:0:166122:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951128704
00000100:00100000:1.0:1651531729.470605:0:166122:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 19
00000100:00100000:1.0:1651531729.470607:0:166122:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008dd476e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:318329:x1731745951128704:12345-10.240.43.61@tcp:1000:mdt00_000.0
00000100:00100000:1.0:1651531729.470645:0:166122:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008dd476e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:318329:x1731745951128704:12345-10.240.43.61@tcp:1000:mdt00_000.0 Request processed in 37us (69us total) trans 21474868988 rc 0/0
00000100:00100000:1.0:1651531729.470648:0:166122:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 19
00000100:00100000:0.0:1651531729.491270:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531729.491278:0:191990:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466780544
00000100:00100000:0.0:1651531729.491290:0:191990:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44197
00000100:00100000:0.0:1651531729.491292:0:191990:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e11ae1c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:37d7cd70-23c8-4282-b9a2-e45fd1319801+9:438146:x1731754466780544:12345-10.240.43.64@tcp:101:md5sum.0
00010000:00010000:0.0:1651531729.491296:0:191990:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531729.491300:0:191990:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca26c3 lrc: 2/0,0 mode: --/PR res: [0x3450b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4424ca expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531729.491325:0:191990:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cb694635 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:191990:1731745997340800:10.240.43.64@tcp:106:
00000100:00100000:0.0:1651531729.491340:0:191990:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d9e1a9f8 going to sleep for 6 seconds
00000100:00100000:0.0:1651531729.491564:0:191990:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cb694635 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:191990:1731745997340800:10.240.43.64@tcp:106:
00010000:00010000:0.0:1651531729.491571:0:191990:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca26c3 lrc: 1/0,0 mode: --/PR res: [0x3450b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4424ca expref: 10 pid: 191990 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531729.491576:0:191990:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca26c3 lrc: 0/0,0 mode: --/PR res: [0x3450b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4424ca expref: 10 pid: 191990 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531729.491580:0:191990:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006da7a892, rc 0)
00000100:00100000:0.0:1651531729.491590:0:191990:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e11ae1c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:37d7cd70-23c8-4282-b9a2-e45fd1319801+9:438146:x1731754466780544:12345-10.240.43.64@tcp:101:md5sum.0 Request processed in 297us (320us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531729.491594:0:191990:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44197
00000100:00100000:0.0:1651531729.497713:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531729.497721:0:191990:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466780992
00000100:00100000:0.0:1651531729.497734:0:191990:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44198
00000100:00100000:0.0:1651531729.497736:0:191990:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cb694635 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:37d7cd70-23c8-4282-b9a2-e45fd1319801+9:656723:x1731754466780992:12345-10.240.43.64@tcp:101:md5sum.0
00010000:00010000:0.0:1651531729.497739:0:191990:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531729.497743:0:191990:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca26ca lrc: 2/0,0 mode: --/PR res: [0x3450b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4424d8 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531729.497750:0:191990:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca26bc lrc: 2/0,0 mode: PW/PW res: [0x3450b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db442492 expref: 10 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531729.497753:0:191990:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531729.497754:0:191990:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531729.497755:0:191990:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca26ca lrc: 4/0,0 mode: --/PR res: [0x3450b:0x0:0x0].0x0 rrc: 3 type: EXT [0->32767] (req 0->32767) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4424d8 expref: 10 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531729.497763:0:191990:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca26bc lrc: 3/0,0 mode: PW/PW res: [0x3450b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db442492 expref: 10 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531729.497767:0:191990:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca26bc lrc: 4/0,0 mode: PW/PW res: [0x3450b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db442492 expref: 10 pid: 191990 timeout: 22538 lvb_type: 0
00000100:00100000:0.0:1651531729.497771:0:191990:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008bb4a649 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:191990:1731745997340864:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531729.497783:0:191990:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d9e1a9f8 going to sleep for 6 seconds
00000100:00100000:0.0:1651531729.497983:0:191990:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008bb4a649 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:191990:1731745997340864:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651531729.497990:0:191990:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca26ca lrc: 3/0,0 mode: --/PR res: [0x3450b:0x0:0x0].0x0 rrc: 3 type: EXT [0->32767] (req 0->32767) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4424d8 expref: 10 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531729.497995:0:191990:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006da7a892, rc 0)
00000100:00100000:0.0:1651531729.498004:0:191990:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cb694635 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:37d7cd70-23c8-4282-b9a2-e45fd1319801+10:656723:x1731754466780992:12345-10.240.43.64@tcp:101:md5sum.0 Request processed in 268us (292us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531729.498007:0:191990:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44198
00000100:00100000:0.0:1651531729.498059:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531729.498081:0:166103:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466781056
00010000:00010000:1.0:1651531729.498095:0:166103:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca26bc lrc: 4/0,0 mode: PW/PW res: [0x3450b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db442492 expref: 10 pid: 191990 timeout: 22538 lvb_type: 0
00000100:00100000:1.0:1651531729.498105:0:166103:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 67
00000100:00100000:1.0:1651531729.498107:0:166103:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008bb4a649 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:37d7cd70-23c8-4282-b9a2-e45fd1319801+10:438149:x1731754466781056:12345-10.240.43.64@tcp:103:ldlm_bl_03.0
00010000:00010000:1.0:1651531729.498110:0:166103:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1651531729.498114:0:166103:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca26bc lrc: 4/0,0 mode: PW/PW res: [0x3450b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db442492 expref: 10 pid: 191990 timeout: 22538 lvb_type: 0
00010000:00010000:1.0:1651531729.498118:0:166103:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca26bc lrc: 3/0,0 mode: PW/PW res: [0x3450b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db442492 expref: 10 pid: 191990 timeout: 22538 lvb_type: 0
00010000:00010000:1.0:1651531729.498125:0:166103:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca26bc lrc: 0/0,0 mode: --/PW res: [0x3450b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db442492 expref: 10 pid: 191990 timeout: 22538 lvb_type: 0
00010000:00010000:1.0:1651531729.498129:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531729.498129:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531729.498131:0:166103:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca26ca lrc: 2/0,0 mode: PR/PR res: [0x3450b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4424d8 expref: 9 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531729.498139:0:166103:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca26ca lrc: 3/0,0 mode: PR/PR res: [0x3450b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4424d8 expref: 9 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531729.498148:0:166103:0:(ldlm_lockd.c:1067:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca26ca lrc: 3/0,0 mode: PR/PR res: [0x3450b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4424d8 expref: 9 pid: 191990 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531729.498152:0:166103:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000094d62d64 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:166103:1731745997340928:10.240.43.64@tcp:105:
00000100:00100000:1.0:1651531729.498172:0:166103:0:(client.c:2492:ptlrpc_set_wait()) set 0000000073aaa033 going to sleep for 6 seconds
00000100:00100000:1.0:1651531729.498411:0:166103:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000094d62d64 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:166103:1731745997340928:10.240.43.64@tcp:105:
00010000:00010000:1.0:1651531729.498416:0:166103:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1651531729.498429:0:166103:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008bb4a649 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:37d7cd70-23c8-4282-b9a2-e45fd1319801+9:438149:x1731754466781056:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 321us (370us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531729.498432:0:166103:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 67
00000100:00100000:0.0:1651531729.498965:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531729.498983:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466781184
00002000:00100000:1.0:1651531729.498991:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x3450b:0x0] (0->1048575)  req@000000006a8dcc9d x1731754466781184/t0(0) o3->37d7cd70-23c8-4282-b9a2-e45fd1319801@10.240.43.64@tcp:194/0 lens 488/0 e 0 to 0 dl 1651531739 ref 1 fl New:/0/ffffffff rc 0/-1 job:'md5sum.0'
00002000:00100000:1.0:1651531729.498996:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000006a8dcc9d with x1731754466781184 ext(0->1048575)
00002000:00010000:1.0:1651531729.498997:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000006a8dcc9d
00000100:00100000:1.0:1651531729.499008:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249495
00000100:00100000:1.0:1651531729.499010:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006a8dcc9d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:37d7cd70-23c8-4282-b9a2-e45fd1319801+9:438146:x1731754466781184:12345-10.240.43.64@tcp:3:md5sum.0
00000100:00100000:1.0:1651531729.500392:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006a8dcc9d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:37d7cd70-23c8-4282-b9a2-e45fd1319801+9:438146:x1731754466781184:12345-10.240.43.64@tcp:3:md5sum.0 Request processed in 1381us (1427us total) trans 0 rc 1048576/1048576
00000100:00100000:1.0:1651531729.500396:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249495
00002000:00100000:1.0:1651531729.500400:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x3450b:0x0] (0->1048575)  req@000000006a8dcc9d x1731754466781184/t0(0) o3->37d7cd70-23c8-4282-b9a2-e45fd1319801@10.240.43.64@tcp:194/0 lens 488/440 e 0 to 0 dl 1651531739 ref 1 fl Complete:/0/0 rc 1048576/1048576 job:'md5sum.0'
00002000:00100000:1.0:1651531729.500404:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000006a8dcc9d with x1731754466781184 ext(0->1048575)
00002000:00010000:1.0:1651531729.500405:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000006a8dcc9d
00000400:00000080:1.0:1651531730.995983:0:224621:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648
00000001:02000400:1.0:1651531730.995985:0:224621:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 272c: DoM migration: DOM file to the OST-striped file (composite) ========================================================== 22:48:50 (1651531730)
00000100:00100000:0.0:1651531731.464465:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531731.464485:0:191990:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466785920
00000100:00100000:0.0:1651531731.464513:0:191990:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44199
00000100:00100000:0.0:1651531731.464516:0:191990:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b6b1b79d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:37d7cd70-23c8-4282-b9a2-e45fd1319801+9:438147:x1731754466785920:12345-10.240.43.64@tcp:101:lfs.0
00010000:00010000:0.0:1651531731.464525:0:191990:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531731.464537:0:191990:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca26d1 lrc: 2/0,0 mode: --/PR res: [0x3450c:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db442580 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00002000:00010000:0.0:1651531731.464550:0:191990:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x3450c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:0.0:1651531731.464559:0:191990:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531731.464560:0:191990:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531731.464566:0:191990:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca26d1 lrc: 3/0,0 mode: PR/PR res: [0x3450c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db442580 expref: 10 pid: 191990 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531731.464574:0:191990:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca26d1 lrc: 3/0,0 mode: PR/PR res: [0x3450c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db442580 expref: 10 pid: 191990 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531731.464579:0:191990:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001e36c601, rc 0)
00000100:00100000:0.0:1651531731.464606:0:191990:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b6b1b79d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:37d7cd70-23c8-4282-b9a2-e45fd1319801+10:438147:x1731754466785920:12345-10.240.43.64@tcp:101:lfs.0 Request processed in 89us (145us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531731.464609:0:191990:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44199
00000100:00100000:0.0:1651531731.473532:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531731.473560:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466787264
00000100:00100000:1.0:1651531731.473586:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249496
00000100:00100000:1.0:1651531731.473588:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009e786cd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:37d7cd70-23c8-4282-b9a2-e45fd1319801+10:438148:x1731754466787264:12345-10.240.43.64@tcp:4:lfs.0
00010000:00010000:1.0:1651531731.473601:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca26d8 lrc: 3/0,1 mode: --/PW res: [0x3450c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531731.473609:0:216321:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca26d1 lrc: 2/0,0 mode: PR/PR res: [0x3450c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db442580 expref: 10 pid: 191990 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531731.473613:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531731.473614:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531731.473614:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca26d8 lrc: 4/0,1 mode: --/PW res: [0x3450c:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531731.473628:0:216321:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca26d1 lrc: 3/0,0 mode: PR/PR res: [0x3450c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db442580 expref: 10 pid: 191990 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531731.473633:0:216321:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca26d1 lrc: 4/0,0 mode: PR/PR res: [0x3450c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db442580 expref: 10 pid: 191990 timeout: 22540 lvb_type: 1
00000100:00100000:1.0:1651531731.473639:0:216321:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000094d62d64 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997340992:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531731.473669:0:216321:0:(client.c:2492:ptlrpc_set_wait()) set 0000000073aaa033 going to sleep for 6 seconds
00000100:00100000:1.0:1651531731.473912:0:216321:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000094d62d64 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997340992:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651531731.473919:0:216321:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca26d8 lrc: 3/0,1 mode: --/PW res: [0x3450c:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531731.473975:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531731.473988:0:166103:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466787328
00010000:00010000:0.0:1651531731.473997:0:166103:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca26d1 lrc: 4/0,0 mode: PR/PR res: [0x3450c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db442580 expref: 11 pid: 191990 timeout: 22540 lvb_type: 1
00000100:00100000:0.0:1651531731.474010:0:166103:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 68
00000100:00100000:0.0:1651531731.474012:0:166103:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f2eb86bf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:37d7cd70-23c8-4282-b9a2-e45fd1319801+11:438149:x1731754466787328:12345-10.240.43.64@tcp:103:ldlm_bl_02.0
00010000:00010000:0.0:1651531731.474016:0:166103:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531731.474022:0:166103:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca26d1 lrc: 4/0,0 mode: PR/PR res: [0x3450c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db442580 expref: 11 pid: 191990 timeout: 22540 lvb_type: 1
00010000:00010000:0.0:1651531731.474026:0:166103:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca26d1 lrc: 3/0,0 mode: PR/PR res: [0x3450c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db442580 expref: 11 pid: 191990 timeout: 22540 lvb_type: 1
00010000:00010000:0.0:1651531731.474058:0:166103:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca26d1 lrc: 0/0,0 mode: --/PR res: [0x3450c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db442580 expref: 11 pid: 191990 timeout: 22540 lvb_type: 1
00010000:00010000:0.0:1651531731.474062:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531731.474063:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531731.474064:0:166103:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca26d8 lrc: 3/0,1 mode: PW/PW res: [0x3450c:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531731.474067:0:166103:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca26d8 lrc: 4/0,1 mode: PW/PW res: [0x3450c:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531731.474084:0:166103:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651531731.474096:0:166103:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f2eb86bf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:37d7cd70-23c8-4282-b9a2-e45fd1319801+10:438149:x1731754466787328:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 83us (123us total) trans 0 rc 0/0
00010000:00010000:1.0:1651531731.474098:0:216321:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca26d8 lrc: 3/0,1 mode: PW/PW res: [0x3450c:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531731.474099:0:166103:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 68
00010000:00010000:1.0:1651531731.474102:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca26d8 lrc: 3/0,1 mode: PW/PW res: [0x3450c:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651531731.544720:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474868989 is committed
00000001:00080000:1.0:1651531731.544724:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474868988 is committed
00002000:00010000:1.0:1651531731.544757:0:216321:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x3450c:0x0] updating lvb size from disk: 0 -> 1048576
00002000:00010000:1.0:1651531731.544759:0:216321:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x3450c:0x0] updating lvb mtime from disk: 0 -> 1651531731
00002000:00010000:1.0:1651531731.544760:0:216321:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x3450c:0x0] updating lvb ctime from disk: 0 -> 1651531731
00002000:00010000:1.0:1651531731.544761:0:216321:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x3450c:0x0] updating lvb blocks from disk: 0 -> 2048
00010000:00010000:1.0:1651531731.544765:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca26d8 lrc: 3/0,1 mode: PW/PW res: [0x3450c:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531731.544769:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca26d8 lrc: 2/0,0 mode: PW/PW res: [0x3450c:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531731.544798:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009e786cd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:37d7cd70-23c8-4282-b9a2-e45fd1319801+8:438148:x1731754466787264:12345-10.240.43.64@tcp:4:lfs.0 Request processed in 71209us (71266us total) trans 21474868989 rc 0/0
00000100:00100000:1.0:1651531731.544802:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249496
00010000:00010000:1.0:1651531731.544812:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca26d8 lrc: 2/0,0 mode: PW/PW res: [0x3450c:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531731.544819:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000077fc7eeb already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531731.544821:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca26d8 lrc: 2/0,0 mode: PW/PW res: [0x3450c:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531731.544824:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca26d8 lrc: 3/0,0 mode: PW/PW res: [0x3450c:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531731.544840:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca26d8 lrc: 1/0,0 mode: --/PW res: [0x3450c:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531731.544843:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca26d8 lrc: 0/0,0 mode: --/PW res: [0x3450c:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531731.546622:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531731.546641:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466787584
00000100:00100000:1.0:1651531731.546658:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249497
00000100:00100000:1.0:1651531731.546660:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001797bd5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:37d7cd70-23c8-4282-b9a2-e45fd1319801+8:438148:x1731754466787584:12345-10.240.43.64@tcp:4:lfs.0
00002000:00010000:1.0:1651531731.546670:0:216321:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x3450c:0x0] initial LVB size: 1048576, mtime: 0x62705fd3, atime: 0x0, ctime: 0x62705fd3, blocks: 0x800
00010000:00010000:1.0:1651531731.546672:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000df4fd81c/0x3234de053ca26df lrc: 3/0,1 mode: --/PW res: [0x3450c:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531731.546676:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531731.546677:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531731.546678:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000df4fd81c/0x3234de053ca26df lrc: 3/0,1 mode: PW/PW res: [0x3450c:0x0:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531731.546682:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000df4fd81c/0x3234de053ca26df lrc: 3/0,1 mode: PW/PW res: [0x3450c:0x0:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651531731.619965:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474868990 is committed
00002000:00010000:1.0:1651531731.619993:0:216321:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x3450c:0x0] updating lvb size from disk: 1048576 -> 2097152
00002000:00010000:1.0:1651531731.619995:0:216321:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x3450c:0x0] updating lvb blocks from disk: 2048 -> 4096
00010000:00010000:1.0:1651531731.619999:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000df4fd81c/0x3234de053ca26df lrc: 3/0,1 mode: PW/PW res: [0x3450c:0x0:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531731.620003:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000df4fd81c/0x3234de053ca26df lrc: 2/0,0 mode: PW/PW res: [0x3450c:0x0:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531731.620030:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001797bd5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:37d7cd70-23c8-4282-b9a2-e45fd1319801+8:438148:x1731754466787584:12345-10.240.43.64@tcp:4:lfs.0 Request processed in 73369us (73409us total) trans 21474868990 rc 0/0
00010000:00010000:0.0:1651531731.620043:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000df4fd81c/0x3234de053ca26df lrc: 2/0,0 mode: PW/PW res: [0x3450c:0x0:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531731.620045:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249497
00010000:00010000:0.0:1651531731.620050:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000df4fd81c already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531731.620051:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000df4fd81c/0x3234de053ca26df lrc: 2/0,0 mode: PW/PW res: [0x3450c:0x0:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531731.620055:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000df4fd81c/0x3234de053ca26df lrc: 3/0,0 mode: PW/PW res: [0x3450c:0x0:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531731.620061:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000df4fd81c/0x3234de053ca26df lrc: 1/0,0 mode: --/PW res: [0x3450c:0x0:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531731.620064:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000df4fd81c/0x3234de053ca26df lrc: 0/0,0 mode: --/PW res: [0x3450c:0x0:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531731.645691:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531731.645702:0:191990:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466787840
00000100:00100000:0.0:1651531731.645719:0:191990:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44200
00000100:00100000:0.0:1651531731.645721:0:191990:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f817afea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:37d7cd70-23c8-4282-b9a2-e45fd1319801+8:438148:x1731754466787840:12345-10.240.43.64@tcp:16:lfs.0
00000100:00100000:0.0:1651531731.645746:0:191990:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f817afea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:37d7cd70-23c8-4282-b9a2-e45fd1319801+8:438148:x1731754466787840:12345-10.240.43.64@tcp:16:lfs.0 Request processed in 24us (56us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531731.645751:0:191990:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44200
00000100:00100000:0.0:1651531731.646858:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531731.646866:0:191990:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466788096
00000100:00100000:0.0:1651531731.646879:0:191990:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44201
00000100:00100000:0.0:1651531731.646881:0:191990:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bfdd313b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:37d7cd70-23c8-4282-b9a2-e45fd1319801+8:438149:x1731754466788096:12345-10.240.43.64@tcp:2:lfs.0
00000100:00100000:0.0:1651531731.646923:0:191990:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bfdd313b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:37d7cd70-23c8-4282-b9a2-e45fd1319801+9:438149:x1731754466788096:12345-10.240.43.64@tcp:2:lfs.0 Request processed in 41us (65us total) trans 21474868991 rc 0/0
00000100:00100000:0.0:1651531731.646927:0:191990:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44201
00000100:00100000:0.0:1651531731.649147:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651531731.649174:0:192975:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951129600
00000100:00100000:1.0:1651531731.649187:0:192975:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 20
00000100:00100000:1.0:1651531731.649189:0:192975:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e4250bcb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:318329:x1731745951129600:12345-10.240.43.61@tcp:1000:mdt00_000.0
00000100:00100000:1.0:1651531731.649214:0:192975:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e4250bcb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:318329:x1731745951129600:12345-10.240.43.61@tcp:1000:mdt00_000.0 Request processed in 24us (67us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531731.649217:0:192975:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 20
00000100:00100000:0.0:1651531731.649447:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651531731.649474:0:166122:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951129664
00000100:00100000:1.0:1651531731.649483:0:166122:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 21
00000100:00100000:1.0:1651531731.649484:0:166122:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004ce10a25 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:318329:x1731745951129664:12345-10.240.43.61@tcp:1000:mdt00_000.0
00000100:00100000:1.0:1651531731.649517:0:166122:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004ce10a25 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:318329:x1731745951129664:12345-10.240.43.61@tcp:1000:mdt00_000.0 Request processed in 32us (70us total) trans 21474868992 rc 0/0
00000100:00100000:1.0:1651531731.649520:0:166122:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 21
00000100:00100000:0.0:1651531731.668624:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531731.668632:0:191990:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466789760
00000100:00100000:0.0:1651531731.668645:0:191990:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44202
00000100:00100000:0.0:1651531731.668647:0:191990:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000012756c2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:37d7cd70-23c8-4282-b9a2-e45fd1319801+9:438146:x1731754466789760:12345-10.240.43.64@tcp:101:md5sum.0
00010000:00010000:0.0:1651531731.668652:0:191990:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531731.668657:0:191990:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca26e6 lrc: 2/0,0 mode: --/PR res: [0x3450c:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db442605 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00002000:00010000:0.0:1651531731.668663:0:191990:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x3450c:0x0] initial LVB size: 2097152, mtime: 0x62705fd3, atime: 0x62705fd3, ctime: 0x62705fd3, blocks: 0x1000
00010000:00010000:0.0:1651531731.668668:0:191990:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531731.668669:0:191990:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531731.668673:0:191990:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca26e6 lrc: 3/0,0 mode: PR/PR res: [0x3450c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db442605 expref: 10 pid: 191990 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531731.668679:0:191990:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca26e6 lrc: 3/0,0 mode: PR/PR res: [0x3450c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db442605 expref: 10 pid: 191990 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531731.668688:0:191990:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001e36c601, rc 0)
00000100:00100000:0.0:1651531731.668702:0:191990:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000012756c2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:37d7cd70-23c8-4282-b9a2-e45fd1319801+10:438146:x1731754466789760:12345-10.240.43.64@tcp:101:md5sum.0 Request processed in 54us (79us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531731.668706:0:191990:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44202
00000100:00100000:0.0:1651531731.669095:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531731.669117:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466789888
00002000:00100000:1.0:1651531731.669127:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x3450c:0x0] (0->32767)  req@00000000f817afea x1731754466789888/t0(0) o3->37d7cd70-23c8-4282-b9a2-e45fd1319801@10.240.43.64@tcp:196/0 lens 488/0 e 0 to 0 dl 1651531741 ref 1 fl New:/0/ffffffff rc 0/-1 job:'md5sum.0'
00002000:00100000:1.0:1651531731.669132:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000f817afea with x1731754466789888 ext(0->32767)
00002000:00010000:1.0:1651531731.669134:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000f817afea
00000100:00100000:1.0:1651531731.669144:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249498
00000100:00100000:1.0:1651531731.669146:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f817afea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:37d7cd70-23c8-4282-b9a2-e45fd1319801+10:438147:x1731754466789888:12345-10.240.43.64@tcp:3:md5sum.0
00000100:00100000:1.0:1651531731.669471:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f817afea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:37d7cd70-23c8-4282-b9a2-e45fd1319801+10:438147:x1731754466789888:12345-10.240.43.64@tcp:3:md5sum.0 Request processed in 324us (376us total) trans 0 rc 32768/32768
00000100:00100000:1.0:1651531731.669475:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249498
00002000:00100000:1.0:1651531731.669477:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x3450c:0x0] (0->32767)  req@00000000f817afea x1731754466789888/t0(0) o3->37d7cd70-23c8-4282-b9a2-e45fd1319801@10.240.43.64@tcp:196/0 lens 488/440 e 0 to 0 dl 1651531741 ref 1 fl Complete:/0/0 rc 32768/32768 job:'md5sum.0'
00002000:00100000:1.0:1651531731.669481:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000f817afea with x1731754466789888 ext(0->32767)
00002000:00010000:1.0:1651531731.669483:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000f817afea
00000100:00100000:0.0:1651531731.670604:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531731.670626:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466790016
00002000:00100000:1.0:1651531731.670633:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x3450c:0x0] (32768->2097151)  req@00000000bfdd313b x1731754466790016/t0(0) o3->37d7cd70-23c8-4282-b9a2-e45fd1319801@10.240.43.64@tcp:196/0 lens 488/0 e 0 to 0 dl 1651531741 ref 1 fl New:/0/ffffffff rc 0/-1 job:'md5sum.0'
00002000:00100000:1.0:1651531731.670637:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000bfdd313b with x1731754466790016 ext(32768->2097151)
00002000:00010000:1.0:1651531731.670638:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000bfdd313b
00000100:00100000:1.0:1651531731.670647:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249499
00000100:00100000:1.0:1651531731.670649:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bfdd313b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:37d7cd70-23c8-4282-b9a2-e45fd1319801+10:438147:x1731754466790016:12345-10.240.43.64@tcp:3:md5sum.0
00000100:00100000:1.0:1651531731.672403:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bfdd313b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:37d7cd70-23c8-4282-b9a2-e45fd1319801+10:438147:x1731754466790016:12345-10.240.43.64@tcp:3:md5sum.0 Request processed in 1753us (1799us total) trans 0 rc 2064384/2064384
00000100:00100000:1.0:1651531731.672407:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249499
00002000:00100000:1.0:1651531731.672412:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x3450c:0x0] (32768->2097151)  req@00000000bfdd313b x1731754466790016/t0(0) o3->37d7cd70-23c8-4282-b9a2-e45fd1319801@10.240.43.64@tcp:196/0 lens 488/440 e 0 to 0 dl 1651531741 ref 1 fl Complete:/0/0 rc 2064384/2064384 job:'md5sum.0'
00002000:00100000:1.0:1651531731.672416:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000bfdd313b with x1731754466790016 ext(32768->2097151)
00002000:00010000:1.0:1651531731.672417:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000bfdd313b
00000100:00100000:1.0:1651531732.192182:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651531732.192213:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951129792
00000100:00100000:0.0:1651531732.192250:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 415
00000100:00100000:0.0:1651531732.192253:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000094d62d64 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745951129792:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:0.0:1651531732.192266:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 350514368 pending 0 free 81290846208 avail 77117988864
00000100:00100000:0.0:1651531732.192293:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000094d62d64 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745951129792:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 40us (114us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531732.192297:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 415
00000400:00000080:1.0:1651531733.174517:0:224839:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648
00000001:02000400:1.0:1651531733.174520:0:224839:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 272d: DoM mirroring: OST-striped mirror to DOM file ========================================================== 22:48:52 (1651531732)
00000100:00100000:1.0:1651531733.671547:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531733.671582:0:191990:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466794688
00000100:00100000:0.0:1651531733.671611:0:191990:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44203
00000100:00100000:0.0:1651531733.671614:0:191990:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003158b8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:37d7cd70-23c8-4282-b9a2-e45fd1319801+10:438146:x1731754466794688:12345-10.240.43.64@tcp:101:lfs.0
00010000:00010000:0.0:1651531733.671623:0:191990:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531733.671636:0:191990:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca26ed lrc: 2/0,0 mode: --/PR res: [0x3450d:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4426ad expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00002000:00010000:0.0:1651531733.671649:0:191990:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x3450d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:0.0:1651531733.671659:0:191990:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531733.671660:0:191990:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531733.671665:0:191990:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca26ed lrc: 3/0,0 mode: PR/PR res: [0x3450d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4426ad expref: 11 pid: 191990 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531733.671680:0:191990:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca26ed lrc: 3/0,0 mode: PR/PR res: [0x3450d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4426ad expref: 11 pid: 191990 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531733.671686:0:191990:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008558d1b3, rc 0)
00000100:00100000:0.0:1651531733.671711:0:191990:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003158b8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:37d7cd70-23c8-4282-b9a2-e45fd1319801+11:438146:x1731754466794688:12345-10.240.43.64@tcp:101:lfs.0 Request processed in 97us (169us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531733.671715:0:191990:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44203
00000100:00100000:1.0:1651531733.677690:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531733.677713:0:191990:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466795392
00000100:00100000:0.0:1651531733.677726:0:191990:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44204
00000100:00100000:0.0:1651531733.677728:0:191990:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000e33e11e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:37d7cd70-23c8-4282-b9a2-e45fd1319801+11:657962:x1731754466795392:12345-10.240.43.64@tcp:101:lfs.0
00010000:00010000:0.0:1651531733.677732:0:191990:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531733.677736:0:191990:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca26f4 lrc: 2/0,0 mode: --/PW res: [0x3450d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4426c2 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531733.677744:0:191990:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca26ed lrc: 2/0,0 mode: PR/PR res: [0x3450d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4426ad expref: 12 pid: 191990 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531733.677748:0:191990:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531733.677749:0:191990:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531733.677750:0:191990:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca26f4 lrc: 4/0,0 mode: --/PW res: [0x3450d:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4426c2 expref: 12 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531733.677762:0:191990:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca26ed lrc: 3/0,0 mode: PR/PR res: [0x3450d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4426ad expref: 12 pid: 191990 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531733.677767:0:191990:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca26ed lrc: 4/0,0 mode: PR/PR res: [0x3450d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4426ad expref: 12 pid: 191990 timeout: 22542 lvb_type: 1
00000100:00100000:0.0:1651531733.677775:0:191990:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b462545d pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:191990:1731745997341056:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531733.677795:0:191990:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a2b9dcac going to sleep for 6 seconds
00000100:00100000:0.0:1651531733.678023:0:191990:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b462545d pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:191990:1731745997341056:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651531733.678054:0:191990:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca26f4 lrc: 3/0,0 mode: --/PW res: [0x3450d:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4426c2 expref: 12 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531733.678060:0:191990:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b4c8742a, rc 0)
00000100:00100000:0.0:1651531733.678075:0:191990:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000e33e11e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:37d7cd70-23c8-4282-b9a2-e45fd1319801+12:657962:x1731754466795392:12345-10.240.43.64@tcp:101:lfs.0 Request processed in 347us (385us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531733.678079:0:191990:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44204
00000100:00100000:0.0:1651531733.678112:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531733.678136:0:166103:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466795456
00010000:00010000:0.0:1651531733.678143:0:166103:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca26ed lrc: 4/0,0 mode: PR/PR res: [0x3450d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4426ad expref: 12 pid: 191990 timeout: 22542 lvb_type: 1
00000100:00100000:0.0:1651531733.678155:0:166103:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 69
00000100:00100000:0.0:1651531733.678157:0:166103:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b462545d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:37d7cd70-23c8-4282-b9a2-e45fd1319801+12:438148:x1731754466795456:12345-10.240.43.64@tcp:103:ldlm_bl_01.0
00010000:00010000:0.0:1651531733.678161:0:166103:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531733.678166:0:166103:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca26ed lrc: 4/0,0 mode: PR/PR res: [0x3450d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4426ad expref: 12 pid: 191990 timeout: 22542 lvb_type: 1
00010000:00010000:0.0:1651531733.678170:0:166103:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca26ed lrc: 3/0,0 mode: PR/PR res: [0x3450d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4426ad expref: 12 pid: 191990 timeout: 22542 lvb_type: 1
00010000:00010000:0.0:1651531733.678182:0:166103:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca26ed lrc: 0/0,0 mode: --/PR res: [0x3450d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4426ad expref: 12 pid: 191990 timeout: 22542 lvb_type: 1
00010000:00010000:0.0:1651531733.678187:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531733.678187:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531733.678189:0:166103:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca26f4 lrc: 2/0,0 mode: PW/PW res: [0x3450d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4426c2 expref: 11 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531733.678192:0:166103:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca26f4 lrc: 3/0,0 mode: PW/PW res: [0x3450d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4426c2 expref: 11 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531733.678201:0:166103:0:(ldlm_lockd.c:1067:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca26f4 lrc: 3/0,0 mode: PW/PW res: [0x3450d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4426c2 expref: 11 pid: 191990 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531733.678206:0:166103:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003b5b354a pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:166103:1731745997341120:10.240.43.64@tcp:105:
00000100:00100000:0.0:1651531733.678220:0:166103:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a2b9dcac going to sleep for 6 seconds
00000100:00100000:0.0:1651531733.678451:0:166103:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003b5b354a pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:166103:1731745997341120:10.240.43.64@tcp:105:
00010000:00010000:0.0:1651531733.678456:0:166103:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651531733.678472:0:166103:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b462545d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:37d7cd70-23c8-4282-b9a2-e45fd1319801+11:438148:x1731754466795456:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 314us (359us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531733.678475:0:166103:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 69
00000100:00100000:0.0:1651531733.687991:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531733.688018:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466795584
00002000:00100000:1.0:1651531733.688033:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x3450d:0x0] (0->2097151)  req@000000003b5b354a x1731754466795584/t0(0) o4->37d7cd70-23c8-4282-b9a2-e45fd1319801@10.240.43.64@tcp:198/0 lens 488/0 e 0 to 0 dl 1651531743 ref 1 fl New:/0/ffffffff rc 0/-1 job:'lfs.0'
00002000:00100000:1.0:1651531733.688047:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000003b5b354a with x1731754466795584 ext(0->2097151)
00002000:00010000:1.0:1651531733.688049:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000003b5b354a
00000100:00100000:1.0:1651531733.688062:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249500
00000100:00100000:1.0:1651531733.688064:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003b5b354a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:37d7cd70-23c8-4282-b9a2-e45fd1319801+11:438146:x1731754466795584:12345-10.240.43.64@tcp:4:lfs.0
00000100:00100000:1.0:1651531733.691386:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003b5b354a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:37d7cd70-23c8-4282-b9a2-e45fd1319801+13:438146:x1731754466795584:12345-10.240.43.64@tcp:4:lfs.0 Request processed in 3320us (3394us total) trans 21474868993 rc 0/0
00000100:00100000:1.0:1651531733.691391:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249500
00002000:00100000:1.0:1651531733.691394:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x3450d:0x0] (0->2097151)  req@000000003b5b354a x1731754466795584/t21474868993(0) o4->37d7cd70-23c8-4282-b9a2-e45fd1319801@10.240.43.64@tcp:198/0 lens 488/448 e 0 to 0 dl 1651531743 ref 1 fl Complete:/0/0 rc 0/0 job:'lfs.0'
00002000:00100000:1.0:1651531733.691399:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000003b5b354a with x1731754466795584 ext(0->2097151)
00002000:00010000:1.0:1651531733.691401:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000003b5b354a
00000100:00100000:0.0:1651531733.715081:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531733.715091:0:191990:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466795712
00000100:00100000:0.0:1651531733.715108:0:191990:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44205
00000100:00100000:0.0:1651531733.715110:0:191990:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000091075bf7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:37d7cd70-23c8-4282-b9a2-e45fd1319801+13:438147:x1731754466795712:12345-10.240.43.64@tcp:16:lfs.0
00000001:00080000:1.0:1651531733.839189:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474868993 is committed
00000001:00080000:1.0:1651531733.839194:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474868992 is committed
00000100:00100000:0.0:1651531733.839249:0:191990:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000091075bf7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:37d7cd70-23c8-4282-b9a2-e45fd1319801+10:438147:x1731754466795712:12345-10.240.43.64@tcp:16:lfs.0 Request processed in 124138us (124168us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531733.839254:0:191990:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44205
00000100:00100000:0.0:1651531733.841683:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531733.841691:0:191990:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466796096
00000100:00100000:0.0:1651531733.841705:0:191990:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44206
00000100:00100000:0.0:1651531733.841707:0:191990:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000de3fc5c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:37d7cd70-23c8-4282-b9a2-e45fd1319801+10:438146:x1731754466796096:12345-10.240.43.64@tcp:2:lfs.0
00002000:00010000:0.0:1651531733.841743:0:191990:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x3450d:0x0] updating lvb size from disk: 0 -> 2097152
00002000:00010000:0.0:1651531733.841745:0:191990:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x3450d:0x0] updating lvb mtime from disk: 0 -> 1651531733
00002000:00010000:0.0:1651531733.841746:0:191990:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x3450d:0x0] updating lvb atime from disk: 0 -> 1651531733
00002000:00010000:0.0:1651531733.841747:0:191990:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x3450d:0x0] updating lvb ctime from disk: 0 -> 1651531733
00002000:00010000:0.0:1651531733.841747:0:191990:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x3450d:0x0] updating lvb blocks from disk: 0 -> 4096
00000100:00100000:0.0:1651531733.841763:0:191990:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000de3fc5c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:37d7cd70-23c8-4282-b9a2-e45fd1319801+11:438146:x1731754466796096:12345-10.240.43.64@tcp:2:lfs.0 Request processed in 56us (81us total) trans 21474868994 rc 0/0
00000100:00100000:0.0:1651531733.841767:0:191990:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44206
00000100:00100000:0.0:1651531733.844673:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651531733.844684:0:192975:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951130624
00000100:00100000:0.0:1651531733.844700:0:192975:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 22
00000100:00100000:0.0:1651531733.844702:0:192975:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e928e68f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:318333:x1731745951130624:12345-10.240.43.61@tcp:1000:mdt_rdpg00_001.0
00000100:00100000:0.0:1651531733.844730:0:192975:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e928e68f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:318333:x1731745951130624:12345-10.240.43.61@tcp:1000:mdt_rdpg00_001.0 Request processed in 28us (58us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531733.844740:0:192975:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 22
00000100:00100000:0.0:1651531733.844970:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651531733.844978:0:192975:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951130688
00000100:00100000:0.0:1651531733.844990:0:192975:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 23
00000100:00100000:0.0:1651531733.844993:0:192975:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000089eac552 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:318333:x1731745951130688:12345-10.240.43.61@tcp:1000:mdt_rdpg00_001.0
00000100:00100000:0.0:1651531733.845053:0:192975:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000089eac552 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:318333:x1731745951130688:12345-10.240.43.61@tcp:1000:mdt_rdpg00_001.0 Request processed in 58us (83us total) trans 21474868995 rc 0/0
00000100:00100000:0.0:1651531733.845056:0:192975:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 23
00000100:00100000:0.0:1651531733.857596:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651531733.857604:0:192975:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951131008
00000100:00100000:0.0:1651531733.857617:0:192975:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 24
00000100:00100000:0.0:1651531733.857619:0:192975:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000059fab85b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:318333:x1731745951131008:12345-10.240.43.61@tcp:1000:mdt_rdpg00_001.0
00000100:00100000:0.0:1651531733.857638:0:192975:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000059fab85b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:318333:x1731745951131008:12345-10.240.43.61@tcp:1000:mdt_rdpg00_001.0 Request processed in 18us (42us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531733.857641:0:192975:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 24
00000100:00100000:0.0:1651531733.876166:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531733.876174:0:191990:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466799104
00000100:00100000:0.0:1651531733.876187:0:191990:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44207
00000100:00100000:0.0:1651531733.876189:0:191990:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ac545f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:37d7cd70-23c8-4282-b9a2-e45fd1319801+11:438146:x1731754466799104:12345-10.240.43.64@tcp:101:md5sum.0
00010000:00010000:0.0:1651531733.876193:0:191990:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531733.876199:0:191990:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca26fb lrc: 2/0,0 mode: --/PR res: [0x3450d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44272b expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531733.876218:0:191990:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004d72f458 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:191990:1731745997341184:10.240.43.64@tcp:106:
00000100:00100000:0.0:1651531733.876249:0:191990:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a2b9dcac going to sleep for 6 seconds
00000100:00100000:0.0:1651531733.876450:0:191990:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004d72f458 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:191990:1731745997341184:10.240.43.64@tcp:106:
00010000:00010000:0.0:1651531733.876458:0:191990:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca26fb lrc: 1/0,0 mode: --/PR res: [0x3450d:0x0:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44272b expref: 12 pid: 191990 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531733.876468:0:191990:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca26fb lrc: 0/0,0 mode: --/PR res: [0x3450d:0x0:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44272b expref: 12 pid: 191990 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531733.876472:0:191990:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008558d1b3, rc 0)
00000100:00100000:0.0:1651531733.876487:0:191990:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ac545f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:37d7cd70-23c8-4282-b9a2-e45fd1319801+11:438146:x1731754466799104:12345-10.240.43.64@tcp:101:md5sum.0 Request processed in 297us (321us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531733.876490:0:191990:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44207
00000100:00100000:0.0:1651531733.876798:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531733.876805:0:191990:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466799168
00000100:00100000:0.0:1651531733.876819:0:191990:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44208
00000100:00100000:0.0:1651531733.876821:0:191990:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004d72f458 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:37d7cd70-23c8-4282-b9a2-e45fd1319801+11:657969:x1731754466799168:12345-10.240.43.64@tcp:101:md5sum.0
00010000:00010000:0.0:1651531733.876824:0:191990:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531733.876835:0:191990:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca2702 lrc: 2/0,0 mode: --/PR res: [0x3450d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db442732 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531733.876843:0:191990:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca26f4 lrc: 2/0,0 mode: PW/PW res: [0x3450d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4426c2 expref: 12 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531733.876847:0:191990:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531733.876847:0:191990:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531733.876849:0:191990:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca2702 lrc: 4/0,0 mode: --/PR res: [0x3450d:0x0:0x0].0x0 rrc: 3 type: EXT [0->32767] (req 0->32767) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db442732 expref: 12 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531733.876857:0:191990:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca26f4 lrc: 3/0,0 mode: PW/PW res: [0x3450d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4426c2 expref: 12 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531733.876865:0:191990:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca26f4 lrc: 4/0,0 mode: PW/PW res: [0x3450d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4426c2 expref: 12 pid: 191990 timeout: 22542 lvb_type: 0
00000100:00100000:0.0:1651531733.876869:0:191990:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d44b0d9f pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:191990:1731745997341248:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531733.876886:0:191990:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a2b9dcac going to sleep for 6 seconds
00000100:00100000:0.0:1651531733.877078:0:191990:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d44b0d9f pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:191990:1731745997341248:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651531733.877084:0:191990:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca2702 lrc: 3/0,0 mode: --/PR res: [0x3450d:0x0:0x0].0x0 rrc: 3 type: EXT [0->32767] (req 0->32767) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db442732 expref: 12 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531733.877089:0:191990:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d44eb74d, rc 0)
00000100:00100000:0.0:1651531733.877106:0:191990:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004d72f458 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:37d7cd70-23c8-4282-b9a2-e45fd1319801+12:657969:x1731754466799168:12345-10.240.43.64@tcp:101:md5sum.0 Request processed in 284us (308us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531733.877109:0:191990:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44208
00000100:00100000:0.0:1651531733.877144:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531733.877152:0:166103:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466799232
00010000:00010000:0.0:1651531733.877158:0:166103:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca26f4 lrc: 4/0,0 mode: PW/PW res: [0x3450d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4426c2 expref: 12 pid: 191990 timeout: 22542 lvb_type: 0
00000100:00100000:0.0:1651531733.877170:0:166103:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 70
00000100:00100000:0.0:1651531733.877172:0:166103:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d44b0d9f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:37d7cd70-23c8-4282-b9a2-e45fd1319801+12:438148:x1731754466799232:12345-10.240.43.64@tcp:103:ldlm_bl_03.0
00010000:00010000:0.0:1651531733.877176:0:166103:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531733.877180:0:166103:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca26f4 lrc: 4/0,0 mode: PW/PW res: [0x3450d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4426c2 expref: 12 pid: 191990 timeout: 22542 lvb_type: 0
00010000:00010000:0.0:1651531733.877188:0:166103:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca26f4 lrc: 3/0,0 mode: PW/PW res: [0x3450d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4426c2 expref: 12 pid: 191990 timeout: 22542 lvb_type: 0
00010000:00010000:0.0:1651531733.877195:0:166103:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca26f4 lrc: 0/0,0 mode: --/PW res: [0x3450d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4426c2 expref: 12 pid: 191990 timeout: 22542 lvb_type: 0
00010000:00010000:0.0:1651531733.877198:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531733.877199:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531733.877201:0:166103:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca2702 lrc: 2/0,0 mode: PR/PR res: [0x3450d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db442732 expref: 11 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531733.877205:0:166103:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca2702 lrc: 3/0,0 mode: PR/PR res: [0x3450d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db442732 expref: 11 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531733.877213:0:166103:0:(ldlm_lockd.c:1067:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca2702 lrc: 3/0,0 mode: PR/PR res: [0x3450d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db442732 expref: 11 pid: 191990 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531733.877217:0:166103:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000065be21ea pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:166103:1731745997341312:10.240.43.64@tcp:105:
00000100:00100000:0.0:1651531733.877247:0:166103:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a2b9dcac going to sleep for 6 seconds
00000100:00100000:0.0:1651531733.877455:0:166103:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000065be21ea pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:166103:1731745997341312:10.240.43.64@tcp:105:
00010000:00010000:0.0:1651531733.877460:0:166103:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651531733.877474:0:166103:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d44b0d9f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:37d7cd70-23c8-4282-b9a2-e45fd1319801+11:438148:x1731754466799232:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 301us (330us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531733.877478:0:166103:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 70
00000100:00100000:0.0:1651531733.877634:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531733.877656:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466799360
00002000:00100000:1.0:1651531733.877666:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x3450d:0x0] (0->32767)  req@0000000065be21ea x1731754466799360/t0(0) o3->37d7cd70-23c8-4282-b9a2-e45fd1319801@10.240.43.64@tcp:198/0 lens 488/0 e 0 to 0 dl 1651531743 ref 1 fl New:/0/ffffffff rc 0/-1 job:'md5sum.0'
00002000:00100000:1.0:1651531733.877671:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000065be21ea with x1731754466799360 ext(0->32767)
00002000:00010000:1.0:1651531733.877673:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000065be21ea
00000100:00100000:1.0:1651531733.877681:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249501
00000100:00100000:1.0:1651531733.877683:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000065be21ea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:37d7cd70-23c8-4282-b9a2-e45fd1319801+11:438147:x1731754466799360:12345-10.240.43.64@tcp:3:md5sum.0
00000100:00100000:1.0:1651531733.878003:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000065be21ea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:37d7cd70-23c8-4282-b9a2-e45fd1319801+11:438147:x1731754466799360:12345-10.240.43.64@tcp:3:md5sum.0 Request processed in 319us (369us total) trans 0 rc 32768/32768
00000100:00100000:1.0:1651531733.878007:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249501
00002000:00100000:1.0:1651531733.878009:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x3450d:0x0] (0->32767)  req@0000000065be21ea x1731754466799360/t0(0) o3->37d7cd70-23c8-4282-b9a2-e45fd1319801@10.240.43.64@tcp:198/0 lens 488/440 e 0 to 0 dl 1651531743 ref 1 fl Complete:/0/0 rc 32768/32768 job:'md5sum.0'
00002000:00100000:1.0:1651531733.878013:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000065be21ea with x1731754466799360 ext(0->32767)
00002000:00010000:1.0:1651531733.878015:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000065be21ea
00000100:00100000:0.0:1651531733.879067:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531733.879092:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466799488
00002000:00100000:1.0:1651531733.879099:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x3450d:0x0] (32768->2097151)  req@00000000ecb6b3b7 x1731754466799488/t0(0) o3->37d7cd70-23c8-4282-b9a2-e45fd1319801@10.240.43.64@tcp:198/0 lens 488/0 e 0 to 0 dl 1651531743 ref 1 fl New:/0/ffffffff rc 0/-1 job:'md5sum.0'
00002000:00100000:1.0:1651531733.879103:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000ecb6b3b7 with x1731754466799488 ext(32768->2097151)
00002000:00010000:1.0:1651531733.879104:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000ecb6b3b7
00000100:00100000:1.0:1651531733.879114:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249502
00000100:00100000:1.0:1651531733.879115:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ecb6b3b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:37d7cd70-23c8-4282-b9a2-e45fd1319801+11:438147:x1731754466799488:12345-10.240.43.64@tcp:3:md5sum.0
00000100:00100000:1.0:1651531733.880582:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ecb6b3b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:37d7cd70-23c8-4282-b9a2-e45fd1319801+11:438147:x1731754466799488:12345-10.240.43.64@tcp:3:md5sum.0 Request processed in 1465us (1515us total) trans 0 rc 2064384/2064384
00000100:00100000:1.0:1651531733.880589:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249502
00002000:00100000:1.0:1651531733.880591:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x3450d:0x0] (32768->2097151)  req@00000000ecb6b3b7 x1731754466799488/t0(0) o3->37d7cd70-23c8-4282-b9a2-e45fd1319801@10.240.43.64@tcp:198/0 lens 488/440 e 0 to 0 dl 1651531743 ref 1 fl Complete:/0/0 rc 2064384/2064384 job:'md5sum.0'
00002000:00100000:1.0:1651531733.880595:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000ecb6b3b7 with x1731754466799488 ext(32768->2097151)
00002000:00010000:1.0:1651531733.880597:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000ecb6b3b7
00000400:00000080:0.0:1651531735.379706:0:225057:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648
00000001:02000400:0.0:1651531735.379709:0:225057:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 272e: DoM mirroring: DOM mirror to the OST-striped file ========================================================== 22:48:55 (1651531735)
00000100:00100000:1.0:1651531735.416949:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531735.416967:0:191990:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466800832
00000100:00100000:1.0:1651531735.416986:0:191990:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44209
00000100:00100000:1.0:1651531735.416989:0:191990:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000036ee6adc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:37d7cd70-23c8-4282-b9a2-e45fd1319801+11:658571:x1731754466800832:12345-10.240.43.64@tcp:101:dd.0
00010000:00010000:1.0:1651531735.416999:0:191990:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531735.417010:0:191990:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca2709 lrc: 2/0,0 mode: --/PW res: [0x3450e:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db442763 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651531735.417022:0:191990:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x3450e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:1.0:1651531735.417032:0:191990:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531735.417033:0:191990:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531735.417046:0:191990:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca2709 lrc: 3/0,0 mode: PW/PW res: [0x3450e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db442763 expref: 12 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531735.417055:0:191990:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca2709 lrc: 3/0,0 mode: PW/PW res: [0x3450e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db442763 expref: 12 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531735.417060:0:191990:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000077fc7eeb, rc 0)
00000100:00100000:1.0:1651531735.417087:0:191990:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000036ee6adc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:37d7cd70-23c8-4282-b9a2-e45fd1319801+12:658571:x1731754466800832:12345-10.240.43.64@tcp:101:dd.0 Request processed in 98us (141us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531735.417094:0:191990:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44209
00000100:00100000:1.0:1651531735.417828:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531735.417839:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466800960
00002000:00010000:1.0:1651531735.417848:0:216321:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 214286/0 (0->18446744073709551615)
00002000:00100000:1.0:1651531735.417849:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000089660739 with x1731754466800960 ext(0->18446744073709551615)
00002000:00010000:1.0:1651531735.417853:0:216321:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000089660739.
00000100:00100000:1.0:1651531735.417864:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249503
00000100:00100000:1.0:1651531735.417866:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000089660739 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:37d7cd70-23c8-4282-b9a2-e45fd1319801+12:438148:x1731754466800960:12345-10.240.43.64@tcp:10:dd.0
00002000:00010000:1.0:1651531735.417925:0:216321:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x3450e:0x0] updating lvb size from disk: 0 -> 0
00002000:00010000:1.0:1651531735.417927:0:216321:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x3450e:0x0] updating lvb mtime from disk: 0 -> 1651531735
00002000:00010000:1.0:1651531735.417927:0:216321:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x3450e:0x0] updating lvb atime from disk: 0 -> 0
00002000:00010000:1.0:1651531735.417928:0:216321:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x3450e:0x0] updating lvb ctime from disk: 0 -> 1651531735
00002000:00010000:1.0:1651531735.417929:0:216321:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x3450e:0x0] updating lvb blocks from disk: 0 -> 0
00000100:00100000:1.0:1651531735.417945:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000089660739 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:37d7cd70-23c8-4282-b9a2-e45fd1319801+13:438148:x1731754466800960:12345-10.240.43.64@tcp:10:dd.0 Request processed in 78us (117us total) trans 21474868996 rc 0/0
00000100:00100000:1.0:1651531735.417949:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249503
00002000:00010000:1.0:1651531735.417950:0:216321:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 214286/0 (0->18446744073709551615)
00002000:00100000:1.0:1651531735.417951:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000089660739 with x1731754466800960 ext(0->18446744073709551615)
00002000:00010000:1.0:1651531735.417952:0:216321:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000089660739.
00000100:00100000:1.0:1651531735.427849:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531735.427857:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466801216
00000100:00100000:1.0:1651531735.427872:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249504
00000100:00100000:1.0:1651531735.427874:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aa58c961 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:37d7cd70-23c8-4282-b9a2-e45fd1319801+13:438148:x1731754466801216:12345-10.240.43.64@tcp:4:dd.0
00010000:00010000:1.0:1651531735.427883:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca2710 lrc: 3/0,1 mode: --/PW res: [0x3450e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531735.427890:0:216321:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca2709 lrc: 2/0,0 mode: PW/PW res: [0x3450e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db442763 expref: 13 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531735.427893:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531735.427894:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531735.427895:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca2710 lrc: 4/0,1 mode: --/PW res: [0x3450e:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531735.427906:0:216321:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca2709 lrc: 3/0,0 mode: PW/PW res: [0x3450e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db442763 expref: 13 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531735.427911:0:216321:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca2709 lrc: 4/0,0 mode: PW/PW res: [0x3450e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db442763 expref: 13 pid: 191990 timeout: 22544 lvb_type: 0
00000100:00100000:1.0:1651531735.427917:0:216321:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000053de45f6 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997341376:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531735.427939:0:216321:0:(client.c:2492:ptlrpc_set_wait()) set 0000000063465b92 going to sleep for 6 seconds
00000100:00100000:1.0:1651531735.428172:0:216321:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000053de45f6 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997341376:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651531735.428179:0:216321:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca2710 lrc: 3/0,1 mode: --/PW res: [0x3450e:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531735.428255:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531735.428273:0:166103:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466801344
00010000:00010000:1.0:1651531735.428280:0:166103:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca2709 lrc: 4/0,0 mode: PW/PW res: [0x3450e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db442763 expref: 14 pid: 191990 timeout: 22544 lvb_type: 0
00000100:00100000:1.0:1651531735.428290:0:166103:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 71
00000100:00100000:1.0:1651531735.428292:0:166103:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000017d2e325 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:37d7cd70-23c8-4282-b9a2-e45fd1319801+14:438149:x1731754466801344:12345-10.240.43.64@tcp:103:ldlm_bl_03.0
00010000:00010000:1.0:1651531735.428297:0:166103:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1651531735.428300:0:166103:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca2709 lrc: 4/0,0 mode: PW/PW res: [0x3450e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db442763 expref: 14 pid: 191990 timeout: 22544 lvb_type: 0
00010000:00010000:1.0:1651531735.428305:0:166103:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca2709 lrc: 3/0,0 mode: PW/PW res: [0x3450e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db442763 expref: 14 pid: 191990 timeout: 22544 lvb_type: 0
00010000:00010000:1.0:1651531735.428312:0:166103:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca2709 lrc: 0/0,0 mode: --/PW res: [0x3450e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db442763 expref: 14 pid: 191990 timeout: 22544 lvb_type: 0
00010000:00010000:1.0:1651531735.428316:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531735.428316:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531735.428317:0:166103:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca2710 lrc: 3/0,1 mode: PW/PW res: [0x3450e:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531735.428320:0:166103:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca2710 lrc: 4/0,1 mode: PW/PW res: [0x3450e:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531735.428327:0:166103:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1651531735.428336:0:166103:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000017d2e325 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:37d7cd70-23c8-4282-b9a2-e45fd1319801+13:438149:x1731754466801344:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 43us (83us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531735.428339:0:166103:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 71
00010000:00010000:1.0:1651531735.428389:0:216321:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca2710 lrc: 3/0,1 mode: PW/PW res: [0x3450e:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531735.428393:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca2710 lrc: 3/0,1 mode: PW/PW res: [0x3450e:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651531735.550559:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474868997 is committed
00000001:00080000:1.0:1651531735.550564:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474868995 is committed
00002000:00010000:1.0:1651531735.550588:0:216321:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x3450e:0x0] updating lvb size from disk: 0 -> 1048576
00002000:00010000:1.0:1651531735.550589:0:216321:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x3450e:0x0] updating lvb blocks from disk: 0 -> 2048
00010000:00010000:1.0:1651531735.550593:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca2710 lrc: 3/0,1 mode: PW/PW res: [0x3450e:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531735.550598:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca2710 lrc: 2/0,0 mode: PW/PW res: [0x3450e:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531735.550624:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aa58c961 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:37d7cd70-23c8-4282-b9a2-e45fd1319801+10:438148:x1731754466801216:12345-10.240.43.64@tcp:4:dd.0 Request processed in 122749us (122775us total) trans 21474868997 rc 0/0
00000100:00100000:1.0:1651531735.550628:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249504
00010000:00010000:1.0:1651531735.550637:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca2710 lrc: 2/0,0 mode: PW/PW res: [0x3450e:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531735.550641:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006878f48a already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531735.550642:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca2710 lrc: 2/0,0 mode: PW/PW res: [0x3450e:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531735.550646:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca2710 lrc: 3/0,0 mode: PW/PW res: [0x3450e:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531735.550651:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca2710 lrc: 1/0,0 mode: --/PW res: [0x3450e:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531735.550654:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca2710 lrc: 0/0,0 mode: --/PW res: [0x3450e:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531735.555888:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531735.555898:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466801792
00000100:00100000:1.0:1651531735.555906:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44210
00000100:00100000:1.0:1651531735.555908:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000053de45f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:37d7cd70-23c8-4282-b9a2-e45fd1319801+10:438148:x1731754466801792:12345-10.240.43.64@tcp:101:md5sum.0
00010000:00010000:1.0:1651531735.555912:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531735.555916:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca2717 lrc: 2/0,0 mode: --/PR res: [0x3450e:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44277f expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651531735.555922:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x3450e:0x0] initial LVB size: 1048576, mtime: 0x62705fd7, atime: 0x0, ctime: 0x62705fd7, blocks: 0x800
00010000:00010000:1.0:1651531735.555926:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531735.555927:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531735.555929:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca2717 lrc: 3/0,0 mode: PR/PR res: [0x3450e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44277f expref: 11 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531735.555934:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca2717 lrc: 3/0,0 mode: PR/PR res: [0x3450e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44277f expref: 11 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531735.555938:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000077fc7eeb, rc 0)
00000100:00100000:1.0:1651531735.555955:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000053de45f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:37d7cd70-23c8-4282-b9a2-e45fd1319801+11:438148:x1731754466801792:12345-10.240.43.64@tcp:101:md5sum.0 Request processed in 45us (67us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531735.555958:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44210
00000100:00100000:1.0:1651531735.556431:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531735.556440:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466801984
00002000:00100000:1.0:1651531735.556447:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x3450e:0x0] (0->32767)  req@0000000021f31110 x1731754466801984/t0(0) o3->37d7cd70-23c8-4282-b9a2-e45fd1319801@10.240.43.64@tcp:200/0 lens 488/0 e 0 to 0 dl 1651531745 ref 1 fl New:/0/ffffffff rc 0/-1 job:'md5sum.0'
00002000:00100000:1.0:1651531735.556452:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000021f31110 with x1731754466801984 ext(0->32767)
00002000:00010000:1.0:1651531735.556453:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000021f31110
00000100:00100000:1.0:1651531735.556463:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249505
00000100:00100000:1.0:1651531735.556466:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000021f31110 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:37d7cd70-23c8-4282-b9a2-e45fd1319801+11:438149:x1731754466801984:12345-10.240.43.64@tcp:3:md5sum.0
00000100:00100000:1.0:1651531735.556781:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000021f31110 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:37d7cd70-23c8-4282-b9a2-e45fd1319801+11:438149:x1731754466801984:12345-10.240.43.64@tcp:3:md5sum.0 Request processed in 313us (349us total) trans 0 rc 32768/32768
00000100:00100000:1.0:1651531735.556785:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249505
00002000:00100000:1.0:1651531735.556787:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x3450e:0x0] (0->32767)  req@0000000021f31110 x1731754466801984/t0(0) o3->37d7cd70-23c8-4282-b9a2-e45fd1319801@10.240.43.64@tcp:200/0 lens 488/440 e 0 to 0 dl 1651531745 ref 1 fl Complete:/0/0 rc 32768/32768 job:'md5sum.0'
00002000:00100000:1.0:1651531735.556791:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000021f31110 with x1731754466801984 ext(0->32767)
00002000:00010000:1.0:1651531735.556793:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000021f31110
00000100:00100000:1.0:1651531735.557891:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531735.557899:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466802176
00002000:00100000:1.0:1651531735.557905:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x3450e:0x0] (32768->1048575)  req@0000000000615301 x1731754466802176/t0(0) o3->37d7cd70-23c8-4282-b9a2-e45fd1319801@10.240.43.64@tcp:200/0 lens 488/0 e 0 to 0 dl 1651531745 ref 1 fl New:/0/ffffffff rc 0/-1 job:'md5sum.0'
00002000:00100000:1.0:1651531735.557909:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000000615301 with x1731754466802176 ext(32768->1048575)
00002000:00010000:1.0:1651531735.557910:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000000615301
00000100:00100000:1.0:1651531735.557919:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249506
00000100:00100000:1.0:1651531735.557921:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000000615301 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:37d7cd70-23c8-4282-b9a2-e45fd1319801+11:438148:x1731754466802176:12345-10.240.43.64@tcp:3:md5sum.0
00000100:00100000:1.0:1651531735.559108:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000000615301 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:37d7cd70-23c8-4282-b9a2-e45fd1319801+11:438148:x1731754466802176:12345-10.240.43.64@tcp:3:md5sum.0 Request processed in 1186us (1216us total) trans 0 rc 1015808/1015808
00000100:00100000:1.0:1651531735.559112:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249506
00002000:00100000:1.0:1651531735.559114:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x3450e:0x0] (32768->1048575)  req@0000000000615301 x1731754466802176/t0(0) o3->37d7cd70-23c8-4282-b9a2-e45fd1319801@10.240.43.64@tcp:200/0 lens 488/440 e 0 to 0 dl 1651531745 ref 1 fl Complete:/0/0 rc 1015808/1015808 job:'md5sum.0'
00002000:00100000:1.0:1651531735.559118:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000000615301 with x1731754466802176 ext(32768->1048575)
00002000:00010000:1.0:1651531735.559119:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000000615301
00000100:00100000:1.0:1651531735.571557:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531735.571568:0:169267:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466802560
00000100:00100000:1.0:1651531735.571578:0:169267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11086
00000100:00100000:1.0:1651531735.571580:0:169267:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006c46ca95 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:37d7cd70-23c8-4282-b9a2-e45fd1319801+11:607799:x1731754466802560:12345-10.240.43.64@tcp:103:ldlm_bl_01.0
00010000:00010000:1.0:1651531735.571583:0:169267:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 6 locks, starting at 0
00010000:00010000:1.0:1651531735.571590:0:169267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca2717 lrc: 0/0,0 mode: --/PR res: [0x3450e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44277f expref: 11 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531735.571599:0:169267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca2702 lrc: 0/0,0 mode: --/PR res: [0x3450d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x44801000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db442732 expref: 10 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531735.571605:0:169267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca26e6 lrc: 0/0,0 mode: --/PR res: [0x3450c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db442605 expref: 9 pid: 191990 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531735.571612:0:169267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca26ca lrc: 0/0,0 mode: --/PR res: [0x3450b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x44801000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4424d8 expref: 8 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531735.571617:0:169267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9908e14/0x3234de053ca26a0 lrc: 0/0,0 mode: --/PR res: [0x3450a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44237a expref: 7 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531735.571623:0:169267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca265a lrc: 0/0,0 mode: --/PR res: [0x34506:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4360a0 expref: 6 pid: 191990 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531735.571627:0:169267:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1651531735.571641:0:169267:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006c46ca95 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:37d7cd70-23c8-4282-b9a2-e45fd1319801+5:607799:x1731754466802560:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 61us (85us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531735.571644:0:169267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11086
00000100:00100000:1.0:1651531735.583733:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531735.583742:0:191990:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466803456
00000100:00100000:1.0:1651531735.583750:0:191990:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44211
00000100:00100000:1.0:1651531735.583752:0:191990:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cc11a3b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:37d7cd70-23c8-4282-b9a2-e45fd1319801+5:438147:x1731754466803456:12345-10.240.43.64@tcp:101:lfs.0
00010000:00010000:1.0:1651531735.583755:0:191990:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531735.583759:0:191990:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9908e14/0x3234de053ca271e lrc: 2/0,0 mode: --/PR res: [0x3450e:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4427be expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651531735.583764:0:191990:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x3450e:0x0] initial LVB size: 1048576, mtime: 0x62705fd7, atime: 0x0, ctime: 0x62705fd7, blocks: 0x800
00010000:00010000:1.0:1651531735.583768:0:191990:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531735.583769:0:191990:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531735.583771:0:191990:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9908e14/0x3234de053ca271e lrc: 3/0,0 mode: PR/PR res: [0x3450e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4427be expref: 6 pid: 191990 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531735.583776:0:191990:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e9908e14/0x3234de053ca271e lrc: 3/0,0 mode: PR/PR res: [0x3450e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4427be expref: 6 pid: 191990 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531735.583780:0:191990:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e9908e14, rc 0)
00000100:00100000:1.0:1651531735.583795:0:191990:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cc11a3b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:37d7cd70-23c8-4282-b9a2-e45fd1319801+6:438147:x1731754466803456:12345-10.240.43.64@tcp:101:lfs.0 Request processed in 42us (62us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531735.583798:0:191990:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44211
00000100:00100000:1.0:1651531735.585292:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531735.585300:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466803776
00000100:00100000:1.0:1651531735.585306:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44212
00000100:00100000:1.0:1651531735.585308:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000047c291a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:37d7cd70-23c8-4282-b9a2-e45fd1319801+6:438147:x1731754466803776:12345-10.240.43.64@tcp:1:lfs.0
00010000:00010000:1.0:1651531735.585316:0:166112:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca2725 lrc: 3/1,0 mode: --/PR res: [0x3450e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531735.585324:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531735.585324:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531735.585325:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca2725 lrc: 3/1,0 mode: PR/PR res: [0x3450e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531735.585329:0:166112:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca2725 lrc: 3/1,0 mode: PR/PR res: [0x3450e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531735.585335:0:166112:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca2725 lrc: 3/1,0 mode: PR/PR res: [0x3450e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531735.585338:0:166112:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca2725 lrc: 2/0,0 mode: PR/PR res: [0x3450e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531735.585359:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000047c291a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:37d7cd70-23c8-4282-b9a2-e45fd1319801+6:438147:x1731754466803776:12345-10.240.43.64@tcp:1:lfs.0 Request processed in 51us (68us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531735.585362:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44212
00010000:00010000:1.0:1651531735.585369:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca2725 lrc: 2/0,0 mode: PR/PR res: [0x3450e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531735.585373:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000077fc7eeb already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531735.585374:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca2725 lrc: 2/0,0 mode: PR/PR res: [0x3450e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531735.585377:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca2725 lrc: 3/0,0 mode: PR/PR res: [0x3450e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531735.585385:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca2725 lrc: 1/0,0 mode: --/PR res: [0x3450e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531735.585396:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca2725 lrc: 0/0,0 mode: --/PR res: [0x3450e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531735.585877:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531735.585897:0:191990:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466803904
00000100:00100000:0.0:1651531735.585915:0:191990:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44213
00000100:00100000:0.0:1651531735.585917:0:191990:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b462545d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:37d7cd70-23c8-4282-b9a2-e45fd1319801+6:438147:x1731754466803904:12345-10.240.43.64@tcp:23:lfs.0
00000100:00100000:0.0:1651531735.585948:0:191990:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b462545d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:37d7cd70-23c8-4282-b9a2-e45fd1319801+6:438147:x1731754466803904:12345-10.240.43.64@tcp:23:lfs.0 Request processed in 30us (71us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531735.585951:0:191990:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44213
00000100:00100000:1.0:1651531735.586638:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531735.586645:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466804096
00002000:00100000:1.0:1651531735.586652:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x3450e:0x0] (0->1048575)  req@00000000ff354d90 x1731754466804096/t0(0) o3->37d7cd70-23c8-4282-b9a2-e45fd1319801@10.240.43.64@tcp:200/0 lens 488/0 e 0 to 0 dl 1651531745 ref 1 fl New:/0/ffffffff rc 0/-1 job:'lfs.0'
00002000:00100000:1.0:1651531735.586656:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000ff354d90 with x1731754466804096 ext(0->1048575)
00002000:00010000:1.0:1651531735.586657:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000ff354d90
00000100:00100000:1.0:1651531735.586668:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249507
00000100:00100000:1.0:1651531735.586669:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ff354d90 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:37d7cd70-23c8-4282-b9a2-e45fd1319801+6:438147:x1731754466804096:12345-10.240.43.64@tcp:3:lfs.0
00000100:00100000:1.0:1651531735.587412:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ff354d90 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:37d7cd70-23c8-4282-b9a2-e45fd1319801+6:438147:x1731754466804096:12345-10.240.43.64@tcp:3:lfs.0 Request processed in 741us (774us total) trans 0 rc 1048576/1048576
00000100:00100000:1.0:1651531735.587415:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249507
00002000:00100000:1.0:1651531735.587418:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x3450e:0x0] (0->1048575)  req@00000000ff354d90 x1731754466804096/t0(0) o3->37d7cd70-23c8-4282-b9a2-e45fd1319801@10.240.43.64@tcp:200/0 lens 488/440 e 0 to 0 dl 1651531745 ref 1 fl Complete:/0/0 rc 1048576/1048576 job:'lfs.0'
00002000:00100000:1.0:1651531735.587421:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000ff354d90 with x1731754466804096 ext(0->1048575)
00002000:00010000:1.0:1651531735.587423:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000ff354d90
00000100:00100000:1.0:1651531735.597810:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531735.597834:0:191990:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466804736
00000100:00100000:0.0:1651531735.597848:0:191990:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44214
00000100:00100000:0.0:1651531735.597850:0:191990:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000080bc1e67 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:37d7cd70-23c8-4282-b9a2-e45fd1319801+6:658576:x1731754466804736:12345-10.240.43.64@tcp:101:lfs.0
00010000:00010000:0.0:1651531735.597855:0:191990:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531735.597862:0:191990:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca272c lrc: 2/0,0 mode: --/PW res: [0x3450f:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4427f6 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00002000:00010000:0.0:1651531735.597869:0:191990:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x3450f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:0.0:1651531735.597875:0:191990:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531735.597876:0:191990:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531735.597879:0:191990:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca272c lrc: 3/0,0 mode: PW/PW res: [0x3450f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4427f6 expref: 7 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531735.597885:0:191990:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca272c lrc: 3/0,0 mode: PW/PW res: [0x3450f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4427f6 expref: 7 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531735.597889:0:191990:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b4c8742a, rc 0)
00000100:00100000:0.0:1651531735.597902:0:191990:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000080bc1e67 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:37d7cd70-23c8-4282-b9a2-e45fd1319801+7:658576:x1731754466804736:12345-10.240.43.64@tcp:101:lfs.0 Request processed in 51us (93us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531735.597907:0:191990:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44214
00000100:00100000:1.0:1651531735.602525:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531735.602535:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466804800
00002000:00100000:1.0:1651531735.602543:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x3450f:0x0] (0->1048575)  req@00000000427633c3 x1731754466804800/t0(0) o4->37d7cd70-23c8-4282-b9a2-e45fd1319801@10.240.43.64@tcp:200/0 lens 488/0 e 0 to 0 dl 1651531745 ref 1 fl New:/0/ffffffff rc 0/-1 job:'lfs.0'
00002000:00100000:1.0:1651531735.602547:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000427633c3 with x1731754466804800 ext(0->1048575)
00002000:00010000:1.0:1651531735.602548:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000427633c3
00000100:00100000:1.0:1651531735.602558:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249508
00000100:00100000:1.0:1651531735.602560:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000427633c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:37d7cd70-23c8-4282-b9a2-e45fd1319801+7:438147:x1731754466804800:12345-10.240.43.64@tcp:4:lfs.0
00000100:00100000:1.0:1651531735.604073:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000427633c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:37d7cd70-23c8-4282-b9a2-e45fd1319801+9:438147:x1731754466804800:12345-10.240.43.64@tcp:4:lfs.0 Request processed in 1511us (1547us total) trans 21474868998 rc 0/0
00000100:00100000:1.0:1651531735.604077:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249508
00002000:00100000:1.0:1651531735.604079:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x3450f:0x0] (0->1048575)  req@00000000427633c3 x1731754466804800/t21474868998(0) o4->37d7cd70-23c8-4282-b9a2-e45fd1319801@10.240.43.64@tcp:200/0 lens 488/448 e 0 to 0 dl 1651531745 ref 1 fl Complete:/0/0 rc 0/0 job:'lfs.0'
00002000:00100000:1.0:1651531735.604083:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000427633c3 with x1731754466804800 ext(0->1048575)
00002000:00010000:1.0:1651531735.604085:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000427633c3
00000100:00100000:0.0:1651531735.747940:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651531735.747951:0:191990:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951131264
00000100:00100000:0.0:1651531735.747968:0:191990:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 44215
00000100:00100000:0.0:1651531735.747970:0:191990:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bcdb3319 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951131264:12345-10.240.43.61@tcp:2:osp-syn-1-0.0
00000100:00100000:0.0:1651531735.748021:0:191990:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bcdb3319 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745951131264:12345-10.240.43.61@tcp:2:osp-syn-1-0.0 Request processed in 50us (82us total) trans 21474868999 rc 0/0
00000100:00100000:0.0:1651531735.748025:0:191990:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 44215
00000100:00100000:0.0:1651531735.748243:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531735.748252:0:191990:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466805056
00000100:00100000:0.0:1651531735.748265:0:191990:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44216
00000100:00100000:0.0:1651531735.748266:0:191990:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d09aeb66 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:37d7cd70-23c8-4282-b9a2-e45fd1319801+9:438146:x1731754466805056:12345-10.240.43.64@tcp:16:lfs.0
00000001:00080000:1.0:1651531735.830509:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474868999 is committed
00000001:00080000:1.0:1651531735.830512:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474868998 is committed
00000100:00100000:0.0:1651531735.830559:0:191990:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d09aeb66 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:37d7cd70-23c8-4282-b9a2-e45fd1319801+7:438146:x1731754466805056:12345-10.240.43.64@tcp:16:lfs.0 Request processed in 82291us (82315us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531735.830563:0:191990:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44216
00000100:00100000:0.0:1651531735.831615:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531735.831623:0:191990:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466805120
00000100:00100000:0.0:1651531735.831637:0:191990:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44217
00000100:00100000:0.0:1651531735.831639:0:191990:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f47fde78 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:37d7cd70-23c8-4282-b9a2-e45fd1319801+7:438147:x1731754466805120:12345-10.240.43.64@tcp:1:lfs.0
00010000:00010000:0.0:1651531735.831649:0:191990:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca2733 lrc: 3/1,0 mode: --/PR res: [0x3450e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531735.831655:0:191990:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531735.831656:0:191990:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531735.831658:0:191990:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca2733 lrc: 3/1,0 mode: PR/PR res: [0x3450e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531735.831665:0:191990:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca2733 lrc: 3/1,0 mode: PR/PR res: [0x3450e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531735.831671:0:191990:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca2733 lrc: 3/1,0 mode: PR/PR res: [0x3450e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531735.831674:0:191990:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca2733 lrc: 2/0,0 mode: PR/PR res: [0x3450e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531735.831695:0:191990:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f47fde78 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:37d7cd70-23c8-4282-b9a2-e45fd1319801+7:438147:x1731754466805120:12345-10.240.43.64@tcp:1:lfs.0 Request processed in 55us (80us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531735.831697:0:191990:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44217
00010000:00010000:1.0:1651531735.831698:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca2733 lrc: 2/0,0 mode: PR/PR res: [0x3450e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531735.831705:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008558d1b3 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531735.831706:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca2733 lrc: 2/0,0 mode: PR/PR res: [0x3450e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531735.831711:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca2733 lrc: 3/0,0 mode: PR/PR res: [0x3450e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531735.831721:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca2733 lrc: 1/0,0 mode: --/PR res: [0x3450e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531735.831724:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca2733 lrc: 0/0,0 mode: --/PR res: [0x3450e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531735.832689:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531735.832697:0:191990:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466805504
00000100:00100000:0.0:1651531735.832711:0:191990:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44218
00000100:00100000:0.0:1651531735.832713:0:191990:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000380124f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:37d7cd70-23c8-4282-b9a2-e45fd1319801+7:438147:x1731754466805504:12345-10.240.43.64@tcp:2:lfs.0
00002000:00010000:0.0:1651531735.832740:0:191990:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x3450f:0x0] updating lvb size from disk: 0 -> 1048576
00002000:00010000:0.0:1651531735.832742:0:191990:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x3450f:0x0] updating lvb mtime from disk: 0 -> 1651531735
00002000:00010000:0.0:1651531735.832743:0:191990:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x3450f:0x0] updating lvb atime from disk: 0 -> 1651531735
00002000:00010000:0.0:1651531735.832744:0:191990:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x3450f:0x0] updating lvb ctime from disk: 0 -> 1651531735
00002000:00010000:0.0:1651531735.832744:0:191990:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x3450f:0x0] updating lvb blocks from disk: 0 -> 2048
00000100:00100000:0.0:1651531735.832756:0:191990:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000380124f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:37d7cd70-23c8-4282-b9a2-e45fd1319801+8:438147:x1731754466805504:12345-10.240.43.64@tcp:2:lfs.0 Request processed in 42us (67us total) trans 21474869000 rc 0/0
00000100:00100000:0.0:1651531735.832759:0:191990:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44218
00000100:00100000:0.0:1651531735.834018:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531735.834027:0:191990:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466805888
00000100:00100000:0.0:1651531735.834050:0:191990:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44219
00000100:00100000:0.0:1651531735.834052:0:191990:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cfeac242 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:37d7cd70-23c8-4282-b9a2-e45fd1319801+8:438147:x1731754466805888:12345-10.240.43.64@tcp:2:lfs.0
00002000:00010000:0.0:1651531735.834073:0:191990:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x3450e:0x0] updating lvb size from disk: 1048576 -> 1048576
00002000:00010000:0.0:1651531735.834074:0:191990:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x3450e:0x0] updating lvb mtime from disk: 1651531735 -> 1651531735
00002000:00010000:0.0:1651531735.834075:0:191990:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x3450e:0x0] updating lvb atime from disk: 0 -> 1651531735
00002000:00010000:0.0:1651531735.834076:0:191990:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x3450e:0x0] updating lvb ctime from disk: 1651531735 -> 1651531735
00002000:00010000:0.0:1651531735.834077:0:191990:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x3450e:0x0] updating lvb blocks from disk: 2048 -> 2048
00000100:00100000:0.0:1651531735.834088:0:191990:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cfeac242 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:37d7cd70-23c8-4282-b9a2-e45fd1319801+9:438147:x1731754466805888:12345-10.240.43.64@tcp:2:lfs.0 Request processed in 36us (71us total) trans 21474869001 rc 0/0
00000100:00100000:0.0:1651531735.834091:0:191990:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44219
00000100:00100000:0.0:1651531735.835291:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651531735.835315:0:192975:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951131584
00000100:00100000:1.0:1651531735.835328:0:192975:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 25
00000100:00100000:1.0:1651531735.835330:0:192975:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000487b2caa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:320760:x1731745951131584:12345-10.240.43.61@tcp:1000:mdt_rdpg00_002.0
00000100:00100000:1.0:1651531735.835360:0:192975:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000487b2caa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:320760:x1731745951131584:12345-10.240.43.61@tcp:1000:mdt_rdpg00_002.0 Request processed in 29us (68us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531735.835363:0:192975:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 25
00000100:00100000:0.0:1651531735.836098:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651531735.836123:0:166122:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951131776
00000100:00100000:1.0:1651531735.836132:0:166122:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 26
00000100:00100000:1.0:1651531735.836133:0:166122:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000041fd707a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:320760:x1731745951131776:12345-10.240.43.61@tcp:1000:mdt_rdpg00_002.0
00000100:00100000:1.0:1651531735.836156:0:166122:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000041fd707a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:320760:x1731745951131776:12345-10.240.43.61@tcp:1000:mdt_rdpg00_002.0 Request processed in 22us (59us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531735.836159:0:166122:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 26
00000100:00100000:0.0:1651531735.836614:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651531735.836635:0:192975:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951131904
00000100:00100000:1.0:1651531735.836643:0:192975:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 27
00000100:00100000:1.0:1651531735.836644:0:192975:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000021908e31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:320760:x1731745951131904:12345-10.240.43.61@tcp:1000:mdt_rdpg00_002.0
00000100:00100000:1.0:1651531735.836684:0:192975:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000021908e31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:320760:x1731745951131904:12345-10.240.43.61@tcp:1000:mdt_rdpg00_002.0 Request processed in 39us (71us total) trans 21474869002 rc 0/0
00000100:00100000:1.0:1651531735.836687:0:192975:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 27
00000100:00100000:0.0:1651531735.844345:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531735.844353:0:191990:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466807040
00000100:00100000:0.0:1651531735.844365:0:191990:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44220
00000100:00100000:0.0:1651531735.844367:0:191990:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d44b0d9f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:37d7cd70-23c8-4282-b9a2-e45fd1319801+9:438148:x1731754466807040:12345-10.240.43.64@tcp:1:lfs.0
00010000:00010000:0.0:1651531735.844375:0:191990:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca273a lrc: 3/0,1 mode: --/PW res: [0x3450e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531735.844381:0:191990:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e9908e14/0x3234de053ca271e lrc: 2/0,0 mode: PR/PR res: [0x3450e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4427be expref: 9 pid: 191990 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531735.844385:0:191990:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531735.844386:0:191990:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531735.844387:0:191990:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca273a lrc: 4/0,1 mode: --/PW res: [0x3450e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531735.844399:0:191990:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e9908e14/0x3234de053ca271e lrc: 3/0,0 mode: PR/PR res: [0x3450e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4427be expref: 9 pid: 191990 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531735.844405:0:191990:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e9908e14/0x3234de053ca271e lrc: 4/0,0 mode: PR/PR res: [0x3450e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4427be expref: 9 pid: 191990 timeout: 22544 lvb_type: 1
00000100:00100000:0.0:1651531735.844411:0:191990:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000074640db2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:191990:1731745997341440:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531735.844428:0:191990:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fadbf296 going to sleep for 6 seconds
00000100:00100000:0.0:1651531735.844610:0:191990:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000074640db2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:191990:1731745997341440:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651531735.844617:0:191990:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca273a lrc: 3/0,1 mode: --/PW res: [0x3450e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531735.844731:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531735.844751:0:166103:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466807168
00010000:00010000:1.0:1651531735.844759:0:166103:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e9908e14/0x3234de053ca271e lrc: 4/0,0 mode: PR/PR res: [0x3450e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4427be expref: 10 pid: 191990 timeout: 22544 lvb_type: 1
00000100:00100000:1.0:1651531735.844769:0:166103:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 72
00000100:00100000:1.0:1651531735.844770:0:166103:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000074640db2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:37d7cd70-23c8-4282-b9a2-e45fd1319801+10:438149:x1731754466807168:12345-10.240.43.64@tcp:103:ldlm_bl_02.0
00010000:00010000:1.0:1651531735.844774:0:166103:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1651531735.844779:0:166103:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e9908e14/0x3234de053ca271e lrc: 4/0,0 mode: PR/PR res: [0x3450e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4427be expref: 10 pid: 191990 timeout: 22544 lvb_type: 1
00010000:00010000:1.0:1651531735.844783:0:166103:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e9908e14/0x3234de053ca271e lrc: 3/0,0 mode: PR/PR res: [0x3450e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4427be expref: 10 pid: 191990 timeout: 22544 lvb_type: 1
00010000:00010000:1.0:1651531735.844790:0:166103:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9908e14/0x3234de053ca271e lrc: 0/0,0 mode: --/PR res: [0x3450e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4427be expref: 10 pid: 191990 timeout: 22544 lvb_type: 1
00010000:00010000:1.0:1651531735.844794:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531735.844795:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531735.844796:0:166103:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca273a lrc: 3/0,1 mode: PW/PW res: [0x3450e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531735.844799:0:166103:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca273a lrc: 4/0,1 mode: PW/PW res: [0x3450e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531735.844812:0:166103:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1651531735.844821:0:191990:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca273a lrc: 3/0,1 mode: PW/PW res: [0x3450e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531735.844824:0:166103:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000074640db2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:37d7cd70-23c8-4282-b9a2-e45fd1319801+9:438149:x1731754466807168:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 53us (94us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531735.844827:0:166103:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 72
00010000:00010000:0.0:1651531735.844830:0:191990:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca273a lrc: 3/0,1 mode: PW/PW res: [0x3450e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531735.844836:0:191990:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca273a lrc: 3/0,1 mode: PW/PW res: [0x3450e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531735.844839:0:191990:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca273a lrc: 2/0,0 mode: PW/PW res: [0x3450e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531735.844865:0:191990:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d44b0d9f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:37d7cd70-23c8-4282-b9a2-e45fd1319801+8:438148:x1731754466807040:12345-10.240.43.64@tcp:1:lfs.0 Request processed in 497us (521us total) trans 0 rc 0/0
00010000:00010000:1.0:1651531735.844866:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca273a lrc: 2/0,0 mode: PW/PW res: [0x3450e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531735.844869:0:191990:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44220
00010000:00010000:1.0:1651531735.844870:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a8889a80 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531735.844871:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca273a lrc: 2/0,0 mode: PW/PW res: [0x3450e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531735.844874:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca273a lrc: 3/0,0 mode: PW/PW res: [0x3450e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531735.844879:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca273a lrc: 1/0,0 mode: --/PW res: [0x3450e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531735.844882:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca273a lrc: 0/0,0 mode: --/PW res: [0x3450e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531735.871856:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651531735.871865:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651531735.871875:0:191990:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951132160
00000100:00100000:0.0:1651531735.871883:0:191990:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951132224
00000100:00100000:0.0:1651531735.871891:0:191990:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 44221
00000100:00100000:0.0:1651531735.871893:0:191990:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000094cfb6b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745951132160:12345-10.240.43.61@tcp:2:osp-syn-1-0.0
00000100:00100000:1.0:1651531735.871899:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 44222
00000100:00100000:1.0:1651531735.871903:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009414203c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745951132224:12345-10.240.43.61@tcp:2:osp-syn-1-0.0
00000100:00100000:0.0:1651531735.871926:0:191990:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000094cfb6b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+9:39030:x1731745951132160:12345-10.240.43.61@tcp:2:osp-syn-1-0.0 Request processed in 33us (71us total) trans 21474869003 rc 0/0
00000100:00100000:0.0:1651531735.871930:0:191990:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 44221
00002000:00010000:1.0:1651531735.871933:0:166112:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x3450f:0x0] updating lvb size from disk: 1048576 -> 1048576
00002000:00010000:1.0:1651531735.871935:0:166112:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x3450f:0x0] updating lvb mtime from disk: 1651531735 -> 1651531735
00002000:00010000:1.0:1651531735.871936:0:166112:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x3450f:0x0] updating lvb atime from disk: 1651531735 -> 1651531735
00002000:00010000:1.0:1651531735.871937:0:166112:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x3450f:0x0] updating lvb ctime from disk: 1651531735 -> 1651531735
00002000:00010000:1.0:1651531735.871938:0:166112:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x3450f:0x0] updating lvb blocks from disk: 2048 -> 2048
00000100:00100000:1.0:1651531735.871949:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009414203c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:39030:x1731745951132224:12345-10.240.43.61@tcp:2:osp-syn-1-0.0 Request processed in 46us (84us total) trans 21474869004 rc 0/0
00000100:00100000:1.0:1651531735.871952:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 44222
00000100:00100000:0.0:1651531735.872249:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651531735.872263:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651531735.872279:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951132416
00000100:00100000:1.0:1651531735.872292:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951132480
00000100:00100000:1.0:1651531735.872297:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 44223
00000100:00100000:1.0:1651531735.872299:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dfff0362 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:39030:x1731745951132416:12345-10.240.43.61@tcp:2:osp-syn-1-0.0
00000100:00100000:0.0:1651531735.872300:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 44224
00000100:00100000:0.0:1651531735.872303:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c6960eaf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+9:39029:x1731745951132480:12345-10.240.43.61@tcp:2:osp-syn-1-0.0
00002000:00010000:0.0:1651531735.872329:0:206699:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x3450f:0x0] updating lvb size from disk: 1048576 -> 1048576
00002000:00010000:0.0:1651531735.872330:0:206699:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x3450f:0x0] updating lvb mtime from disk: 1651531735 -> 1651531735
00000100:00100000:1.0:1651531735.872334:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dfff0362 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+11:39030:x1731745951132416:12345-10.240.43.61@tcp:2:osp-syn-1-0.0 Request processed in 34us (85us total) trans 21474869005 rc 0/0
00000100:00100000:1.0:1651531735.872337:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 44223
00002000:00010000:0.0:1651531735.872338:0:206699:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x3450f:0x0] updating lvb atime from disk: 1651531735 -> 1651531735
00002000:00010000:0.0:1651531735.872339:0:206699:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x3450f:0x0] updating lvb ctime from disk: 1651531735 -> 1651531735
00002000:00010000:0.0:1651531735.872340:0:206699:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x3450f:0x0] updating lvb blocks from disk: 2048 -> 2048
00000100:00100000:0.0:1651531735.872349:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c6960eaf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+10:39029:x1731745951132480:12345-10.240.43.61@tcp:2:osp-syn-1-0.0 Request processed in 47us (86us total) trans 21474869006 rc 0/0
00000100:00100000:0.0:1651531735.872353:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 44224
00000100:00100000:0.0:1651531735.872673:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531735.872681:0:191990:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466807552
00000100:00100000:0.0:1651531735.872688:0:191990:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44225
00000100:00100000:0.0:1651531735.872689:0:191990:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000232e8d19 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:37d7cd70-23c8-4282-b9a2-e45fd1319801+8:658577:x1731754466807552:12345-10.240.43.64@tcp:101:lfs.0
00010000:00010000:0.0:1651531735.872693:0:191990:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531735.872698:0:191990:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca2741 lrc: 2/0,0 mode: --/PR res: [0x3450e:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db442827 expref: -99 pid: 191990 timeout: 0 lvb_type: 0
00002000:00010000:0.0:1651531735.872703:0:191990:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x3450e:0x0] initial LVB size: 1048576, mtime: 0x62705fd7, atime: 0x62705fd7, ctime: 0x62705fd7, blocks: 0x800
00010000:00010000:0.0:1651531735.872708:0:191990:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531735.872709:0:191990:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531735.872711:0:191990:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca2741 lrc: 3/0,0 mode: PR/PR res: [0x3450e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db442827 expref: 9 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531735.872715:0:191990:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca2741 lrc: 3/0,0 mode: PR/PR res: [0x3450e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db442827 expref: 9 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531735.872720:0:191990:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000968553c1, rc 0)
00000100:00100000:0.0:1651531735.872729:0:191990:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000232e8d19 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:37d7cd70-23c8-4282-b9a2-e45fd1319801+9:658577:x1731754466807552:12345-10.240.43.64@tcp:101:lfs.0 Request processed in 39us (57us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531735.872732:0:191990:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44225
00000100:00100000:0.0:1651531735.873272:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531735.873280:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466807680
00000100:00100000:0.0:1651531735.873287:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44226
00000100:00100000:0.0:1651531735.873289:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002eb188c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:37d7cd70-23c8-4282-b9a2-e45fd1319801+9:438149:x1731754466807680:12345-10.240.43.64@tcp:23:lfs.0
00000100:00100000:0.0:1651531735.873309:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002eb188c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:37d7cd70-23c8-4282-b9a2-e45fd1319801+9:438149:x1731754466807680:12345-10.240.43.64@tcp:23:lfs.0 Request processed in 19us (37us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531735.873315:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44226
00000100:00100000:0.0:1651531735.873636:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531735.873643:0:191990:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466807808
00000100:00100000:0.0:1651531735.873650:0:191990:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44227
00000100:00100000:0.0:1651531735.873652:0:191990:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007a693f14 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:37d7cd70-23c8-4282-b9a2-e45fd1319801+9:438149:x1731754466807808:12345-10.240.43.64@tcp:23:lfs.0
00000100:00100000:0.0:1651531735.873669:0:191990:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007a693f14 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:37d7cd70-23c8-4282-b9a2-e45fd1319801+9:438149:x1731754466807808:12345-10.240.43.64@tcp:23:lfs.0 Request processed in 17us (34us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531735.873672:0:191990:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44227
00000100:00100000:0.0:1651531735.874850:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531735.874874:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466808000
00000100:00100000:1.0:1651531735.874889:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249509
00000100:00100000:1.0:1651531735.874891:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008bb4a649 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:37d7cd70-23c8-4282-b9a2-e45fd1319801+9:438149:x1731754466808000:12345-10.240.43.64@tcp:3:lfs.0
00010000:00010000:1.0:1651531735.874899:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e9908e14/0x3234de053ca2748 lrc: 3/1,0 mode: --/PR res: [0x3450e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531735.874904:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531735.874905:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531735.874906:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9908e14/0x3234de053ca2748 lrc: 3/1,0 mode: PR/PR res: [0x3450e:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531735.874911:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9908e14/0x3234de053ca2748 lrc: 3/1,0 mode: PR/PR res: [0x3450e:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531735.875667:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e9908e14/0x3234de053ca2748 lrc: 3/1,0 mode: PR/PR res: [0x3450e:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531735.875672:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e9908e14/0x3234de053ca2748 lrc: 2/0,0 mode: PR/PR res: [0x3450e:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531735.875692:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008bb4a649 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:37d7cd70-23c8-4282-b9a2-e45fd1319801+9:438149:x1731754466808000:12345-10.240.43.64@tcp:3:lfs.0 Request processed in 800us (842us total) trans 0 rc 1048576/1048576
00000100:00100000:1.0:1651531735.875698:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249509
00010000:00010000:1.0:1651531735.875706:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e9908e14/0x3234de053ca2748 lrc: 2/0,0 mode: PR/PR res: [0x3450e:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531735.875710:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e9908e14 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531735.875719:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9908e14/0x3234de053ca2748 lrc: 2/0,0 mode: PR/PR res: [0x3450e:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531735.875723:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9908e14/0x3234de053ca2748 lrc: 3/0,0 mode: PR/PR res: [0x3450e:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531735.875728:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e9908e14/0x3234de053ca2748 lrc: 1/0,0 mode: --/PR res: [0x3450e:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531735.875731:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9908e14/0x3234de053ca2748 lrc: 0/0,0 mode: --/PR res: [0x3450e:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531735.988354:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531735.988365:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466808448
00000100:00100000:0.0:1651531735.988375:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44228
00000100:00100000:0.0:1651531735.988377:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f2eb86bf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:37d7cd70-23c8-4282-b9a2-e45fd1319801+9:438148:x1731754466808448:12345-10.240.43.64@tcp:2:lfs.0
00002000:00010000:0.0:1651531735.988413:0:206699:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x3450e:0x0] updating lvb size from disk: 1048576 -> 1048576
00002000:00010000:0.0:1651531735.988414:0:206699:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x3450e:0x0] updating lvb mtime from disk: 1651531735 -> 1651531735
00002000:00010000:0.0:1651531735.988415:0:206699:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x3450e:0x0] updating lvb atime from disk: 1651531735 -> 1651531735
00002000:00010000:0.0:1651531735.988416:0:206699:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x3450e:0x0] updating lvb ctime from disk: 1651531735 -> 1651531735
00002000:00010000:0.0:1651531735.988417:0:206699:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x3450e:0x0] updating lvb blocks from disk: 2048 -> 2048
00000100:00100000:0.0:1651531735.988430:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f2eb86bf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:37d7cd70-23c8-4282-b9a2-e45fd1319801+10:438148:x1731754466808448:12345-10.240.43.64@tcp:2:lfs.0 Request processed in 52us (78us total) trans 21474869007 rc 0/0
00000100:00100000:0.0:1651531735.988433:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44228
00000100:00100000:0.0:1651531736.027380:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651531736.027389:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651531736.027395:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951132928
00000100:00100000:0.0:1651531736.027407:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951132864
00000100:00100000:0.0:1651531736.027414:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 44229
00000100:00100000:0.0:1651531736.027415:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e589436f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+11:39029:x1731745951132928:12345-10.240.43.61@tcp:2:osp-syn-1-0.0
00000100:00100000:1.0:1651531736.027434:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 44230
00000100:00100000:1.0:1651531736.027437:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a19b10fa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+12:39029:x1731745951132864:12345-10.240.43.61@tcp:2:osp-syn-1-0.0
00002000:00010000:0.0:1651531736.027440:0:206699:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x3450f:0x0] updating lvb size from disk: 1048576 -> 1048576
00002000:00010000:0.0:1651531736.027441:0:206699:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x3450f:0x0] updating lvb mtime from disk: 1651531735 -> 1651531735
00002000:00010000:0.0:1651531736.027442:0:206699:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x3450f:0x0] updating lvb atime from disk: 1651531735 -> 1651531735
00002000:00010000:0.0:1651531736.027443:0:206699:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x3450f:0x0] updating lvb ctime from disk: 1651531735 -> 1651531735
00002000:00010000:0.0:1651531736.027444:0:206699:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x3450f:0x0] updating lvb blocks from disk: 2048 -> 2048
00000100:00100000:0.0:1651531736.027457:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e589436f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+12:39029:x1731745951132928:12345-10.240.43.61@tcp:2:osp-syn-1-0.0 Request processed in 41us (78us total) trans 21474869008 rc 0/0
00000100:00100000:0.0:1651531736.027460:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 44229
00002000:00010000:1.0:1651531736.027465:0:167632:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x3450e:0x0] updating lvb size from disk: 1048576 -> 1048576
00002000:00010000:1.0:1651531736.027467:0:167632:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x3450e:0x0] updating lvb mtime from disk: 1651531735 -> 1651531735
00002000:00010000:1.0:1651531736.027468:0:167632:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x3450e:0x0] updating lvb atime from disk: 1651531735 -> 1651531735
00002000:00010000:1.0:1651531736.027469:0:167632:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x3450e:0x0] updating lvb ctime from disk: 1651531735 -> 1651531735
00002000:00010000:1.0:1651531736.027470:0:167632:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x3450e:0x0] updating lvb blocks from disk: 2048 -> 2048
00000100:00100000:1.0:1651531736.027481:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a19b10fa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+12:39029:x1731745951132864:12345-10.240.43.61@tcp:2:osp-syn-1-0.0 Request processed in 44us (92us total) trans 21474869009 rc 0/0
00000100:00100000:1.0:1651531736.027487:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 44230
00000100:00100000:0.0:1651531736.035494:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651531736.035517:0:166122:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951133376
00000100:00100000:1.0:1651531736.035528:0:166122:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 28
00000100:00100000:1.0:1651531736.035530:0:166122:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006430b767 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+12:320760:x1731745951133376:12345-10.240.43.61@tcp:1000:mdt_rdpg00_002.0
00000100:00100000:1.0:1651531736.035558:0:166122:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006430b767 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+12:320760:x1731745951133376:12345-10.240.43.61@tcp:1000:mdt_rdpg00_002.0 Request processed in 27us (64us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531736.035561:0:166122:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 28
00000100:00100000:0.0:1651531736.035780:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651531736.035805:0:192975:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951133440
00000100:00100000:1.0:1651531736.035813:0:192975:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 29
00000100:00100000:1.0:1651531736.035815:0:192975:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000091a5f763 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+12:320760:x1731745951133440:12345-10.240.43.61@tcp:1000:mdt_rdpg00_002.0
00000100:00100000:1.0:1651531736.035851:0:192975:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000091a5f763 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+13:320760:x1731745951133440:12345-10.240.43.61@tcp:1000:mdt_rdpg00_002.0 Request processed in 35us (71us total) trans 21474869010 rc 0/0
00000100:00100000:1.0:1651531736.035854:0:192975:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 29
00000100:00100000:0.0:1651531736.046797:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531736.046819:0:169267:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466810816
00000100:00100000:1.0:1651531736.046831:0:169267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11087
00000100:00100000:1.0:1651531736.046833:0:169267:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e11ae1c5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:37d7cd70-23c8-4282-b9a2-e45fd1319801+10:607799:x1731754466810816:12345-10.240.43.64@tcp:103:ldlm_bl_01.0
00010000:00010000:1.0:1651531736.046836:0:169267:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0
00010000:00010000:1.0:1651531736.046846:0:169267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca2741 lrc: 0/0,0 mode: --/PR res: [0x3450e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db442827 expref: 10 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531736.046854:0:169267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca272c lrc: 0/0,0 mode: --/PW res: [0x3450f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4427f6 expref: 9 pid: 191990 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531736.046859:0:169267:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1651531736.046876:0:169267:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e11ae1c5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:37d7cd70-23c8-4282-b9a2-e45fd1319801+8:607799:x1731754466810816:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 42us (79us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531736.046878:0:169267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11087
00000100:00100000:0.0:1651531736.055861:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531736.055881:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466811264
00000100:00100000:1.0:1651531736.055894:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44231
00000100:00100000:1.0:1651531736.055895:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cb694635 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:37d7cd70-23c8-4282-b9a2-e45fd1319801+8:438149:x1731754466811264:12345-10.240.43.64@tcp:101:md5sum.0
00010000:00010000:1.0:1651531736.055899:0:167632:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531736.055904:0:167632:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9908e14/0x3234de053ca274f lrc: 2/0,0 mode: --/PR res: [0x3450f:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db442890 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651531736.055909:0:167632:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x3450f:0x0] initial LVB size: 1048576, mtime: 0x62705fd7, atime: 0x62705fd7, ctime: 0x62705fd7, blocks: 0x800
00010000:00010000:1.0:1651531736.055914:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531736.055915:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531736.055917:0:167632:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9908e14/0x3234de053ca274f lrc: 3/0,0 mode: PR/PR res: [0x3450f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db442890 expref: 9 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531736.055923:0:167632:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e9908e14/0x3234de053ca274f lrc: 3/0,0 mode: PR/PR res: [0x3450f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db442890 expref: 9 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531736.055927:0:167632:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e9908e14, rc 0)
00000100:00100000:1.0:1651531736.055942:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cb694635 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:37d7cd70-23c8-4282-b9a2-e45fd1319801+9:438149:x1731754466811264:12345-10.240.43.64@tcp:101:md5sum.0 Request processed in 46us (81us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531736.055945:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44231
00000100:00100000:0.0:1651531736.057954:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531736.057976:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466811648
00002000:00100000:1.0:1651531736.057985:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x3450f:0x0] (0->1048575)  req@00000000b6b1b79d x1731754466811648/t0(0) o3->37d7cd70-23c8-4282-b9a2-e45fd1319801@10.240.43.64@tcp:201/0 lens 488/0 e 0 to 0 dl 1651531746 ref 1 fl New:/0/ffffffff rc 0/-1 job:'md5sum.0'
00002000:00100000:1.0:1651531736.057990:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000b6b1b79d with x1731754466811648 ext(0->1048575)
00002000:00010000:1.0:1651531736.057992:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000b6b1b79d
00000100:00100000:1.0:1651531736.058002:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249510
00000100:00100000:1.0:1651531736.058004:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b6b1b79d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:37d7cd70-23c8-4282-b9a2-e45fd1319801+9:438149:x1731754466811648:12345-10.240.43.64@tcp:3:md5sum.0
00000100:00100000:1.0:1651531736.058823:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b6b1b79d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:37d7cd70-23c8-4282-b9a2-e45fd1319801+9:438149:x1731754466811648:12345-10.240.43.64@tcp:3:md5sum.0 Request processed in 817us (868us total) trans 0 rc 1048576/1048576
00000100:00100000:1.0:1651531736.058827:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249510
00002000:00100000:1.0:1651531736.058829:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x3450f:0x0] (0->1048575)  req@00000000b6b1b79d x1731754466811648/t0(0) o3->37d7cd70-23c8-4282-b9a2-e45fd1319801@10.240.43.64@tcp:201/0 lens 488/440 e 0 to 0 dl 1651531746 ref 1 fl Complete:/0/0 rc 1048576/1048576 job:'md5sum.0'
00002000:00100000:1.0:1651531736.058833:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000b6b1b79d with x1731754466811648 ext(0->1048575)
00002000:00010000:1.0:1651531736.058835:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000b6b1b79d
00000100:00100000:0.0:1651531737.312181:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651531737.312199:0:182071:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951133632
00000100:00100000:0.0:1651531737.312218:0:182071:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 416
00000100:00100000:0.0:1651531737.312220:0:182071:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f31dd71a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+13:39029:x1731745951133632:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:0.0:1651531737.312252:0:182071:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 350514368 pending 0 free 81286651904 avail 77113794560
00000100:00100000:0.0:1651531737.312277:0:182071:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f31dd71a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+13:39029:x1731745951133632:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 57us (99us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531737.312281:0:182071:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 416
00000400:00000080:0.0:1651531737.525446:0:225275:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648
00000001:02000400:0.0:1651531737.525448:0:225275:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 272f: DoM migration: OST-striped file to DOM file ========================================================== 22:48:57 (1651531737)
00000100:00100000:0.0:1651531737.573198:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531737.573259:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466812992
00000100:00100000:1.0:1651531737.573363:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44232
00000100:00100000:1.0:1651531737.573366:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007fc0def2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:37d7cd70-23c8-4282-b9a2-e45fd1319801+9:659176:x1731754466812992:12345-10.240.43.64@tcp:101:dd.0
00010000:00010000:1.0:1651531737.573391:0:167632:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531737.573434:0:167632:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca2756 lrc: 2/0,0 mode: --/PW res: [0x34510:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4428c1 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651531737.573469:0:167632:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34510:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:1.0:1651531737.573500:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531737.573501:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531737.573516:0:167632:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca2756 lrc: 3/0,0 mode: PW/PW res: [0x34510:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4428c1 expref: 10 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531737.573532:0:167632:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca2756 lrc: 3/0,0 mode: PW/PW res: [0x34510:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4428c1 expref: 10 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531737.573542:0:167632:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000077fc7eeb, rc 0)
00000100:00100000:1.0:1651531737.573632:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007fc0def2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:37d7cd70-23c8-4282-b9a2-e45fd1319801+10:659176:x1731754466812992:12345-10.240.43.64@tcp:101:dd.0 Request processed in 265us (447us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531737.573635:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44232
00000100:00100000:0.0:1651531737.574398:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531737.574435:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466813120
00002000:00010000:1.0:1651531737.574448:0:216321:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 214288/0 (0->18446744073709551615)
00002000:00100000:1.0:1651531737.574450:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000033723645 with x1731754466813120 ext(0->18446744073709551615)
00002000:00010000:1.0:1651531737.574458:0:216321:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000033723645.
00000100:00100000:1.0:1651531737.574487:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249511
00000100:00100000:1.0:1651531737.574489:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000033723645 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:37d7cd70-23c8-4282-b9a2-e45fd1319801+10:438148:x1731754466813120:12345-10.240.43.64@tcp:10:dd.0
00002000:00010000:1.0:1651531737.574697:0:216321:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x34510:0x0] updating lvb size from disk: 0 -> 0
00002000:00010000:1.0:1651531737.574699:0:216321:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x34510:0x0] updating lvb mtime from disk: 0 -> 1651531737
00002000:00010000:1.0:1651531737.574700:0:216321:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x34510:0x0] updating lvb atime from disk: 0 -> 0
00002000:00010000:1.0:1651531737.574701:0:216321:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x34510:0x0] updating lvb ctime from disk: 0 -> 1651531737
00002000:00010000:1.0:1651531737.574701:0:216321:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x34510:0x0] updating lvb blocks from disk: 0 -> 0
00000100:00100000:1.0:1651531737.574719:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000033723645 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:37d7cd70-23c8-4282-b9a2-e45fd1319801+11:438148:x1731754466813120:12345-10.240.43.64@tcp:10:dd.0 Request processed in 229us (322us total) trans 21474869011 rc 0/0
00000100:00100000:1.0:1651531737.574722:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249511
00002000:00010000:1.0:1651531737.574723:0:216321:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 214288/0 (0->18446744073709551615)
00002000:00100000:1.0:1651531737.574724:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000033723645 with x1731754466813120 ext(0->18446744073709551615)
00002000:00010000:1.0:1651531737.574726:0:216321:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000033723645.
00000100:00100000:0.0:1651531737.584602:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531737.584621:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466813376
00000100:00100000:1.0:1651531737.584639:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249512
00000100:00100000:1.0:1651531737.584640:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000315bf4eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:37d7cd70-23c8-4282-b9a2-e45fd1319801+11:438148:x1731754466813376:12345-10.240.43.64@tcp:4:dd.0
00010000:00010000:1.0:1651531737.584657:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca275d lrc: 3/0,1 mode: --/PW res: [0x34510:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531737.584663:0:216321:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca2756 lrc: 2/0,0 mode: PW/PW res: [0x34510:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4428c1 expref: 11 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531737.584667:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531737.584667:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531737.584668:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca275d lrc: 4/0,1 mode: --/PW res: [0x34510:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531737.584685:0:216321:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca2756 lrc: 3/0,0 mode: PW/PW res: [0x34510:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4428c1 expref: 11 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531737.584691:0:216321:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca2756 lrc: 4/0,0 mode: PW/PW res: [0x34510:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4428c1 expref: 11 pid: 167632 timeout: 22546 lvb_type: 0
00000100:00100000:1.0:1651531737.584696:0:216321:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b10bc064 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997341504:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531737.584748:0:216321:0:(client.c:2492:ptlrpc_set_wait()) set 000000004b59914c going to sleep for 6 seconds
00000100:00100000:1.0:1651531737.584976:0:216321:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b10bc064 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997341504:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651531737.584983:0:216321:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca275d lrc: 3/0,1 mode: --/PW res: [0x34510:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531737.585095:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531737.585108:0:166103:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466813504
00010000:00010000:1.0:1651531737.585115:0:166103:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca2756 lrc: 4/0,0 mode: PW/PW res: [0x34510:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4428c1 expref: 12 pid: 167632 timeout: 22546 lvb_type: 0
00000100:00100000:1.0:1651531737.585139:0:166103:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 73
00000100:00100000:1.0:1651531737.585141:0:166103:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000046de8644 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:37d7cd70-23c8-4282-b9a2-e45fd1319801+12:438149:x1731754466813504:12345-10.240.43.64@tcp:103:ldlm_bl_02.0
00010000:00010000:1.0:1651531737.585145:0:166103:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1651531737.585150:0:166103:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca2756 lrc: 4/0,0 mode: PW/PW res: [0x34510:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4428c1 expref: 12 pid: 167632 timeout: 22546 lvb_type: 0
00010000:00010000:1.0:1651531737.585154:0:166103:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca2756 lrc: 3/0,0 mode: PW/PW res: [0x34510:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4428c1 expref: 12 pid: 167632 timeout: 22546 lvb_type: 0
00010000:00010000:1.0:1651531737.585170:0:166103:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca2756 lrc: 0/0,0 mode: --/PW res: [0x34510:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4428c1 expref: 12 pid: 167632 timeout: 22546 lvb_type: 0
00010000:00010000:1.0:1651531737.585174:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531737.585174:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531737.585175:0:166103:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca275d lrc: 3/0,1 mode: PW/PW res: [0x34510:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531737.585178:0:166103:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca275d lrc: 4/0,1 mode: PW/PW res: [0x34510:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531737.585186:0:166103:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1651531737.585204:0:166103:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000046de8644 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:37d7cd70-23c8-4282-b9a2-e45fd1319801+11:438149:x1731754466813504:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 62us (110us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531737.585207:0:166103:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 73
00010000:00010000:1.0:1651531737.585216:0:216321:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca275d lrc: 3/0,1 mode: PW/PW res: [0x34510:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531737.585234:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca275d lrc: 3/0,1 mode: PW/PW res: [0x34510:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651531737.741247:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869012 is committed
00000001:00080000:1.0:1651531737.741251:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869010 is committed
00002000:00010000:1.0:1651531737.741279:0:216321:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x34510:0x0] updating lvb size from disk: 0 -> 1048576
00002000:00010000:1.0:1651531737.741280:0:216321:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x34510:0x0] updating lvb blocks from disk: 0 -> 2048
00010000:00010000:1.0:1651531737.741290:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca275d lrc: 3/0,1 mode: PW/PW res: [0x34510:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531737.741295:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca275d lrc: 2/0,0 mode: PW/PW res: [0x34510:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531737.741329:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000315bf4eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:37d7cd70-23c8-4282-b9a2-e45fd1319801+6:438148:x1731754466813376:12345-10.240.43.64@tcp:4:dd.0 Request processed in 156687us (156727us total) trans 21474869012 rc 0/0
00000100:00100000:1.0:1651531737.741333:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249512
00010000:00010000:1.0:1651531737.741351:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca275d lrc: 2/0,0 mode: PW/PW res: [0x34510:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531737.741355:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006878f48a already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531737.741357:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca275d lrc: 2/0,0 mode: PW/PW res: [0x34510:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531737.741360:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca275d lrc: 3/0,0 mode: PW/PW res: [0x34510:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531737.741366:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca275d lrc: 1/0,0 mode: --/PW res: [0x34510:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531737.741380:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca275d lrc: 0/0,0 mode: --/PW res: [0x34510:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531737.747543:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531737.747566:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466813952
00000100:00100000:1.0:1651531737.747580:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44233
00000100:00100000:1.0:1651531737.747581:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001946d870 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:37d7cd70-23c8-4282-b9a2-e45fd1319801+6:438149:x1731754466813952:12345-10.240.43.64@tcp:101:md5sum.0
00010000:00010000:1.0:1651531737.747585:0:167632:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531737.747590:0:167632:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca2764 lrc: 2/0,0 mode: --/PR res: [0x34510:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4428dd expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651531737.747595:0:167632:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34510:0x0] initial LVB size: 1048576, mtime: 0x62705fd9, atime: 0x0, ctime: 0x62705fd9, blocks: 0x800
00010000:00010000:1.0:1651531737.747600:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531737.747600:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531737.747603:0:167632:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca2764 lrc: 3/0,0 mode: PR/PR res: [0x34510:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4428dd expref: 7 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531737.747608:0:167632:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca2764 lrc: 3/0,0 mode: PR/PR res: [0x34510:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4428dd expref: 7 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531737.747612:0:167632:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006878f48a, rc 0)
00000100:00100000:1.0:1651531737.747628:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001946d870 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:37d7cd70-23c8-4282-b9a2-e45fd1319801+7:438149:x1731754466813952:12345-10.240.43.64@tcp:101:md5sum.0 Request processed in 46us (86us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531737.747631:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44233
00000100:00100000:0.0:1651531737.748090:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531737.748112:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466814144
00002000:00100000:1.0:1651531737.748120:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x34510:0x0] (0->32767)  req@000000009a23bcd5 x1731754466814144/t0(0) o3->37d7cd70-23c8-4282-b9a2-e45fd1319801@10.240.43.64@tcp:202/0 lens 488/0 e 0 to 0 dl 1651531747 ref 1 fl New:/0/ffffffff rc 0/-1 job:'md5sum.0'
00002000:00100000:1.0:1651531737.748130:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000009a23bcd5 with x1731754466814144 ext(0->32767)
00002000:00010000:1.0:1651531737.748131:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000009a23bcd5
00000100:00100000:1.0:1651531737.748141:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249513
00000100:00100000:1.0:1651531737.748143:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a23bcd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:37d7cd70-23c8-4282-b9a2-e45fd1319801+7:438149:x1731754466814144:12345-10.240.43.64@tcp:3:md5sum.0
00000100:00100000:1.0:1651531737.748492:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a23bcd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:37d7cd70-23c8-4282-b9a2-e45fd1319801+7:438149:x1731754466814144:12345-10.240.43.64@tcp:3:md5sum.0 Request processed in 348us (402us total) trans 0 rc 32768/32768
00000100:00100000:1.0:1651531737.748496:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249513
00002000:00100000:1.0:1651531737.748499:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x34510:0x0] (0->32767)  req@000000009a23bcd5 x1731754466814144/t0(0) o3->37d7cd70-23c8-4282-b9a2-e45fd1319801@10.240.43.64@tcp:202/0 lens 488/440 e 0 to 0 dl 1651531747 ref 1 fl Complete:/0/0 rc 32768/32768 job:'md5sum.0'
00002000:00100000:1.0:1651531737.748502:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000009a23bcd5 with x1731754466814144 ext(0->32767)
00002000:00010000:1.0:1651531737.748504:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000009a23bcd5
00000100:00100000:0.0:1651531737.749618:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531737.749641:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466814336
00002000:00100000:1.0:1651531737.749648:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x34510:0x0] (32768->1048575)  req@000000005ec1cbc3 x1731754466814336/t0(0) o3->37d7cd70-23c8-4282-b9a2-e45fd1319801@10.240.43.64@tcp:202/0 lens 488/0 e 0 to 0 dl 1651531747 ref 1 fl New:/0/ffffffff rc 0/-1 job:'md5sum.0'
00002000:00100000:1.0:1651531737.749651:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000005ec1cbc3 with x1731754466814336 ext(32768->1048575)
00002000:00010000:1.0:1651531737.749652:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000005ec1cbc3
00000100:00100000:1.0:1651531737.749662:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249514
00000100:00100000:1.0:1651531737.749663:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005ec1cbc3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:37d7cd70-23c8-4282-b9a2-e45fd1319801+7:438149:x1731754466814336:12345-10.240.43.64@tcp:3:md5sum.0
00000100:00100000:1.0:1651531737.750781:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005ec1cbc3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:37d7cd70-23c8-4282-b9a2-e45fd1319801+7:438149:x1731754466814336:12345-10.240.43.64@tcp:3:md5sum.0 Request processed in 1117us (1163us total) trans 0 rc 1015808/1015808
00000100:00100000:1.0:1651531737.750785:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249514
00002000:00100000:1.0:1651531737.750788:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x34510:0x0] (32768->1048575)  req@000000005ec1cbc3 x1731754466814336/t0(0) o3->37d7cd70-23c8-4282-b9a2-e45fd1319801@10.240.43.64@tcp:202/0 lens 488/440 e 0 to 0 dl 1651531747 ref 1 fl Complete:/0/0 rc 1015808/1015808 job:'md5sum.0'
00002000:00100000:1.0:1651531737.750796:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000005ec1cbc3 with x1731754466814336 ext(32768->1048575)
00002000:00010000:1.0:1651531737.750797:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000005ec1cbc3
00000100:00100000:0.0:1651531737.761857:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531737.761880:0:169267:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466814784
00000100:00100000:1.0:1651531737.761898:0:169267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11088
00000100:00100000:1.0:1651531737.761900:0:169267:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000046e76bd1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:37d7cd70-23c8-4282-b9a2-e45fd1319801+7:607799:x1731754466814784:12345-10.240.43.64@tcp:103:ldlm_bl_01.0
00010000:00010000:1.0:1651531737.761903:0:169267:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0
00010000:00010000:1.0:1651531737.761911:0:169267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca2764 lrc: 0/0,0 mode: --/PR res: [0x34510:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4428dd expref: 7 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531737.761925:0:169267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9908e14/0x3234de053ca274f lrc: 0/0,0 mode: --/PR res: [0x3450f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db442890 expref: 6 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531737.761934:0:169267:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1651531737.761949:0:169267:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000046e76bd1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:37d7cd70-23c8-4282-b9a2-e45fd1319801+5:607799:x1731754466814784:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 48us (92us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531737.761952:0:169267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11088
00000100:00100000:0.0:1651531737.774067:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531737.774089:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466815680
00000100:00100000:1.0:1651531737.774102:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44234
00000100:00100000:1.0:1651531737.774104:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006e9adaac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:37d7cd70-23c8-4282-b9a2-e45fd1319801+5:438146:x1731754466815680:12345-10.240.43.64@tcp:101:lfs.0
00010000:00010000:1.0:1651531737.774108:0:167632:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531737.774112:0:167632:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9908e14/0x3234de053ca276b lrc: 2/0,0 mode: --/PR res: [0x34510:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44291c expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651531737.774118:0:167632:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34510:0x0] initial LVB size: 1048576, mtime: 0x62705fd9, atime: 0x0, ctime: 0x62705fd9, blocks: 0x800
00010000:00010000:1.0:1651531737.774122:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531737.774123:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531737.774125:0:167632:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9908e14/0x3234de053ca276b lrc: 3/0,0 mode: PR/PR res: [0x34510:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44291c expref: 6 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531737.774130:0:167632:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e9908e14/0x3234de053ca276b lrc: 3/0,0 mode: PR/PR res: [0x34510:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44291c expref: 6 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531737.774134:0:167632:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e9908e14, rc 0)
00000100:00100000:1.0:1651531737.774149:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006e9adaac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:37d7cd70-23c8-4282-b9a2-e45fd1319801+6:438146:x1731754466815680:12345-10.240.43.64@tcp:101:lfs.0 Request processed in 44us (82us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531737.774152:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44234
00000100:00100000:0.0:1651531737.775487:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531737.775508:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466816000
00000100:00100000:1.0:1651531737.775519:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44235
00000100:00100000:1.0:1651531737.775521:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a9fc5082 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:37d7cd70-23c8-4282-b9a2-e45fd1319801+6:438146:x1731754466816000:12345-10.240.43.64@tcp:1:lfs.0
00010000:00010000:1.0:1651531737.775529:0:167632:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca2772 lrc: 3/1,0 mode: --/PR res: [0x34510:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531737.775533:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531737.775534:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531737.775535:0:167632:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca2772 lrc: 3/1,0 mode: PR/PR res: [0x34510:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531737.775539:0:167632:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca2772 lrc: 3/1,0 mode: PR/PR res: [0x34510:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531737.775545:0:167632:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca2772 lrc: 3/1,0 mode: PR/PR res: [0x34510:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531737.775548:0:167632:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca2772 lrc: 2/0,0 mode: PR/PR res: [0x34510:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531737.775571:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a9fc5082 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:37d7cd70-23c8-4282-b9a2-e45fd1319801+6:438146:x1731754466816000:12345-10.240.43.64@tcp:1:lfs.0 Request processed in 49us (84us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531737.775574:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44235
00010000:00010000:1.0:1651531737.775581:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca2772 lrc: 2/0,0 mode: PR/PR res: [0x34510:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531737.775584:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006878f48a already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531737.775585:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca2772 lrc: 2/0,0 mode: PR/PR res: [0x34510:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531737.775588:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca2772 lrc: 3/0,0 mode: PR/PR res: [0x34510:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531737.775593:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca2772 lrc: 1/0,0 mode: --/PR res: [0x34510:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531737.775595:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca2772 lrc: 0/0,0 mode: --/PR res: [0x34510:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531737.776029:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531737.776055:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466816128
00000100:00100000:1.0:1651531737.776068:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44236
00000100:00100000:1.0:1651531737.776069:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dac65852 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:37d7cd70-23c8-4282-b9a2-e45fd1319801+6:438146:x1731754466816128:12345-10.240.43.64@tcp:23:lfs.0
00000100:00100000:1.0:1651531737.776109:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dac65852 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:37d7cd70-23c8-4282-b9a2-e45fd1319801+6:438146:x1731754466816128:12345-10.240.43.64@tcp:23:lfs.0 Request processed in 38us (80us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531737.776112:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44236
00000100:00100000:0.0:1651531737.776802:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531737.776819:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466816320
00000100:00100000:1.0:1651531737.776834:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249515
00000100:00100000:1.0:1651531737.776836:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b9b10d48 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:37d7cd70-23c8-4282-b9a2-e45fd1319801+6:438146:x1731754466816320:12345-10.240.43.64@tcp:3:lfs.0
00010000:00010000:1.0:1651531737.776842:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca2779 lrc: 3/1,0 mode: --/PR res: [0x34510:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531737.776846:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531737.776847:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531737.776848:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca2779 lrc: 3/1,0 mode: PR/PR res: [0x34510:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531737.776852:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca2779 lrc: 3/1,0 mode: PR/PR res: [0x34510:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531737.777611:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca2779 lrc: 3/1,0 mode: PR/PR res: [0x34510:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531737.777615:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca2779 lrc: 2/0,0 mode: PR/PR res: [0x34510:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531737.777647:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b9b10d48 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:37d7cd70-23c8-4282-b9a2-e45fd1319801+6:438146:x1731754466816320:12345-10.240.43.64@tcp:3:lfs.0 Request processed in 810us (846us total) trans 0 rc 1048576/1048576
00000100:00100000:1.0:1651531737.777651:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249515
00010000:00010000:1.0:1651531737.777658:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca2779 lrc: 2/0,0 mode: PR/PR res: [0x34510:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531737.777662:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000077fc7eeb already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531737.777663:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca2779 lrc: 2/0,0 mode: PR/PR res: [0x34510:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531737.777680:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca2779 lrc: 3/0,0 mode: PR/PR res: [0x34510:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531737.777685:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca2779 lrc: 1/0,0 mode: --/PR res: [0x34510:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531737.777687:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca2779 lrc: 0/0,0 mode: --/PR res: [0x34510:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531737.880341:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651531737.880373:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951133888
00000100:00100000:1.0:1651531737.880390:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 44237
00000100:00100000:1.0:1651531737.880392:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c62d1815 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951133888:12345-10.240.43.61@tcp:6:osp-syn-1-0.0
00002000:00080000:1.0:1651531737.880401:0:167632:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:214286 count 1
00002000:00010000:1.0:1651531737.880422:0:167632:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x3450e:0x0] initial LVB size: 1048576, mtime: 0x62705fd7, atime: 0x62705fd7, ctime: 0x62705fd7, blocks: 0x800
00010000:00010000:1.0:1651531737.880425:0:167632:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca2780 lrc: 3/0,1 mode: --/PW res: [0x3450e:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531737.880429:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531737.880430:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531737.880431:0:167632:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca2780 lrc: 3/0,1 mode: PW/PW res: [0x3450e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531737.880436:0:167632:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca2780 lrc: 3/0,1 mode: PW/PW res: [0x3450e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531737.880439:0:167632:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca2780 lrc: 3/0,1 mode: PW/PW res: [0x3450e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531737.880447:0:167632:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca2780 lrc: 2/0,0 mode: PW/PW res: [0x3450e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531737.880740:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c62d1815 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745951133888:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 347us (401us total) trans 21474869013 rc 0/0
00000100:00100000:1.0:1651531737.880744:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 44237
00010000:00010000:1.0:1651531737.880753:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca2780 lrc: 2/0,0 mode: PW/PW res: [0x3450e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531737.880757:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000077fc7eeb already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531737.880758:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca2780 lrc: 2/0,0 mode: PW/PW res: [0x3450e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531737.880761:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca2780 lrc: 3/0,0 mode: PW/PW res: [0x3450e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531737.880767:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca2780 lrc: 1/0,0 mode: --/PW res: [0x3450e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531737.880770:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca2780 lrc: 0/0,0 mode: --/PW res: [0x3450e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531737.882598:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531737.882615:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466816960
00000100:00100000:1.0:1651531737.882632:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249516
00000100:00100000:1.0:1651531737.882634:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000071f9ee43 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:37d7cd70-23c8-4282-b9a2-e45fd1319801+6:438146:x1731754466816960:12345-10.240.43.64@tcp:4:lfs.0
00002000:00010000:1.0:1651531737.882650:0:216321:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34511:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:1.0:1651531737.882658:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca2787 lrc: 3/0,1 mode: --/PW res: [0x34511:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531737.882662:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531737.882663:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531737.882664:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca2787 lrc: 3/0,1 mode: PW/PW res: [0x34511:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531737.882667:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca2787 lrc: 3/0,1 mode: PW/PW res: [0x34511:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651531737.954579:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869014 is committed
00000001:00080000:1.0:1651531737.954583:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869013 is committed
00002000:00010000:1.0:1651531737.954607:0:216321:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x34511:0x0] updating lvb size from disk: 0 -> 1048576
00002000:00010000:1.0:1651531737.954609:0:216321:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x34511:0x0] updating lvb mtime from disk: 0 -> 1651531737
00002000:00010000:1.0:1651531737.954610:0:216321:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x34511:0x0] updating lvb ctime from disk: 0 -> 1651531737
00002000:00010000:1.0:1651531737.954610:0:216321:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x34511:0x0] updating lvb blocks from disk: 0 -> 2048
00010000:00010000:1.0:1651531737.954613:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca2787 lrc: 3/0,1 mode: PW/PW res: [0x34511:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531737.954618:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca2787 lrc: 2/0,0 mode: PW/PW res: [0x34511:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531737.954643:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000071f9ee43 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:37d7cd70-23c8-4282-b9a2-e45fd1319801+6:438146:x1731754466816960:12345-10.240.43.64@tcp:4:lfs.0 Request processed in 72008us (72046us total) trans 21474869014 rc 0/0
00000100:00100000:1.0:1651531737.954647:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249516
00010000:00010000:1.0:1651531737.954656:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca2787 lrc: 2/0,0 mode: PW/PW res: [0x34511:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531737.954659:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006878f48a already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531737.954662:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca2787 lrc: 2/0,0 mode: PW/PW res: [0x34511:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531737.954665:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca2787 lrc: 3/0,0 mode: PW/PW res: [0x34511:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531737.954670:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca2787 lrc: 1/0,0 mode: --/PW res: [0x34511:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531737.954673:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca2787 lrc: 0/0,0 mode: --/PW res: [0x34511:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531737.955400:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531737.955419:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466817216
00000100:00100000:1.0:1651531737.955433:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44238
00000100:00100000:1.0:1651531737.955435:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000670433b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:37d7cd70-23c8-4282-b9a2-e45fd1319801+6:438147:x1731754466817216:12345-10.240.43.64@tcp:16:lfs.0
00000100:00100000:1.0:1651531737.955458:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000670433b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:37d7cd70-23c8-4282-b9a2-e45fd1319801+6:438147:x1731754466817216:12345-10.240.43.64@tcp:16:lfs.0 Request processed in 22us (59us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531737.955461:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44238
00000100:00100000:0.0:1651531737.955736:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531737.955753:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466817280
00000100:00100000:1.0:1651531737.955765:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44239
00000100:00100000:1.0:1651531737.955767:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fb90eb28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:37d7cd70-23c8-4282-b9a2-e45fd1319801+6:438147:x1731754466817280:12345-10.240.43.64@tcp:1:lfs.0
00010000:00010000:1.0:1651531737.955774:0:167632:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca278e lrc: 3/1,0 mode: --/PR res: [0x34510:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531737.955778:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531737.955779:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531737.955780:0:167632:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca278e lrc: 3/1,0 mode: PR/PR res: [0x34510:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531737.955788:0:167632:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca278e lrc: 3/1,0 mode: PR/PR res: [0x34510:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531737.955794:0:167632:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca278e lrc: 3/1,0 mode: PR/PR res: [0x34510:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531737.955796:0:167632:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca278e lrc: 2/0,0 mode: PR/PR res: [0x34510:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531737.955817:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fb90eb28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:37d7cd70-23c8-4282-b9a2-e45fd1319801+6:438147:x1731754466817280:12345-10.240.43.64@tcp:1:lfs.0 Request processed in 50us (81us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531737.955820:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44239
00010000:00010000:1.0:1651531737.955827:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca278e lrc: 2/0,0 mode: PR/PR res: [0x34510:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531737.955831:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000077fc7eeb already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531737.955832:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca278e lrc: 2/0,0 mode: PR/PR res: [0x34510:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531737.955835:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca278e lrc: 3/0,0 mode: PR/PR res: [0x34510:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531737.955839:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca278e lrc: 1/0,0 mode: --/PR res: [0x34510:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531737.955841:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca278e lrc: 0/0,0 mode: --/PR res: [0x34510:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531737.956772:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531737.956789:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466817664
00000100:00100000:1.0:1651531737.956801:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44240
00000100:00100000:1.0:1651531737.956803:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dccc50c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:37d7cd70-23c8-4282-b9a2-e45fd1319801+6:438147:x1731754466817664:12345-10.240.43.64@tcp:2:lfs.0
00000100:00100000:1.0:1651531737.956843:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dccc50c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:37d7cd70-23c8-4282-b9a2-e45fd1319801+7:438147:x1731754466817664:12345-10.240.43.64@tcp:2:lfs.0 Request processed in 39us (72us total) trans 21474869015 rc 0/0
00000100:00100000:1.0:1651531737.956846:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44240
00000100:00100000:0.0:1651531737.958821:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651531737.958851:0:166122:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951134272
00000100:00100000:1.0:1651531737.958878:0:166122:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 30
00000100:00100000:1.0:1651531737.958880:0:166122:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007fa3b3da pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:320760:x1731745951134272:12345-10.240.43.61@tcp:1000:mdt_rdpg00_002.0
00000100:00100000:1.0:1651531737.958906:0:166122:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007fa3b3da pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:320760:x1731745951134272:12345-10.240.43.61@tcp:1000:mdt_rdpg00_002.0 Request processed in 26us (86us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531737.958910:0:166122:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 30
00000100:00100000:0.0:1651531737.959586:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651531737.959607:0:192975:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951134464
00000100:00100000:1.0:1651531737.959615:0:192975:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 31
00000100:00100000:1.0:1651531737.959617:0:192975:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007d0a1d09 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:320760:x1731745951134464:12345-10.240.43.61@tcp:1000:mdt_rdpg00_002.0
00000100:00100000:1.0:1651531737.959640:0:192975:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007d0a1d09 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:320760:x1731745951134464:12345-10.240.43.61@tcp:1000:mdt_rdpg00_002.0 Request processed in 22us (55us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531737.959643:0:192975:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 31
00000100:00100000:0.0:1651531737.960095:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651531737.960112:0:166122:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951134592
00000100:00100000:1.0:1651531737.960119:0:166122:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 32
00000100:00100000:1.0:1651531737.960120:0:166122:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000031ab4acd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:320760:x1731745951134592:12345-10.240.43.61@tcp:1000:mdt_rdpg00_002.0
00000100:00100000:1.0:1651531737.960160:0:166122:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000031ab4acd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:320760:x1731745951134592:12345-10.240.43.61@tcp:1000:mdt_rdpg00_002.0 Request processed in 38us (65us total) trans 21474869016 rc 0/0
00000100:00100000:1.0:1651531737.960176:0:166122:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 32
00000100:00100000:0.0:1651531737.963599:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531737.963616:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466818944
00000100:00100000:1.0:1651531737.963629:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44241
00000100:00100000:1.0:1651531737.963631:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008270c7c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:37d7cd70-23c8-4282-b9a2-e45fd1319801+7:438147:x1731754466818944:12345-10.240.43.64@tcp:1:lfs.0
00010000:00010000:1.0:1651531737.963639:0:167632:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca2795 lrc: 3/0,1 mode: --/PW res: [0x34510:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531737.963645:0:167632:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e9908e14/0x3234de053ca276b lrc: 2/0,0 mode: PR/PR res: [0x34510:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44291c expref: 7 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531737.963648:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531737.963649:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531737.963650:0:167632:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca2795 lrc: 4/0,1 mode: --/PW res: [0x34510:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531737.963661:0:167632:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e9908e14/0x3234de053ca276b lrc: 3/0,0 mode: PR/PR res: [0x34510:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44291c expref: 7 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531737.963667:0:167632:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e9908e14/0x3234de053ca276b lrc: 4/0,0 mode: PR/PR res: [0x34510:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44291c expref: 7 pid: 167632 timeout: 22546 lvb_type: 1
00000100:00100000:1.0:1651531737.963673:0:167632:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b10bc064 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:167632:1731745997341568:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531737.963694:0:167632:0:(client.c:2492:ptlrpc_set_wait()) set 000000004b59914c going to sleep for 6 seconds
00000100:00100000:0.0:1651531737.963943:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531737.963956:0:167632:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b10bc064 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:167632:1731745997341568:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651531737.963962:0:167632:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca2795 lrc: 3/0,1 mode: --/PW res: [0x34510:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531737.963983:0:166103:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466819136
00010000:00010000:1.0:1651531737.963988:0:166103:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e9908e14/0x3234de053ca276b lrc: 4/0,0 mode: PR/PR res: [0x34510:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44291c expref: 8 pid: 167632 timeout: 22546 lvb_type: 1
00000100:00100000:1.0:1651531737.963997:0:166103:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 74
00000100:00100000:1.0:1651531737.963999:0:166103:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b67ad021 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:37d7cd70-23c8-4282-b9a2-e45fd1319801+8:438146:x1731754466819136:12345-10.240.43.64@tcp:103:ldlm_bl_01.0
00010000:00010000:1.0:1651531737.964002:0:166103:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1651531737.964007:0:166103:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e9908e14/0x3234de053ca276b lrc: 4/0,0 mode: PR/PR res: [0x34510:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44291c expref: 8 pid: 167632 timeout: 22546 lvb_type: 1
00010000:00010000:1.0:1651531737.964011:0:166103:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e9908e14/0x3234de053ca276b lrc: 3/0,0 mode: PR/PR res: [0x34510:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44291c expref: 8 pid: 167632 timeout: 22546 lvb_type: 1
00010000:00010000:1.0:1651531737.964017:0:166103:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9908e14/0x3234de053ca276b lrc: 0/0,0 mode: --/PR res: [0x34510:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44291c expref: 8 pid: 167632 timeout: 22546 lvb_type: 1
00010000:00010000:1.0:1651531737.964020:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531737.964021:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531737.964022:0:166103:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca2795 lrc: 3/0,1 mode: PW/PW res: [0x34510:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531737.964025:0:166103:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca2795 lrc: 4/0,1 mode: PW/PW res: [0x34510:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531737.964032:0:166103:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1651531737.964062:0:166103:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b67ad021 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:37d7cd70-23c8-4282-b9a2-e45fd1319801+7:438146:x1731754466819136:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 62us (119us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531737.964067:0:166103:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 74
00010000:00010000:1.0:1651531737.964076:0:167632:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca2795 lrc: 3/0,1 mode: PW/PW res: [0x34510:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531737.964079:0:167632:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca2795 lrc: 3/0,1 mode: PW/PW res: [0x34510:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531737.964085:0:167632:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca2795 lrc: 3/0,1 mode: PW/PW res: [0x34510:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531737.964088:0:167632:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca2795 lrc: 2/0,0 mode: PW/PW res: [0x34510:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531737.964117:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008270c7c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:37d7cd70-23c8-4282-b9a2-e45fd1319801+6:438147:x1731754466818944:12345-10.240.43.64@tcp:1:lfs.0 Request processed in 485us (518us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531737.964120:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44241
00010000:00010000:1.0:1651531737.964179:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca2795 lrc: 2/0,0 mode: PW/PW res: [0x34510:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531737.964184:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006878f48a already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531737.964185:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca2795 lrc: 2/0,0 mode: PW/PW res: [0x34510:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531737.964188:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca2795 lrc: 3/0,0 mode: PW/PW res: [0x34510:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531737.964193:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca2795 lrc: 1/0,0 mode: --/PW res: [0x34510:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531737.964197:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca2795 lrc: 0/0,0 mode: --/PW res: [0x34510:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531737.995984:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651531737.995997:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651531737.996006:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951134912
00000100:00100000:1.0:1651531737.996008:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951134976
00000100:00100000:1.0:1651531737.996027:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 44242
00000100:00100000:1.0:1651531737.996029:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e4e3ecb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745951134912:12345-10.240.43.61@tcp:2:osp-syn-1-0.0
00000100:00100000:0.0:1651531737.996032:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 44243
00000100:00100000:0.0:1651531737.996034:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dce6a2c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745951134976:12345-10.240.43.61@tcp:2:osp-syn-1-0.0
00000100:00100000:1.0:1651531737.996076:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e4e3ecb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:39030:x1731745951134912:12345-10.240.43.61@tcp:2:osp-syn-1-0.0 Request processed in 47us (93us total) trans 21474869017 rc 0/0
00000100:00100000:1.0:1651531737.996080:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 44242
00000100:00100000:0.0:1651531737.996097:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dce6a2c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:39030:x1731745951134976:12345-10.240.43.61@tcp:2:osp-syn-1-0.0 Request processed in 62us (100us total) trans 21474869018 rc 0/0
00000100:00100000:0.0:1651531737.996104:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 44243
00000100:00100000:0.0:1651531737.996367:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651531737.996382:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651531737.996395:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951135168
00000100:00100000:0.0:1651531737.996404:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951135232
00000100:00100000:0.0:1651531737.996411:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 44244
00000100:00100000:0.0:1651531737.996413:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009078ca7d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:39030:x1731745951135168:12345-10.240.43.61@tcp:2:osp-syn-1-0.0
00000100:00100000:1.0:1651531737.996417:0:191990:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 44245
00000100:00100000:1.0:1651531737.996420:0:191990:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002d3e5ae4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+9:39029:x1731745951135232:12345-10.240.43.61@tcp:2:osp-syn-1-0.0
00000100:00100000:0.0:1651531737.996449:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009078ca7d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+10:39030:x1731745951135168:12345-10.240.43.61@tcp:2:osp-syn-1-0.0 Request processed in 34us (82us total) trans 21474869019 rc 0/0
00000100:00100000:0.0:1651531737.996452:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 44244
00000100:00100000:1.0:1651531737.996470:0:191990:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002d3e5ae4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+10:39029:x1731745951135232:12345-10.240.43.61@tcp:2:osp-syn-1-0.0 Request processed in 50us (95us total) trans 21474869020 rc 0/0
00000100:00100000:1.0:1651531737.996474:0:191990:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 44245
00000100:00100000:0.0:1651531737.996757:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531737.996779:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466819456
00000100:00100000:1.0:1651531737.996788:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44246
00000100:00100000:1.0:1651531737.996790:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000028779db6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:37d7cd70-23c8-4282-b9a2-e45fd1319801+6:659181:x1731754466819456:12345-10.240.43.64@tcp:101:lfs.0
00010000:00010000:1.0:1651531737.996793:0:167632:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531737.996797:0:167632:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca279c lrc: 2/0,0 mode: --/PR res: [0x34510:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db442970 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651531737.996803:0:167632:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34510:0x0] initial LVB size: 1048576, mtime: 0x62705fd9, atime: 0x0, ctime: 0x62705fd9, blocks: 0x800
00010000:00010000:1.0:1651531737.996808:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531737.996808:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531737.996811:0:167632:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca279c lrc: 3/0,0 mode: PR/PR res: [0x34510:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db442970 expref: 7 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531737.996816:0:167632:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca279c lrc: 3/0,0 mode: PR/PR res: [0x34510:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db442970 expref: 7 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531737.996820:0:167632:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006878f48a, rc 0)
00000100:00100000:1.0:1651531737.996831:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000028779db6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:37d7cd70-23c8-4282-b9a2-e45fd1319801+7:659181:x1731754466819456:12345-10.240.43.64@tcp:101:lfs.0 Request processed in 41us (74us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531737.996834:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44246
00000100:00100000:0.0:1651531737.997352:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531737.997374:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466819584
00000100:00100000:1.0:1651531737.997391:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44247
00000100:00100000:1.0:1651531737.997393:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000add44b2e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:37d7cd70-23c8-4282-b9a2-e45fd1319801+7:438146:x1731754466819584:12345-10.240.43.64@tcp:23:lfs.0
00000100:00100000:1.0:1651531737.997415:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000add44b2e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:37d7cd70-23c8-4282-b9a2-e45fd1319801+7:438146:x1731754466819584:12345-10.240.43.64@tcp:23:lfs.0 Request processed in 22us (64us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531737.997418:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44247
00000100:00100000:0.0:1651531737.997696:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531737.997718:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466819712
00000100:00100000:1.0:1651531737.997726:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44248
00000100:00100000:1.0:1651531737.997728:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000670433b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:37d7cd70-23c8-4282-b9a2-e45fd1319801+7:438146:x1731754466819712:12345-10.240.43.64@tcp:23:lfs.0
00000100:00100000:1.0:1651531737.997746:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000670433b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:37d7cd70-23c8-4282-b9a2-e45fd1319801+7:438146:x1731754466819712:12345-10.240.43.64@tcp:23:lfs.0 Request processed in 17us (50us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531737.997749:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44248
00000100:00100000:0.0:1651531737.998396:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531737.998419:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466819904
00000100:00100000:1.0:1651531737.998434:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249517
00000100:00100000:1.0:1651531737.998442:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fb90eb28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:37d7cd70-23c8-4282-b9a2-e45fd1319801+7:438146:x1731754466819904:12345-10.240.43.64@tcp:3:lfs.0
00010000:00010000:1.0:1651531737.998450:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e9908e14/0x3234de053ca27a3 lrc: 3/1,0 mode: --/PR res: [0x34510:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531737.998456:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531737.998456:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531737.998457:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9908e14/0x3234de053ca27a3 lrc: 3/1,0 mode: PR/PR res: [0x34510:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531737.998461:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9908e14/0x3234de053ca27a3 lrc: 3/1,0 mode: PR/PR res: [0x34510:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531737.999157:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e9908e14/0x3234de053ca27a3 lrc: 3/1,0 mode: PR/PR res: [0x34510:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531737.999161:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e9908e14/0x3234de053ca27a3 lrc: 2/0,0 mode: PR/PR res: [0x34510:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531737.999178:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fb90eb28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:37d7cd70-23c8-4282-b9a2-e45fd1319801+7:438146:x1731754466819904:12345-10.240.43.64@tcp:3:lfs.0 Request processed in 741us (782us total) trans 0 rc 1048576/1048576
00000100:00100000:1.0:1651531737.999182:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249517
00010000:00010000:1.0:1651531737.999188:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e9908e14/0x3234de053ca27a3 lrc: 2/0,0 mode: PR/PR res: [0x34510:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531737.999192:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e9908e14 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531737.999193:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9908e14/0x3234de053ca27a3 lrc: 2/0,0 mode: PR/PR res: [0x34510:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531737.999195:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9908e14/0x3234de053ca27a3 lrc: 3/0,0 mode: PR/PR res: [0x34510:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531737.999200:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e9908e14/0x3234de053ca27a3 lrc: 1/0,0 mode: --/PR res: [0x34510:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531737.999205:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9908e14/0x3234de053ca27a3 lrc: 0/0,0 mode: --/PR res: [0x34510:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531738.119409:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531738.119433:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466820352
00000100:00100000:1.0:1651531738.119445:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44249
00000100:00100000:1.0:1651531738.119447:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dccc50c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:37d7cd70-23c8-4282-b9a2-e45fd1319801+7:659181:x1731754466820352:12345-10.240.43.64@tcp:101:lfs.0
00010000:00010000:1.0:1651531738.119452:0:206699:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531738.119457:0:206699:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9908e14/0x3234de053ca27aa lrc: 2/0,0 mode: --/PW res: [0x34510:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db442985 expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531738.119465:0:206699:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca279c lrc: 2/0,0 mode: PR/PR res: [0x34510:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db442970 expref: 8 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531738.119469:0:206699:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531738.119469:0:206699:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531738.119471:0:206699:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9908e14/0x3234de053ca27aa lrc: 4/0,0 mode: --/PW res: [0x34510:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db442985 expref: 8 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531738.119478:0:206699:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca279c lrc: 3/0,0 mode: PR/PR res: [0x34510:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db442970 expref: 8 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531738.119482:0:206699:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca279c lrc: 4/0,0 mode: PR/PR res: [0x34510:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db442970 expref: 8 pid: 167632 timeout: 22546 lvb_type: 0
00000100:00100000:1.0:1651531738.119487:0:206699:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b10bc064 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:206699:1731745997341632:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531738.119502:0:206699:0:(client.c:2492:ptlrpc_set_wait()) set 000000003176d4e8 going to sleep for 6 seconds
00000100:00100000:0.0:1651531738.119760:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531738.119769:0:169267:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466820416
00010000:00010000:1.0:1651531738.119775:0:169267:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca279c lrc: 5/0,0 mode: PR/PR res: [0x34510:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db442970 expref: 9 pid: 167632 timeout: 22546 lvb_type: 0
00000100:00100000:1.0:1651531738.119784:0:169267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 75
00000100:00100000:1.0:1651531738.119786:0:169267:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000beeec7c7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:37d7cd70-23c8-4282-b9a2-e45fd1319801+9:438147:x1731754466820416:12345-10.240.43.64@tcp:103:ldlm_bl_01.0
00010000:00010000:1.0:1651531738.119789:0:169267:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1651531738.119794:0:169267:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca279c lrc: 5/0,0 mode: PR/PR res: [0x34510:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db442970 expref: 9 pid: 167632 timeout: 22546 lvb_type: 0
00010000:00010000:1.0:1651531738.119798:0:169267:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca279c lrc: 4/0,0 mode: PR/PR res: [0x34510:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db442970 expref: 9 pid: 167632 timeout: 22546 lvb_type: 0
00010000:00010000:1.0:1651531738.119804:0:169267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531738.119804:0:169267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531738.119806:0:169267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e9908e14/0x3234de053ca27aa lrc: 3/0,0 mode: PW/PW res: [0x34510:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db442985 expref: 9 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531738.119809:0:169267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9908e14/0x3234de053ca27aa lrc: 4/0,0 mode: PW/PW res: [0x34510:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db442985 expref: 9 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531738.119827:0:169267:0:(ldlm_lockd.c:1067:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000e9908e14/0x3234de053ca27aa lrc: 4/0,0 mode: PW/PW res: [0x34510:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db442985 expref: 9 pid: 206699 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531738.119831:0:169267:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008b42dfe9 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:169267:1731745997341696:10.240.43.64@tcp:105:
00000100:00100000:1.0:1651531738.119845:0:169267:0:(client.c:2492:ptlrpc_set_wait()) set 0000000030e02371 going to sleep for 6 seconds
00010000:00010000:1.0:1651531738.119853:0:206699:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca279c lrc: 0/0,0 mode: --/PR res: [0x34510:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db442970 expref: 9 pid: 167632 timeout: 22546 lvb_type: 0
00000100:00100000:1.0:1651531738.119859:0:206699:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b10bc064 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:206699:1731745997341632:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651531738.119864:0:206699:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e9908e14/0x3234de053ca27aa lrc: 4/0,0 mode: PW/PW res: [0x34510:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db442985 expref: 8 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531738.119868:0:206699:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e9908e14, rc 0)
00000100:00100000:1.0:1651531738.119874:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dccc50c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:37d7cd70-23c8-4282-b9a2-e45fd1319801+8:659181:x1731754466820352:12345-10.240.43.64@tcp:101:lfs.0 Request processed in 427us (466us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531738.119878:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44249
00000100:00100000:1.0:1651531738.120107:0:169267:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008b42dfe9 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:169267:1731745997341696:10.240.43.64@tcp:105:
00010000:00010000:1.0:1651531738.120111:0:169267:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1651531738.120120:0:169267:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000beeec7c7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:37d7cd70-23c8-4282-b9a2-e45fd1319801+7:438147:x1731754466820416:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 334us (361us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531738.120123:0:169267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 75
00000100:00100000:0.0:1651531738.120982:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531738.120999:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466820608
00000100:00100000:1.0:1651531738.121007:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44250
00000100:00100000:1.0:1651531738.121009:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b67ad021 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:37d7cd70-23c8-4282-b9a2-e45fd1319801+7:438147:x1731754466820608:12345-10.240.43.64@tcp:2:lfs.0
00002000:00010000:1.0:1651531738.121051:0:206699:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x34510:0x0] updating lvb size from disk: 1048576 -> 1048576
00002000:00010000:1.0:1651531738.121052:0:206699:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x34510:0x0] updating lvb mtime from disk: 1651531737 -> 1651531737
00002000:00010000:1.0:1651531738.121053:0:206699:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x34510:0x0] updating lvb atime from disk: 0 -> 1651531737
00002000:00010000:1.0:1651531738.121054:0:206699:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x34510:0x0] updating lvb ctime from disk: 1651531737 -> 1651531738
00002000:00010000:1.0:1651531738.121055:0:206699:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x34510:0x0] updating lvb blocks from disk: 2048 -> 2048
00000100:00100000:1.0:1651531738.121067:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b67ad021 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:37d7cd70-23c8-4282-b9a2-e45fd1319801+8:438147:x1731754466820608:12345-10.240.43.64@tcp:2:lfs.0 Request processed in 57us (86us total) trans 21474869021 rc 0/0
00000100:00100000:1.0:1651531738.121073:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44250
00000100:00100000:0.0:1651531738.159815:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651531738.159833:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651531738.159844:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951135680
00000100:00100000:1.0:1651531738.159853:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951135616
00000100:00100000:1.0:1651531738.159863:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 44251
00000100:00100000:1.0:1651531738.159865:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007d76765b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+11:39029:x1731745951135680:12345-10.240.43.61@tcp:2:osp-syn-1-0.0
00000100:00100000:0.0:1651531738.159874:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 44252
00000100:00100000:0.0:1651531738.159877:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009c93d7f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+11:39030:x1731745951135616:12345-10.240.43.61@tcp:2:osp-syn-1-0.0
00000100:00100000:1.0:1651531738.159899:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007d76765b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:39029:x1731745951135680:12345-10.240.43.61@tcp:2:osp-syn-1-0.0 Request processed in 34us (85us total) trans 21474869022 rc 0/0
00000100:00100000:1.0:1651531738.159903:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 44251
00002000:00010000:0.0:1651531738.159905:0:166112:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x34510:0x0] updating lvb size from disk: 1048576 -> 1048576
00002000:00010000:0.0:1651531738.159906:0:166112:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x34510:0x0] updating lvb mtime from disk: 1651531737 -> 1651531737
00002000:00010000:0.0:1651531738.159907:0:166112:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x34510:0x0] updating lvb atime from disk: 1651531737 -> 1651531737
00002000:00010000:0.0:1651531738.159908:0:166112:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x34510:0x0] updating lvb ctime from disk: 1651531738 -> 1651531738
00002000:00010000:0.0:1651531738.159910:0:166112:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x34510:0x0] updating lvb blocks from disk: 2048 -> 2048
00000100:00100000:0.0:1651531738.159922:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009c93d7f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:39030:x1731745951135616:12345-10.240.43.61@tcp:2:osp-syn-1-0.0 Request processed in 45us (93us total) trans 21474869023 rc 0/0
00000100:00100000:0.0:1651531738.159925:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 44252
00000100:00100000:0.0:1651531738.164087:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651531738.164110:0:192975:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951136000
00000100:00100000:1.0:1651531738.164120:0:192975:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 33
00000100:00100000:1.0:1651531738.164121:0:192975:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009d2316f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+12:320760:x1731745951136000:12345-10.240.43.61@tcp:1000:mdt_rdpg00_002.0
00000100:00100000:1.0:1651531738.164141:0:192975:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009d2316f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+12:320760:x1731745951136000:12345-10.240.43.61@tcp:1000:mdt_rdpg00_002.0 Request processed in 18us (54us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531738.164144:0:192975:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 33
00000100:00100000:0.0:1651531738.164368:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651531738.164395:0:166122:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951136064
00000100:00100000:1.0:1651531738.164403:0:166122:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 34
00000100:00100000:1.0:1651531738.164404:0:166122:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008cea90b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+12:320760:x1731745951136064:12345-10.240.43.61@tcp:1000:mdt_rdpg00_002.0
00000100:00100000:1.0:1651531738.164433:0:166122:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008cea90b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+13:320760:x1731745951136064:12345-10.240.43.61@tcp:1000:mdt_rdpg00_002.0 Request processed in 28us (65us total) trans 21474869024 rc 0/0
00000100:00100000:1.0:1651531738.164436:0:166122:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 34
00000100:00100000:0.0:1651531738.176199:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531738.176229:0:169267:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466822976
00000100:00100000:1.0:1651531738.176240:0:169267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11089
00000100:00100000:1.0:1651531738.176241:0:169267:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008f58a6d8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:37d7cd70-23c8-4282-b9a2-e45fd1319801+8:607799:x1731754466822976:12345-10.240.43.64@tcp:103:ldlm_bl_01.0
00010000:00010000:1.0:1651531738.176245:0:169267:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1651531738.176261:0:169267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9908e14/0x3234de053ca27aa lrc: 0/0,0 mode: --/PW res: [0x34510:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db442985 expref: 8 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531738.176267:0:169267:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1651531738.176277:0:169267:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008f58a6d8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:37d7cd70-23c8-4282-b9a2-e45fd1319801+7:607799:x1731754466822976:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 36us (79us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531738.176280:0:169267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11089
00000100:00100000:0.0:1651531738.186062:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531738.186070:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466823424
00000100:00100000:0.0:1651531738.186084:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44253
00000100:00100000:0.0:1651531738.186086:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004d249e37 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:37d7cd70-23c8-4282-b9a2-e45fd1319801+7:438146:x1731754466823424:12345-10.240.43.64@tcp:101:md5sum.0
00010000:00010000:0.0:1651531738.186090:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531738.186107:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e5cdccc8/0x3234de053ca27b1 lrc: 2/0,0 mode: --/PR res: [0x34511:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4429e7 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00002000:00010000:0.0:1651531738.186114:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34511:0x0] initial LVB size: 1048576, mtime: 0x62705fd9, atime: 0x62705fd9, ctime: 0x62705fd9, blocks: 0x800
00010000:00010000:0.0:1651531738.186119:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531738.186120:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531738.186123:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e5cdccc8/0x3234de053ca27b1 lrc: 3/0,0 mode: PR/PR res: [0x34511:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4429e7 expref: 8 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531738.186133:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e5cdccc8/0x3234de053ca27b1 lrc: 3/0,0 mode: PR/PR res: [0x34511:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4429e7 expref: 8 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531738.186138:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e5cdccc8, rc 0)
00000100:00100000:0.0:1651531738.186158:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004d249e37 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:37d7cd70-23c8-4282-b9a2-e45fd1319801+8:438146:x1731754466823424:12345-10.240.43.64@tcp:101:md5sum.0 Request processed in 67us (92us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531738.186165:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44253
00000100:00100000:0.0:1651531738.188188:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531738.188211:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466823808
00002000:00100000:1.0:1651531738.188220:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x34511:0x0] (0->1048575)  req@000000000df1eb0d x1731754466823808/t0(0) o3->37d7cd70-23c8-4282-b9a2-e45fd1319801@10.240.43.64@tcp:203/0 lens 488/0 e 0 to 0 dl 1651531748 ref 1 fl New:/0/ffffffff rc 0/-1 job:'md5sum.0'
00002000:00100000:1.0:1651531738.188235:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000000df1eb0d with x1731754466823808 ext(0->1048575)
00002000:00010000:1.0:1651531738.188236:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000000df1eb0d
00000100:00100000:1.0:1651531738.188246:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249518
00000100:00100000:1.0:1651531738.188248:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000df1eb0d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:37d7cd70-23c8-4282-b9a2-e45fd1319801+8:438146:x1731754466823808:12345-10.240.43.64@tcp:3:md5sum.0
00000100:00100000:1.0:1651531738.188990:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000df1eb0d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:37d7cd70-23c8-4282-b9a2-e45fd1319801+8:438146:x1731754466823808:12345-10.240.43.64@tcp:3:md5sum.0 Request processed in 740us (802us total) trans 0 rc 1048576/1048576
00000100:00100000:1.0:1651531738.188994:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249518
00002000:00100000:1.0:1651531738.188997:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x34511:0x0] (0->1048575)  req@000000000df1eb0d x1731754466823808/t0(0) o3->37d7cd70-23c8-4282-b9a2-e45fd1319801@10.240.43.64@tcp:203/0 lens 488/440 e 0 to 0 dl 1651531748 ref 1 fl Complete:/0/0 rc 1048576/1048576 job:'md5sum.0'
00002000:00100000:1.0:1651531738.189000:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000000df1eb0d with x1731754466823808 ext(0->1048575)
00002000:00010000:1.0:1651531738.189002:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000000df1eb0d
00000100:00100000:0.0:1651531739.773326:0:39099:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008b42dfe9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9063caa-b124-4cb6-99ef-d01a735595c3:39099:1731745997341760:10.240.43.61@tcp:400:kworker/u4:1.0
00000100:00100000:1.0:1651531739.773350:0:39100:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b10bc064 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:39100:1731745997341824:10.240.43.61@tcp:400:kworker/u4:1.0
00000100:00100000:0.0:1651531739.773761:0:39099:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008b42dfe9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9063caa-b124-4cb6-99ef-d01a735595c3:39099:1731745997341760:10.240.43.61@tcp:400:kworker/u4:1.0
00000100:00100000:1.0:1651531739.773764:0:39100:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b10bc064 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:39100:1731745997341824:10.240.43.61@tcp:400:kworker/u4:1.0
00000400:00000080:1.0:1651531740.020676:0:225493:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648
00000001:02000400:1.0:1651531740.020679:0:225493:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 273a: DoM: layout swapping should fail with DOM ========================================================== 22:48:59 (1651531739)
00000100:00100000:1.0:1651531740.051176:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651531740.051194:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951136256
00000100:00100000:1.0:1651531740.051213:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 44254
00000100:00100000:1.0:1651531740.051216:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b10bc064 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:318354:x1731745951136256:12345-10.240.43.61@tcp:5:osp-pre-1-0.0
00002000:00080000:1.0:1651531740.051255:0:166112:0:(ofd_dev.c:1706:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x0 at 214306
00000100:00100000:1.0:1651531740.052037:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b10bc064 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:318354:x1731745951136256:12345-10.240.43.61@tcp:5:osp-pre-1-0.0 Request processed in 820us (863us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531740.052052:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 44254
00000100:00100000:1.0:1651531740.063018:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531740.063027:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466825792
00000100:00100000:1.0:1651531740.063036:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44255
00000100:00100000:1.0:1651531740.063038:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000099b6616a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:37d7cd70-23c8-4282-b9a2-e45fd1319801+8:438146:x1731754466825792:12345-10.240.43.64@tcp:101:lfs.0
00010000:00010000:1.0:1651531740.063052:0:206699:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531740.063063:0:206699:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9908e14/0x3234de053ca27b8 lrc: 2/0,0 mode: --/PR res: [0x34512:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db442a34 expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651531740.063072:0:206699:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34512:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:1.0:1651531740.063080:0:206699:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531740.063081:0:206699:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531740.063085:0:206699:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9908e14/0x3234de053ca27b8 lrc: 3/0,0 mode: PR/PR res: [0x34512:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db442a34 expref: 9 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531740.063092:0:206699:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e9908e14/0x3234de053ca27b8 lrc: 3/0,0 mode: PR/PR res: [0x34512:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db442a34 expref: 9 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531740.063098:0:206699:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e9908e14, rc 0)
00000100:00100000:1.0:1651531740.063111:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000099b6616a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:37d7cd70-23c8-4282-b9a2-e45fd1319801+9:438146:x1731754466825792:12345-10.240.43.64@tcp:101:lfs.0 Request processed in 72us (93us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531740.063114:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44255
00000100:00100000:1.0:1651531740.066446:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531740.066454:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466826496
00000100:00100000:1.0:1651531740.066462:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44256
00000100:00100000:1.0:1651531740.066463:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a20162bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:37d7cd70-23c8-4282-b9a2-e45fd1319801+9:659780:x1731754466826496:12345-10.240.43.64@tcp:101:lfs.0
00010000:00010000:1.0:1651531740.066467:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531740.066471:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca27bf lrc: 2/0,0 mode: --/GROUP res: [0x34513:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db442a5e expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651531740.066477:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34513:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:1.0:1651531740.066481:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531740.066482:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531740.066483:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca27bf lrc: 3/0,0 mode: GROUP/GROUP res: [0x34513:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 708174359 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db442a5e expref: 10 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531740.066488:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca27bf lrc: 3/0,0 mode: GROUP/GROUP res: [0x34513:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 708174359 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db442a5e expref: 10 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531740.066492:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006878f48a, rc 0)
00000100:00100000:1.0:1651531740.066501:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a20162bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:37d7cd70-23c8-4282-b9a2-e45fd1319801+10:659780:x1731754466826496:12345-10.240.43.64@tcp:101:lfs.0 Request processed in 37us (56us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531740.066504:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44256
00000100:00100000:1.0:1651531740.066738:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531740.066747:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466826560
00000100:00100000:1.0:1651531740.066754:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44257
00000100:00100000:1.0:1651531740.066757:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d76314b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:37d7cd70-23c8-4282-b9a2-e45fd1319801+10:659780:x1731754466826560:12345-10.240.43.64@tcp:101:lfs.0
00010000:00010000:1.0:1651531740.066760:0:206699:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531740.066764:0:206699:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca27c6 lrc: 2/0,0 mode: --/GROUP res: [0x34512:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db442a65 expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531740.066771:0:206699:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e9908e14/0x3234de053ca27b8 lrc: 2/0,0 mode: PR/PR res: [0x34512:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db442a34 expref: 11 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531740.066775:0:206699:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531740.066775:0:206699:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531740.066776:0:206699:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca27c6 lrc: 4/0,0 mode: --/GROUP res: [0x34512:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 708174359 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db442a65 expref: 11 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531740.066788:0:206699:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e9908e14/0x3234de053ca27b8 lrc: 3/0,0 mode: PR/PR res: [0x34512:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db442a34 expref: 11 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531740.066793:0:206699:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e9908e14/0x3234de053ca27b8 lrc: 4/0,0 mode: PR/PR res: [0x34512:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db442a34 expref: 11 pid: 206699 timeout: 22548 lvb_type: 1
00000100:00100000:1.0:1651531740.066798:0:206699:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001f3a0807 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:206699:1731745997341888:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531740.066816:0:206699:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c8fe001d going to sleep for 6 seconds
00000100:00100000:1.0:1651531740.067060:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531740.067069:0:166103:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466826624
00010000:00010000:1.0:1651531740.067075:0:166103:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e9908e14/0x3234de053ca27b8 lrc: 5/0,0 mode: PR/PR res: [0x34512:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db442a34 expref: 12 pid: 206699 timeout: 22548 lvb_type: 1
00000100:00100000:1.0:1651531740.067084:0:166103:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 76
00000100:00100000:1.0:1651531740.067087:0:166103:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000073d3f68d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:37d7cd70-23c8-4282-b9a2-e45fd1319801+12:438147:x1731754466826624:12345-10.240.43.64@tcp:103:ldlm_bl_03.0
00010000:00010000:1.0:1651531740.067091:0:166103:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1651531740.067096:0:166103:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e9908e14/0x3234de053ca27b8 lrc: 5/0,0 mode: PR/PR res: [0x34512:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db442a34 expref: 12 pid: 206699 timeout: 22548 lvb_type: 1
00010000:00010000:1.0:1651531740.067100:0:166103:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e9908e14/0x3234de053ca27b8 lrc: 4/0,0 mode: PR/PR res: [0x34512:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db442a34 expref: 12 pid: 206699 timeout: 22548 lvb_type: 1
00010000:00010000:1.0:1651531740.067107:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531740.067108:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531740.067109:0:166103:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca27c6 lrc: 3/0,0 mode: GROUP/GROUP res: [0x34512:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 708174359 flags: 0x50080000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db442a65 expref: 12 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531740.067112:0:166103:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca27c6 lrc: 4/0,0 mode: GROUP/GROUP res: [0x34512:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 708174359 flags: 0x50080000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db442a65 expref: 12 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531740.067121:0:166103:0:(ldlm_lockd.c:1067:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca27c6 lrc: 4/0,0 mode: GROUP/GROUP res: [0x34512:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 708174359 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db442a65 expref: 12 pid: 206699 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531740.067125:0:166103:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009d9a9718 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:166103:1731745997341952:10.240.43.64@tcp:105:
00000100:00100000:1.0:1651531740.067136:0:166103:0:(client.c:2492:ptlrpc_set_wait()) set 000000001a1ce0e5 going to sleep for 6 seconds
00010000:00010000:1.0:1651531740.067179:0:206699:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9908e14/0x3234de053ca27b8 lrc: 0/0,0 mode: --/PR res: [0x34512:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db442a34 expref: 12 pid: 206699 timeout: 22548 lvb_type: 1
00000100:00100000:1.0:1651531740.067184:0:206699:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001f3a0807 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:206699:1731745997341888:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651531740.067190:0:206699:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca27c6 lrc: 4/0,0 mode: GROUP/GROUP res: [0x34512:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 708174359 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db442a65 expref: 11 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531740.067195:0:206699:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000077fc7eeb, rc 0)
00000100:00100000:1.0:1651531740.067204:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d76314b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:37d7cd70-23c8-4282-b9a2-e45fd1319801+11:659780:x1731754466826560:12345-10.240.43.64@tcp:101:lfs.0 Request processed in 447us (474us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531740.067207:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44257
00000100:00100000:1.0:1651531740.067329:0:166103:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009d9a9718 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:166103:1731745997341952:10.240.43.64@tcp:105:
00010000:00010000:1.0:1651531740.067334:0:166103:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1651531740.067342:0:166103:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000073d3f68d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:37d7cd70-23c8-4282-b9a2-e45fd1319801+10:438147:x1731754466826624:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 254us (283us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531740.067345:0:166103:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 76
00000100:00100000:1.0:1651531740.069034:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531740.069052:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531740.069060:0:169267:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466826880
00000100:00100000:1.0:1651531740.069068:0:169267:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466827136
00000100:00100000:1.0:1651531740.069073:0:169267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11090
00000100:00100000:1.0:1651531740.069075:0:169267:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009d9a9718 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:37d7cd70-23c8-4282-b9a2-e45fd1319801+11:438146:x1731754466826880:12345-10.240.43.64@tcp:103:lfs.0
00010000:00010000:1.0:1651531740.069078:0:169267:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1651531740.069085:0:169267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca27c6 lrc: 0/0,0 mode: --/GROUP res: [0x34512:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 708174359 flags: 0x44801000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db442a65 expref: 11 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531740.069090:0:169267:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1651531740.069099:0:169267:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009d9a9718 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:37d7cd70-23c8-4282-b9a2-e45fd1319801+10:438146:x1731754466826880:12345-10.240.43.64@tcp:103:lfs.0 Request processed in 23us (65us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531740.069101:0:169267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11090
00000100:00100000:1.0:1651531740.069105:0:169267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11091
00000100:00100000:1.0:1651531740.069108:0:169267:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f3a0807 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:37d7cd70-23c8-4282-b9a2-e45fd1319801+9:438146:x1731754466827136:12345-10.240.43.64@tcp:103:lfs.0
00010000:00010000:1.0:1651531740.069110:0:169267:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1651531740.069114:0:169267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca27bf lrc: 0/0,0 mode: --/GROUP res: [0x34513:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 708174359 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db442a5e expref: 9 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531740.069118:0:169267:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1651531740.069122:0:169267:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f3a0807 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:37d7cd70-23c8-4282-b9a2-e45fd1319801+8:438146:x1731754466827136:12345-10.240.43.64@tcp:103:lfs.0 Request processed in 14us (70us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531740.069124:0:169267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11091
00000100:00100000:1.0:1651531740.076966:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531740.076975:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466827904
00000100:00100000:1.0:1651531740.076982:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44258
00000100:00100000:1.0:1651531740.076984:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000329eeeee pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:37d7cd70-23c8-4282-b9a2-e45fd1319801+8:438146:x1731754466827904:12345-10.240.43.64@tcp:101:lfs.0
00010000:00010000:1.0:1651531740.076987:0:206699:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531740.076991:0:206699:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca27cd lrc: 2/0,0 mode: --/PR res: [0x34513:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db442a8f expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651531740.076996:0:206699:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34513:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:1.0:1651531740.076999:0:206699:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531740.077000:0:206699:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531740.077002:0:206699:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca27cd lrc: 3/0,0 mode: PR/PR res: [0x34513:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db442a8f expref: 9 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531740.077006:0:206699:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca27cd lrc: 3/0,0 mode: PR/PR res: [0x34513:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db442a8f expref: 9 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531740.077010:0:206699:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006878f48a, rc 0)
00000100:00100000:1.0:1651531740.077021:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000329eeeee pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:37d7cd70-23c8-4282-b9a2-e45fd1319801+9:438146:x1731754466827904:12345-10.240.43.64@tcp:101:lfs.0 Request processed in 37us (63us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531740.077024:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44258
00000100:00100000:1.0:1651531740.077749:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531740.077756:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466828032
00000100:00100000:1.0:1651531740.077763:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44259
00000100:00100000:1.0:1651531740.077764:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b97e3b28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:37d7cd70-23c8-4282-b9a2-e45fd1319801+9:438146:x1731754466828032:12345-10.240.43.64@tcp:101:lfs.0
00010000:00010000:1.0:1651531740.077767:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531740.077771:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca27d4 lrc: 2/0,0 mode: --/PR res: [0x34512:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db442a9d expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651531740.077776:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34512:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:1.0:1651531740.077779:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531740.077780:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531740.077782:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca27d4 lrc: 3/0,0 mode: PR/PR res: [0x34512:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db442a9d expref: 10 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531740.077786:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca27d4 lrc: 3/0,0 mode: PR/PR res: [0x34512:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db442a9d expref: 10 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531740.077790:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000077fc7eeb, rc 0)
00000100:00100000:1.0:1651531740.077799:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b97e3b28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:37d7cd70-23c8-4282-b9a2-e45fd1319801+10:438146:x1731754466828032:12345-10.240.43.64@tcp:101:lfs.0 Request processed in 34us (51us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531740.077801:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44259
00000100:00100000:1.0:1651531740.080524:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531740.080532:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466828672
00000100:00100000:1.0:1651531740.080540:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44260
00000100:00100000:1.0:1651531740.080542:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002ae2aeac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:37d7cd70-23c8-4282-b9a2-e45fd1319801+10:659781:x1731754466828672:12345-10.240.43.64@tcp:101:lfs.0
00010000:00010000:1.0:1651531740.080546:0:206699:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531740.080550:0:206699:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9908e14/0x3234de053ca27db lrc: 2/0,0 mode: --/GROUP res: [0x34513:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db442ac0 expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531740.080556:0:206699:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca27cd lrc: 2/0,0 mode: PR/PR res: [0x34513:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db442a8f expref: 11 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531740.080560:0:206699:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531740.080560:0:206699:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531740.080561:0:206699:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9908e14/0x3234de053ca27db lrc: 4/0,0 mode: --/GROUP res: [0x34513:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 1524678433 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db442ac0 expref: 11 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531740.080568:0:206699:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca27cd lrc: 3/0,0 mode: PR/PR res: [0x34513:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db442a8f expref: 11 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531740.080572:0:206699:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca27cd lrc: 4/0,0 mode: PR/PR res: [0x34513:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db442a8f expref: 11 pid: 206699 timeout: 22548 lvb_type: 1
00000100:00100000:1.0:1651531740.080576:0:206699:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008b42dfe9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:206699:1731745997342016:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531740.080588:0:206699:0:(client.c:2492:ptlrpc_set_wait()) set 000000004b59914c going to sleep for 6 seconds
00000100:00100000:1.0:1651531740.080784:0:206699:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008b42dfe9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:206699:1731745997342016:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651531740.080790:0:206699:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e9908e14/0x3234de053ca27db lrc: 3/0,0 mode: --/GROUP res: [0x34513:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 1524678433 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db442ac0 expref: 11 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531740.080795:0:206699:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e9908e14, rc 0)
00000100:00100000:1.0:1651531740.080805:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002ae2aeac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:37d7cd70-23c8-4282-b9a2-e45fd1319801+11:659781:x1731754466828672:12345-10.240.43.64@tcp:101:lfs.0 Request processed in 262us (282us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531740.080809:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44260
00000100:00100000:1.0:1651531740.080857:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531740.080865:0:166103:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466828736
00010000:00010000:1.0:1651531740.080870:0:166103:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca27cd lrc: 4/0,0 mode: PR/PR res: [0x34513:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db442a8f expref: 11 pid: 206699 timeout: 22548 lvb_type: 1
00000100:00100000:1.0:1651531740.080877:0:166103:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 77
00000100:00100000:1.0:1651531740.080879:0:166103:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008b42dfe9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:37d7cd70-23c8-4282-b9a2-e45fd1319801+11:438149:x1731754466828736:12345-10.240.43.64@tcp:103:ldlm_bl_02.0
00010000:00010000:1.0:1651531740.080882:0:166103:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1651531740.080886:0:166103:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca27cd lrc: 4/0,0 mode: PR/PR res: [0x34513:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db442a8f expref: 11 pid: 206699 timeout: 22548 lvb_type: 1
00010000:00010000:1.0:1651531740.080889:0:166103:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca27cd lrc: 3/0,0 mode: PR/PR res: [0x34513:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db442a8f expref: 11 pid: 206699 timeout: 22548 lvb_type: 1
00010000:00010000:1.0:1651531740.080895:0:166103:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca27cd lrc: 0/0,0 mode: --/PR res: [0x34513:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db442a8f expref: 11 pid: 206699 timeout: 22548 lvb_type: 1
00010000:00010000:1.0:1651531740.080898:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531740.080899:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531740.080900:0:166103:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e9908e14/0x3234de053ca27db lrc: 2/0,0 mode: GROUP/GROUP res: [0x34513:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 1524678433 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db442ac0 expref: 10 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531740.080903:0:166103:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9908e14/0x3234de053ca27db lrc: 3/0,0 mode: GROUP/GROUP res: [0x34513:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 1524678433 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db442ac0 expref: 10 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531740.080915:0:166103:0:(ldlm_lockd.c:1067:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000e9908e14/0x3234de053ca27db lrc: 3/0,0 mode: GROUP/GROUP res: [0x34513:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 1524678433 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db442ac0 expref: 10 pid: 206699 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531740.080919:0:166103:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006c46ca95 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:166103:1731745997342080:10.240.43.64@tcp:105:
00000100:00100000:1.0:1651531740.080930:0:166103:0:(client.c:2492:ptlrpc_set_wait()) set 000000004b59914c going to sleep for 6 seconds
00000100:00100000:1.0:1651531740.081142:0:166103:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006c46ca95 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:166103:1731745997342080:10.240.43.64@tcp:105:
00010000:00010000:1.0:1651531740.081147:0:166103:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1651531740.081164:0:166103:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008b42dfe9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:37d7cd70-23c8-4282-b9a2-e45fd1319801+10:438149:x1731754466828736:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 275us (298us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531740.081167:0:166103:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 77
00000100:00100000:1.0:1651531740.081249:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531740.081257:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466828800
00000100:00100000:1.0:1651531740.081264:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44261
00000100:00100000:1.0:1651531740.081266:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006c46ca95 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:37d7cd70-23c8-4282-b9a2-e45fd1319801+10:659781:x1731754466828800:12345-10.240.43.64@tcp:101:lfs.0
00010000:00010000:1.0:1651531740.081269:0:206699:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531740.081272:0:206699:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000141899af/0x3234de053ca27e2 lrc: 2/0,0 mode: --/GROUP res: [0x34512:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db442ac7 expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531740.081279:0:206699:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca27d4 lrc: 2/0,0 mode: PR/PR res: [0x34512:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db442a9d expref: 11 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531740.081282:0:206699:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531740.081282:0:206699:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531740.081283:0:206699:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000141899af/0x3234de053ca27e2 lrc: 4/0,0 mode: --/GROUP res: [0x34512:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 1524678433 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db442ac7 expref: 11 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531740.081294:0:206699:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca27d4 lrc: 3/0,0 mode: PR/PR res: [0x34512:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db442a9d expref: 11 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531740.081297:0:206699:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca27d4 lrc: 4/0,0 mode: PR/PR res: [0x34512:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db442a9d expref: 11 pid: 166112 timeout: 22548 lvb_type: 1
00000100:00100000:1.0:1651531740.081301:0:206699:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003158b8a7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:206699:1731745997342144:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531740.081312:0:206699:0:(client.c:2492:ptlrpc_set_wait()) set 000000004b59914c going to sleep for 6 seconds
00000100:00100000:1.0:1651531740.081537:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531740.081543:0:166103:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466828864
00010000:00010000:1.0:1651531740.081548:0:166103:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca27d4 lrc: 5/0,0 mode: PR/PR res: [0x34512:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db442a9d expref: 12 pid: 166112 timeout: 22548 lvb_type: 1
00000100:00100000:1.0:1651531740.081555:0:166103:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 78
00000100:00100000:1.0:1651531740.081557:0:166103:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000e33e11e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:37d7cd70-23c8-4282-b9a2-e45fd1319801+12:438147:x1731754466828864:12345-10.240.43.64@tcp:103:ldlm_bl_01.0
00010000:00010000:1.0:1651531740.081560:0:166103:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1651531740.081563:0:166103:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca27d4 lrc: 5/0,0 mode: PR/PR res: [0x34512:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db442a9d expref: 12 pid: 166112 timeout: 22548 lvb_type: 1
00010000:00010000:1.0:1651531740.081567:0:166103:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca27d4 lrc: 4/0,0 mode: PR/PR res: [0x34512:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db442a9d expref: 12 pid: 166112 timeout: 22548 lvb_type: 1
00010000:00010000:1.0:1651531740.081572:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531740.081573:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531740.081574:0:166103:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000141899af/0x3234de053ca27e2 lrc: 3/0,0 mode: GROUP/GROUP res: [0x34512:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 1524678433 flags: 0x50080000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db442ac7 expref: 12 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531740.081578:0:166103:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000141899af/0x3234de053ca27e2 lrc: 4/0,0 mode: GROUP/GROUP res: [0x34512:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 1524678433 flags: 0x50080000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db442ac7 expref: 12 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531740.081586:0:166103:0:(ldlm_lockd.c:1067:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000141899af/0x3234de053ca27e2 lrc: 4/0,0 mode: GROUP/GROUP res: [0x34512:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 1524678433 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db442ac7 expref: 12 pid: 206699 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531740.081589:0:166103:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000036ee6adc pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:166103:1731745997342208:10.240.43.64@tcp:105:
00000100:00100000:1.0:1651531740.081600:0:166103:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c8fe001d going to sleep for 6 seconds
00010000:00010000:1.0:1651531740.081639:0:206699:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca27d4 lrc: 0/0,0 mode: --/PR res: [0x34512:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db442a9d expref: 12 pid: 166112 timeout: 22548 lvb_type: 1
00000100:00100000:1.0:1651531740.081644:0:206699:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003158b8a7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:206699:1731745997342144:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651531740.081648:0:206699:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000141899af/0x3234de053ca27e2 lrc: 4/0,0 mode: GROUP/GROUP res: [0x34512:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 1524678433 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db442ac7 expref: 11 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531740.081652:0:206699:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000141899af, rc 0)
00000100:00100000:1.0:1651531740.081661:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006c46ca95 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:37d7cd70-23c8-4282-b9a2-e45fd1319801+11:659781:x1731754466828800:12345-10.240.43.64@tcp:101:lfs.0 Request processed in 395us (412us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531740.081664:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44261
00000100:00100000:1.0:1651531740.081833:0:166103:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000036ee6adc pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:166103:1731745997342208:10.240.43.64@tcp:105:
00010000:00010000:1.0:1651531740.081837:0:166103:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1651531740.081845:0:166103:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000e33e11e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:37d7cd70-23c8-4282-b9a2-e45fd1319801+10:438147:x1731754466828864:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 287us (309us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531740.081850:0:166103:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 78
00000100:00100000:1.0:1651531740.083332:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531740.083350:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531740.083358:0:166104:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466829120
00000100:00100000:1.0:1651531740.083372:0:166104:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466829376
00000100:00100000:1.0:1651531740.083378:0:166104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11092
00000100:00100000:1.0:1651531740.083379:0:166104:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000091c6e81f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:37d7cd70-23c8-4282-b9a2-e45fd1319801+11:438149:x1731754466829120:12345-10.240.43.64@tcp:103:lfs.0
00010000:00010000:1.0:1651531740.083382:0:166104:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1651531740.083389:0:166104:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000141899af/0x3234de053ca27e2 lrc: 0/0,0 mode: --/GROUP res: [0x34512:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 1524678433 flags: 0x44801000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db442ac7 expref: 11 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531740.083394:0:166104:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1651531740.083402:0:166104:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000091c6e81f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:37d7cd70-23c8-4282-b9a2-e45fd1319801+10:438149:x1731754466829120:12345-10.240.43.64@tcp:103:lfs.0 Request processed in 23us (71us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531740.083405:0:166104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11092
00000100:00100000:1.0:1651531740.083415:0:166104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11093
00000100:00100000:1.0:1651531740.083423:0:166104:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000036ee6adc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:37d7cd70-23c8-4282-b9a2-e45fd1319801+9:438149:x1731754466829376:12345-10.240.43.64@tcp:103:lfs.0
00010000:00010000:1.0:1651531740.083426:0:166104:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1651531740.083431:0:166104:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9908e14/0x3234de053ca27db lrc: 0/0,0 mode: --/GROUP res: [0x34513:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 1524678433 flags: 0x44801000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db442ac0 expref: 9 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531740.083436:0:166104:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1651531740.083441:0:166104:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000036ee6adc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:37d7cd70-23c8-4282-b9a2-e45fd1319801+8:438149:x1731754466829376:12345-10.240.43.64@tcp:103:lfs.0 Request processed in 24us (91us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531740.083443:0:166104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11093
00000100:00100000:1.0:1651531740.097750:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531740.097758:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466830912
00000100:00100000:1.0:1651531740.097765:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44262
00000100:00100000:1.0:1651531740.097767:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000e33e11e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:37d7cd70-23c8-4282-b9a2-e45fd1319801+8:438147:x1731754466830912:12345-10.240.43.64@tcp:101:lfs.0
00010000:00010000:1.0:1651531740.097770:0:206699:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531740.097774:0:206699:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9908e14/0x3234de053ca27e9 lrc: 2/0,0 mode: --/PR res: [0x34513:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db442b14 expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651531740.097779:0:206699:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34513:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:1.0:1651531740.097782:0:206699:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531740.097783:0:206699:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531740.097785:0:206699:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9908e14/0x3234de053ca27e9 lrc: 3/0,0 mode: PR/PR res: [0x34513:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db442b14 expref: 9 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531740.097789:0:206699:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e9908e14/0x3234de053ca27e9 lrc: 3/0,0 mode: PR/PR res: [0x34513:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db442b14 expref: 9 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531740.097793:0:206699:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e9908e14, rc 0)
00000100:00100000:1.0:1651531740.097802:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000e33e11e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:37d7cd70-23c8-4282-b9a2-e45fd1319801+9:438147:x1731754466830912:12345-10.240.43.64@tcp:101:lfs.0 Request processed in 34us (52us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531740.097804:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44262
00000100:00100000:1.0:1651531740.099346:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531740.099354:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466831232
00000100:00100000:1.0:1651531740.099361:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44263
00000100:00100000:1.0:1651531740.099362:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003158b8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:37d7cd70-23c8-4282-b9a2-e45fd1319801+9:659783:x1731754466831232:12345-10.240.43.64@tcp:101:lfs.0
00010000:00010000:1.0:1651531740.099365:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531740.099369:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000141899af/0x3234de053ca27f0 lrc: 2/0,0 mode: --/GROUP res: [0x34514:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db442b29 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651531740.099376:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34514:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:1.0:1651531740.099379:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531740.099380:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531740.099382:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000141899af/0x3234de053ca27f0 lrc: 3/0,0 mode: GROUP/GROUP res: [0x34514:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 1982953276 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db442b29 expref: 10 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531740.099386:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000141899af/0x3234de053ca27f0 lrc: 3/0,0 mode: GROUP/GROUP res: [0x34514:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 1982953276 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db442b29 expref: 10 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531740.099390:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000141899af, rc 0)
00000100:00100000:1.0:1651531740.099399:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003158b8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:37d7cd70-23c8-4282-b9a2-e45fd1319801+10:659783:x1731754466831232:12345-10.240.43.64@tcp:101:lfs.0 Request processed in 36us (54us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531740.099402:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44263
00000100:00100000:1.0:1651531740.102394:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531740.102401:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466831872
00000100:00100000:1.0:1651531740.102408:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44264
00000100:00100000:1.0:1651531740.102410:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000053de45f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:37d7cd70-23c8-4282-b9a2-e45fd1319801+10:659783:x1731754466831872:12345-10.240.43.64@tcp:101:lfs.0
00010000:00010000:1.0:1651531740.102413:0:206699:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531740.102417:0:206699:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca27f7 lrc: 2/0,0 mode: --/GROUP res: [0x34513:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db442b4c expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531740.102423:0:206699:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e9908e14/0x3234de053ca27e9 lrc: 2/0,0 mode: PR/PR res: [0x34513:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db442b14 expref: 11 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531740.102426:0:206699:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531740.102428:0:206699:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531740.102428:0:206699:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca27f7 lrc: 4/0,0 mode: --/GROUP res: [0x34513:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 1982953276 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db442b4c expref: 11 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531740.102435:0:206699:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e9908e14/0x3234de053ca27e9 lrc: 3/0,0 mode: PR/PR res: [0x34513:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db442b14 expref: 11 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531740.102439:0:206699:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e9908e14/0x3234de053ca27e9 lrc: 4/0,0 mode: PR/PR res: [0x34513:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db442b14 expref: 11 pid: 206699 timeout: 22548 lvb_type: 1
00000100:00100000:1.0:1651531740.102443:0:206699:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cc11a3b9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:206699:1731745997342272:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531740.102454:0:206699:0:(client.c:2492:ptlrpc_set_wait()) set 000000003731e840 going to sleep for 6 seconds
00000100:00100000:1.0:1651531740.102708:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531740.102715:0:166103:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466831936
00010000:00010000:1.0:1651531740.102720:0:166103:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e9908e14/0x3234de053ca27e9 lrc: 5/0,0 mode: PR/PR res: [0x34513:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db442b14 expref: 12 pid: 206699 timeout: 22548 lvb_type: 1
00000100:00100000:1.0:1651531740.102727:0:166103:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 79
00000100:00100000:1.0:1651531740.102729:0:166103:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000047c291a9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:37d7cd70-23c8-4282-b9a2-e45fd1319801+12:438146:x1731754466831936:12345-10.240.43.64@tcp:103:ldlm_bl_01.0
00010000:00010000:1.0:1651531740.102732:0:166103:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1651531740.102735:0:166103:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e9908e14/0x3234de053ca27e9 lrc: 5/0,0 mode: PR/PR res: [0x34513:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db442b14 expref: 12 pid: 206699 timeout: 22548 lvb_type: 1
00010000:00010000:1.0:1651531740.102739:0:166103:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e9908e14/0x3234de053ca27e9 lrc: 4/0,0 mode: PR/PR res: [0x34513:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db442b14 expref: 12 pid: 206699 timeout: 22548 lvb_type: 1
00010000:00010000:1.0:1651531740.102744:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531740.102746:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531740.102747:0:166103:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca27f7 lrc: 3/0,0 mode: GROUP/GROUP res: [0x34513:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 1982953276 flags: 0x50080000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db442b4c expref: 12 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531740.102750:0:166103:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca27f7 lrc: 4/0,0 mode: GROUP/GROUP res: [0x34513:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 1982953276 flags: 0x50080000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db442b4c expref: 12 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531740.102758:0:166103:0:(ldlm_lockd.c:1067:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca27f7 lrc: 4/0,0 mode: GROUP/GROUP res: [0x34513:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 1982953276 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db442b4c expref: 12 pid: 206699 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531740.102762:0:166103:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000073d3f68d pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:166103:1731745997342336:10.240.43.64@tcp:105:
00000100:00100000:1.0:1651531740.102772:0:166103:0:(client.c:2492:ptlrpc_set_wait()) set 000000004b59914c going to sleep for 6 seconds
00010000:00010000:1.0:1651531740.102811:0:206699:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9908e14/0x3234de053ca27e9 lrc: 0/0,0 mode: --/PR res: [0x34513:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db442b14 expref: 12 pid: 206699 timeout: 22548 lvb_type: 1
00000100:00100000:1.0:1651531740.102815:0:206699:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cc11a3b9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:206699:1731745997342272:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651531740.102828:0:206699:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca27f7 lrc: 4/0,0 mode: GROUP/GROUP res: [0x34513:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 1982953276 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db442b4c expref: 11 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531740.102832:0:206699:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000077fc7eeb, rc 0)
00000100:00100000:1.0:1651531740.102842:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000053de45f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:37d7cd70-23c8-4282-b9a2-e45fd1319801+11:659783:x1731754466831872:12345-10.240.43.64@tcp:101:lfs.0 Request processed in 431us (449us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531740.102845:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44264
00000100:00100000:1.0:1651531740.102987:0:166103:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000073d3f68d pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:166103:1731745997342336:10.240.43.64@tcp:105:
00010000:00010000:1.0:1651531740.102991:0:166103:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1651531740.102999:0:166103:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000047c291a9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:37d7cd70-23c8-4282-b9a2-e45fd1319801+10:438146:x1731754466831936:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 270us (292us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531740.103003:0:166103:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 79
00000100:00100000:1.0:1651531740.106169:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531740.106185:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531740.106193:0:169267:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466832192
00000100:00100000:1.0:1651531740.106200:0:169267:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466832320
00000100:00100000:1.0:1651531740.106204:0:169267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11094
00000100:00100000:1.0:1651531740.106205:0:169267:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000073d3f68d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:37d7cd70-23c8-4282-b9a2-e45fd1319801+11:438147:x1731754466832192:12345-10.240.43.64@tcp:103:lfs.0
00010000:00010000:1.0:1651531740.106208:0:169267:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1651531740.106215:0:169267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca27f7 lrc: 0/0,0 mode: --/GROUP res: [0x34513:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 1982953276 flags: 0x44801000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db442b4c expref: 11 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531740.106220:0:169267:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651531740.106220:0:166102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11095
00000100:00100000:0.0:1651531740.106243:0:166102:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009d9a9718 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:37d7cd70-23c8-4282-b9a2-e45fd1319801+10:438147:x1731754466832320:12345-10.240.43.64@tcp:103:lfs.0
00000100:00100000:1.0:1651531740.106245:0:169267:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000073d3f68d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:37d7cd70-23c8-4282-b9a2-e45fd1319801+10:438147:x1731754466832192:12345-10.240.43.64@tcp:103:lfs.0 Request processed in 38us (75us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531740.106247:0:169267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11094
00010000:00010000:0.0:1651531740.106249:0:166102:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531740.106269:0:166102:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000141899af/0x3234de053ca27f0 lrc: 0/0,0 mode: --/GROUP res: [0x34514:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 1982953276 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db442b29 expref: 9 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531740.106276:0:166102:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651531740.106294:0:166102:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009d9a9718 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:37d7cd70-23c8-4282-b9a2-e45fd1319801+8:438147:x1731754466832320:12345-10.240.43.64@tcp:103:lfs.0 Request processed in 51us (108us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531740.106297:0:166102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11095
00000100:00100000:1.0:1651531740.111833:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531740.111841:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466833152
00000100:00100000:1.0:1651531740.111849:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44265
00000100:00100000:1.0:1651531740.111850:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f3a0807 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:37d7cd70-23c8-4282-b9a2-e45fd1319801+8:438146:x1731754466833152:12345-10.240.43.64@tcp:101:lfs.0
00010000:00010000:1.0:1651531740.111853:0:206699:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531740.111857:0:206699:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca27fe lrc: 2/0,0 mode: --/PR res: [0x34513:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db442b6f expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651531740.111862:0:206699:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34513:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:1.0:1651531740.111866:0:206699:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531740.111866:0:206699:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531740.111869:0:206699:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca27fe lrc: 3/0,0 mode: PR/PR res: [0x34513:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db442b6f expref: 9 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531740.111873:0:206699:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca27fe lrc: 3/0,0 mode: PR/PR res: [0x34513:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db442b6f expref: 9 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531740.111877:0:206699:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000077fc7eeb, rc 0)
00000100:00100000:1.0:1651531740.111887:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f3a0807 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:37d7cd70-23c8-4282-b9a2-e45fd1319801+9:438146:x1731754466833152:12345-10.240.43.64@tcp:101:lfs.0 Request processed in 36us (54us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531740.111889:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44265
00000100:00100000:1.0:1651531740.112654:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531740.112662:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466833344
00000100:00100000:1.0:1651531740.112668:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44266
00000100:00100000:1.0:1651531740.112670:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008b42dfe9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:37d7cd70-23c8-4282-b9a2-e45fd1319801+9:438146:x1731754466833344:12345-10.240.43.64@tcp:101:lfs.0
00010000:00010000:1.0:1651531740.112673:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531740.112685:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9908e14/0x3234de053ca2805 lrc: 2/0,0 mode: --/PR res: [0x34514:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db442b84 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651531740.112690:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34514:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:1.0:1651531740.112693:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531740.112694:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531740.112696:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9908e14/0x3234de053ca2805 lrc: 3/0,0 mode: PR/PR res: [0x34514:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db442b84 expref: 10 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531740.112700:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e9908e14/0x3234de053ca2805 lrc: 3/0,0 mode: PR/PR res: [0x34514:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db442b84 expref: 10 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531740.112704:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e9908e14, rc 0)
00000100:00100000:1.0:1651531740.112715:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008b42dfe9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:37d7cd70-23c8-4282-b9a2-e45fd1319801+10:438146:x1731754466833344:12345-10.240.43.64@tcp:101:lfs.0 Request processed in 45us (62us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531740.112718:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44266
00000100:00100000:1.0:1651531740.114248:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531740.114258:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466833728
00000100:00100000:1.0:1651531740.114265:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44267
00000100:00100000:1.0:1651531740.114267:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cc11a3b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:37d7cd70-23c8-4282-b9a2-e45fd1319801+10:659784:x1731754466833728:12345-10.240.43.64@tcp:101:lfs.0
00010000:00010000:1.0:1651531740.114270:0:206699:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531740.114273:0:206699:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca280c lrc: 2/0,0 mode: --/GROUP res: [0x34514:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db442ba0 expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531740.114279:0:206699:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e9908e14/0x3234de053ca2805 lrc: 2/0,0 mode: PR/PR res: [0x34514:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db442b84 expref: 11 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531740.114283:0:206699:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531740.114283:0:206699:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531740.114284:0:206699:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca280c lrc: 4/0,0 mode: --/GROUP res: [0x34514:0x0:0x0].0x0 rrc: 3 type: EXT [1048576->18446744073709551615] (req 1048576->18446744073709551615) gid 647869929 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db442ba0 expref: 11 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531740.114291:0:206699:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e9908e14/0x3234de053ca2805 lrc: 3/0,0 mode: PR/PR res: [0x34514:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db442b84 expref: 11 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531740.114295:0:206699:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e9908e14/0x3234de053ca2805 lrc: 4/0,0 mode: PR/PR res: [0x34514:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db442b84 expref: 11 pid: 166112 timeout: 22548 lvb_type: 1
00000100:00100000:1.0:1651531740.114299:0:206699:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000091075bf7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:206699:1731745997342400:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531740.114310:0:206699:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c8fe001d going to sleep for 6 seconds
00000100:00100000:1.0:1651531740.114544:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531740.114558:0:206699:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000091075bf7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:206699:1731745997342400:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651531740.114563:0:206699:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca280c lrc: 3/0,0 mode: --/GROUP res: [0x34514:0x0:0x0].0x0 rrc: 3 type: EXT [1048576->18446744073709551615] (req 1048576->18446744073709551615) gid 647869929 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db442ba0 expref: 11 pid: 206699 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531740.114567:0:166102:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466833792
00010000:00010000:1.0:1651531740.114568:0:206699:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006878f48a, rc 0)
00010000:00010000:0.0:1651531740.114575:0:166102:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e9908e14/0x3234de053ca2805 lrc: 4/0,0 mode: PR/PR res: [0x34514:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db442b84 expref: 12 pid: 166112 timeout: 22548 lvb_type: 1
00000100:00100000:1.0:1651531740.114577:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cc11a3b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:37d7cd70-23c8-4282-b9a2-e45fd1319801+12:659784:x1731754466833728:12345-10.240.43.64@tcp:101:lfs.0 Request processed in 310us (337us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531740.114580:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44267
00000100:00100000:0.0:1651531740.114587:0:166102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 80
00000100:00100000:0.0:1651531740.114589:0:166102:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000de3fc5c8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:37d7cd70-23c8-4282-b9a2-e45fd1319801+11:438147:x1731754466833792:12345-10.240.43.64@tcp:103:ldlm_bl_01.0
00010000:00010000:0.0:1651531740.114592:0:166102:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531740.114596:0:166102:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e9908e14/0x3234de053ca2805 lrc: 4/0,0 mode: PR/PR res: [0x34514:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db442b84 expref: 11 pid: 166112 timeout: 22548 lvb_type: 1
00010000:00010000:0.0:1651531740.114605:0:166102:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e9908e14/0x3234de053ca2805 lrc: 3/0,0 mode: PR/PR res: [0x34514:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db442b84 expref: 11 pid: 166112 timeout: 22548 lvb_type: 1
00010000:00010000:0.0:1651531740.114611:0:166102:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9908e14/0x3234de053ca2805 lrc: 0/0,0 mode: --/PR res: [0x34514:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db442b84 expref: 11 pid: 166112 timeout: 22548 lvb_type: 1
00010000:00010000:0.0:1651531740.114614:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531740.114615:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531740.114617:0:166102:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca280c lrc: 2/0,0 mode: GROUP/GROUP res: [0x34514:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 647869929 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db442ba0 expref: 10 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531740.114621:0:166102:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca280c lrc: 3/0,0 mode: GROUP/GROUP res: [0x34514:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 647869929 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db442ba0 expref: 10 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531740.114630:0:166102:0:(ldlm_lockd.c:1067:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca280c lrc: 3/0,0 mode: GROUP/GROUP res: [0x34514:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 647869929 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db442ba0 expref: 10 pid: 206699 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531740.114634:0:166102:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000053497d pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:166102:1731745997342464:10.240.43.64@tcp:105:
00000100:00100000:0.0:1651531740.114653:0:166102:0:(client.c:2492:ptlrpc_set_wait()) set 0000000044420fb0 going to sleep for 6 seconds
00000100:00100000:0.0:1651531740.114894:0:166102:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000053497d pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:166102:1731745997342464:10.240.43.64@tcp:105:
00010000:00010000:0.0:1651531740.114899:0:166102:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651531740.114912:0:166102:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000de3fc5c8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:37d7cd70-23c8-4282-b9a2-e45fd1319801+10:438147:x1731754466833792:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 323us (368us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531740.114915:0:166102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 80
00000100:00100000:1.0:1651531740.117992:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531740.118000:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466834496
00000100:00100000:1.0:1651531740.118007:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44268
00000100:00100000:1.0:1651531740.118009:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000091075bf7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:37d7cd70-23c8-4282-b9a2-e45fd1319801+10:659784:x1731754466834496:12345-10.240.43.64@tcp:101:lfs.0
00010000:00010000:1.0:1651531740.118012:0:206699:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531740.118016:0:206699:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000141899af/0x3234de053ca2813 lrc: 2/0,0 mode: --/GROUP res: [0x34513:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db442bc3 expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531740.118022:0:206699:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca27fe lrc: 2/0,0 mode: PR/PR res: [0x34513:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db442b6f expref: 11 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531740.118025:0:206699:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531740.118026:0:206699:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531740.118027:0:206699:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000141899af/0x3234de053ca2813 lrc: 4/0,0 mode: --/GROUP res: [0x34513:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 647869929 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db442bc3 expref: 11 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531740.118033:0:206699:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca27fe lrc: 3/0,0 mode: PR/PR res: [0x34513:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db442b6f expref: 11 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531740.118051:0:206699:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca27fe lrc: 4/0,0 mode: PR/PR res: [0x34513:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db442b6f expref: 11 pid: 206699 timeout: 22548 lvb_type: 1
00000100:00100000:1.0:1651531740.118055:0:206699:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009ac545f3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:206699:1731745997342528:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531740.118066:0:206699:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c8fe001d going to sleep for 6 seconds
00000100:00100000:1.0:1651531740.118296:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531740.118310:0:206699:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009ac545f3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:206699:1731745997342528:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531740.118314:0:166102:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466834560
00010000:00010000:1.0:1651531740.118315:0:206699:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000141899af/0x3234de053ca2813 lrc: 3/0,0 mode: --/GROUP res: [0x34513:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 647869929 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db442bc3 expref: 11 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531740.118320:0:206699:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000141899af, rc 0)
00010000:00010000:0.0:1651531740.118321:0:166102:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca27fe lrc: 4/0,0 mode: PR/PR res: [0x34513:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db442b6f expref: 12 pid: 206699 timeout: 22548 lvb_type: 1
00000100:00100000:0.0:1651531740.118332:0:166102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 81
00000100:00100000:0.0:1651531740.118334:0:166102:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004d72f458 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:37d7cd70-23c8-4282-b9a2-e45fd1319801+12:438147:x1731754466834560:12345-10.240.43.64@tcp:103:ldlm_bl_01.0
00000100:00100000:1.0:1651531740.118335:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000091075bf7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:37d7cd70-23c8-4282-b9a2-e45fd1319801+12:659784:x1731754466834496:12345-10.240.43.64@tcp:101:lfs.0 Request processed in 319us (337us total) trans 0 rc 0/0
00010000:00010000:0.0:1651531740.118337:0:166102:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00000100:00100000:1.0:1651531740.118338:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44268
00010000:00010000:0.0:1651531740.118341:0:166102:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca27fe lrc: 4/0,0 mode: PR/PR res: [0x34513:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db442b6f expref: 11 pid: 206699 timeout: 22548 lvb_type: 1
00010000:00010000:0.0:1651531740.118345:0:166102:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca27fe lrc: 3/0,0 mode: PR/PR res: [0x34513:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db442b6f expref: 11 pid: 206699 timeout: 22548 lvb_type: 1
00010000:00010000:0.0:1651531740.118351:0:166102:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca27fe lrc: 0/0,0 mode: --/PR res: [0x34513:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db442b6f expref: 11 pid: 206699 timeout: 22548 lvb_type: 1
00010000:00010000:0.0:1651531740.118355:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531740.118355:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531740.118357:0:166102:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000141899af/0x3234de053ca2813 lrc: 2/0,0 mode: GROUP/GROUP res: [0x34513:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 647869929 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db442bc3 expref: 10 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531740.118360:0:166102:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000141899af/0x3234de053ca2813 lrc: 3/0,0 mode: GROUP/GROUP res: [0x34513:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 647869929 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db442bc3 expref: 10 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531740.118368:0:166102:0:(ldlm_lockd.c:1067:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000141899af/0x3234de053ca2813 lrc: 3/0,0 mode: GROUP/GROUP res: [0x34513:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 647869929 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db442bc3 expref: 10 pid: 206699 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531740.118376:0:166102:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000053497d pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:166102:1731745997342592:10.240.43.64@tcp:105:
00000100:00100000:0.0:1651531740.118396:0:166102:0:(client.c:2492:ptlrpc_set_wait()) set 0000000044420fb0 going to sleep for 6 seconds
00000100:00100000:0.0:1651531740.118598:0:166102:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000053497d pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:166102:1731745997342592:10.240.43.64@tcp:105:
00010000:00010000:0.0:1651531740.118603:0:166102:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651531740.118615:0:166102:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004d72f458 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:37d7cd70-23c8-4282-b9a2-e45fd1319801+10:438147:x1731754466834560:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 280us (320us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531740.118618:0:166102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 81
00000100:00100000:1.0:1651531740.121767:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531740.121785:0:166102:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466834816
00000100:00100000:1.0:1651531740.121793:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531740.121803:0:166102:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466834944
00000100:00100000:0.0:1651531740.121810:0:166102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11096
00000100:00100000:0.0:1651531740.121812:0:166102:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cd6821b8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:37d7cd70-23c8-4282-b9a2-e45fd1319801+11:438146:x1731754466834816:12345-10.240.43.64@tcp:103:lfs.0
00010000:00010000:0.0:1651531740.121815:0:166102:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00000100:00100000:1.0:1651531740.121816:0:166104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11097
00000100:00100000:1.0:1651531740.121818:0:166104:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ac545f3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:37d7cd70-23c8-4282-b9a2-e45fd1319801+11:438146:x1731754466834944:12345-10.240.43.64@tcp:103:lfs.0
00010000:00010000:1.0:1651531740.121821:0:166104:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531740.121822:0:166102:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000141899af/0x3234de053ca2813 lrc: 0/0,0 mode: --/GROUP res: [0x34513:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 647869929 flags: 0x44801000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db442bc3 expref: 11 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531740.121827:0:166102:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1651531740.121829:0:166104:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca280c lrc: 0/0,0 mode: --/GROUP res: [0x34514:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 647869929 flags: 0x44801000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db442ba0 expref: 10 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531740.121834:0:166104:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651531740.121839:0:166102:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cd6821b8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:37d7cd70-23c8-4282-b9a2-e45fd1319801+9:438146:x1731754466834816:12345-10.240.43.64@tcp:103:lfs.0 Request processed in 26us (73us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531740.121842:0:166102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11096
00000100:00100000:1.0:1651531740.121849:0:166104:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ac545f3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:37d7cd70-23c8-4282-b9a2-e45fd1319801+8:438146:x1731754466834944:12345-10.240.43.64@tcp:103:lfs.0 Request processed in 31us (56us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531740.121852:0:166104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11097
00000400:00000080:0.0:1651531741.429969:0:225711:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648
00000001:02000400:0.0:1651531741.429971:0:225711:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 273b: DoM: race writeback and object destroy ========================================================== 22:49:01 (1651531741)
00000100:00100000:1.0:1651531741.652239:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531741.652259:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466836544
00000100:00100000:1.0:1651531741.652280:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44269
00000100:00100000:1.0:1651531741.652283:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b462545d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:37d7cd70-23c8-4282-b9a2-e45fd1319801+8:660381:x1731754466836544:12345-10.240.43.64@tcp:101:multiop.0
00010000:00010000:1.0:1651531741.652292:0:206699:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531741.652303:0:206699:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca281a lrc: 2/0,0 mode: --/PW res: [0x34515:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db442bfb expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651531741.652316:0:206699:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34515:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:1.0:1651531741.652327:0:206699:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531741.652328:0:206699:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531741.652333:0:206699:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca281a lrc: 3/0,0 mode: PW/PW res: [0x34515:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db442bfb expref: 9 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531741.652341:0:206699:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca281a lrc: 3/0,0 mode: PW/PW res: [0x34515:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db442bfb expref: 9 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531741.652346:0:206699:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006878f48a, rc 0)
00000100:00100000:1.0:1651531741.652368:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b462545d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:37d7cd70-23c8-4282-b9a2-e45fd1319801+9:660381:x1731754466836544:12345-10.240.43.64@tcp:101:multiop.0 Request processed in 85us (134us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531741.652371:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44269
00000100:00100000:1.0:1651531742.432152:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651531742.432180:0:182071:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951137856
00000100:00100000:0.0:1651531742.432200:0:182071:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 417
00000100:00100000:0.0:1651531742.432203:0:182071:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000de3fc5c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+13:39029:x1731745951137856:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:0.0:1651531742.432218:0:182071:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 350513472 pending 0 free 81283506176 avail 77112795136
00000100:00100000:0.0:1651531742.432253:0:182071:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000de3fc5c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+13:39029:x1731745951137856:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 50us (102us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531742.432257:0:182071:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 417
00000001:00080000:0.0:1651531743.585267:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869024 is committed
00000001:00080000:0.0:1651531743.585271:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869021 is committed
00000100:00100000:1.0:1651531743.768251:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651531743.768261:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651531743.768269:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951137920
00000100:00100000:1.0:1651531743.768280:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951138048
00000100:00100000:1.0:1651531743.768285:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 44270
00000100:00100000:1.0:1651531743.768287:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004d72f458 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745951137920:12345-10.240.43.61@tcp:6:osp-syn-1-0.0
00002000:00080000:1.0:1651531743.768297:0:166112:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:214288 count 1
00002000:00010000:1.0:1651531743.768308:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34510:0x0] initial LVB size: 1048576, mtime: 0x62705fd9, atime: 0x62705fd9, ctime: 0x62705fda, blocks: 0x800
00010000:00010000:1.0:1651531743.768311:0:166112:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000df4fd81c/0x3234de053ca2821 lrc: 3/0,1 mode: --/PW res: [0x34510:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531743.768317:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531743.768318:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531743.768320:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000df4fd81c/0x3234de053ca2821 lrc: 3/0,1 mode: PW/PW res: [0x34510:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531743.768325:0:166112:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000df4fd81c/0x3234de053ca2821 lrc: 3/0,1 mode: PW/PW res: [0x34510:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531743.768329:0:166112:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000df4fd81c/0x3234de053ca2821 lrc: 3/0,1 mode: PW/PW res: [0x34510:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531743.768332:0:166112:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000df4fd81c/0x3234de053ca2821 lrc: 2/0,0 mode: PW/PW res: [0x34510:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531743.768556:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004d72f458 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745951137920:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 267us (306us total) trans 21474869025 rc 0/0
00000100:00100000:1.0:1651531743.768560:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 44270
00000100:00100000:1.0:1651531743.768565:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 44271
00000100:00100000:1.0:1651531743.768567:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000080bc1e67 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745951138048:12345-10.240.43.61@tcp:6:osp-syn-1-0.0
00002000:00080000:1.0:1651531743.768572:0:166112:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:214293 count 1
00010000:00010000:1.0:1651531743.768578:0:166112:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003ad4b055/0x3234de053ca2828 lrc: 3/0,1 mode: --/PW res: [0x34515:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531743.768584:0:166112:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca281a lrc: 2/0,0 mode: PW/PW res: [0x34515:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db442bfb expref: 6 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531743.768588:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531743.768588:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531743.768589:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003ad4b055/0x3234de053ca2828 lrc: 4/0,1 mode: --/PW res: [0x34515:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531743.768612:0:166112:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca281a lrc: 3/0,0 mode: PW/PW res: [0x34515:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db442bfb expref: 6 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531743.768618:0:166112:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca281a lrc: 4/0,0 mode: PW/PW res: [0x34515:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db442bfb expref: 6 pid: 206699 timeout: 22552 lvb_type: 0
00000100:00100000:1.0:1651531743.768624:0:166112:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bcdb3319 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:166112:1731745997342656:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531743.768643:0:166112:0:(client.c:2492:ptlrpc_set_wait()) set 000000003731e840 going to sleep for 6 seconds
00010000:00010000:1.0:1651531743.768652:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000df4fd81c/0x3234de053ca2821 lrc: 2/0,0 mode: PW/PW res: [0x34510:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531743.768656:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000df4fd81c already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531743.768657:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000df4fd81c/0x3234de053ca2821 lrc: 2/0,0 mode: PW/PW res: [0x34510:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531743.768661:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000df4fd81c/0x3234de053ca2821 lrc: 3/0,0 mode: PW/PW res: [0x34510:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531743.768674:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000df4fd81c/0x3234de053ca2821 lrc: 1/0,0 mode: --/PW res: [0x34510:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531743.768679:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000df4fd81c/0x3234de053ca2821 lrc: 0/0,0 mode: --/PW res: [0x34510:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531743.769951:0:166112:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bcdb3319 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:166112:1731745997342656:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651531743.769957:0:166112:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003ad4b055/0x3234de053ca2828 lrc: 3/0,1 mode: --/PW res: [0x34515:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531743.771556:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531743.771584:0:166103:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466836992
00010000:00010000:0.0:1651531743.771594:0:166103:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca281a lrc: 4/0,0 mode: PW/PW res: [0x34515:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db442bfb expref: 7 pid: 206699 timeout: 22552 lvb_type: 0
00000100:00100000:0.0:1651531743.771607:0:166103:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 82
00000100:00100000:0.0:1651531743.771609:0:166103:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bcdb3319 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:37d7cd70-23c8-4282-b9a2-e45fd1319801+7:438148:x1731754466836992:12345-10.240.43.64@tcp:103:ldlm_bl_02.0
00010000:00010000:0.0:1651531743.771614:0:166103:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531743.771615:0:166103:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca281a lrc: 4/0,0 mode: PW/PW res: [0x34515:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db442bfb expref: 7 pid: 206699 timeout: 22552 lvb_type: 0
00010000:00010000:0.0:1651531743.771620:0:166103:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca281a lrc: 3/0,0 mode: PW/PW res: [0x34515:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db442bfb expref: 7 pid: 206699 timeout: 22552 lvb_type: 0
00010000:00010000:0.0:1651531743.771628:0:166103:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca281a lrc: 0/0,0 mode: --/PW res: [0x34515:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db442bfb expref: 7 pid: 206699 timeout: 22552 lvb_type: 0
00010000:00010000:0.0:1651531743.771632:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531743.771633:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531743.771634:0:166103:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003ad4b055/0x3234de053ca2828 lrc: 3/0,1 mode: PW/PW res: [0x34515:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531743.771642:0:166103:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003ad4b055/0x3234de053ca2828 lrc: 4/0,1 mode: PW/PW res: [0x34515:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531743.771654:0:166103:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1651531743.771662:0:166112:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003ad4b055/0x3234de053ca2828 lrc: 3/0,1 mode: PW/PW res: [0x34515:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531743.771669:0:166103:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bcdb3319 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:37d7cd70-23c8-4282-b9a2-e45fd1319801+6:438148:x1731754466836992:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 59us (113us total) trans 0 rc 0/0
00010000:00010000:1.0:1651531743.771672:0:166112:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003ad4b055/0x3234de053ca2828 lrc: 3/0,1 mode: PW/PW res: [0x34515:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531743.771672:0:166103:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 82
00010000:00010000:1.0:1651531743.771676:0:166112:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003ad4b055/0x3234de053ca2828 lrc: 3/0,1 mode: PW/PW res: [0x34515:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531743.771679:0:166112:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003ad4b055/0x3234de053ca2828 lrc: 2/0,0 mode: PW/PW res: [0x34515:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531743.771712:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003ad4b055/0x3234de053ca2828 lrc: 2/0,0 mode: PW/PW res: [0x34515:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531743.771716:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003ad4b055 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531743.771717:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003ad4b055/0x3234de053ca2828 lrc: 2/0,0 mode: PW/PW res: [0x34515:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531743.771721:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003ad4b055/0x3234de053ca2828 lrc: 3/0,0 mode: PW/PW res: [0x34515:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531743.771725:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003ad4b055/0x3234de053ca2828 lrc: 1/0,0 mode: --/PW res: [0x34515:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531743.771728:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003ad4b055/0x3234de053ca2828 lrc: 0/0,0 mode: --/PW res: [0x34515:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531743.771737:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000080bc1e67 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745951138048:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 3169us (3475us total) trans 21474869026 rc 0/0
00000100:00100000:1.0:1651531743.771741:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 44271
00000400:00000080:1.0:1651531745.317574:0:225929:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648
00000001:02000400:1.0:1651531745.317576:0:225929:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 275: Read on a canceled duplicate lock ==== 22:49:05 (1651531745)
00000100:00100000:0.0:1651531745.456828:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531745.456847:0:169267:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466837504
00000100:00100000:0.0:1651531745.456871:0:169267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11098
00000100:00100000:0.0:1651531745.456874:0:169267:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000053497d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:37d7cd70-23c8-4282-b9a2-e45fd1319801+6:628039:x1731754466837504:12345-10.240.43.64@tcp:103:ldlm_bl_03.0
00010000:00010000:0.0:1651531745.456883:0:169267:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531745.456905:0:169267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e5cdccc8/0x3234de053ca27b1 lrc: 0/0,0 mode: --/PR res: [0x34511:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4429e7 expref: 6 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531745.456914:0:169267:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651531745.456941:0:169267:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000053497d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:37d7cd70-23c8-4282-b9a2-e45fd1319801+5:628039:x1731754466837504:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 66us (116us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531745.456944:0:169267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11098
00000100:00100000:0.0:1651531747.040328:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651531747.040358:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951138368
00000100:00100000:1.0:1651531747.040380:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 58
00000100:00100000:1.0:1651531747.040383:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ffcdece2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745951138368:12345-10.240.43.61@tcp:400:kworker/u4:0.0
00000100:00100000:1.0:1651531747.040416:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ffcdece2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745951138368:12345-10.240.43.61@tcp:400:kworker/u4:0.0 Request processed in 34us (92us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531747.040420:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 58
00000100:00100000:1.0:1651531747.555280:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651531747.555308:0:182071:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951138496
00000100:00100000:1.0:1651531747.555328:0:182071:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 418
00000100:00100000:1.0:1651531747.555331:0:182071:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d09aeb66 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745951138496:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:1.0:1651531747.555348:0:182071:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 350513472 pending 0 free 81284554752 avail 77113843712
00000100:00100000:1.0:1651531747.555373:0:182071:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d09aeb66 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745951138496:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 42us (95us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531747.555376:0:182071:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 418
00000400:00000080:0.0:1651531748.005267:0:226201:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648
00000001:02000400:0.0:1651531748.005269:0:226201:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 276: Race between mount and obd_statfs ==== 22:49:07 (1651531747)
00000100:00100000:1.0:1651531748.545079:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531748.545095:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466838144
00000100:00100000:1.0:1651531748.545113:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 59
00000100:00100000:1.0:1651531748.545115:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f47fde78 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:37d7cd70-23c8-4282-b9a2-e45fd1319801+5:438147:x1731754466838144:12345-10.240.43.64@tcp:400:kworker/u4:1.0
00000100:00100000:1.0:1651531748.545146:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f47fde78 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:37d7cd70-23c8-4282-b9a2-e45fd1319801+5:438147:x1731754466838144:12345-10.240.43.64@tcp:400:kworker/u4:1.0 Request processed in 30us (69us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531748.545149:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 59
00000001:00080000:0.0:1651531749.579621:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869026 is committed
00000100:00100000:1.0:1651531752.672097:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651531752.672109:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951139072
00000100:00100000:1.0:1651531752.672131:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 419
00000100:00100000:1.0:1651531752.672136:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000380124f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951139072:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:1.0:1651531752.672149:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 350513472 pending 0 free 81284554752 avail 77113843712
00000100:00100000:1.0:1651531752.672168:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000380124f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951139072:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 32us (73us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531752.672171:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 419
00000100:00100000:1.0:1651531757.792149:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651531757.792165:0:182071:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951139776
00000100:00100000:1.0:1651531757.792181:0:182071:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 420
00000100:00100000:1.0:1651531757.792184:0:182071:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cfeac242 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951139776:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:1.0:1651531757.792197:0:182071:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 350513472 pending 0 free 81284554752 avail 77113843712
00000100:00100000:1.0:1651531757.792217:0:182071:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cfeac242 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951139776:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 33us (70us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531757.792221:0:182071:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 420
00000100:00100000:1.0:1651531762.912168:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651531762.912195:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951140672
00000100:00100000:0.0:1651531762.912216:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 421
00000100:00100000:0.0:1651531762.912218:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d44b0d9f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951140672:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:0.0:1651531762.912240:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 350513472 pending 0 free 81284554752 avail 77113843712
00000100:00100000:0.0:1651531762.912265:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d44b0d9f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951140672:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 46us (98us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531762.912269:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 421
00000100:00100000:1.0:1651531764.861405:0:39100:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000094cfb6b4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:39100:1731745997342784:10.240.43.61@tcp:400:kworker/u4:0.0
00000100:00100000:0.0:1651531764.861407:0:39099:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000074640db2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9063caa-b124-4cb6-99ef-d01a735595c3:39099:1731745997342720:10.240.43.61@tcp:400:kworker/u4:0.0
00000100:00100000:1.0:1651531764.861715:0:39100:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000094cfb6b4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:39100:1731745997342784:10.240.43.61@tcp:400:kworker/u4:0.0
00000100:00100000:0.0:1651531764.861723:0:39099:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000074640db2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9063caa-b124-4cb6-99ef-d01a735595c3:39099:1731745997342720:10.240.43.61@tcp:400:kworker/u4:0.0
00000100:00100000:1.0:1651531768.032118:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651531768.032141:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951141376
00000100:00100000:0.0:1651531768.032159:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 422
00000100:00100000:0.0:1651531768.032161:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000094cfb6b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951141376:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:0.0:1651531768.032175:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 350513472 pending 0 free 81284554752 avail 77113843712
00000100:00100000:0.0:1651531768.032196:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000094cfb6b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951141376:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 34us (79us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531768.032199:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 422
00000100:00100000:1.0:1651531773.152132:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651531773.152159:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951142144
00000100:00100000:0.0:1651531773.152177:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 423
00000100:00100000:0.0:1651531773.152179:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009414203c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951142144:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:0.0:1651531773.152190:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 350513472 pending 0 free 81284554752 avail 77113843712
00000100:00100000:0.0:1651531773.152211:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009414203c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951142144:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 31us (80us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531773.152215:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 423
00000100:00100000:1.0:1651531774.144966:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531774.144978:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466839872
00000100:00100000:1.0:1651531774.144989:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44272
00000100:00100000:1.0:1651531774.144991:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dfff0362 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:37d7cd70-23c8-4282-b9a2-e45fd1319801+5:438145:x1731754466839872:12345-10.240.43.64@tcp:9:kworker/u4:1.0
00000020:00000080:1.0:1651531774.145029:0:166112:0:(genops.c:1442:class_disconnect()) disconnect: cookie 0x3234de053c863a5
00000100:00080000:1.0:1651531774.145043:0:166112:0:(import.c:85:import_set_state_nolock()) 000000002221d22c �������: changing import state from FULL to CLOSED
00000001:00000004:1.0:1651531774.145110:0:166112:0:(tgt_lastrcvd.c:701:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 5, last_transno is 21474869026
00000100:00100000:1.0:1651531774.145166:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dfff0362 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:37d7cd70-23c8-4282-b9a2-e45fd1319801+2:438145:x1731754466839872:12345-10.240.43.64@tcp:9:kworker/u4:1.0 Request processed in 173us (200us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531774.145169:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44272
00000100:00100000:1.0:1651531778.272114:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651531778.272124:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951142848
00000100:00100000:1.0:1651531778.272135:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 424
00000100:00100000:1.0:1651531778.272137:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c6960eaf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951142848:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:1.0:1651531778.272146:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 141632 pending 0 free 81284554752 avail 77113843712
00000100:00100000:1.0:1651531778.272159:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c6960eaf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951142848:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 22us (47us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531778.272162:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 424
00000001:00100000:0.0:1651531780.271739:0:166098:0:(tgt_lastrcvd.c:537:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 37d7cd70-23c8-4282-b9a2-e45fd1319801
00000020:00000080:0.0:1651531780.271742:0:166098:0:(genops.c:985:class_export_put()) final put 000000006b213d89/37d7cd70-23c8-4282-b9a2-e45fd1319801
00000020:00000080:1.0:1651531780.271773:0:213652:0:(genops.c:944:class_export_destroy()) destroying export 000000006b213d89/37d7cd70-23c8-4282-b9a2-e45fd1319801 for lustre-OST0001
00000020:00000080:1.0:1651531780.271800:0:213652:0:(genops.c:1164:obd_zombie_import_free()) destroying import 000000002221d22c for lustre-OST0001
00000100:00100000:1.0:1651531783.392142:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651531783.392152:0:182071:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951143552
00000100:00100000:1.0:1651531783.392164:0:182071:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 425
00000100:00100000:1.0:1651531783.392166:0:182071:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000232e8d19 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951143552:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:1.0:1651531783.392175:0:182071:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 141632 pending 0 free 81284554752 avail 77113843712
00000100:00100000:1.0:1651531783.392190:0:182071:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000232e8d19 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951143552:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 24us (50us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531783.392193:0:182071:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 425
00000100:00100000:1.0:1651531788.512095:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651531788.512121:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951144320
00000100:00100000:0.0:1651531788.512140:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 426
00000100:00100000:0.0:1651531788.512142:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002eb188c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951144320:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:0.0:1651531788.512153:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 141632 pending 0 free 81284554752 avail 77113843712
00000100:00100000:0.0:1651531788.512175:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002eb188c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951144320:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 33us (81us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531788.512179:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 426
00000100:00100000:1.0:1651531789.949288:0:39100:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e11ae1c5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:39100:1731745997342912:10.240.43.61@tcp:400:kworker/u4:0.0
00000100:00100000:0.0:1651531789.949291:0:39099:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000074640db2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9063caa-b124-4cb6-99ef-d01a735595c3:39099:1731745997342848:10.240.43.61@tcp:400:kworker/u4:0.0
00000100:00100000:1.0:1651531789.949559:0:39100:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e11ae1c5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:39100:1731745997342912:10.240.43.61@tcp:400:kworker/u4:0.0
00000100:00100000:0.0:1651531789.949559:0:39099:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000074640db2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9063caa-b124-4cb6-99ef-d01a735595c3:39099:1731745997342848:10.240.43.61@tcp:400:kworker/u4:0.0
00000100:00100000:1.0:1651531793.632110:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651531793.632139:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951145088
00000100:00100000:0.0:1651531793.632157:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 427
00000100:00100000:0.0:1651531793.632162:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e11ae1c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951145088:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:0.0:1651531793.632172:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 141632 pending 0 free 81284554752 avail 77113843712
00000100:00100000:0.0:1651531793.632194:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e11ae1c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951145088:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 32us (85us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531793.632197:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 427
00000100:00100000:1.0:1651531798.752098:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651531798.752120:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951145856
00000100:00100000:0.0:1651531798.752146:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 428
00000100:00100000:0.0:1651531798.752149:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007a693f14 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951145856:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:0.0:1651531798.752159:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 141632 pending 0 free 81284554752 avail 77113843712
00000100:00100000:0.0:1651531798.752178:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007a693f14 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951145856:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 29us (81us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531798.752182:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 428
00000100:00100000:1.0:1651531803.872103:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651531803.872130:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951146624
00000100:00100000:0.0:1651531803.872148:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 429
00000100:00100000:0.0:1651531803.872150:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f2eb86bf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951146624:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:0.0:1651531803.872160:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 141632 pending 0 free 81284554752 avail 77113843712
00000100:00100000:0.0:1651531803.872181:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f2eb86bf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951146624:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 31us (79us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531803.872184:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 429
00000100:00100000:1.0:1651531808.992085:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651531808.992115:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951147328
00000100:00100000:0.0:1651531808.992132:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 430
00000100:00100000:0.0:1651531808.992134:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e589436f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951147328:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:0.0:1651531808.992143:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 141632 pending 0 free 81284554752 avail 77113843712
00000100:00100000:0.0:1651531808.992164:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e589436f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951147328:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 30us (81us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531808.992172:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 430
00000100:00100000:1.0:1651531814.112178:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651531814.112210:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951148032
00000100:00100000:0.0:1651531814.112245:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 431
00000100:00100000:0.0:1651531814.112247:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a19b10fa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951148032:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:0.0:1651531814.112265:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 141632 pending 0 free 81284554752 avail 77113843712
00000100:00100000:0.0:1651531814.112297:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a19b10fa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951148032:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 49us (123us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531814.112300:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 431
00000100:00100000:1.0:1651531815.037308:0:39100:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000046de8644 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:39100:1731745997343040:10.240.43.61@tcp:400:kworker/u4:0.0
00000100:00100000:0.0:1651531815.037312:0:39099:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cb694635 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9063caa-b124-4cb6-99ef-d01a735595c3:39099:1731745997342976:10.240.43.61@tcp:400:kworker/u4:0.0
00000100:00100000:1.0:1651531815.037629:0:39100:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000046de8644 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:39100:1731745997343040:10.240.43.61@tcp:400:kworker/u4:0.0
00000100:00100000:0.0:1651531815.037633:0:39099:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cb694635 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9063caa-b124-4cb6-99ef-d01a735595c3:39099:1731745997342976:10.240.43.61@tcp:400:kworker/u4:0.0
00000100:00100000:1.0:1651531819.232112:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651531819.232138:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951148736
00000100:00100000:0.0:1651531819.232156:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 432
00000100:00100000:0.0:1651531819.232159:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000046de8644 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951148736:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:0.0:1651531819.232169:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 141632 pending 0 free 81284554752 avail 77113843712
00000100:00100000:0.0:1651531819.232191:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000046de8644 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951148736:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 31us (80us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531819.232194:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 432
00000100:00100000:1.0:1651531824.352090:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651531824.352118:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951149504
00000100:00100000:0.0:1651531824.352136:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 433
00000100:00100000:0.0:1651531824.352138:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000046e76bd1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951149504:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:0.0:1651531824.352148:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 141632 pending 0 free 81284554752 avail 77113843712
00000100:00100000:0.0:1651531824.352169:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000046e76bd1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951149504:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 30us (81us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531824.352179:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 433
00000100:00100000:1.0:1651531829.472078:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651531829.472099:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951150400
00000100:00100000:0.0:1651531829.472128:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 434
00000100:00100000:0.0:1651531829.472130:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007fc0def2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951150400:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:0.0:1651531829.472141:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 141632 pending 0 free 81284554752 avail 77113843712
00000100:00100000:0.0:1651531829.472162:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007fc0def2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951150400:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 31us (86us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531829.472165:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 434
00000100:00100000:1.0:1651531834.592085:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651531834.592118:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951151104
00000100:00100000:0.0:1651531834.592136:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 435
00000100:00100000:0.0:1651531834.592138:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001946d870 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951151104:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:0.0:1651531834.592147:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 141632 pending 0 free 81284554752 avail 77113843712
00000100:00100000:0.0:1651531834.592168:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001946d870 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951151104:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 29us (84us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531834.592171:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 435
00000100:00100000:1.0:1651531839.712091:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651531839.712126:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951151808
00000100:00100000:0.0:1651531839.712143:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 436
00000100:00100000:0.0:1651531839.712146:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006e9adaac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951151808:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:0.0:1651531839.712155:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 141632 pending 0 free 81284554752 avail 77113843712
00000100:00100000:0.0:1651531839.712173:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006e9adaac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951151808:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 27us (83us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531839.712177:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 436
00000100:00100000:1.0:1651531840.125280:0:39100:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dac65852 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:39100:1731745997343168:10.240.43.61@tcp:400:kworker/u4:1.0
00000100:00100000:0.0:1651531840.125285:0:39099:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a9fc5082 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9063caa-b124-4cb6-99ef-d01a735595c3:39099:1731745997343104:10.240.43.61@tcp:400:kworker/u4:1.0
00000100:00100000:1.0:1651531840.125566:0:39100:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dac65852 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:39100:1731745997343168:10.240.43.61@tcp:400:kworker/u4:1.0
00000100:00100000:0.0:1651531840.125571:0:39099:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a9fc5082 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9063caa-b124-4cb6-99ef-d01a735595c3:39099:1731745997343104:10.240.43.61@tcp:400:kworker/u4:1.0
00000100:00100000:1.0:1651531844.832134:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651531844.832160:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951152448
00000100:00100000:0.0:1651531844.832177:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 437
00000100:00100000:0.0:1651531844.832180:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dac65852 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951152448:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:0.0:1651531844.832189:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 141632 pending 0 free 81284554752 avail 77113843712
00000100:00100000:0.0:1651531844.832207:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dac65852 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951152448:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 26us (74us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531844.832210:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 437
00000400:00000080:1.0:1651531848.975852:0:226419:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648
00000001:02000400:1.0:1651531848.975854:0:226419:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 277: Direct IO shall drop page cache ====== 22:50:48 (1651531848)
00000100:00100000:1.0:1651531848.999423:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531848.999441:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466845440
00000100:00100000:1.0:1651531848.999461:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44273
00000100:00100000:1.0:1651531848.999464:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c62d1815 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:438145:x1731754466845440:12345-10.240.43.64@tcp:8:dd.0
00010000:00080000:1.0:1651531848.999488:0:166112:0:(ldlm_lib.c:1365:target_handle_connect()) lustre-OST0001: connection from 37d7cd70-23c8-4282-b9a2-e45fd1319801@10.240.43.64@tcp t0 exp 0000000055bfac58 cur 22507 last 0
00000020:00000080:1.0:1651531848.999509:0:166112:0:(genops.c:1359:class_connect()) connect: client 37d7cd70-23c8-4282-b9a2-e45fd1319801, cookie 0x3234de053ca282f
00002000:00100000:1.0:1651531848.999517:0:166112:0:(ofd_obd.c:150:ofd_parse_connect_data()) lustre-OST0001: cli 37d7cd70-23c8-4282-b9a2-e45fd1319801/00000000a9a81765 ocd_connect_flags: 0xa0465af2e3640078 ocd_version: 20f0000 ocd_grant: 349298688 ocd_index: 0 ocd_group 0
00002000:00100000:1.0:1651531848.999527:0:166112:0:(ofd_obd.c:249:ofd_parse_connect_data()) lustre-OST0001: cli <unknown> supports cksum type f7, return f7
00000020:01000000:1.0:1651531848.999565:0:166112:0:(lprocfs_status_server.c:544:lprocfs_exp_setup()) using hash 00000000427049c0
00002000:00080000:1.0:1651531848.999580:0:166112:0:(ofd_obd.c:391:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0
00000100:00080000:1.0:1651531848.999606:0:166112:0:(import.c:85:import_set_state_nolock()) 0000000035d1f7a9 �������: changing import state from RECOVER to FULL
00000100:00100000:1.0:1651531848.999633:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c62d1815 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:37d7cd70-23c8-4282-b9a2-e45fd1319801+6:438145:x1731754466845440:12345-10.240.43.64@tcp:8:dd.0 Request processed in 169us (213us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531848.999637:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44273
00000100:00100000:1.0:1651531848.999912:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531848.999920:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466845504
00000100:00100000:1.0:1651531848.999935:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44274
00000100:00100000:1.0:1651531848.999937:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a9fc5082 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:37d7cd70-23c8-4282-b9a2-e45fd1319801+6:665910:x1731754466845504:12345-10.240.43.64@tcp:101:dd.0
00010000:00010000:1.0:1651531848.999941:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531848.999951:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000df4fd81c/0x3234de053ca2836 lrc: 2/0,0 mode: --/PW res: [0x34516:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db442cb8 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651531848.999962:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34516:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:1.0:1651531848.999969:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531848.999970:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531848.999975:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000df4fd81c/0x3234de053ca2836 lrc: 3/0,0 mode: PW/PW res: [0x34516:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db442cb8 expref: 7 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531848.999982:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000df4fd81c/0x3234de053ca2836 lrc: 3/0,0 mode: PW/PW res: [0x34516:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db442cb8 expref: 7 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531848.999987:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000df4fd81c, rc 0)
00000100:00100000:1.0:1651531848.999998:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a9fc5082 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:37d7cd70-23c8-4282-b9a2-e45fd1319801+7:665910:x1731754466845504:12345-10.240.43.64@tcp:101:dd.0 Request processed in 61us (87us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531849.000003:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44274
00000100:00100000:1.0:1651531849.017147:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531849.017158:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466845952
00002000:00100000:1.0:1651531849.017177:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x34516:0x0] (0->1048575)  req@00000000d710c5fd x1731754466845952/t0(0) o4->37d7cd70-23c8-4282-b9a2-e45fd1319801@10.240.43.64@tcp:314/0 lens 488/0 e 0 to 0 dl 1651531859 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0'
00002000:00100000:1.0:1651531849.017182:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000d710c5fd with x1731754466845952 ext(0->1048575)
00002000:00010000:1.0:1651531849.017184:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000d710c5fd
00000100:00100000:1.0:1651531849.017196:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249519
00000100:00100000:1.0:1651531849.017198:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d710c5fd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:37d7cd70-23c8-4282-b9a2-e45fd1319801+7:438148:x1731754466845952:12345-10.240.43.64@tcp:4:dd.0
00000001:00100000:0.0:1651531849.043781:0:166098:0:(tgt_lastrcvd.c:537:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 37d7cd70-23c8-4282-b9a2-e45fd1319801
00000100:00100000:1.0:1651531849.044484:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d710c5fd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:37d7cd70-23c8-4282-b9a2-e45fd1319801+8:438148:x1731754466845952:12345-10.240.43.64@tcp:4:dd.0 Request processed in 27285us (27336us total) trans 21474869027 rc 0/0
00000100:00100000:1.0:1651531849.044489:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249519
00002000:00100000:1.0:1651531849.044492:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x34516:0x0] (0->1048575)  req@00000000d710c5fd x1731754466845952/t21474869027(0) o4->37d7cd70-23c8-4282-b9a2-e45fd1319801@10.240.43.64@tcp:314/0 lens 488/448 e 0 to 0 dl 1651531859 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0'
00002000:00100000:1.0:1651531849.044496:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000d710c5fd with x1731754466845952 ext(0->1048575)
00002000:00010000:1.0:1651531849.044498:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000d710c5fd
00000100:00100000:1.0:1651531849.045220:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531849.045238:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466846080
00000100:00100000:1.0:1651531849.045256:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249520
00000100:00100000:1.0:1651531849.045257:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001304ce4c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:37d7cd70-23c8-4282-b9a2-e45fd1319801+8:438149:x1731754466846080:12345-10.240.43.64@tcp:4:dd.0
00010000:00010000:1.0:1651531849.045266:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000378a069e/0x3234de053ca283d lrc: 3/0,1 mode: --/PW res: [0x34516:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531849.045273:0:216321:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000df4fd81c/0x3234de053ca2836 lrc: 2/0,0 mode: PW/PW res: [0x34516:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db442cb8 expref: 8 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531849.045278:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531849.045279:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531849.045280:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000378a069e/0x3234de053ca283d lrc: 4/0,1 mode: --/PW res: [0x34516:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531849.045291:0:216321:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000df4fd81c/0x3234de053ca2836 lrc: 3/0,0 mode: PW/PW res: [0x34516:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db442cb8 expref: 8 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531849.045296:0:216321:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000df4fd81c/0x3234de053ca2836 lrc: 4/0,0 mode: PW/PW res: [0x34516:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db442cb8 expref: 8 pid: 166112 timeout: 22657 lvb_type: 0
00000100:00100000:1.0:1651531849.045301:0:216321:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009b569a7a pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997343232:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531849.045320:0:216321:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b0ded350 going to sleep for 11 seconds
00000100:00100000:1.0:1651531849.045564:0:216321:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009b569a7a pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997343232:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651531849.045570:0:216321:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000378a069e/0x3234de053ca283d lrc: 3/0,1 mode: --/PW res: [0x34516:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531849.045627:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531849.045649:0:166103:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466846144
00010000:00010000:0.0:1651531849.045660:0:166103:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000df4fd81c/0x3234de053ca2836 lrc: 4/0,0 mode: PW/PW res: [0x34516:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db442cb8 expref: 9 pid: 166112 timeout: 22657 lvb_type: 0
00000100:00100000:0.0:1651531849.045673:0:166103:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 83
00000100:00100000:0.0:1651531849.045675:0:166103:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009b569a7a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:37d7cd70-23c8-4282-b9a2-e45fd1319801+9:438148:x1731754466846144:12345-10.240.43.64@tcp:103:ldlm_bl_02.0
00010000:00010000:0.0:1651531849.045680:0:166103:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00002000:00010000:0.0:1651531849.045685:0:166103:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x34516:0x0] updating lvb size from disk: 0 -> 1048576
00002000:00010000:0.0:1651531849.045686:0:166103:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x34516:0x0] updating lvb mtime from disk: 0 -> 1651531849
00002000:00010000:0.0:1651531849.045687:0:166103:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x34516:0x0] updating lvb ctime from disk: 0 -> 1651531849
00002000:00010000:0.0:1651531849.045688:0:166103:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x34516:0x0] updating lvb blocks from disk: 0 -> 2048
00010000:00010000:0.0:1651531849.045690:0:166103:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000df4fd81c/0x3234de053ca2836 lrc: 4/0,0 mode: PW/PW res: [0x34516:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db442cb8 expref: 9 pid: 166112 timeout: 22657 lvb_type: 0
00010000:00010000:0.0:1651531849.045695:0:166103:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000df4fd81c/0x3234de053ca2836 lrc: 3/0,0 mode: PW/PW res: [0x34516:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db442cb8 expref: 9 pid: 166112 timeout: 22657 lvb_type: 0
00010000:00010000:0.0:1651531849.045703:0:166103:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000df4fd81c/0x3234de053ca2836 lrc: 0/0,0 mode: --/PW res: [0x34516:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db442cb8 expref: 9 pid: 166112 timeout: 22657 lvb_type: 0
00010000:00010000:0.0:1651531849.045709:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531849.045710:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531849.045711:0:166103:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000378a069e/0x3234de053ca283d lrc: 3/0,1 mode: PW/PW res: [0x34516:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531849.045714:0:166103:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000378a069e/0x3234de053ca283d lrc: 4/0,1 mode: PW/PW res: [0x34516:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531849.045728:0:166103:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1651531849.045740:0:216321:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000378a069e/0x3234de053ca283d lrc: 3/0,1 mode: PW/PW res: [0x34516:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531849.045744:0:166103:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009b569a7a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:37d7cd70-23c8-4282-b9a2-e45fd1319801+8:438148:x1731754466846144:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 68us (125us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531849.045747:0:166103:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 83
00010000:00010000:1.0:1651531849.045749:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000378a069e/0x3234de053ca283d lrc: 3/0,1 mode: PW/PW res: [0x34516:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531849.118274:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869028 is committed
00010000:00010000:1.0:1651531849.118319:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000378a069e/0x3234de053ca283d lrc: 3/0,1 mode: PW/PW res: [0x34516:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531849.118330:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000378a069e/0x3234de053ca283d lrc: 2/0,0 mode: PW/PW res: [0x34516:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531849.118355:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001304ce4c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:37d7cd70-23c8-4282-b9a2-e45fd1319801+5:438149:x1731754466846080:12345-10.240.43.64@tcp:4:dd.0 Request processed in 73097us (73135us total) trans 21474869028 rc 0/0
00010000:00010000:0.0:1651531849.118355:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000378a069e/0x3234de053ca283d lrc: 2/0,0 mode: PW/PW res: [0x34516:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531849.118359:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249520
00010000:00010000:0.0:1651531849.118361:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000378a069e already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531849.118363:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000378a069e/0x3234de053ca283d lrc: 2/0,0 mode: PW/PW res: [0x34516:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531849.118367:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000378a069e/0x3234de053ca283d lrc: 3/0,0 mode: PW/PW res: [0x34516:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531849.118373:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000378a069e/0x3234de053ca283d lrc: 1/0,0 mode: --/PW res: [0x34516:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531849.118376:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000378a069e/0x3234de053ca283d lrc: 0/0,0 mode: --/PW res: [0x34516:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531849.952217:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651531849.952255:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951153216
00000100:00100000:1.0:1651531849.952275:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 438
00000100:00100000:1.0:1651531849.952277:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6928355 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951153216:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:1.0:1651531849.952291:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 23308608 pending 0 free 81284554752 avail 77111697408
00000100:00100000:1.0:1651531849.952314:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6928355 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951153216:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 37us (101us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531849.952318:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 438
00000400:00000080:0.0:1651531850.491976:0:226637:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648
00000001:02000400:0.0:1651531850.491978:0:226637:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 278: Race starting MDS between MDTs stop/start ========================================================== 22:50:50 (1651531850)
00000400:00000080:1.0:1651531850.810945:0:226691:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648
00000001:02000400:1.0:1651531850.810948:0:226691:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity test_278 needs >= 2 MDTs
00000400:00000080:0.0:1651531851.160664:0:226745:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648
00000001:02000400:0.0:1651531851.160667:0:226745:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 280: Race between MGS umount and client llog processing ========================================================== 22:50:50 (1651531850)
00000100:00100000:1.0:1651531851.435550:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531851.435583:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466846656
00000100:00100000:0.0:1651531851.435605:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44275
00000100:00100000:0.0:1651531851.435608:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002512e905 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:37d7cd70-23c8-4282-b9a2-e45fd1319801+5:666844:x1731754466846656:12345-10.240.43.64@tcp:9:umount.0
00000020:00000080:0.0:1651531851.435625:0:166112:0:(genops.c:1442:class_disconnect()) disconnect: cookie 0x3234de053ca282f
00000100:00080000:0.0:1651531851.435628:0:166112:0:(import.c:85:import_set_state_nolock()) 0000000035d1f7a9 �������: changing import state from FULL to CLOSED
00000001:00000004:0.0:1651531851.435645:0:166112:0:(tgt_lastrcvd.c:701:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 5, last_transno is 21474869028
00000100:00100000:0.0:1651531851.435716:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002512e905 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:37d7cd70-23c8-4282-b9a2-e45fd1319801+2:666844:x1731754466846656:12345-10.240.43.64@tcp:9:umount.0 Request processed in 107us (169us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531851.435720:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44275
00000100:00100000:1.0:1651531853.227220:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651531853.227262:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951153792
00000100:00100000:0.0:1651531853.227286:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 44276
00000100:00100000:0.0:1651531853.227289:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000374facb9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:330390:x1731745951153792:12345-10.240.43.61@tcp:9:umount.0
00000020:00000080:0.0:1651531853.227307:0:206699:0:(genops.c:1442:class_disconnect()) disconnect: cookie 0x3234de053ca24d2
00000100:00080000:0.0:1651531853.227311:0:206699:0:(import.c:85:import_set_state_nolock()) 00000000bac59f98 �������: changing import state from FULL to CLOSED
00000001:00000004:0.0:1651531853.227329:0:206699:0:(tgt_lastrcvd.c:701:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 5, last_transno is 21474869028
00000100:00100000:0.0:1651531853.227395:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000374facb9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+2:330390:x1731745951153792:12345-10.240.43.61@tcp:9:umount.0 Request processed in 105us (179us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531853.227399:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 44276
00000001:00100000:0.0:1651531857.559421:0:166098:0:(tgt_lastrcvd.c:537:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID
00000020:00000080:0.0:1651531857.559425:0:166098:0:(genops.c:985:class_export_put()) final put 00000000747c1313/lustre-MDT0000-mdtlov_UUID
00000001:00100000:0.0:1651531857.559438:0:166098:0:(tgt_lastrcvd.c:537:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 37d7cd70-23c8-4282-b9a2-e45fd1319801
00000020:00000080:0.0:1651531857.559439:0:166098:0:(genops.c:985:class_export_put()) final put 00000000a9a81765/37d7cd70-23c8-4282-b9a2-e45fd1319801
00000020:00000080:1.0:1651531857.559450:0:213652:0:(genops.c:944:class_export_destroy()) destroying export 00000000747c1313/lustre-MDT0000-mdtlov_UUID for lustre-OST0001
00000020:00000080:1.0:1651531857.559471:0:213652:0:(genops.c:944:class_export_destroy()) destroying export 00000000a9a81765/37d7cd70-23c8-4282-b9a2-e45fd1319801 for lustre-OST0001
00000020:00000080:1.0:1651531857.559477:0:213652:0:(genops.c:1164:obd_zombie_import_free()) destroying import 00000000bac59f98 for lustre-OST0001
00000020:00000080:1.0:1651531857.559478:0:213652:0:(genops.c:1164:obd_zombie_import_free()) destroying import 0000000035d1f7a9 for lustre-OST0001
00000100:00100000:1.0:1651531864.013048:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651531864.013083:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951154688
00000100:00100000:0.0:1651531864.013106:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 44277
00000100:00100000:0.0:1651531864.013109:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ee01c0ad pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:39028:x1731745951154688:12345-10.240.43.61@tcp:8:llog_process_th.0
00010000:00080000:0.0:1651531864.013124:0:166112:0:(ldlm_lib.c:1365:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@10.240.43.61@tcp t0 exp 0000000055bfac58 cur 22522 last 0
00000020:00000080:0.0:1651531864.013150:0:166112:0:(genops.c:1359:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3234de053ca2844
00002000:00100000:0.0:1651531864.013155:0:166112:0:(ofd_obd.c:150:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/00000000f885a60d ocd_connect_flags: 0x2044401443000066 ocd_version: 20f0000 ocd_grant: 0 ocd_index: 1 ocd_group 0
00002000:00080000:0.0:1651531864.013157:0:166112:0:(ofd_obd.c:168:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0
00002000:00100000:0.0:1651531864.013158:0:166112:0:(ofd_obd.c:257:ofd_parse_connect_data()) lustre-OST0001: cli <unknown> does not support OBD_CONNECT_CKSUM
00000020:01000000:0.0:1651531864.013190:0:166112:0:(lprocfs_status_server.c:544:lprocfs_exp_setup()) using hash 00000000427049c0
00002000:00080000:0.0:1651531864.013194:0:166112:0:(ofd_obd.c:391:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0
00000100:00080000:0.0:1651531864.013216:0:166112:0:(import.c:85:import_set_state_nolock()) 00000000478135a8 �������: changing import state from RECOVER to FULL
00000100:00100000:0.0:1651531864.013263:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ee01c0ad pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:39028:x1731745951154688:12345-10.240.43.61@tcp:8:llog_process_th.0 Request processed in 153us (220us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531864.013267:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 44277
00000100:00100000:1.0:1651531864.014878:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651531864.014890:0:182071:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951154816
00000100:00100000:1.0:1651531864.014902:0:182071:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 439
00000100:00100000:1.0:1651531864.014908:0:182071:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006ea40253 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745951154816:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:1.0:1651531864.014919:0:182071:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 141632 pending 0 free 81283506176 avail 77112795136
00000100:00100000:1.0:1651531864.014934:0:182071:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006ea40253 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745951154816:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 25us (56us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531864.014937:0:182071:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 439
00000100:00100000:1.0:1651531865.213284:0:39100:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002ef35a72 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:39100:1731745997343360:10.240.43.61@tcp:400:kworker/u4:1.0
00000100:00100000:1.0:1651531865.213317:0:39100:0:(ptlrpcd.c:414:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1651531865.213320:0:39100:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000052213cb9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9063caa-b124-4cb6-99ef-d01a735595c3:39100:1731745997343296:10.240.43.61@tcp:400:kworker/u4:1.0
00000100:00080000:1.0:1651531865.213576:0:39100:0:(recover.c:232:ptlrpc_request_handle_notconn()) import MGC10.240.43.61@tcp of MGS@10.240.43.61@tcp abruptly disconnected: reconnecting
00000100:00080000:1.0:1651531865.213578:0:39100:0:(import.c:85:import_set_state_nolock()) 000000000aba9d44 MGS: changing import state from FULL to DISCONN
00000100:02020000:1.0:1651531865.213580:0:39100:0:(import.c:205:ptlrpc_set_import_discon()) 166-1: MGC10.240.43.61@tcp: Connection to MGS (at 10.240.43.61@tcp) was lost; in progress operations using this service will fail
00000100:00080000:1.0:1651531865.217266:0:39100:0:(import.c:211:ptlrpc_set_import_discon()) import MGS@10.240.43.61@tcp for MGC10.240.43.61@tcp not replayable, auto-deactivating
00000100:00080000:1.0:1651531865.217268:0:39100:0:(import.c:156:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID
00000100:00100000:1.0:1651531865.217271:0:39100:0:(client.c:3319:ptlrpc_abort_inflight()) @@@ inflight  req@0000000052213cb9 x1731745997343296/t0(0) o400->MGC10.240.43.61@tcp@10.240.43.61@tcp:26/25 lens 224/224 e 0 to 0 dl 1651531872 ref 1 fl Rpc:RNQU/0/0 rc 0/-107 job:'kworker/u4:1.0'
10000000:01000000:1.0:1651531865.217286:0:39100:0:(mgc_request.c:1330:mgc_import_event()) import event 0x808001
00000100:00080000:1.0:1651531865.217288:0:39100:0:(pinger.c:214:ptlrpc_pinger_ir_down()) IR down
10000000:01000000:1.0:1651531865.217288:0:39100:0:(mgc_request.c:1330:mgc_import_event()) import event 0x808002
00000100:00080000:1.0:1651531865.217290:0:39100:0:(import.c:85:import_set_state_nolock()) 000000000aba9d44 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1651531865.217292:0:39100:0:(import.c:533:import_select_connection()) MGC10.240.43.61@tcp: connect to NID 10.240.43.61@tcp last attempt 22323
00000100:00080000:1.0:1651531865.217298:0:39100:0:(import.c:614:import_select_connection()) MGC10.240.43.61@tcp: import 000000000aba9d44 using connection MGC10.240.43.61@tcp_0/10.240.43.61@tcp
00000100:00100000:1.0:1651531865.217305:0:39100:0:(import.c:806:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000be87d738 x1731745997343424/t0(0) o250->MGC10.240.43.61@tcp@10.240.43.61@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:1.0:1651531865.217319:0:39100:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000052213cb9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9063caa-b124-4cb6-99ef-d01a735595c3:39100:1731745997343296:10.240.43.61@tcp:400:kworker/u4:1.0
00000100:00080000:1.0:1651531865.217325:0:39100:0:(recover.c:232:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@10.240.43.61@tcp abruptly disconnected: reconnecting
00000100:00080000:1.0:1651531865.217328:0:39100:0:(import.c:85:import_set_state_nolock()) 0000000070a36139 lustre-MDT0000_UUID: changing import state from FULL to DISCONN
00000100:02000400:1.0:1651531865.217329:0:39100:0:(import.c:199:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 10.240.43.61@tcp) was lost; in progress operations using this service will wait for recovery to complete
00000100:00100000:0.0:1651531865.217556:0:39098:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000be87d738 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c9063caa-b124-4cb6-99ef-d01a735595c3:39098:1731745997343424:10.240.43.61@tcp:250:ptlrpcd_00_01.0
00000100:00080000:1.0:1651531865.221308:0:39100:0:(import.c:85:import_set_state_nolock()) 0000000070a36139 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1651531865.221310:0:39100:0:(import.c:533:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 10.240.43.61@tcp last attempt 22323
00000100:00080000:1.0:1651531865.221312:0:39100:0:(import.c:614:import_select_connection()) lustre-MDT0000-lwp-OST0001: import 0000000070a36139 using connection 10.240.43.61@tcp/10.240.43.61@tcp
00000100:00100000:1.0:1651531865.221320:0:39100:0:(import.c:806:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@0000000063869776 x1731745997343488/t0(0) o38->lustre-MDT0000-lwp-OST0001@10.240.43.61@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:1.0:1651531865.221328:0:39100:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002ef35a72 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:39100:1731745997343360:10.240.43.61@tcp:400:kworker/u4:1.0
00000100:00100000:0.0:1651531865.221342:0:39098:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000063869776 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:39098:1731745997343488:10.240.43.61@tcp:38:ptlrpcd_00_01.0
00000100:00080000:0.0:1651531865.221359:0:39098:0:(import.c:1073:ptlrpc_connect_interpret()) MGC10.240.43.61@tcp: connect to target with instance 0
10000000:01000000:0.0:1651531865.221375:0:39098:0:(mgc_request.c:1330:mgc_import_event()) import event 0x808005
00000100:02000400:0.0:1651531865.221376:0:39098:0:(import.c:1233:ptlrpc_connect_interpret()) Evicted from MGS (at 10.240.43.61@tcp) after server handle changed from 0x7e7b1585546a16ed to 0x7e7b1585546d7712
00000100:00080000:0.0:1651531865.224599:0:39098:0:(import.c:85:import_set_state_nolock()) 000000000aba9d44 MGS: changing import state from CONNECTING to EVICTED
00000100:00080000:0.0:1651531865.224601:0:39098:0:(import.c:1572:ptlrpc_import_recovery_state_machine()) evicted from MGS@10.240.43.61@tcp; invalidating
00000100:00100000:0.0:1651531865.224802:0:39098:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000be87d738 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c9063caa-b124-4cb6-99ef-d01a735595c3:39098:1731745997343424:10.240.43.61@tcp:250:ptlrpcd_00_01.0
00000100:00080000:0.0:1651531865.224817:0:39098:0:(import.c:85:import_set_state_nolock()) 0000000070a36139 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1651531865.224823:0:39098:0:(import.c:1428:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 10.240.43.61@tcp failed (-11)
00000100:00100000:0.0:1651531865.224825:0:39098:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000063869776 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:39098:1731745997343488:10.240.43.61@tcp:38:ptlrpcd_00_01.0
00000100:00080000:1.0:1651531865.225179:0:226749:0:(import.c:1512:ptlrpc_invalidate_import_thread()) thread invalidate import MGC10.240.43.61@tcp to MGS@10.240.43.61@tcp
00000100:00100000:1.0:1651531865.225181:0:226749:0:(import.c:338:ptlrpc_invalidate_import()) Sleeping 100s for inflight to error out
10000000:01000000:1.0:1651531865.225182:0:226749:0:(mgc_request.c:1330:mgc_import_event()) import event 0x808003
00010000:00010000:1.0:1651531865.225197:0:226749:0:(ldlm_request.c:1234:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC10.240.43.61@tcp lock: 00000000e9b84540/0x3234de053ca25c7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x7e7b1585546a1710 expref: -99 pid: 166108 timeout: 0 lvb_type: 0
10000000:00010000:1.0:1651531865.225203:0:226749:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC10.240.43.61@tcp lock: 00000000e9b84540/0x3234de053ca25c7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x7e7b1585546a1710 expref: -99 pid: 166108 timeout: 0 lvb_type: 0
10000000:01000000:1.0:1651531865.225206:0:226749:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap)
00010000:00010000:1.0:1651531865.225216:0:226749:0:(ldlm_request.c:1250:ldlm_cli_cancel_local()) not sending request (at caller's instruction)
00010000:00010000:1.0:1651531865.225219:0:226749:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC10.240.43.61@tcp lock: 00000000e9b84540/0x3234de053ca25c7 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x7e7b1585546a1710 expref: -99 pid: 166108 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531865.225235:0:226749:0:(ldlm_request.c:1234:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC10.240.43.61@tcp lock: 0000000000dcc150/0x3234de053ca25b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x7e7b1585546a16fb expref: -99 pid: 166108 timeout: 0 lvb_type: 0
10000000:00010000:1.0:1651531865.225238:0:226749:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC10.240.43.61@tcp lock: 0000000000dcc150/0x3234de053ca25b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x7e7b1585546a16fb expref: -99 pid: 166108 timeout: 0 lvb_type: 0
10000000:01000000:1.0:1651531865.225240:0:226749:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre)
00010000:00010000:1.0:1651531865.225243:0:226749:0:(ldlm_request.c:1250:ldlm_cli_cancel_local()) not sending request (at caller's instruction)
00010000:00010000:1.0:1651531865.225244:0:226749:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC10.240.43.61@tcp lock: 0000000000dcc150/0x3234de053ca25b2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x7e7b1585546a16fb expref: -99 pid: 166108 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531865.225247:0:226749:0:(ldlm_request.c:1234:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC10.240.43.61@tcp lock: 00000000bc1fa390/0x3234de053ca25b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x7e7b1585546a1702 expref: -99 pid: 166108 timeout: 0 lvb_type: 0
10000000:00010000:1.0:1651531865.225250:0:226749:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC10.240.43.61@tcp lock: 00000000bc1fa390/0x3234de053ca25b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x7e7b1585546a1702 expref: -99 pid: 166108 timeout: 0 lvb_type: 0
10000000:01000000:1.0:1651531865.225252:0:226749:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre)
00010000:00010000:1.0:1651531865.225253:0:226749:0:(ldlm_request.c:1250:ldlm_cli_cancel_local()) not sending request (at caller's instruction)
00010000:00010000:1.0:1651531865.225253:0:226749:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC10.240.43.61@tcp lock: 00000000bc1fa390/0x3234de053ca25b9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x7e7b1585546a1702 expref: -99 pid: 166108 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531865.225256:0:226749:0:(ldlm_request.c:1234:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC10.240.43.61@tcp lock: 000000008abee82b/0x3234de053ca25ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x7e7b1585546a1717 expref: -99 pid: 166108 timeout: 0 lvb_type: 0
10000000:00010000:1.0:1651531865.225258:0:226749:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC10.240.43.61@tcp lock: 000000008abee82b/0x3234de053ca25ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x7e7b1585546a1717 expref: -99 pid: 166108 timeout: 0 lvb_type: 0
10000000:01000000:1.0:1651531865.225266:0:226749:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre)
00010000:00010000:1.0:1651531865.225273:0:226749:0:(ldlm_request.c:1250:ldlm_cli_cancel_local()) not sending request (at caller's instruction)
00010000:00010000:1.0:1651531865.225274:0:226749:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC10.240.43.61@tcp lock: 000000008abee82b/0x3234de053ca25ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x7e7b1585546a1717 expref: -99 pid: 166108 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531865.225278:0:226749:0:(ldlm_request.c:1234:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC10.240.43.61@tcp lock: 00000000ab087537/0x3234de053ca25c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x7e7b1585546a1709 expref: -99 pid: 166108 timeout: 0 lvb_type: 0
10000000:00010000:1.0:1651531865.225280:0:226749:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC10.240.43.61@tcp lock: 00000000ab087537/0x3234de053ca25c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x7e7b1585546a1709 expref: -99 pid: 166108 timeout: 0 lvb_type: 0
10000000:01000000:1.0:1651531865.225282:0:226749:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params)
00010000:00010000:1.0:1651531865.225287:0:226749:0:(ldlm_request.c:1250:ldlm_cli_cancel_local()) not sending request (at caller's instruction)
00010000:00010000:1.0:1651531865.225288:0:226749:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC10.240.43.61@tcp lock: 00000000ab087537/0x3234de053ca25c0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x7e7b1585546a1709 expref: -99 pid: 166108 timeout: 0 lvb_type: 0
00000100:00080000:1.0:1651531865.225292:0:226749:0:(import.c:85:import_set_state_nolock()) 000000000aba9d44 MGS: changing import state from EVICTED to RECOVER
00000100:00080000:1.0:1651531865.225294:0:226749:0:(import.c:85:import_set_state_nolock()) 000000000aba9d44 MGS: changing import state from RECOVER to FULL
10000000:01000000:1.0:1651531865.225294:0:226749:0:(mgc_request.c:1330:mgc_import_event()) import event 0x808004
00000100:00080000:1.0:1651531865.225298:0:226749:0:(pinger.c:207:ptlrpc_pinger_ir_up()) IR up
00000100:02000000:1.0:1651531865.225299:0:226749:0:(import.c:1642:ptlrpc_import_recovery_state_machine()) MGC10.240.43.61@tcp: Connection restored to 10.240.43.61@tcp (at 10.240.43.61@tcp)
10000000:01000000:0.0:1651531867.133248:0:166108:0:(mgc_request.c:609:do_requeue()) updating log lustre-client
10000000:01000000:0.0:1651531867.133257:0:166108:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff94e0d279b000 from 263
10000000:01000000:0.0:1651531867.133259:0:166108:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c)
00010000:00010000:0.0:1651531867.133271:0:166108:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC10.240.43.61@tcp lock: 00000000e5cdccc8/0x3234de053ca284b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 166108 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531867.133276:0:166108:0:(ldlm_request.c:1028:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC10.240.43.61@tcp lock: 00000000e5cdccc8/0x3234de053ca284b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 166108 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531867.133280:0:166108:0:(ldlm_request.c:1116:ldlm_cli_enqueue()) ### sending request ns: MGC10.240.43.61@tcp lock: 00000000e5cdccc8/0x3234de053ca284b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 166108 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531867.133288:0:166108:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007f998d3c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997343552:10.240.43.61@tcp:101:ll_cfg_requeue.0
00000100:00100000:0.0:1651531867.133307:0:166108:0:(client.c:2492:ptlrpc_set_wait()) set 0000000060d3a5ac going to sleep for 43 seconds
00000100:00100000:0.0:1651531867.133597:0:166108:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007f998d3c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997343552:10.240.43.61@tcp:101:ll_cfg_requeue.0
00010000:00010000:0.0:1651531867.133604:0:166108:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC10.240.43.61@tcp lock: 00000000e5cdccc8/0x3234de053ca284b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b1585546d7719 expref: -99 pid: 166108 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531867.133608:0:166108:0:(ldlm_request.c:798:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC10.240.43.61@tcp lock: 00000000e5cdccc8/0x3234de053ca284b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e7b1585546d7719 expref: -99 pid: 166108 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531867.133661:0:166108:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007f998d3c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997343616:10.240.43.61@tcp:501:ll_cfg_requeue.0
00000100:00100000:0.0:1651531867.133681:0:166108:0:(client.c:2492:ptlrpc_set_wait()) set 0000000060d3a5ac going to sleep for 43 seconds
00000100:00100000:0.0:1651531867.133905:0:166108:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007f998d3c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997343616:10.240.43.61@tcp:501:ll_cfg_requeue.0
00000100:00100000:0.0:1651531867.133926:0:166108:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007f998d3c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997343680:10.240.43.61@tcp:503:ll_cfg_requeue.0
00000100:00100000:0.0:1651531867.133945:0:166108:0:(client.c:2492:ptlrpc_set_wait()) set 0000000060d3a5ac going to sleep for 43 seconds
00000100:00100000:0.0:1651531867.134238:0:166108:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007f998d3c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997343680:10.240.43.61@tcp:503:ll_cfg_requeue.0
00000040:00080000:0.0:1651531867.134561:0:226750:0:(llog.c:768:llog_process_thread()) stop processing plain 0x3:10:0 index 64768 count 258
00000020:01000000:0.0:1651531867.134612:0:166108:0:(obd_config.c:2042:class_config_parse_llog()) Processed log lustre-client gen 263-262 (rc=0)
10000000:01000000:0.0:1651531867.134622:0:166108:0:(mgc_request.c:2136:mgc_process_log()) MGC10.240.43.61@tcp: configuration from log 'lustre-client' succeeded (0).
00010000:00010000:0.0:1651531867.134624:0:166108:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC10.240.43.61@tcp lock: 00000000e5cdccc8/0x3234de053ca284b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b1585546d7719 expref: -99 pid: 166108 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531867.134628:0:166108:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC10.240.43.61@tcp lock: 00000000e5cdccc8/0x3234de053ca284b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b1585546d7719 expref: -99 pid: 166108 timeout: 0 lvb_type: 0
10000000:01000000:0.0:1651531867.134632:0:166108:0:(mgc_request.c:609:do_requeue()) updating log lustre-OST0001
10000000:01000000:0.0:1651531867.134632:0:166108:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 29
10000000:01000000:0.0:1651531867.134633:0:166108:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c)
00010000:00010000:0.0:1651531867.134639:0:166108:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC10.240.43.61@tcp lock: 00000000ab087537/0x3234de053ca2852 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 166108 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531867.134642:0:166108:0:(ldlm_request.c:1028:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC10.240.43.61@tcp lock: 00000000ab087537/0x3234de053ca2852 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 166108 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531867.134645:0:166108:0:(ldlm_request.c:1116:ldlm_cli_enqueue()) ### sending request ns: MGC10.240.43.61@tcp lock: 00000000ab087537/0x3234de053ca2852 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 166108 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531867.134650:0:166108:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007f998d3c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997343744:10.240.43.61@tcp:101:ll_cfg_requeue.0
00000100:00100000:0.0:1651531867.134667:0:166108:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fadbf296 going to sleep for 43 seconds
00000100:00100000:0.0:1651531867.134895:0:166108:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007f998d3c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997343744:10.240.43.61@tcp:101:ll_cfg_requeue.0
00010000:00010000:0.0:1651531867.134899:0:166108:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC10.240.43.61@tcp lock: 00000000ab087537/0x3234de053ca2852 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b1585546d7720 expref: -99 pid: 166108 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531867.134904:0:166108:0:(ldlm_request.c:798:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC10.240.43.61@tcp lock: 00000000ab087537/0x3234de053ca2852 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e7b1585546d7720 expref: -99 pid: 166108 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531867.134919:0:166108:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007f998d3c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997343808:10.240.43.61@tcp:501:ll_cfg_requeue.0
00000100:00100000:0.0:1651531867.134935:0:166108:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fadbf296 going to sleep for 43 seconds
00000100:00100000:0.0:1651531867.135154:0:166108:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007f998d3c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997343808:10.240.43.61@tcp:501:ll_cfg_requeue.0
00000100:00100000:0.0:1651531867.135164:0:166108:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007f998d3c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997343872:10.240.43.61@tcp:503:ll_cfg_requeue.0
00000100:00100000:0.0:1651531867.135180:0:166108:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fadbf296 going to sleep for 43 seconds
00000100:00100000:0.0:1651531867.135564:0:166108:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007f998d3c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997343872:10.240.43.61@tcp:503:ll_cfg_requeue.0
00000040:00080000:0.0:1651531867.135853:0:226751:0:(llog.c:768:llog_process_thread()) stop processing plain 0x9:10:0 index 64768 count 29
00000020:01000000:0.0:1651531867.135880:0:166108:0:(obd_config.c:2042:class_config_parse_llog()) Processed log lustre-OST0001 gen 29-28 (rc=0)
10000000:01000000:0.0:1651531867.135886:0:166108:0:(mgc_request.c:2136:mgc_process_log()) MGC10.240.43.61@tcp: configuration from log 'lustre-OST0001' succeeded (0).
00010000:00010000:0.0:1651531867.135888:0:166108:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC10.240.43.61@tcp lock: 00000000ab087537/0x3234de053ca2852 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b1585546d7720 expref: -99 pid: 166108 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531867.135891:0:166108:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC10.240.43.61@tcp lock: 00000000ab087537/0x3234de053ca2852 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b1585546d7720 expref: -99 pid: 166108 timeout: 0 lvb_type: 0
10000000:01000000:0.0:1651531867.135894:0:166108:0:(mgc_request.c:609:do_requeue()) updating log params
10000000:01000000:0.0:1651531867.135894:0:166108:0:(mgc_request.c:2064:mgc_process_log()) Process log params-ffff94e0d279b000 from 19
10000000:01000000:0.0:1651531867.135895:0:166108:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for params (res 0x736d61726170)
00010000:00010000:0.0:1651531867.135901:0:166108:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC10.240.43.61@tcp lock: 000000008abee82b/0x3234de053ca2859 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 166108 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531867.135903:0:166108:0:(ldlm_request.c:1028:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC10.240.43.61@tcp lock: 000000008abee82b/0x3234de053ca2859 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 166108 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531867.135910:0:166108:0:(ldlm_request.c:1116:ldlm_cli_enqueue()) ### sending request ns: MGC10.240.43.61@tcp lock: 000000008abee82b/0x3234de053ca2859 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 166108 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531867.135914:0:166108:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007f998d3c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997343936:10.240.43.61@tcp:101:ll_cfg_requeue.0
00000100:00100000:0.0:1651531867.135931:0:166108:0:(client.c:2492:ptlrpc_set_wait()) set 00000000792eeca0 going to sleep for 43 seconds
00000100:00100000:0.0:1651531867.136146:0:166108:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007f998d3c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997343936:10.240.43.61@tcp:101:ll_cfg_requeue.0
00010000:00010000:0.0:1651531867.136150:0:166108:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC10.240.43.61@tcp lock: 000000008abee82b/0x3234de053ca2859 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b1585546d7727 expref: -99 pid: 166108 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531867.136153:0:166108:0:(ldlm_request.c:798:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC10.240.43.61@tcp lock: 000000008abee82b/0x3234de053ca2859 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e7b1585546d7727 expref: -99 pid: 166108 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531867.136167:0:166108:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007f998d3c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997344000:10.240.43.61@tcp:501:ll_cfg_requeue.0
00000100:00100000:0.0:1651531867.136183:0:166108:0:(client.c:2492:ptlrpc_set_wait()) set 00000000792eeca0 going to sleep for 43 seconds
00000100:00100000:0.0:1651531867.136385:0:166108:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007f998d3c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997344000:10.240.43.61@tcp:501:ll_cfg_requeue.0
00000100:00100000:0.0:1651531867.136394:0:166108:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007f998d3c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997344064:10.240.43.61@tcp:503:ll_cfg_requeue.0
00000100:00100000:0.0:1651531867.136411:0:166108:0:(client.c:2492:ptlrpc_set_wait()) set 00000000792eeca0 going to sleep for 43 seconds
00000100:00100000:0.0:1651531867.136611:0:166108:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007f998d3c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997344064:10.240.43.61@tcp:503:ll_cfg_requeue.0
00000040:00080000:0.0:1651531867.136893:0:226752:0:(llog.c:768:llog_process_thread()) stop processing plain 0x2:10:0 index 64768 count 19
00000020:01000000:0.0:1651531867.136919:0:166108:0:(obd_config.c:2042:class_config_parse_llog()) Processed log params gen 19-18 (rc=0)
10000000:01000000:0.0:1651531867.136924:0:166108:0:(mgc_request.c:2136:mgc_process_log()) MGC10.240.43.61@tcp: configuration from log 'params' succeeded (0).
00010000:00010000:0.0:1651531867.136925:0:166108:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC10.240.43.61@tcp lock: 000000008abee82b/0x3234de053ca2859 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b1585546d7727 expref: -99 pid: 166108 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531867.136928:0:166108:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC10.240.43.61@tcp lock: 000000008abee82b/0x3234de053ca2859 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b1585546d7727 expref: -99 pid: 166108 timeout: 0 lvb_type: 0
10000000:01000000:0.0:1651531867.136933:0:166108:0:(mgc_request.c:609:do_requeue()) updating log nodemap
10000000:01000000:0.0:1651531867.136933:0:166108:0:(mgc_request.c:2064:mgc_process_log()) Process log nodemap-ffff94e0b53b8000 from 1
10000000:01000000:0.0:1651531867.136934:0:166108:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e)
00010000:00010000:0.0:1651531867.136939:0:166108:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC10.240.43.61@tcp lock: 00000000bc1fa390/0x3234de053ca2860 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 166108 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531867.136942:0:166108:0:(ldlm_request.c:1028:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC10.240.43.61@tcp lock: 00000000bc1fa390/0x3234de053ca2860 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 166108 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531867.136944:0:166108:0:(ldlm_request.c:1116:ldlm_cli_enqueue()) ### sending request ns: MGC10.240.43.61@tcp lock: 00000000bc1fa390/0x3234de053ca2860 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 166108 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531867.136949:0:166108:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007f998d3c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997344128:10.240.43.61@tcp:101:ll_cfg_requeue.0
00000100:00100000:0.0:1651531867.136963:0:166108:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f9740e6e going to sleep for 43 seconds
00000100:00100000:0.0:1651531867.137157:0:166108:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007f998d3c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997344128:10.240.43.61@tcp:101:ll_cfg_requeue.0
00010000:00010000:0.0:1651531867.137161:0:166108:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC10.240.43.61@tcp lock: 00000000bc1fa390/0x3234de053ca2860 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b1585546d772e expref: -99 pid: 166108 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531867.137165:0:166108:0:(ldlm_request.c:798:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC10.240.43.61@tcp lock: 00000000bc1fa390/0x3234de053ca2860 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e7b1585546d772e expref: -99 pid: 166108 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531867.137251:0:166108:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007f998d3c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997344192:10.240.43.61@tcp:256:ll_cfg_requeue.0
00000100:00100000:0.0:1651531867.137275:0:166108:0:(client.c:2492:ptlrpc_set_wait()) set 0000000060d3a5ac going to sleep for 43 seconds
00000100:00100000:0.0:1651531867.137721:0:166108:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007f998d3c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997344192:10.240.43.61@tcp:256:ll_cfg_requeue.0
00080000:10000000:0.0:1651531867.137988:0:166108:0:(osd_handler.c:5198:osd_index_try()) lustre-OST0001: index object [0x200000003:0x1a:0x0] (8/32) registered
10000000:01000000:0.0:1651531867.138053:0:166108:0:(mgc_request.c:2136:mgc_process_log()) MGC10.240.43.61@tcp: configuration from log 'nodemap' succeeded (0).
00010000:00010000:0.0:1651531867.138055:0:166108:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC10.240.43.61@tcp lock: 00000000bc1fa390/0x3234de053ca2860 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b1585546d772e expref: -99 pid: 166108 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531867.138060:0:166108:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC10.240.43.61@tcp lock: 00000000bc1fa390/0x3234de053ca2860 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b1585546d772e expref: -99 pid: 166108 timeout: 0 lvb_type: 0
10000000:01000000:0.0:1651531867.138063:0:166108:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc
10000000:01000000:0.0:1651531867.138064:0:166108:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff94e0b53b8000 from 1
10000000:01000000:0.0:1651531867.138065:0:166108:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c)
00010000:00010000:0.0:1651531867.138070:0:166108:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC10.240.43.61@tcp lock: 0000000000dcc150/0x3234de053ca2867 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 166108 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531867.138073:0:166108:0:(ldlm_request.c:1028:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC10.240.43.61@tcp lock: 0000000000dcc150/0x3234de053ca2867 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 166108 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531867.138076:0:166108:0:(ldlm_request.c:1116:ldlm_cli_enqueue()) ### sending request ns: MGC10.240.43.61@tcp lock: 0000000000dcc150/0x3234de053ca2867 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 166108 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531867.138081:0:166108:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007f998d3c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997344256:10.240.43.61@tcp:101:ll_cfg_requeue.0
00000100:00100000:0.0:1651531867.138094:0:166108:0:(client.c:2492:ptlrpc_set_wait()) set 000000007ac4e30e going to sleep for 43 seconds
00000100:00100000:0.0:1651531867.138310:0:166108:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007f998d3c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997344256:10.240.43.61@tcp:101:ll_cfg_requeue.0
00010000:00010000:0.0:1651531867.138314:0:166108:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC10.240.43.61@tcp lock: 0000000000dcc150/0x3234de053ca2867 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b1585546d7735 expref: -99 pid: 166108 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531867.138318:0:166108:0:(ldlm_request.c:798:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC10.240.43.61@tcp lock: 0000000000dcc150/0x3234de053ca2867 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e7b1585546d7735 expref: -99 pid: 166108 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531867.138332:0:166108:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007f998d3c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997344320:10.240.43.61@tcp:501:ll_cfg_requeue.0
00000100:00100000:0.0:1651531867.138343:0:166108:0:(client.c:2492:ptlrpc_set_wait()) set 000000007ac4e30e going to sleep for 43 seconds
00000100:00100000:0.0:1651531867.138529:0:166108:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007f998d3c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9063caa-b124-4cb6-99ef-d01a735595c3:166108:1731745997344320:10.240.43.61@tcp:501:ll_cfg_requeue.0
10000000:01000000:0.0:1651531867.138540:0:166108:0:(mgc_request.c:2136:mgc_process_log()) MGC10.240.43.61@tcp: configuration from log 'lustre-sptlrpc' failed (-2).
00010000:00010000:0.0:1651531867.138542:0:166108:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC10.240.43.61@tcp lock: 0000000000dcc150/0x3234de053ca2867 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b1585546d7735 expref: -99 pid: 166108 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531867.138545:0:166108:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC10.240.43.61@tcp lock: 0000000000dcc150/0x3234de053ca2867 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e7b1585546d7735 expref: -99 pid: 166108 timeout: 0 lvb_type: 0
00000001:00100000:0.0:1651531869.333671:0:166098:0:(tgt_lastrcvd.c:537:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID
00000100:00080000:1.0:1651531872.381281:0:213652:0:(pinger.c:250:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1651531872.381285:0:213652:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1651531872.381286:0:213652:0:(import.c:85:import_set_state_nolock()) 0000000070a36139 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1651531872.381291:0:213652:0:(import.c:533:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 10.240.43.61@tcp last attempt 22523
00000100:00080000:1.0:1651531872.381294:0:213652:0:(import.c:614:import_select_connection()) lustre-MDT0000-lwp-OST0001: import 0000000070a36139 using connection 10.240.43.61@tcp/10.240.43.61@tcp
00000100:00100000:1.0:1651531872.381306:0:213652:0:(import.c:806:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000002ef35a72 x1731745997344384/t0(0) o38->lustre-MDT0000-lwp-OST0001@10.240.43.61@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:0.0:1651531872.381337:0:39098:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002ef35a72 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:39098:1731745997344384:10.240.43.61@tcp:38:kworker/u4:1.0
00000100:00080000:0.0:1651531872.381612:0:39098:0:(import.c:85:import_set_state_nolock()) 0000000070a36139 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1651531872.381615:0:39098:0:(import.c:1428:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 10.240.43.61@tcp failed (-11)
00000100:00100000:0.0:1651531872.381617:0:39098:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002ef35a72 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:39098:1731745997344384:10.240.43.61@tcp:38:kworker/u4:1.0
00000100:00080000:1.0:1651531877.501258:0:213652:0:(pinger.c:250:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1651531877.501261:0:213652:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1651531877.501262:0:213652:0:(import.c:85:import_set_state_nolock()) 0000000070a36139 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1651531877.501265:0:213652:0:(import.c:533:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 10.240.43.61@tcp last attempt 22531
00000100:00080000:1.0:1651531877.501267:0:213652:0:(import.c:614:import_select_connection()) lustre-MDT0000-lwp-OST0001: import 0000000070a36139 using connection 10.240.43.61@tcp/10.240.43.61@tcp
00000100:00100000:1.0:1651531877.501282:0:213652:0:(import.c:806:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@0000000052213cb9 x1731745997344448/t0(0) o38->lustre-MDT0000-lwp-OST0001@10.240.43.61@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:0.0:1651531877.501310:0:39098:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000052213cb9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:39098:1731745997344448:10.240.43.61@tcp:38:kworker/u4:1.0
00000100:00080000:0.0:1651531877.501565:0:39098:0:(import.c:85:import_set_state_nolock()) 0000000070a36139 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1651531877.501567:0:39098:0:(import.c:1428:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 10.240.43.61@tcp failed (-11)
00000100:00100000:0.0:1651531877.501569:0:39098:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000052213cb9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:39098:1731745997344448:10.240.43.61@tcp:38:kworker/u4:1.0
00000100:00100000:0.0:1651531879.538343:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651531879.538363:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951156544
00000100:00100000:0.0:1651531879.538385:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 44278
00000100:00100000:0.0:1651531879.538387:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007f998d3c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:330937:x1731745951156544:12345-10.240.43.61@tcp:5:osp-pre-1-0.0
00002000:00080000:0.0:1651531879.538401:0:166112:0:(ofd_dev.c:1586:ofd_create_hdl()) ofd_last_id() = 214337 -> diff = -43
00002000:02000040:0.0:1651531879.538403:0:166112:0:(ofd_dev.c:1442:ofd_orphans_destroy()) lustre-OST0001: deleting orphan objects from 0x0:214295 to 0x0:214337
00002000:00010000:0.0:1651531879.540046:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34541:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:0.0:1651531879.540050:0:166112:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca286e lrc: 3/0,1 mode: --/PW res: [0x34541:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.540060:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531879.540061:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531879.540063:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca286e lrc: 3/0,1 mode: PW/PW res: [0x34541:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.540070:0:166112:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca286e lrc: 3/0,1 mode: PW/PW res: [0x34541:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.540074:0:166112:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca286e lrc: 3/0,1 mode: PW/PW res: [0x34541:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.540077:0:166112:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca286e lrc: 2/0,0 mode: PW/PW res: [0x34541:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00002000:00010000:0.0:1651531879.540170:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34540:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:0.0:1651531879.540172:0:166112:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca2875 lrc: 3/0,1 mode: --/PW res: [0x34540:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.540176:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531879.540177:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531879.540178:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca2875 lrc: 3/0,1 mode: PW/PW res: [0x34540:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.540181:0:166112:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca2875 lrc: 3/0,1 mode: PW/PW res: [0x34540:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.540184:0:166112:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca2875 lrc: 3/0,1 mode: PW/PW res: [0x34540:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.540191:0:166112:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca2875 lrc: 2/0,0 mode: PW/PW res: [0x34540:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00002000:00010000:0.0:1651531879.540251:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x3453f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:0.0:1651531879.540253:0:166112:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca287c lrc: 3/0,1 mode: --/PW res: [0x3453f:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.540257:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531879.540257:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531879.540258:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca287c lrc: 3/0,1 mode: PW/PW res: [0x3453f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.540261:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca286e lrc: 2/0,0 mode: PW/PW res: [0x34541:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.540262:0:166112:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca287c lrc: 3/0,1 mode: PW/PW res: [0x3453f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.540265:0:166112:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca287c lrc: 3/0,1 mode: PW/PW res: [0x3453f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.540268:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e9b84540 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531879.540268:0:166112:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca287c lrc: 2/0,0 mode: PW/PW res: [0x3453f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.540272:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca286e lrc: 2/0,0 mode: PW/PW res: [0x34541:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.540282:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca286e lrc: 3/0,0 mode: PW/PW res: [0x34541:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.540291:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca286e lrc: 1/0,0 mode: --/PW res: [0x34541:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.540294:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca286e lrc: 0/0,0 mode: --/PW res: [0x34541:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.540300:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca2875 lrc: 2/0,0 mode: PW/PW res: [0x34540:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00002000:00010000:0.0:1651531879.540300:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x3453e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:0.0:1651531879.540301:0:166112:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2883 lrc: 3/0,1 mode: --/PW res: [0x3453e:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.540303:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b4c8742a already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531879.540304:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca2875 lrc: 2/0,0 mode: PW/PW res: [0x34540:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.540305:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531879.540305:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531879.540306:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca2875 lrc: 3/0,0 mode: PW/PW res: [0x34540:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.540306:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2883 lrc: 3/0,1 mode: PW/PW res: [0x3453e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.540310:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca2875 lrc: 1/0,0 mode: --/PW res: [0x34540:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.540311:0:166112:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2883 lrc: 3/0,1 mode: PW/PW res: [0x3453e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.540312:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca2875 lrc: 0/0,0 mode: --/PW res: [0x34540:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.540314:0:166112:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2883 lrc: 3/0,1 mode: PW/PW res: [0x3453e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.540316:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca287c lrc: 2/0,0 mode: PW/PW res: [0x3453f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.540316:0:166112:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2883 lrc: 2/0,0 mode: PW/PW res: [0x3453e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.540320:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000968553c1 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531879.540320:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca287c lrc: 2/0,0 mode: PW/PW res: [0x3453f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.540323:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca287c lrc: 3/0,0 mode: PW/PW res: [0x3453f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.540326:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca287c lrc: 1/0,0 mode: --/PW res: [0x3453f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.540329:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca287c lrc: 0/0,0 mode: --/PW res: [0x3453f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.540332:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2883 lrc: 2/0,0 mode: PW/PW res: [0x3453e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.540335:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a8889a80 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531879.540335:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2883 lrc: 2/0,0 mode: PW/PW res: [0x3453e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.540338:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2883 lrc: 3/0,0 mode: PW/PW res: [0x3453e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00002000:00010000:0.0:1651531879.540338:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x3453d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:0.0:1651531879.540340:0:166112:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca288a lrc: 3/0,1 mode: --/PW res: [0x3453d:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.540341:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2883 lrc: 1/0,0 mode: --/PW res: [0x3453e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.540343:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531879.540343:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531879.540344:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2883 lrc: 0/0,0 mode: --/PW res: [0x3453e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.540344:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca288a lrc: 3/0,1 mode: PW/PW res: [0x3453d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.540347:0:166112:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca288a lrc: 3/0,1 mode: PW/PW res: [0x3453d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.540350:0:166112:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca288a lrc: 3/0,1 mode: PW/PW res: [0x3453d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.540353:0:166112:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca288a lrc: 2/0,0 mode: PW/PW res: [0x3453d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00002000:00010000:0.0:1651531879.540384:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x3453c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:0.0:1651531879.540386:0:166112:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca2891 lrc: 3/0,1 mode: --/PW res: [0x3453c:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.540389:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531879.540389:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531879.540390:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca2891 lrc: 3/0,1 mode: PW/PW res: [0x3453c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.540393:0:166112:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca2891 lrc: 3/0,1 mode: PW/PW res: [0x3453c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.540396:0:166112:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca2891 lrc: 3/0,1 mode: PW/PW res: [0x3453c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.540399:0:166112:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca2891 lrc: 2/0,0 mode: PW/PW res: [0x3453c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00002000:00010000:0.0:1651531879.540435:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x3453b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:0.0:1651531879.540437:0:166112:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca2898 lrc: 3/0,1 mode: --/PW res: [0x3453b:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.540440:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531879.540441:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531879.540442:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca2898 lrc: 3/0,1 mode: PW/PW res: [0x3453b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.540445:0:166112:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca2898 lrc: 3/0,1 mode: PW/PW res: [0x3453b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.540450:0:166112:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca2898 lrc: 3/0,1 mode: PW/PW res: [0x3453b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.540452:0:166112:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca2898 lrc: 2/0,0 mode: PW/PW res: [0x3453b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00002000:00010000:0.0:1651531879.540481:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x3453a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:0.0:1651531879.540483:0:166112:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca289f lrc: 3/0,1 mode: --/PW res: [0x3453a:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.540486:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531879.540486:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531879.540487:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca289f lrc: 3/0,1 mode: PW/PW res: [0x3453a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.540490:0:166112:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca289f lrc: 3/0,1 mode: PW/PW res: [0x3453a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.540493:0:166112:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca289f lrc: 3/0,1 mode: PW/PW res: [0x3453a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.540496:0:166112:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca289f lrc: 2/0,0 mode: PW/PW res: [0x3453a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00002000:00010000:0.0:1651531879.540516:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34539:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:0.0:1651531879.540518:0:166112:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca28a6 lrc: 3/0,1 mode: --/PW res: [0x34539:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.540524:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531879.540525:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531879.540526:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca28a6 lrc: 3/0,1 mode: PW/PW res: [0x34539:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.540529:0:166112:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca28a6 lrc: 3/0,1 mode: PW/PW res: [0x34539:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.540532:0:166112:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca28a6 lrc: 3/0,1 mode: PW/PW res: [0x34539:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.540534:0:166112:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca28a6 lrc: 2/0,0 mode: PW/PW res: [0x34539:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.540554:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca288a lrc: 2/0,0 mode: PW/PW res: [0x3453d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00002000:00010000:0.0:1651531879.540555:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34538:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:0.0:1651531879.540557:0:166112:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b93c49e9/0x3234de053ca28ad lrc: 3/0,1 mode: --/PW res: [0x34538:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.540558:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008558d1b3 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531879.540559:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca288a lrc: 2/0,0 mode: PW/PW res: [0x3453d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.540560:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531879.540560:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531879.540561:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b93c49e9/0x3234de053ca28ad lrc: 3/0,1 mode: PW/PW res: [0x34538:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.540563:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca288a lrc: 3/0,0 mode: PW/PW res: [0x3453d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.540564:0:166112:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b93c49e9/0x3234de053ca28ad lrc: 3/0,1 mode: PW/PW res: [0x34538:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.540567:0:166112:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b93c49e9/0x3234de053ca28ad lrc: 3/0,1 mode: PW/PW res: [0x34538:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.540568:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca288a lrc: 1/0,0 mode: --/PW res: [0x3453d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.540571:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca288a lrc: 0/0,0 mode: --/PW res: [0x3453d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.540573:0:166112:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b93c49e9/0x3234de053ca28ad lrc: 2/0,0 mode: PW/PW res: [0x34538:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.540575:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca2891 lrc: 2/0,0 mode: PW/PW res: [0x3453c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.540578:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c2b76533 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531879.540579:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca2891 lrc: 2/0,0 mode: PW/PW res: [0x3453c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.540582:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca2891 lrc: 3/0,0 mode: PW/PW res: [0x3453c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.540585:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca2891 lrc: 1/0,0 mode: --/PW res: [0x3453c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.540590:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca2891 lrc: 0/0,0 mode: --/PW res: [0x3453c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.540593:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca2898 lrc: 2/0,0 mode: PW/PW res: [0x3453b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.540596:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006da7a892 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531879.540596:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca2898 lrc: 2/0,0 mode: PW/PW res: [0x3453b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.540599:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca2898 lrc: 3/0,0 mode: PW/PW res: [0x3453b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00002000:00010000:0.0:1651531879.540600:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34537:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:0.0:1651531879.540601:0:166112:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000369400b3/0x3234de053ca28b4 lrc: 3/0,1 mode: --/PW res: [0x34537:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.540602:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca2898 lrc: 1/0,0 mode: --/PW res: [0x3453b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.540604:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531879.540605:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca2898 lrc: 0/0,0 mode: --/PW res: [0x3453b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.540605:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531879.540606:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000369400b3/0x3234de053ca28b4 lrc: 3/0,1 mode: PW/PW res: [0x34537:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.540608:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca289f lrc: 2/0,0 mode: PW/PW res: [0x3453a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.540609:0:166112:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000369400b3/0x3234de053ca28b4 lrc: 3/0,1 mode: PW/PW res: [0x34537:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.540610:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001e36c601 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531879.540611:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca289f lrc: 2/0,0 mode: PW/PW res: [0x3453a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.540612:0:166112:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000369400b3/0x3234de053ca28b4 lrc: 3/0,1 mode: PW/PW res: [0x34537:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.540614:0:166112:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000369400b3/0x3234de053ca28b4 lrc: 2/0,0 mode: PW/PW res: [0x34537:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.540617:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca289f lrc: 3/0,0 mode: PW/PW res: [0x3453a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.540620:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca289f lrc: 1/0,0 mode: --/PW res: [0x3453a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.540623:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca289f lrc: 0/0,0 mode: --/PW res: [0x3453a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.540626:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca28a6 lrc: 2/0,0 mode: PW/PW res: [0x34539:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.540629:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d44eb74d already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531879.540629:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca28a6 lrc: 2/0,0 mode: PW/PW res: [0x34539:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.540632:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca28a6 lrc: 3/0,0 mode: PW/PW res: [0x34539:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.540635:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca28a6 lrc: 1/0,0 mode: --/PW res: [0x34539:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00002000:00010000:0.0:1651531879.540635:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34536:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:0.0:1651531879.540636:0:166112:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f253fba8/0x3234de053ca28bb lrc: 3/0,1 mode: --/PW res: [0x34536:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.540638:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca28a6 lrc: 0/0,0 mode: --/PW res: [0x34539:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.540639:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531879.540640:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531879.540640:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f253fba8/0x3234de053ca28bb lrc: 3/0,1 mode: PW/PW res: [0x34536:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.540641:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b93c49e9/0x3234de053ca28ad lrc: 2/0,0 mode: PW/PW res: [0x34538:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.540645:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b93c49e9 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531879.540645:0:166112:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f253fba8/0x3234de053ca28bb lrc: 3/0,1 mode: PW/PW res: [0x34536:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.540646:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b93c49e9/0x3234de053ca28ad lrc: 2/0,0 mode: PW/PW res: [0x34538:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.540648:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b93c49e9/0x3234de053ca28ad lrc: 3/0,0 mode: PW/PW res: [0x34538:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.540648:0:166112:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f253fba8/0x3234de053ca28bb lrc: 3/0,1 mode: PW/PW res: [0x34536:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.540650:0:166112:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f253fba8/0x3234de053ca28bb lrc: 2/0,0 mode: PW/PW res: [0x34536:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.540651:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b93c49e9/0x3234de053ca28ad lrc: 1/0,0 mode: --/PW res: [0x34538:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.540654:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b93c49e9/0x3234de053ca28ad lrc: 0/0,0 mode: --/PW res: [0x34538:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.540657:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000369400b3/0x3234de053ca28b4 lrc: 2/0,0 mode: PW/PW res: [0x34537:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.540660:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000369400b3 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531879.540661:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000369400b3/0x3234de053ca28b4 lrc: 2/0,0 mode: PW/PW res: [0x34537:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.540663:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000369400b3/0x3234de053ca28b4 lrc: 3/0,0 mode: PW/PW res: [0x34537:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.540666:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000369400b3/0x3234de053ca28b4 lrc: 1/0,0 mode: --/PW res: [0x34537:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.540669:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000369400b3/0x3234de053ca28b4 lrc: 0/0,0 mode: --/PW res: [0x34537:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00002000:00010000:0.0:1651531879.540672:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34535:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:1.0:1651531879.540673:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f253fba8/0x3234de053ca28bb lrc: 2/0,0 mode: PW/PW res: [0x34536:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.540673:0:166112:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e1f4768/0x3234de053ca28c2 lrc: 3/0,1 mode: --/PW res: [0x34535:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.540675:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f253fba8 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531879.540676:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f253fba8/0x3234de053ca28bb lrc: 2/0,0 mode: PW/PW res: [0x34536:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.540676:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531879.540677:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531879.540677:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e1f4768/0x3234de053ca28c2 lrc: 3/0,1 mode: PW/PW res: [0x34535:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.540679:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f253fba8/0x3234de053ca28bb lrc: 3/0,0 mode: PW/PW res: [0x34536:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.540680:0:166112:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004e1f4768/0x3234de053ca28c2 lrc: 3/0,1 mode: PW/PW res: [0x34535:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.540682:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f253fba8/0x3234de053ca28bb lrc: 1/0,0 mode: --/PW res: [0x34536:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.540683:0:166112:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e1f4768/0x3234de053ca28c2 lrc: 3/0,1 mode: PW/PW res: [0x34535:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.540685:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f253fba8/0x3234de053ca28bb lrc: 0/0,0 mode: --/PW res: [0x34536:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.540686:0:166112:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004e1f4768/0x3234de053ca28c2 lrc: 2/0,0 mode: PW/PW res: [0x34535:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.540706:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004e1f4768/0x3234de053ca28c2 lrc: 2/0,0 mode: PW/PW res: [0x34535:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.540710:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004e1f4768 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531879.540710:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004e1f4768/0x3234de053ca28c2 lrc: 2/0,0 mode: PW/PW res: [0x34535:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.540713:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004e1f4768/0x3234de053ca28c2 lrc: 3/0,0 mode: PW/PW res: [0x34535:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.540717:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004e1f4768/0x3234de053ca28c2 lrc: 1/0,0 mode: --/PW res: [0x34535:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00002000:00010000:0.0:1651531879.540717:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34534:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:0.0:1651531879.540719:0:166112:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000030d4a6f9/0x3234de053ca28c9 lrc: 3/0,1 mode: --/PW res: [0x34534:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.540721:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004e1f4768/0x3234de053ca28c2 lrc: 0/0,0 mode: --/PW res: [0x34535:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.540722:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531879.540723:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531879.540724:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000030d4a6f9/0x3234de053ca28c9 lrc: 3/0,1 mode: PW/PW res: [0x34534:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.540727:0:166112:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000030d4a6f9/0x3234de053ca28c9 lrc: 3/0,1 mode: PW/PW res: [0x34534:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.540729:0:166112:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000030d4a6f9/0x3234de053ca28c9 lrc: 3/0,1 mode: PW/PW res: [0x34534:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.540732:0:166112:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000030d4a6f9/0x3234de053ca28c9 lrc: 2/0,0 mode: PW/PW res: [0x34534:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.540752:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000030d4a6f9/0x3234de053ca28c9 lrc: 2/0,0 mode: PW/PW res: [0x34534:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.540756:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000030d4a6f9 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531879.540757:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000030d4a6f9/0x3234de053ca28c9 lrc: 2/0,0 mode: PW/PW res: [0x34534:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.540760:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000030d4a6f9/0x3234de053ca28c9 lrc: 3/0,0 mode: PW/PW res: [0x34534:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00002000:00010000:0.0:1651531879.540763:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34533:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:1.0:1651531879.540764:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000030d4a6f9/0x3234de053ca28c9 lrc: 1/0,0 mode: --/PW res: [0x34534:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.540764:0:166112:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000768f2bc3/0x3234de053ca28d0 lrc: 3/0,1 mode: --/PW res: [0x34533:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.540766:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000030d4a6f9/0x3234de053ca28c9 lrc: 0/0,0 mode: --/PW res: [0x34534:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.540768:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531879.540768:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531879.540769:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000768f2bc3/0x3234de053ca28d0 lrc: 3/0,1 mode: PW/PW res: [0x34533:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.540772:0:166112:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000768f2bc3/0x3234de053ca28d0 lrc: 3/0,1 mode: PW/PW res: [0x34533:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.540776:0:166112:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000768f2bc3/0x3234de053ca28d0 lrc: 3/0,1 mode: PW/PW res: [0x34533:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.540779:0:166112:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000768f2bc3/0x3234de053ca28d0 lrc: 2/0,0 mode: PW/PW res: [0x34533:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.540789:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000768f2bc3/0x3234de053ca28d0 lrc: 2/0,0 mode: PW/PW res: [0x34533:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.540792:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000768f2bc3 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531879.540793:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000768f2bc3/0x3234de053ca28d0 lrc: 2/0,0 mode: PW/PW res: [0x34533:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.540800:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000768f2bc3/0x3234de053ca28d0 lrc: 3/0,0 mode: PW/PW res: [0x34533:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.540804:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000768f2bc3/0x3234de053ca28d0 lrc: 1/0,0 mode: --/PW res: [0x34533:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.540806:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000768f2bc3/0x3234de053ca28d0 lrc: 0/0,0 mode: --/PW res: [0x34533:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00002000:00010000:0.0:1651531879.540806:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34532:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:0.0:1651531879.540808:0:166112:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cfb802a0/0x3234de053ca28d7 lrc: 3/0,1 mode: --/PW res: [0x34532:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.540811:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531879.540811:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531879.540812:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cfb802a0/0x3234de053ca28d7 lrc: 3/0,1 mode: PW/PW res: [0x34532:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.540815:0:166112:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cfb802a0/0x3234de053ca28d7 lrc: 3/0,1 mode: PW/PW res: [0x34532:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.540818:0:166112:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cfb802a0/0x3234de053ca28d7 lrc: 3/0,1 mode: PW/PW res: [0x34532:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.540821:0:166112:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cfb802a0/0x3234de053ca28d7 lrc: 2/0,0 mode: PW/PW res: [0x34532:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.540830:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cfb802a0/0x3234de053ca28d7 lrc: 2/0,0 mode: PW/PW res: [0x34532:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.540833:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000cfb802a0 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531879.540834:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cfb802a0/0x3234de053ca28d7 lrc: 2/0,0 mode: PW/PW res: [0x34532:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.540836:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cfb802a0/0x3234de053ca28d7 lrc: 3/0,0 mode: PW/PW res: [0x34532:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.540840:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cfb802a0/0x3234de053ca28d7 lrc: 1/0,0 mode: --/PW res: [0x34532:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.540843:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cfb802a0/0x3234de053ca28d7 lrc: 0/0,0 mode: --/PW res: [0x34532:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00002000:00010000:0.0:1651531879.540847:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34531:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:0.0:1651531879.540848:0:166112:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000007a8a843/0x3234de053ca28de lrc: 3/0,1 mode: --/PW res: [0x34531:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.540854:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531879.540855:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531879.540856:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000007a8a843/0x3234de053ca28de lrc: 3/0,1 mode: PW/PW res: [0x34531:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.540859:0:166112:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000007a8a843/0x3234de053ca28de lrc: 3/0,1 mode: PW/PW res: [0x34531:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.540862:0:166112:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000007a8a843/0x3234de053ca28de lrc: 3/0,1 mode: PW/PW res: [0x34531:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.540864:0:166112:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000007a8a843/0x3234de053ca28de lrc: 2/0,0 mode: PW/PW res: [0x34531:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.540873:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000007a8a843/0x3234de053ca28de lrc: 2/0,0 mode: PW/PW res: [0x34531:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.540877:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000007a8a843 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531879.540879:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000007a8a843/0x3234de053ca28de lrc: 2/0,0 mode: PW/PW res: [0x34531:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.540881:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000007a8a843/0x3234de053ca28de lrc: 3/0,0 mode: PW/PW res: [0x34531:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.540885:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000007a8a843/0x3234de053ca28de lrc: 1/0,0 mode: --/PW res: [0x34531:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.540887:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000007a8a843/0x3234de053ca28de lrc: 0/0,0 mode: --/PW res: [0x34531:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00002000:00010000:0.0:1651531879.540891:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34530:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:0.0:1651531879.540892:0:166112:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000083070e4b/0x3234de053ca28e5 lrc: 3/0,1 mode: --/PW res: [0x34530:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.540895:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531879.540896:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531879.540897:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000083070e4b/0x3234de053ca28e5 lrc: 3/0,1 mode: PW/PW res: [0x34530:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.540900:0:166112:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000083070e4b/0x3234de053ca28e5 lrc: 3/0,1 mode: PW/PW res: [0x34530:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.540903:0:166112:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000083070e4b/0x3234de053ca28e5 lrc: 3/0,1 mode: PW/PW res: [0x34530:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.540909:0:166112:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000083070e4b/0x3234de053ca28e5 lrc: 2/0,0 mode: PW/PW res: [0x34530:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.540919:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000083070e4b/0x3234de053ca28e5 lrc: 2/0,0 mode: PW/PW res: [0x34530:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.540922:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000083070e4b already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531879.540922:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000083070e4b/0x3234de053ca28e5 lrc: 2/0,0 mode: PW/PW res: [0x34530:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.540925:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000083070e4b/0x3234de053ca28e5 lrc: 3/0,0 mode: PW/PW res: [0x34530:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.540929:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000083070e4b/0x3234de053ca28e5 lrc: 1/0,0 mode: --/PW res: [0x34530:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.540931:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000083070e4b/0x3234de053ca28e5 lrc: 0/0,0 mode: --/PW res: [0x34530:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00002000:00010000:0.0:1651531879.540935:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x3452f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:0.0:1651531879.540937:0:166112:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035e369e2/0x3234de053ca28ec lrc: 3/0,1 mode: --/PW res: [0x3452f:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.540940:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531879.540941:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531879.540941:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000035e369e2/0x3234de053ca28ec lrc: 3/0,1 mode: PW/PW res: [0x3452f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.540944:0:166112:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000035e369e2/0x3234de053ca28ec lrc: 3/0,1 mode: PW/PW res: [0x3452f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.540947:0:166112:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035e369e2/0x3234de053ca28ec lrc: 3/0,1 mode: PW/PW res: [0x3452f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.540950:0:166112:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000035e369e2/0x3234de053ca28ec lrc: 2/0,0 mode: PW/PW res: [0x3452f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.540959:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000035e369e2/0x3234de053ca28ec lrc: 2/0,0 mode: PW/PW res: [0x3452f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.540963:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000035e369e2 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531879.540963:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000035e369e2/0x3234de053ca28ec lrc: 2/0,0 mode: PW/PW res: [0x3452f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.540966:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000035e369e2/0x3234de053ca28ec lrc: 3/0,0 mode: PW/PW res: [0x3452f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.540970:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000035e369e2/0x3234de053ca28ec lrc: 1/0,0 mode: --/PW res: [0x3452f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.540972:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000035e369e2/0x3234de053ca28ec lrc: 0/0,0 mode: --/PW res: [0x3452f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00002000:00010000:0.0:1651531879.540976:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x3452e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:0.0:1651531879.540977:0:166112:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2f464ac/0x3234de053ca28f3 lrc: 3/0,1 mode: --/PW res: [0x3452e:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.540981:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531879.540981:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531879.540982:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2f464ac/0x3234de053ca28f3 lrc: 3/0,1 mode: PW/PW res: [0x3452e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.540986:0:166112:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2f464ac/0x3234de053ca28f3 lrc: 3/0,1 mode: PW/PW res: [0x3452e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.540989:0:166112:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2f464ac/0x3234de053ca28f3 lrc: 3/0,1 mode: PW/PW res: [0x3452e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.540992:0:166112:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e2f464ac/0x3234de053ca28f3 lrc: 2/0,0 mode: PW/PW res: [0x3452e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.541001:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e2f464ac/0x3234de053ca28f3 lrc: 2/0,0 mode: PW/PW res: [0x3452e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.541004:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e2f464ac already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531879.541004:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2f464ac/0x3234de053ca28f3 lrc: 2/0,0 mode: PW/PW res: [0x3452e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.541007:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2f464ac/0x3234de053ca28f3 lrc: 3/0,0 mode: PW/PW res: [0x3452e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.541011:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e2f464ac/0x3234de053ca28f3 lrc: 1/0,0 mode: --/PW res: [0x3452e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.541014:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2f464ac/0x3234de053ca28f3 lrc: 0/0,0 mode: --/PW res: [0x3452e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00002000:00010000:0.0:1651531879.541017:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x3452d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:0.0:1651531879.541019:0:166112:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f7e6a6f/0x3234de053ca28fa lrc: 3/0,1 mode: --/PW res: [0x3452d:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.541022:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531879.541023:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531879.541023:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f7e6a6f/0x3234de053ca28fa lrc: 3/0,1 mode: PW/PW res: [0x3452d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.541026:0:166112:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003f7e6a6f/0x3234de053ca28fa lrc: 3/0,1 mode: PW/PW res: [0x3452d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.541029:0:166112:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f7e6a6f/0x3234de053ca28fa lrc: 3/0,1 mode: PW/PW res: [0x3452d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.541032:0:166112:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003f7e6a6f/0x3234de053ca28fa lrc: 2/0,0 mode: PW/PW res: [0x3452d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.541044:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003f7e6a6f/0x3234de053ca28fa lrc: 2/0,0 mode: PW/PW res: [0x3452d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.541047:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003f7e6a6f already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531879.541048:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003f7e6a6f/0x3234de053ca28fa lrc: 2/0,0 mode: PW/PW res: [0x3452d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.541051:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003f7e6a6f/0x3234de053ca28fa lrc: 3/0,0 mode: PW/PW res: [0x3452d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.541055:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003f7e6a6f/0x3234de053ca28fa lrc: 1/0,0 mode: --/PW res: [0x3452d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.541057:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003f7e6a6f/0x3234de053ca28fa lrc: 0/0,0 mode: --/PW res: [0x3452d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00002000:00010000:0.0:1651531879.541068:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x3452c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:0.0:1651531879.541070:0:166112:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000049c67f6a/0x3234de053ca2901 lrc: 3/0,1 mode: --/PW res: [0x3452c:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.541074:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531879.541074:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531879.541075:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049c67f6a/0x3234de053ca2901 lrc: 3/0,1 mode: PW/PW res: [0x3452c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.541078:0:166112:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000049c67f6a/0x3234de053ca2901 lrc: 3/0,1 mode: PW/PW res: [0x3452c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.541081:0:166112:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000049c67f6a/0x3234de053ca2901 lrc: 3/0,1 mode: PW/PW res: [0x3452c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.541084:0:166112:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000049c67f6a/0x3234de053ca2901 lrc: 2/0,0 mode: PW/PW res: [0x3452c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.541093:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000049c67f6a/0x3234de053ca2901 lrc: 2/0,0 mode: PW/PW res: [0x3452c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.541096:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000049c67f6a already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531879.541096:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000049c67f6a/0x3234de053ca2901 lrc: 2/0,0 mode: PW/PW res: [0x3452c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.541105:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000049c67f6a/0x3234de053ca2901 lrc: 3/0,0 mode: PW/PW res: [0x3452c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.541108:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000049c67f6a/0x3234de053ca2901 lrc: 1/0,0 mode: --/PW res: [0x3452c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.541111:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000049c67f6a/0x3234de053ca2901 lrc: 0/0,0 mode: --/PW res: [0x3452c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00002000:00010000:0.0:1651531879.541112:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x3452b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:0.0:1651531879.541113:0:166112:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f2479f0/0x3234de053ca2908 lrc: 3/0,1 mode: --/PW res: [0x3452b:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.541116:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531879.541117:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531879.541117:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002f2479f0/0x3234de053ca2908 lrc: 3/0,1 mode: PW/PW res: [0x3452b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.541120:0:166112:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002f2479f0/0x3234de053ca2908 lrc: 3/0,1 mode: PW/PW res: [0x3452b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.541125:0:166112:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f2479f0/0x3234de053ca2908 lrc: 3/0,1 mode: PW/PW res: [0x3452b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.541128:0:166112:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002f2479f0/0x3234de053ca2908 lrc: 2/0,0 mode: PW/PW res: [0x3452b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.541137:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002f2479f0/0x3234de053ca2908 lrc: 2/0,0 mode: PW/PW res: [0x3452b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.541140:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002f2479f0 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531879.541141:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002f2479f0/0x3234de053ca2908 lrc: 2/0,0 mode: PW/PW res: [0x3452b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.541152:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002f2479f0/0x3234de053ca2908 lrc: 3/0,0 mode: PW/PW res: [0x3452b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.541155:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002f2479f0/0x3234de053ca2908 lrc: 1/0,0 mode: --/PW res: [0x3452b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.541158:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002f2479f0/0x3234de053ca2908 lrc: 0/0,0 mode: --/PW res: [0x3452b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00002000:00010000:0.0:1651531879.541167:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x3452a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:0.0:1651531879.541169:0:166112:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca290f lrc: 3/0,1 mode: --/PW res: [0x3452a:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.541172:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531879.541173:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531879.541173:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca290f lrc: 3/0,1 mode: PW/PW res: [0x3452a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.541177:0:166112:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca290f lrc: 3/0,1 mode: PW/PW res: [0x3452a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.541180:0:166112:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca290f lrc: 3/0,1 mode: PW/PW res: [0x3452a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.541182:0:166112:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca290f lrc: 2/0,0 mode: PW/PW res: [0x3452a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.541192:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca290f lrc: 2/0,0 mode: PW/PW res: [0x3452a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.541196:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d3014069 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531879.541197:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca290f lrc: 2/0,0 mode: PW/PW res: [0x3452a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.541200:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca290f lrc: 3/0,0 mode: PW/PW res: [0x3452a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.541203:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca290f lrc: 1/0,0 mode: --/PW res: [0x3452a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.541206:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca290f lrc: 0/0,0 mode: --/PW res: [0x3452a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00002000:00010000:0.0:1651531879.541209:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34529:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:0.0:1651531879.541211:0:166112:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca2916 lrc: 3/0,1 mode: --/PW res: [0x34529:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.541217:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531879.541218:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531879.541219:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca2916 lrc: 3/0,1 mode: PW/PW res: [0x34529:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.541235:0:166112:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca2916 lrc: 3/0,1 mode: PW/PW res: [0x34529:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.541238:0:166112:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca2916 lrc: 3/0,1 mode: PW/PW res: [0x34529:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.541241:0:166112:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca2916 lrc: 2/0,0 mode: PW/PW res: [0x34529:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.541250:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca2916 lrc: 2/0,0 mode: PW/PW res: [0x34529:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.541253:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000000bb25cc already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531879.541254:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca2916 lrc: 2/0,0 mode: PW/PW res: [0x34529:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.541257:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca2916 lrc: 3/0,0 mode: PW/PW res: [0x34529:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.541261:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca2916 lrc: 1/0,0 mode: --/PW res: [0x34529:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.541263:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca2916 lrc: 0/0,0 mode: --/PW res: [0x34529:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00002000:00010000:0.0:1651531879.541269:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34528:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:0.0:1651531879.541271:0:166112:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca291d lrc: 3/0,1 mode: --/PW res: [0x34528:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.541274:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531879.541275:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531879.541276:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca291d lrc: 3/0,1 mode: PW/PW res: [0x34528:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.541279:0:166112:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca291d lrc: 3/0,1 mode: PW/PW res: [0x34528:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.541282:0:166112:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca291d lrc: 3/0,1 mode: PW/PW res: [0x34528:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.541288:0:166112:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca291d lrc: 2/0,0 mode: PW/PW res: [0x34528:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.541298:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca291d lrc: 2/0,0 mode: PW/PW res: [0x34528:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.541301:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f2af03c8 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531879.541302:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca291d lrc: 2/0,0 mode: PW/PW res: [0x34528:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.541305:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca291d lrc: 3/0,0 mode: PW/PW res: [0x34528:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.541308:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca291d lrc: 1/0,0 mode: --/PW res: [0x34528:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.541311:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca291d lrc: 0/0,0 mode: --/PW res: [0x34528:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00002000:00010000:0.0:1651531879.541315:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34527:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:0.0:1651531879.541316:0:166112:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca2924 lrc: 3/0,1 mode: --/PW res: [0x34527:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.541319:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531879.541320:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531879.541321:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca2924 lrc: 3/0,1 mode: PW/PW res: [0x34527:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.541324:0:166112:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca2924 lrc: 3/0,1 mode: PW/PW res: [0x34527:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.541327:0:166112:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca2924 lrc: 3/0,1 mode: PW/PW res: [0x34527:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.541329:0:166112:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca2924 lrc: 2/0,0 mode: PW/PW res: [0x34527:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.541338:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca2924 lrc: 2/0,0 mode: PW/PW res: [0x34527:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.541341:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009c5faf65 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531879.541342:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca2924 lrc: 2/0,0 mode: PW/PW res: [0x34527:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.541344:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca2924 lrc: 3/0,0 mode: PW/PW res: [0x34527:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.541348:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca2924 lrc: 1/0,0 mode: --/PW res: [0x34527:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.541352:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca2924 lrc: 0/0,0 mode: --/PW res: [0x34527:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00002000:00010000:0.0:1651531879.541354:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34526:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:0.0:1651531879.541356:0:166112:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca292b lrc: 3/0,1 mode: --/PW res: [0x34526:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.541359:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531879.541359:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531879.541360:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca292b lrc: 3/0,1 mode: PW/PW res: [0x34526:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.541365:0:166112:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca292b lrc: 3/0,1 mode: PW/PW res: [0x34526:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.541367:0:166112:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca292b lrc: 3/0,1 mode: PW/PW res: [0x34526:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.541370:0:166112:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca292b lrc: 2/0,0 mode: PW/PW res: [0x34526:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.541379:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca292b lrc: 2/0,0 mode: PW/PW res: [0x34526:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.541382:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008b0c325f already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531879.541383:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca292b lrc: 2/0,0 mode: PW/PW res: [0x34526:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.541386:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca292b lrc: 3/0,0 mode: PW/PW res: [0x34526:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.541389:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca292b lrc: 1/0,0 mode: --/PW res: [0x34526:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.541392:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca292b lrc: 0/0,0 mode: --/PW res: [0x34526:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00002000:00010000:0.0:1651531879.541397:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34525:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:0.0:1651531879.541399:0:166112:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca2932 lrc: 3/0,1 mode: --/PW res: [0x34525:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.541402:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531879.541402:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531879.541403:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca2932 lrc: 3/0,1 mode: PW/PW res: [0x34525:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.541406:0:166112:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca2932 lrc: 3/0,1 mode: PW/PW res: [0x34525:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.541409:0:166112:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca2932 lrc: 3/0,1 mode: PW/PW res: [0x34525:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.541411:0:166112:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca2932 lrc: 2/0,0 mode: PW/PW res: [0x34525:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.541424:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca2932 lrc: 2/0,0 mode: PW/PW res: [0x34525:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.541427:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000eebd17a1 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531879.541427:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca2932 lrc: 2/0,0 mode: PW/PW res: [0x34525:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.541433:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca2932 lrc: 3/0,0 mode: PW/PW res: [0x34525:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.541437:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca2932 lrc: 1/0,0 mode: --/PW res: [0x34525:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.541440:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca2932 lrc: 0/0,0 mode: --/PW res: [0x34525:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00002000:00010000:0.0:1651531879.541441:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34524:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:0.0:1651531879.541443:0:166112:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca2939 lrc: 3/0,1 mode: --/PW res: [0x34524:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.541446:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531879.541447:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531879.541447:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca2939 lrc: 3/0,1 mode: PW/PW res: [0x34524:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.541450:0:166112:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca2939 lrc: 3/0,1 mode: PW/PW res: [0x34524:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.541453:0:166112:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca2939 lrc: 3/0,1 mode: PW/PW res: [0x34524:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.541456:0:166112:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca2939 lrc: 2/0,0 mode: PW/PW res: [0x34524:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.541465:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca2939 lrc: 2/0,0 mode: PW/PW res: [0x34524:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.541468:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f6ecb7e5 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531879.541469:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca2939 lrc: 2/0,0 mode: PW/PW res: [0x34524:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.541471:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca2939 lrc: 3/0,0 mode: PW/PW res: [0x34524:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.541475:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca2939 lrc: 1/0,0 mode: --/PW res: [0x34524:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.541478:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca2939 lrc: 0/0,0 mode: --/PW res: [0x34524:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00002000:00010000:0.0:1651531879.541482:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34523:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:0.0:1651531879.541484:0:166112:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca2940 lrc: 3/0,1 mode: --/PW res: [0x34523:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.541487:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531879.541488:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531879.541488:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca2940 lrc: 3/0,1 mode: PW/PW res: [0x34523:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.541491:0:166112:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca2940 lrc: 3/0,1 mode: PW/PW res: [0x34523:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.541496:0:166112:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca2940 lrc: 3/0,1 mode: PW/PW res: [0x34523:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.541498:0:166112:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca2940 lrc: 2/0,0 mode: PW/PW res: [0x34523:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.541507:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca2940 lrc: 2/0,0 mode: PW/PW res: [0x34523:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.541511:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c806f265 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531879.541512:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca2940 lrc: 2/0,0 mode: PW/PW res: [0x34523:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.541515:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca2940 lrc: 3/0,0 mode: PW/PW res: [0x34523:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.541519:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca2940 lrc: 1/0,0 mode: --/PW res: [0x34523:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.541521:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca2940 lrc: 0/0,0 mode: --/PW res: [0x34523:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00002000:00010000:0.0:1651531879.541524:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34522:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:0.0:1651531879.541525:0:166112:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca2947 lrc: 3/0,1 mode: --/PW res: [0x34522:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.541528:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531879.541529:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531879.541530:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca2947 lrc: 3/0,1 mode: PW/PW res: [0x34522:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.541533:0:166112:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca2947 lrc: 3/0,1 mode: PW/PW res: [0x34522:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.541536:0:166112:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca2947 lrc: 3/0,1 mode: PW/PW res: [0x34522:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.541538:0:166112:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca2947 lrc: 2/0,0 mode: PW/PW res: [0x34522:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.541547:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca2947 lrc: 2/0,0 mode: PW/PW res: [0x34522:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.541550:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000022b2104e already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531879.541551:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca2947 lrc: 2/0,0 mode: PW/PW res: [0x34522:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.541553:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca2947 lrc: 3/0,0 mode: PW/PW res: [0x34522:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.541557:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca2947 lrc: 1/0,0 mode: --/PW res: [0x34522:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.541560:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca2947 lrc: 0/0,0 mode: --/PW res: [0x34522:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00002000:00010000:0.0:1651531879.541563:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34521:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:0.0:1651531879.541564:0:166112:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca294e lrc: 3/0,1 mode: --/PW res: [0x34521:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.541571:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531879.541571:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531879.541572:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca294e lrc: 3/0,1 mode: PW/PW res: [0x34521:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.541575:0:166112:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca294e lrc: 3/0,1 mode: PW/PW res: [0x34521:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.541578:0:166112:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca294e lrc: 3/0,1 mode: PW/PW res: [0x34521:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.541581:0:166112:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca294e lrc: 2/0,0 mode: PW/PW res: [0x34521:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.541590:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca294e lrc: 2/0,0 mode: PW/PW res: [0x34521:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.541593:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000060a6272d already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531879.541594:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca294e lrc: 2/0,0 mode: PW/PW res: [0x34521:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.541597:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca294e lrc: 3/0,0 mode: PW/PW res: [0x34521:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.541601:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca294e lrc: 1/0,0 mode: --/PW res: [0x34521:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.541603:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca294e lrc: 0/0,0 mode: --/PW res: [0x34521:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00002000:00010000:0.0:1651531879.541614:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34520:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:0.0:1651531879.541615:0:166112:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca2955 lrc: 3/0,1 mode: --/PW res: [0x34520:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.541619:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531879.541619:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531879.541620:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca2955 lrc: 3/0,1 mode: PW/PW res: [0x34520:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.541624:0:166112:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca2955 lrc: 3/0,1 mode: PW/PW res: [0x34520:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.541626:0:166112:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca2955 lrc: 3/0,1 mode: PW/PW res: [0x34520:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.541632:0:166112:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca2955 lrc: 2/0,0 mode: PW/PW res: [0x34520:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.541641:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca2955 lrc: 2/0,0 mode: PW/PW res: [0x34520:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.541644:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001cf49bf2 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531879.541645:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca2955 lrc: 2/0,0 mode: PW/PW res: [0x34520:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.541648:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca2955 lrc: 3/0,0 mode: PW/PW res: [0x34520:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.541651:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca2955 lrc: 1/0,0 mode: --/PW res: [0x34520:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.541655:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca2955 lrc: 0/0,0 mode: --/PW res: [0x34520:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00002000:00010000:0.0:1651531879.541666:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x3451f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:0.0:1651531879.541667:0:166112:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca295c lrc: 3/0,1 mode: --/PW res: [0x3451f:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.541671:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531879.541671:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531879.541672:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca295c lrc: 3/0,1 mode: PW/PW res: [0x3451f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.541675:0:166112:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca295c lrc: 3/0,1 mode: PW/PW res: [0x3451f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.541678:0:166112:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca295c lrc: 3/0,1 mode: PW/PW res: [0x3451f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.541681:0:166112:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca295c lrc: 2/0,0 mode: PW/PW res: [0x3451f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.541690:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca295c lrc: 2/0,0 mode: PW/PW res: [0x3451f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.541693:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c8969b4f already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531879.541694:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca295c lrc: 2/0,0 mode: PW/PW res: [0x3451f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.541697:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca295c lrc: 3/0,0 mode: PW/PW res: [0x3451f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.541701:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca295c lrc: 1/0,0 mode: --/PW res: [0x3451f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.541703:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca295c lrc: 0/0,0 mode: --/PW res: [0x3451f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00002000:00010000:0.0:1651531879.541708:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x3451e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:0.0:1651531879.541710:0:166112:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca2963 lrc: 3/0,1 mode: --/PW res: [0x3451e:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.541713:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531879.541713:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531879.541714:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca2963 lrc: 3/0,1 mode: PW/PW res: [0x3451e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.541719:0:166112:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca2963 lrc: 3/0,1 mode: PW/PW res: [0x3451e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.541722:0:166112:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca2963 lrc: 3/0,1 mode: PW/PW res: [0x3451e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.541724:0:166112:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca2963 lrc: 2/0,0 mode: PW/PW res: [0x3451e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.541733:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca2963 lrc: 2/0,0 mode: PW/PW res: [0x3451e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.541736:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f58aeba9 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531879.541737:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca2963 lrc: 2/0,0 mode: PW/PW res: [0x3451e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.541743:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca2963 lrc: 3/0,0 mode: PW/PW res: [0x3451e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.541747:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca2963 lrc: 1/0,0 mode: --/PW res: [0x3451e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.541749:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca2963 lrc: 0/0,0 mode: --/PW res: [0x3451e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00002000:00010000:0.0:1651531879.541756:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x3451d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:0.0:1651531879.541758:0:166112:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca296a lrc: 3/0,1 mode: --/PW res: [0x3451d:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.541761:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531879.541761:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531879.541762:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca296a lrc: 3/0,1 mode: PW/PW res: [0x3451d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.541765:0:166112:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca296a lrc: 3/0,1 mode: PW/PW res: [0x3451d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.541768:0:166112:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca296a lrc: 3/0,1 mode: PW/PW res: [0x3451d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.541771:0:166112:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca296a lrc: 2/0,0 mode: PW/PW res: [0x3451d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.541783:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca296a lrc: 2/0,0 mode: PW/PW res: [0x3451d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.541786:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f6135e30 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531879.541787:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca296a lrc: 2/0,0 mode: PW/PW res: [0x3451d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.541790:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca296a lrc: 3/0,0 mode: PW/PW res: [0x3451d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.541793:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca296a lrc: 1/0,0 mode: --/PW res: [0x3451d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.541796:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca296a lrc: 0/0,0 mode: --/PW res: [0x3451d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00002000:00010000:0.0:1651531879.541809:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x3451c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:0.0:1651531879.541810:0:166112:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce7f2d16/0x3234de053ca2971 lrc: 3/0,1 mode: --/PW res: [0x3451c:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.541814:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531879.541814:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531879.541815:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce7f2d16/0x3234de053ca2971 lrc: 3/0,1 mode: PW/PW res: [0x3451c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.541818:0:166112:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ce7f2d16/0x3234de053ca2971 lrc: 3/0,1 mode: PW/PW res: [0x3451c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.541821:0:166112:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce7f2d16/0x3234de053ca2971 lrc: 3/0,1 mode: PW/PW res: [0x3451c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.541824:0:166112:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ce7f2d16/0x3234de053ca2971 lrc: 2/0,0 mode: PW/PW res: [0x3451c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.541833:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ce7f2d16/0x3234de053ca2971 lrc: 2/0,0 mode: PW/PW res: [0x3451c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.541837:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ce7f2d16 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531879.541838:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce7f2d16/0x3234de053ca2971 lrc: 2/0,0 mode: PW/PW res: [0x3451c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.541841:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce7f2d16/0x3234de053ca2971 lrc: 3/0,0 mode: PW/PW res: [0x3451c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.541845:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ce7f2d16/0x3234de053ca2971 lrc: 1/0,0 mode: --/PW res: [0x3451c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.541847:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ce7f2d16/0x3234de053ca2971 lrc: 0/0,0 mode: --/PW res: [0x3451c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00002000:00010000:0.0:1651531879.541855:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x3451b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:0.0:1651531879.541857:0:166112:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002dfc67f7/0x3234de053ca2978 lrc: 3/0,1 mode: --/PW res: [0x3451b:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.541860:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531879.541861:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531879.541862:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002dfc67f7/0x3234de053ca2978 lrc: 3/0,1 mode: PW/PW res: [0x3451b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.541865:0:166112:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002dfc67f7/0x3234de053ca2978 lrc: 3/0,1 mode: PW/PW res: [0x3451b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.541869:0:166112:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002dfc67f7/0x3234de053ca2978 lrc: 3/0,1 mode: PW/PW res: [0x3451b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.541872:0:166112:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002dfc67f7/0x3234de053ca2978 lrc: 2/0,0 mode: PW/PW res: [0x3451b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.541881:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002dfc67f7/0x3234de053ca2978 lrc: 2/0,0 mode: PW/PW res: [0x3451b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.541884:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002dfc67f7 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531879.541885:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002dfc67f7/0x3234de053ca2978 lrc: 2/0,0 mode: PW/PW res: [0x3451b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.541887:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002dfc67f7/0x3234de053ca2978 lrc: 3/0,0 mode: PW/PW res: [0x3451b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.541891:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002dfc67f7/0x3234de053ca2978 lrc: 1/0,0 mode: --/PW res: [0x3451b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.541894:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002dfc67f7/0x3234de053ca2978 lrc: 0/0,0 mode: --/PW res: [0x3451b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00002000:00010000:0.0:1651531879.541905:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x3451a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:0.0:1651531879.541907:0:166112:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0fea916/0x3234de053ca297f lrc: 3/0,1 mode: --/PW res: [0x3451a:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.541910:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531879.541910:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531879.541911:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0fea916/0x3234de053ca297f lrc: 3/0,1 mode: PW/PW res: [0x3451a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.541914:0:166112:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a0fea916/0x3234de053ca297f lrc: 3/0,1 mode: PW/PW res: [0x3451a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.541917:0:166112:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0fea916/0x3234de053ca297f lrc: 3/0,1 mode: PW/PW res: [0x3451a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.541920:0:166112:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a0fea916/0x3234de053ca297f lrc: 2/0,0 mode: PW/PW res: [0x3451a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.541929:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a0fea916/0x3234de053ca297f lrc: 2/0,0 mode: PW/PW res: [0x3451a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.541933:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a0fea916 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531879.541933:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0fea916/0x3234de053ca297f lrc: 2/0,0 mode: PW/PW res: [0x3451a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.541936:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0fea916/0x3234de053ca297f lrc: 3/0,0 mode: PW/PW res: [0x3451a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.541940:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a0fea916/0x3234de053ca297f lrc: 1/0,0 mode: --/PW res: [0x3451a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.541942:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a0fea916/0x3234de053ca297f lrc: 0/0,0 mode: --/PW res: [0x3451a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00002000:00010000:0.0:1651531879.541946:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34519:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:0.0:1651531879.541948:0:166112:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009dff3fc3/0x3234de053ca2986 lrc: 3/0,1 mode: --/PW res: [0x34519:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.541954:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531879.541955:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531879.541956:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009dff3fc3/0x3234de053ca2986 lrc: 3/0,1 mode: PW/PW res: [0x34519:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.541959:0:166112:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009dff3fc3/0x3234de053ca2986 lrc: 3/0,1 mode: PW/PW res: [0x34519:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.541962:0:166112:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009dff3fc3/0x3234de053ca2986 lrc: 3/0,1 mode: PW/PW res: [0x34519:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.541964:0:166112:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009dff3fc3/0x3234de053ca2986 lrc: 2/0,0 mode: PW/PW res: [0x34519:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.541973:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009dff3fc3/0x3234de053ca2986 lrc: 2/0,0 mode: PW/PW res: [0x34519:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.541976:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009dff3fc3 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531879.541977:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009dff3fc3/0x3234de053ca2986 lrc: 2/0,0 mode: PW/PW res: [0x34519:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.541980:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009dff3fc3/0x3234de053ca2986 lrc: 3/0,0 mode: PW/PW res: [0x34519:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.541983:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009dff3fc3/0x3234de053ca2986 lrc: 1/0,0 mode: --/PW res: [0x34519:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.541987:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009dff3fc3/0x3234de053ca2986 lrc: 0/0,0 mode: --/PW res: [0x34519:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00002000:00010000:0.0:1651531879.541989:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34518:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:0.0:1651531879.541991:0:166112:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003cf86247/0x3234de053ca298d lrc: 3/0,1 mode: --/PW res: [0x34518:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.541994:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531879.541994:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531879.541995:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003cf86247/0x3234de053ca298d lrc: 3/0,1 mode: PW/PW res: [0x34518:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.541998:0:166112:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003cf86247/0x3234de053ca298d lrc: 3/0,1 mode: PW/PW res: [0x34518:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.542001:0:166112:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003cf86247/0x3234de053ca298d lrc: 3/0,1 mode: PW/PW res: [0x34518:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.542006:0:166112:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003cf86247/0x3234de053ca298d lrc: 2/0,0 mode: PW/PW res: [0x34518:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.542016:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003cf86247/0x3234de053ca298d lrc: 2/0,0 mode: PW/PW res: [0x34518:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.542019:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003cf86247 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531879.542019:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003cf86247/0x3234de053ca298d lrc: 2/0,0 mode: PW/PW res: [0x34518:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.542022:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003cf86247/0x3234de053ca298d lrc: 3/0,0 mode: PW/PW res: [0x34518:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.542026:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003cf86247/0x3234de053ca298d lrc: 1/0,0 mode: --/PW res: [0x34518:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.542029:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003cf86247/0x3234de053ca298d lrc: 0/0,0 mode: --/PW res: [0x34518:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00002000:00010000:0.0:1651531879.542030:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34517:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:0.0:1651531879.542032:0:166112:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b7d0a41/0x3234de053ca2994 lrc: 3/0,1 mode: --/PW res: [0x34517:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.542035:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531879.542035:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531879.542036:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b7d0a41/0x3234de053ca2994 lrc: 3/0,1 mode: PW/PW res: [0x34517:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.542039:0:166112:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004b7d0a41/0x3234de053ca2994 lrc: 3/0,1 mode: PW/PW res: [0x34517:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.542042:0:166112:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b7d0a41/0x3234de053ca2994 lrc: 3/0,1 mode: PW/PW res: [0x34517:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531879.542045:0:166112:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004b7d0a41/0x3234de053ca2994 lrc: 2/0,0 mode: PW/PW res: [0x34517:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.542054:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004b7d0a41/0x3234de053ca2994 lrc: 2/0,0 mode: PW/PW res: [0x34517:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.542057:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004b7d0a41 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531879.542058:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004b7d0a41/0x3234de053ca2994 lrc: 2/0,0 mode: PW/PW res: [0x34517:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.542064:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004b7d0a41/0x3234de053ca2994 lrc: 3/0,0 mode: PW/PW res: [0x34517:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531879.542067:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004b7d0a41/0x3234de053ca2994 lrc: 1/0,0 mode: --/PW res: [0x34517:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00002000:00080000:0.0:1651531879.542068:0:166112:0:(ofd_dev.c:1469:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x0:214294
00010000:00010000:1.0:1651531879.542070:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004b7d0a41/0x3234de053ca2994 lrc: 0/0,0 mode: --/PW res: [0x34517:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531879.542090:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007f998d3c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:330937:x1731745951156544:12345-10.240.43.61@tcp:5:osp-pre-1-0.0 Request processed in 3702us (3748us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531879.542094:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 44278
00000100:00100000:0.0:1651531879.542606:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651531879.542617:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651531879.542634:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951156736
00000100:00100000:1.0:1651531879.542639:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951156672
00000100:00100000:0.0:1651531879.542645:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 44279
00000100:00100000:0.0:1651531879.542647:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000942b56fd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:330937:x1731745951156736:12345-10.240.43.61@tcp:5:osp-pre-1-0.0
00000100:00100000:1.0:1651531879.542658:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 440
00002000:00080000:0.0:1651531879.542658:0:166112:0:(ofd_dev.c:1706:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x0 at 214338
00000100:00100000:1.0:1651531879.542660:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000964ce442 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745951156672:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:1.0:1651531879.542667:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 141632 pending 896 free 81283506176 avail 77112795136
00000100:00100000:1.0:1651531879.542681:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000964ce442 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745951156672:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 21us (64us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531879.542684:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 440
00000100:00100000:0.0:1651531879.543164:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000942b56fd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:330937:x1731745951156736:12345-10.240.43.61@tcp:5:osp-pre-1-0.0 Request processed in 516us (557us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531879.543168:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 44279
00000100:00080000:1.0:1651531882.621263:0:213652:0:(pinger.c:250:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1651531882.621268:0:213652:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1651531882.621269:0:213652:0:(import.c:85:import_set_state_nolock()) 0000000070a36139 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1651531882.621276:0:213652:0:(import.c:533:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 10.240.43.61@tcp last attempt 22536
00000100:00080000:1.0:1651531882.621279:0:213652:0:(import.c:614:import_select_connection()) lustre-MDT0000-lwp-OST0001: import 0000000070a36139 using connection 10.240.43.61@tcp/10.240.43.61@tcp
00000100:00100000:1.0:1651531882.621295:0:213652:0:(import.c:806:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@0000000052213cb9 x1731745997344512/t0(0) o38->lustre-MDT0000-lwp-OST0001@10.240.43.61@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:1.0:1651531882.621319:0:39098:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000052213cb9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:39098:1731745997344512:10.240.43.61@tcp:38:kworker/u4:1.0
00010000:00080000:1.0:1651531882.621700:0:39098:0:(ldlm_request.c:1448:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=133199)  req@0000000052213cb9 x1731745997344512/t0(0) o38->lustre-MDT0000-lwp-OST0001@10.240.43.61@tcp:12/10 lens 520/416 e 0 to 0 dl 1651531888 ref 1 fl Rpc:RNQU/0/0 rc 0/0 job:'kworker/u4:1.0'
00000100:00080000:1.0:1651531882.621708:0:39098:0:(import.c:1073:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 17
00000100:00080000:1.0:1651531882.623495:0:39098:0:(import.c:1279:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover  req@0000000052213cb9 x1731745997344512/t0(0) o38->lustre-MDT0000-lwp-OST0001@10.240.43.61@tcp:12/10 lens 520/416 e 0 to 0 dl 1651531888 ref 1 fl Interpret:RNQU/0/0 rc 0/0 job:'kworker/u4:1.0'
00000100:00080000:1.0:1651531882.623499:0:39098:0:(import.c:85:import_set_state_nolock()) 0000000070a36139 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER
00000100:00080000:1.0:1651531882.623501:0:39098:0:(import.c:85:import_set_state_nolock()) 0000000070a36139 lustre-MDT0000_UUID: changing import state from RECOVER to FULL
00000100:02000000:1.0:1651531882.623503:0:39098:0:(import.c:1642:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 10.240.43.61@tcp (at 10.240.43.61@tcp)
00000100:00100000:1.0:1651531882.623505:0:39098:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000052213cb9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:39098:1731745997344512:10.240.43.61@tcp:38:kworker/u4:1.0
00000100:00100000:0.0:1651531884.768130:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651531884.768169:0:182071:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951157120
00000100:00100000:1.0:1651531884.768188:0:182071:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 441
00000100:00100000:1.0:1651531884.768191:0:182071:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008f58a6d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951157120:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:1.0:1651531884.768205:0:182071:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140736 pending 0 free 81283506176 avail 77112795136
00000100:00100000:1.0:1651531884.768242:0:182071:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008f58a6d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951157120:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 50us (113us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531884.768246:0:182071:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 441
00000100:00100000:0.0:1651531887.741291:0:39099:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cb694635 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9063caa-b124-4cb6-99ef-d01a735595c3:39099:1731745997344576:10.240.43.61@tcp:400:kworker/u4:0.0
00000100:00100000:1.0:1651531887.741300:0:39100:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000074640db2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:39100:1731745997344640:10.240.43.61@tcp:400:kworker/u4:0.0
00000100:00100000:0.0:1651531887.741600:0:39099:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cb694635 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9063caa-b124-4cb6-99ef-d01a735595c3:39099:1731745997344576:10.240.43.61@tcp:400:kworker/u4:0.0
00010000:00080000:1.0:1651531887.741605:0:39100:0:(ldlm_request.c:1448:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=133199)  req@0000000074640db2 x1731745997344640/t0(0) o400->lustre-MDT0000-lwp-OST0001@10.240.43.61@tcp:12/10 lens 224/224 e 0 to 0 dl 1651531894 ref 1 fl Rpc:RNQU/0/0 rc 0/0 job:'kworker/u4:0.0'
00000100:00100000:1.0:1651531887.741611:0:39100:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000074640db2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:39100:1731745997344640:10.240.43.61@tcp:400:kworker/u4:0.0
00000100:00100000:0.0:1651531889.888116:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651531889.888130:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951157312
00000100:00100000:0.0:1651531889.888162:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 442
00000100:00100000:0.0:1651531889.888164:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000074640db2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951157312:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:0.0:1651531889.888173:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140736 pending 0 free 81283506176 avail 77112795136
00000100:00100000:0.0:1651531889.888189:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000074640db2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951157312:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 24us (76us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531889.888193:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 442
00000100:00100000:0.0:1651531890.451060:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531890.451092:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466849344
00000100:00100000:1.0:1651531890.451104:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44280
00000100:00100000:1.0:1651531890.451106:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cb694635 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:438145:x1731754466849344:12345-10.240.43.64@tcp:8:mount.lustre.0
00010000:00080000:1.0:1651531890.451117:0:166112:0:(ldlm_lib.c:1365:target_handle_connect()) lustre-OST0001: connection from 0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp t0 exp 0000000055bfac58 cur 22549 last 0
00000020:00000080:1.0:1651531890.451128:0:166112:0:(genops.c:1359:class_connect()) connect: client 0c703c47-a140-4387-a181-4e0a15e9b24e, cookie 0x3234de053ca299b
00002000:00100000:1.0:1651531890.451132:0:166112:0:(ofd_obd.c:150:ofd_parse_connect_data()) lustre-OST0001: cli 0c703c47-a140-4387-a181-4e0a15e9b24e/000000009dcd8a6d ocd_connect_flags: 0xa0465af2e3640078 ocd_version: 20f0000 ocd_grant: 134217728 ocd_index: 0 ocd_group 0
00002000:00100000:1.0:1651531890.451136:0:166112:0:(ofd_obd.c:249:ofd_parse_connect_data()) lustre-OST0001: cli <unknown> supports cksum type f7, return f7
00000020:01000000:1.0:1651531890.451176:0:166112:0:(lprocfs_status_server.c:544:lprocfs_exp_setup()) using hash 00000000427049c0
00002000:00080000:1.0:1651531890.451180:0:166112:0:(ofd_obd.c:391:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0
00000100:00080000:1.0:1651531890.451195:0:166112:0:(import.c:85:import_set_state_nolock()) 0000000035d1f7a9 �������: changing import state from RECOVER to FULL
00000100:00100000:1.0:1651531890.451211:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cb694635 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438145:x1731754466849344:12345-10.240.43.64@tcp:8:mount.lustre.0 Request processed in 104us (153us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531890.451215:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44280
00000400:00000080:0.0:1651531891.803077:0:226967:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648
00000001:02000400:0.0:1651531891.803079:0:226967:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 300a: basic striped dir sanity test ======= 22:51:31 (1651531891)
00000400:00000080:0.0:1651531892.125310:0:227021:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648
00000001:02000400:0.0:1651531892.125312:0:227021:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity test_300a needs >= 2 MDTs
00000400:00000080:0.0:1651531892.475235:0:227075:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648
00000001:02000400:0.0:1651531892.475238:0:227075:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 300b: check ctime/mtime for striped dir === 22:51:32 (1651531892)
00000400:00000080:0.0:1651531892.799954:0:227129:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648
00000001:02000400:0.0:1651531892.799957:0:227129:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity test_300b needs >= 2 MDTs
00000400:00000080:1.0:1651531893.150889:0:227184:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648
00000001:02000400:1.0:1651531893.150892:0:227184:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 300c: chown
00000400:00000080:0.0:1651531893.497340:0:227238:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648
00000001:02000400:0.0:1651531893.497342:0:227238:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity test_300c needs >= 2 MDTs
00000400:00000080:0.0:1651531893.836300:0:227292:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648
00000001:02000400:0.0:1651531893.836302:0:227292:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 300d: check default stripe under striped directory ========================================================== 22:51:33 (1651531893)
00000400:00000080:0.0:1651531894.160766:0:227346:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648
00000001:02000400:0.0:1651531894.160768:0:227346:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity test_300d needs >= 2 MDTs
00000400:00000080:0.0:1651531894.513482:0:227400:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648
00000001:02000400:0.0:1651531894.513484:0:227400:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 300e: check rename under striped directory ========================================================== 22:51:34 (1651531894)
00000400:00000080:0.0:1651531894.834467:0:227454:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648
00000001:02000400:0.0:1651531894.834470:0:227454:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity test_300e needs >= 2 MDTs
00000100:00100000:0.0:1651531895.008263:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651531895.008281:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951157440
00000100:00100000:0.0:1651531895.008305:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 443
00000100:00100000:0.0:1651531895.008307:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000036ee6adc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951157440:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:0.0:1651531895.008324:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 8578496 pending 0 free 81283506176 avail 77112795136
00000100:00100000:0.0:1651531895.008353:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000036ee6adc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951157440:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 45us (93us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531895.008356:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 443
00000400:00000080:0.0:1651531895.184726:0:227508:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648
00000001:02000400:0.0:1651531895.184729:0:227508:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 300f: check rename cross striped directory ========================================================== 22:51:34 (1651531894)
00000400:00000080:0.0:1651531895.491968:0:227562:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648
00000001:02000400:0.0:1651531895.491970:0:227562:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity test_300f needs >= 2 MDTs
00000400:00000080:1.0:1651531895.844695:0:227616:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648
00000001:02000400:1.0:1651531895.844698:0:227616:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 300g: check default striped directory for normal directory ========================================================== 22:51:35 (1651531895)
00000400:00000080:0.0:1651531896.153927:0:227670:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648
00000001:02000400:0.0:1651531896.153930:0:227670:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity test_300g needs >= 2 MDTs
00000001:00100000:0.0:1651531896.468946:0:166098:0:(tgt_lastrcvd.c:537:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0c703c47-a140-4387-a181-4e0a15e9b24e
00000400:00000080:0.0:1651531896.710572:0:227724:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648
00000001:02000400:0.0:1651531896.710575:0:227724:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 300h: check default striped directory for striped directory ========================================================== 22:51:36 (1651531896)
00000400:00000080:0.0:1651531897.032221:0:227778:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648
00000001:02000400:0.0:1651531897.032237:0:227778:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity test_300h needs >= 2 MDTs
00000400:00000080:0.0:1651531897.376008:0:227832:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648
00000001:02000400:0.0:1651531897.376010:0:227832:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 300i: client handle unknown hash type striped directory ========================================================== 22:51:37 (1651531897)
00000400:00000080:1.0:1651531897.694827:0:227886:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648
00000001:02000400:1.0:1651531897.694830:0:227886:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity test_300i needs >= 2 MDTs
00000400:00000080:0.0:1651531898.039129:0:227940:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648
00000001:02000400:0.0:1651531898.039131:0:227940:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 300j: test large update record ============ 22:51:37 (1651531897)
00000400:00000080:0.0:1651531898.362965:0:227994:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648
00000001:02000400:0.0:1651531898.362967:0:227994:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity test_300j needs >= 2 MDTs
00000400:00000080:0.0:1651531898.706859:0:228048:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648
00000001:02000400:0.0:1651531898.706861:0:228048:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 300k: test large striped directory ======== 22:51:38 (1651531898)
00000400:00000080:1.0:1651531899.021756:0:228102:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648
00000001:02000400:1.0:1651531899.021759:0:228102:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity test_300k needs >= 2 MDTs
00000400:00000080:0.0:1651531899.375286:0:228156:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648
00000001:02000400:0.0:1651531899.375288:0:228156:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 300l: non-root user to create dir under striped dir with stale layout ========================================================== 22:51:39 (1651531899)
00000400:00000080:0.0:1651531899.694685:0:228210:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648
00000001:02000400:0.0:1651531899.694687:0:228210:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity test_300l needs >= 2 MDTs
00000400:00000080:0.0:1651531900.042341:0:228264:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648
00000001:02000400:0.0:1651531900.042344:0:228264:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 300m: setstriped directory on single MDT FS ========================================================== 22:51:39 (1651531899)
00000100:00100000:0.0:1651531900.128140:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651531900.128180:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951157696
00000100:00100000:1.0:1651531900.128203:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 444
00000100:00100000:1.0:1651531900.128205:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000047c291a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951157696:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:1.0:1651531900.128239:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 8578496 pending 0 free 81283506176 avail 77112795136
00000100:00100000:1.0:1651531900.128268:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000047c291a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951157696:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 62us (130us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531900.128271:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 444
00000400:00000080:0.0:1651531901.460693:0:228482:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648
00000001:02000400:0.0:1651531901.460695:0:228482:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 300n: non-root user to create dir under striped dir with default EA ========================================================== 22:51:41 (1651531901)
00000400:00000080:1.0:1651531901.789605:0:228536:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648
00000001:02000400:1.0:1651531901.789609:0:228536:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity test_300n needs >= 2 MDTs
00000400:00000080:1.0:1651531902.120055:0:228590:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648
00000001:02000400:1.0:1651531902.120058:0:228590:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity test_300o skipping SLOW test 300o
00000400:00000080:0.0:1651531902.471604:0:228644:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648
00000001:02000400:0.0:1651531902.471606:0:228644:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 300p: create striped directory without space ========================================================== 22:51:42 (1651531902)
00000400:00000080:0.0:1651531902.787973:0:228698:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648
00000001:02000400:0.0:1651531902.787975:0:228698:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity test_300p needs >= 2 MDTs
00000400:00000080:1.0:1651531903.144841:0:228752:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648
00000001:02000400:1.0:1651531903.144844:0:228752:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 300q: create remote directory under orphan directory ========================================================== 22:51:42 (1651531902)
00000400:00000080:0.0:1651531903.459585:0:228806:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648
00000001:02000400:0.0:1651531903.459587:0:228806:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity test_300q needs >= 2 MDTs
00000400:00000080:1.0:1651531903.818066:0:228860:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648
00000001:02000400:1.0:1651531903.818068:0:228860:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 300r: test -1 striped directory =========== 22:51:43 (1651531903)
00000400:00000080:1.0:1651531904.157833:0:228914:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648
00000001:02000400:1.0:1651531904.157835:0:228914:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity test_300r needs >= 2 MDTs
00000400:00000080:1.0:1651531904.506945:0:228968:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648
00000001:02000400:1.0:1651531904.506948:0:228968:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 300s: test lfs mkdir -c without -i ======== 22:51:44 (1651531904)
00000400:00000080:1.0:1651531904.830585:0:229022:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648
00000001:02000400:1.0:1651531904.830588:0:229022:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity test_300s needs >= 2 MDTs
00000400:00000080:0.0:1651531905.211561:0:229076:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648
00000001:02000400:0.0:1651531905.211564:0:229076:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 300t: test max_mdt_stripecount ============ 22:51:44 (1651531904)
00000100:00100000:0.0:1651531905.248199:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651531905.248235:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951157824
00000100:00100000:1.0:1651531905.248260:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 445
00000100:00100000:1.0:1651531905.248263:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000073d3f68d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951157824:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:1.0:1651531905.248280:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 8578496 pending 0 free 81283506176 avail 77112795136
00000100:00100000:1.0:1651531905.248307:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000073d3f68d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951157824:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 43us (111us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531905.248311:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 445
00000400:00000080:1.0:1651531905.535879:0:229130:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648
00000001:02000400:1.0:1651531905.535882:0:229130:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity test_300t needs at least 2 MDTs
00000400:00000080:1.0:1651531905.887644:0:229184:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648
00000001:02000400:1.0:1651531905.887646:0:229184:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 310a: open unlink remote file ============= 22:51:45 (1651531905)
00000400:00000080:1.0:1651531906.205878:0:229238:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648
00000001:02000400:1.0:1651531906.205880:0:229238:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity test_310a needs >= 4 MDTs
00000400:00000080:1.0:1651531906.556626:0:229292:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648
00000001:02000400:1.0:1651531906.556628:0:229292:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 310b: unlink remote file with multiple links while open ========================================================== 22:51:46 (1651531906)
00000400:00000080:0.0:1651531906.871435:0:229346:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648
00000001:02000400:0.0:1651531906.871438:0:229346:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity test_310b needs >= 4 MDTs
00000400:00000080:1.0:1651531907.220171:0:229400:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648
00000001:02000400:1.0:1651531907.220175:0:229400:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 310c: open-unlink remote file with multiple links ========================================================== 22:51:46 (1651531906)
00000400:00000080:0.0:1651531907.536949:0:229454:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648
00000001:02000400:0.0:1651531907.536952:0:229454:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity test_310c needs >= 4 MDTs
00000400:00000080:0.0:1651531907.885972:0:229508:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648
00000001:02000400:0.0:1651531907.885975:0:229508:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 311: disable OSP precreate, and unlink should destroy objs ========================================================== 22:51:47 (1651531907)
00000100:00100000:0.0:1651531907.956011:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531907.956044:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754466855104
00000100:00100000:1.0:1651531907.956068:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 446
00000100:00100000:1.0:1651531907.956071:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009d9a9718 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0c703c47-a140-4387-a181-4e0a15e9b24e+5:674902:x1731754466855104:12345-10.240.43.64@tcp:13:lfs.0
00002000:00000024:1.0:1651531907.956088:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 8578496 pending 0 free 81283506176 avail 77112795136
00000100:00100000:1.0:1651531907.956119:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009d9a9718 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0c703c47-a140-4387-a181-4e0a15e9b24e+5:674902:x1731754466855104:12345-10.240.43.64@tcp:13:lfs.0 Request processed in 47us (110us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531907.956123:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 446
00000100:00100000:0.0:1651531910.368191:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651531910.368232:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951160064
00000100:00100000:1.0:1651531910.368259:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 447
00000100:00100000:1.0:1651531910.368261:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a5d8c030 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951160064:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:1.0:1651531910.368279:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 8578496 pending 0 free 81283506176 avail 77112795136
00000100:00100000:1.0:1651531910.368309:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a5d8c030 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951160064:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 47us (121us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531910.368313:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 447
00000100:00100000:0.0:1651531912.140006:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531912.140047:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467241088
00000100:00100000:1.0:1651531912.140075:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 448
00000100:00100000:1.0:1651531912.140078:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000015411af3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0c703c47-a140-4387-a181-4e0a15e9b24e+5:675437:x1731754467241088:12345-10.240.43.64@tcp:13:lfs.0
00002000:00000024:1.0:1651531912.140092:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 8578496 pending 0 free 81283506176 avail 77112795136
00000100:00100000:1.0:1651531912.140125:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000015411af3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0c703c47-a140-4387-a181-4e0a15e9b24e+5:675437:x1731754467241088:12345-10.240.43.64@tcp:13:lfs.0 Request processed in 46us (123us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531912.140129:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 448
00000100:00100000:1.0:1651531912.829321:0:39100:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002ef35a72 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:39100:1731745997344768:10.240.43.61@tcp:400:kworker/u4:1.0
00000100:00100000:0.0:1651531912.829322:0:39099:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000052213cb9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9063caa-b124-4cb6-99ef-d01a735595c3:39099:1731745997344704:10.240.43.61@tcp:400:kworker/u4:1.0
00000100:00100000:1.0:1651531912.829653:0:39100:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002ef35a72 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:39100:1731745997344768:10.240.43.61@tcp:400:kworker/u4:1.0
00000100:00100000:0.0:1651531912.829654:0:39099:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000052213cb9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9063caa-b124-4cb6-99ef-d01a735595c3:39099:1731745997344704:10.240.43.61@tcp:400:kworker/u4:1.0
00000100:00100000:0.0:1651531914.159318:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531914.159348:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467241280
00000100:00100000:1.0:1651531914.159366:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 449
00000100:00100000:1.0:1651531914.159369:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f646cd75 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0c703c47-a140-4387-a181-4e0a15e9b24e+5:675445:x1731754467241280:12345-10.240.43.64@tcp:13:lfs.0
00002000:00000024:1.0:1651531914.159381:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 8578496 pending 0 free 81283506176 avail 77112795136
00000100:00100000:1.0:1651531914.159400:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f646cd75 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0c703c47-a140-4387-a181-4e0a15e9b24e+5:675445:x1731754467241280:12345-10.240.43.64@tcp:13:lfs.0 Request processed in 31us (84us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531914.159404:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 449
00000100:00100000:0.0:1651531915.488140:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651531915.488164:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951160320
00000100:00100000:1.0:1651531915.488189:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 450
00000100:00100000:1.0:1651531915.488191:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004ffe7cb4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951160320:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:1.0:1651531915.488199:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 8578496 pending 0 free 81283506176 avail 77112795136
00000100:00100000:1.0:1651531915.488214:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004ffe7cb4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951160320:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 22us (76us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531915.488217:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 450
00000100:00100000:0.0:1651531916.175938:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531916.175974:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467241536
00000100:00100000:1.0:1651531916.175990:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 451
00000100:00100000:1.0:1651531916.175991:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ec383f97 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0c703c47-a140-4387-a181-4e0a15e9b24e+5:675453:x1731754467241536:12345-10.240.43.64@tcp:13:lfs.0
00002000:00000024:1.0:1651531916.175997:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 8578496 pending 0 free 81283506176 avail 77112795136
00000100:00100000:1.0:1651531916.176012:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ec383f97 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0c703c47-a140-4387-a181-4e0a15e9b24e+5:675453:x1731754467241536:12345-10.240.43.64@tcp:13:lfs.0 Request processed in 20us (76us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531916.176015:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 451
00000100:00100000:0.0:1651531918.192470:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531918.192505:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467241728
00000100:00100000:1.0:1651531918.192521:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 452
00000100:00100000:1.0:1651531918.192523:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000051619ab4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0c703c47-a140-4387-a181-4e0a15e9b24e+5:675461:x1731754467241728:12345-10.240.43.64@tcp:13:lfs.0
00002000:00000024:1.0:1651531918.192533:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 8578496 pending 0 free 81283506176 avail 77112795136
00000100:00100000:1.0:1651531918.192548:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000051619ab4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0c703c47-a140-4387-a181-4e0a15e9b24e+5:675461:x1731754467241728:12345-10.240.43.64@tcp:13:lfs.0 Request processed in 25us (80us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531918.192551:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 452
00000100:00100000:0.0:1651531920.208713:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531920.208742:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467241920
00000100:00100000:1.0:1651531920.208757:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 453
00000100:00100000:1.0:1651531920.208759:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000055e8b273 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0c703c47-a140-4387-a181-4e0a15e9b24e+5:675469:x1731754467241920:12345-10.240.43.64@tcp:13:lfs.0
00002000:00000024:1.0:1651531920.208766:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 8578496 pending 0 free 81283506176 avail 77112795136
00000100:00100000:1.0:1651531920.208781:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000055e8b273 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0c703c47-a140-4387-a181-4e0a15e9b24e+5:675469:x1731754467241920:12345-10.240.43.64@tcp:13:lfs.0 Request processed in 22us (70us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531920.208785:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 453
00000100:00100000:0.0:1651531920.608103:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651531920.608128:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951160384
00000100:00100000:1.0:1651531920.608143:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 454
00000100:00100000:1.0:1651531920.608145:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ab1c7bbb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951160384:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:1.0:1651531920.608151:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 8578496 pending 0 free 81283506176 avail 77112795136
00000100:00100000:1.0:1651531920.608165:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ab1c7bbb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951160384:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 19us (63us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531920.608167:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 454
00000100:00100000:0.0:1651531922.226452:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531922.226488:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467242112
00000100:00100000:1.0:1651531922.226505:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 455
00000100:00100000:1.0:1651531922.226507:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000074959ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0c703c47-a140-4387-a181-4e0a15e9b24e+5:675477:x1731754467242112:12345-10.240.43.64@tcp:13:lfs.0
00002000:00000024:1.0:1651531922.226517:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 8578496 pending 0 free 81283506176 avail 77112795136
00000100:00100000:1.0:1651531922.226535:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000074959ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0c703c47-a140-4387-a181-4e0a15e9b24e+5:675477:x1731754467242112:12345-10.240.43.64@tcp:13:lfs.0 Request processed in 27us (84us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531922.226541:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 455
00000400:00000080:1.0:1651531923.535615:0:229942:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648
00000001:02000400:1.0:1651531923.535618:0:229942:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity test_312 skipping ALWAYS excluded test 312
00000400:00000080:1.0:1651531923.885479:0:229996:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648
00000001:02000400:1.0:1651531923.885481:0:229996:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 313: io should fail after last_rcvd update fail ========================================================== 22:52:03 (1651531923)
00000400:00000080:0.0:1651531925.678103:0:230214:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648
00000001:02000400:0.0:1651531925.678106:0:230214:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 314: OSP shouldn't fail after last_rcvd update failure ========================================================== 22:52:05 (1651531925)
00000100:00100000:0.0:1651531925.728134:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651531925.728165:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951224640
00000100:00100000:1.0:1651531925.728202:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 456
00000100:00100000:1.0:1651531925.728205:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aacbbaef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951224640:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:1.0:1651531925.728232:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 8578496 pending 0 free 81283506176 avail 77112795136
00000100:00100000:1.0:1651531925.728260:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aacbbaef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951224640:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 55us (129us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531925.728263:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 456
00000100:00100000:0.0:1651531925.890350:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531925.890375:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467244480
00000100:00100000:1.0:1651531925.890389:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44281
00000100:00100000:1.0:1651531925.890391:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000422b3f7a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438149:x1731754467244480:12345-10.240.43.64@tcp:101:rm.0
00010000:00010000:1.0:1651531925.890396:0:206699:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531925.890406:0:206699:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008d0d3608/0x3234de053ca29a2 lrc: 2/0,0 mode: --/PR res: [0x34543:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db444a24 expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651531925.890430:0:206699:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34543:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:1.0:1651531925.890438:0:206699:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531925.890439:0:206699:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531925.890444:0:206699:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008d0d3608/0x3234de053ca29a2 lrc: 3/0,0 mode: PR/PR res: [0x34543:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444a24 expref: 6 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531925.890452:0:206699:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008d0d3608/0x3234de053ca29a2 lrc: 3/0,0 mode: PR/PR res: [0x34543:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444a24 expref: 6 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531925.890459:0:206699:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d0d3608, rc 0)
00000100:00100000:1.0:1651531925.890473:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000422b3f7a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467244480:12345-10.240.43.64@tcp:101:rm.0 Request processed in 81us (123us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531925.890475:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44281
00000100:00100000:0.0:1651531926.427421:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651531926.427454:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951224768
00000100:00100000:1.0:1651531926.427480:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 44282
00000100:00100000:1.0:1651531926.427482:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007a05c3e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951224768:12345-10.240.43.61@tcp:6:osp-syn-1-0.0
00002000:00080000:1.0:1651531926.427499:0:166112:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:214339 count 1
00010000:00010000:1.0:1651531926.427514:0:166112:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea9f3321/0x3234de053ca29a9 lrc: 3/0,1 mode: --/PW res: [0x34543:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531926.427524:0:166112:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008d0d3608/0x3234de053ca29a2 lrc: 2/0,0 mode: PR/PR res: [0x34543:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444a24 expref: 5 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531926.427528:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531926.427529:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531926.427530:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea9f3321/0x3234de053ca29a9 lrc: 4/0,1 mode: --/PW res: [0x34543:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531926.427545:0:166112:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008d0d3608/0x3234de053ca29a2 lrc: 3/0,0 mode: PR/PR res: [0x34543:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444a24 expref: 5 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531926.427550:0:166112:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008d0d3608/0x3234de053ca29a2 lrc: 4/0,0 mode: PR/PR res: [0x34543:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444a24 expref: 5 pid: 206699 timeout: 22735 lvb_type: 1
00000100:00100000:1.0:1651531926.427556:0:166112:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002512e905 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:166112:1731745997344832:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531926.427591:0:166112:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ac137653 going to sleep for 11 seconds
00000100:00100000:1.0:1651531926.427929:0:166112:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002512e905 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:166112:1731745997344832:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651531926.427936:0:166112:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ea9f3321/0x3234de053ca29a9 lrc: 3/0,1 mode: --/PW res: [0x34543:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531926.428160:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531926.428199:0:169267:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467244672
00010000:00010000:0.0:1651531926.428210:0:169267:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008d0d3608/0x3234de053ca29a2 lrc: 4/0,0 mode: PR/PR res: [0x34543:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444a24 expref: 6 pid: 206699 timeout: 22735 lvb_type: 1
00000100:00100000:0.0:1651531926.428248:0:169267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 84
00000100:00100000:0.0:1651531926.428250:0:169267:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002512e905 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467244672:12345-10.240.43.64@tcp:103:ldlm_bl_01.0
00010000:00010000:0.0:1651531926.428255:0:169267:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531926.428257:0:169267:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008d0d3608/0x3234de053ca29a2 lrc: 4/0,0 mode: PR/PR res: [0x34543:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444a24 expref: 6 pid: 206699 timeout: 22735 lvb_type: 1
00010000:00010000:0.0:1651531926.428262:0:169267:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008d0d3608/0x3234de053ca29a2 lrc: 3/0,0 mode: PR/PR res: [0x34543:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444a24 expref: 6 pid: 206699 timeout: 22735 lvb_type: 1
00010000:00010000:0.0:1651531926.428274:0:169267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008d0d3608/0x3234de053ca29a2 lrc: 0/0,0 mode: --/PR res: [0x34543:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444a24 expref: 6 pid: 206699 timeout: 22735 lvb_type: 1
00010000:00010000:0.0:1651531926.428279:0:169267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531926.428279:0:169267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531926.428281:0:169267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ea9f3321/0x3234de053ca29a9 lrc: 3/0,1 mode: PW/PW res: [0x34543:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531926.428285:0:169267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea9f3321/0x3234de053ca29a9 lrc: 4/0,1 mode: PW/PW res: [0x34543:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531926.428298:0:169267:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1651531926.428312:0:166112:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ea9f3321/0x3234de053ca29a9 lrc: 3/0,1 mode: PW/PW res: [0x34543:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531926.428313:0:169267:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002512e905 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438149:x1731754467244672:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 62us (154us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531926.428316:0:169267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 84
00010000:00010000:1.0:1651531926.428317:0:166112:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ea9f3321/0x3234de053ca29a9 lrc: 3/0,1 mode: PW/PW res: [0x34543:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531926.428320:0:166112:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea9f3321/0x3234de053ca29a9 lrc: 3/0,1 mode: PW/PW res: [0x34543:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531926.428323:0:166112:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ea9f3321/0x3234de053ca29a9 lrc: 2/0,0 mode: PW/PW res: [0x34543:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531926.428357:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ea9f3321/0x3234de053ca29a9 lrc: 2/0,0 mode: PW/PW res: [0x34543:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531926.428366:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ea9f3321 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531926.428367:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea9f3321/0x3234de053ca29a9 lrc: 2/0,0 mode: PW/PW res: [0x34543:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531926.428371:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea9f3321/0x3234de053ca29a9 lrc: 3/0,0 mode: PW/PW res: [0x34543:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531926.428376:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ea9f3321/0x3234de053ca29a9 lrc: 1/0,0 mode: --/PW res: [0x34543:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531926.428379:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ea9f3321/0x3234de053ca29a9 lrc: 0/0,0 mode: --/PW res: [0x34543:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531926.428478:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007a05c3e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745951224768:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 994us (1059us total) trans 21474869029 rc 0/0
00000100:00100000:1.0:1651531926.428482:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 44282
00000100:00100000:0.0:1651531929.824237:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651531929.824273:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951225024
00000100:00100000:1.0:1651531929.824298:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 60
00000100:00100000:1.0:1651531929.824300:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005dd15341 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745951225024:12345-10.240.43.61@tcp:400:kworker/u4:0.0
00000100:00100000:1.0:1651531929.824335:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005dd15341 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745951225024:12345-10.240.43.61@tcp:400:kworker/u4:0.0 Request processed in 34us (115us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531929.824342:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 60
00000100:00100000:0.0:1651531930.848197:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651531930.848243:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951225152
00000100:00100000:1.0:1651531930.848272:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 457
00000100:00100000:1.0:1651531930.848275:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007ee473ef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745951225152:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:1.0:1651531930.848293:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 8578496 pending 0 free 81283506176 avail 77112795136
00000100:00100000:1.0:1651531930.848330:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007ee473ef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745951225152:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 54us (150us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531930.848336:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 457
00000001:00080000:0.0:1651531932.339352:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869029 is committed
00000100:00100000:0.0:1651531935.968241:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651531935.968261:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951225344
00000100:00100000:0.0:1651531935.968281:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 458
00000100:00100000:0.0:1651531935.968284:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f99b3c22 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951225344:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:0.0:1651531935.968301:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 8578496 pending 0 free 81283506176 avail 77112795136
00000100:00100000:0.0:1651531935.968331:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f99b3c22 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951225344:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 47us (110us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531935.968335:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 458
00000100:00100000:0.0:1651531937.917300:0:39099:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000374facb9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9063caa-b124-4cb6-99ef-d01a735595c3:39099:1731745997344896:10.240.43.61@tcp:400:kworker/u4:0.0
00000100:00100000:1.0:1651531937.917301:0:39100:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ee01c0ad pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:39100:1731745997344960:10.240.43.61@tcp:400:kworker/u4:0.0
00000100:00100000:1.0:1651531937.917789:0:39100:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ee01c0ad pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:39100:1731745997344960:10.240.43.61@tcp:400:kworker/u4:0.0
00000100:00100000:0.0:1651531937.917796:0:39099:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000374facb9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9063caa-b124-4cb6-99ef-d01a735595c3:39099:1731745997344896:10.240.43.61@tcp:400:kworker/u4:0.0
00000400:00000080:0.0:1651531940.491104:0:230432:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648
00000001:02000400:0.0:1651531940.491106:0:230432:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 315: read should be accounted ============= 22:52:20 (1651531940)
00000100:00100000:1.0:1651531941.088269:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651531941.088301:0:182071:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951225472
00000100:00100000:0.0:1651531941.088324:0:182071:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 459
00000100:00100000:0.0:1651531941.088326:0:182071:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ee01c0ad pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951225472:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:0.0:1651531941.088343:0:182071:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 8578496 pending 0 free 81283506176 avail 77112795136
00000100:00100000:0.0:1651531941.088375:0:182071:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ee01c0ad pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951225472:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 48us (109us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531941.088379:0:182071:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 459
00000400:00000080:0.0:1651531944.032555:0:230650:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648
00000001:02000400:0.0:1651531944.032557:0:230650:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 316: lfs mv =============================== 22:52:23 (1651531943)
00000400:00000080:1.0:1651531944.355896:0:230704:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648
00000001:02000400:1.0:1651531944.355898:0:230704:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity test_316 needs >= 2 MDTs
00000400:00000080:1.0:1651531944.706687:0:230758:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648
00000001:02000400:1.0:1651531944.706689:0:230758:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 317: Verify blocks get correctly update after truncate ========================================================== 22:52:24 (1651531944)
00000100:00100000:1.0:1651531944.736020:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531944.736037:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467246336
00000100:00100000:1.0:1651531944.736056:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44283
00000100:00100000:1.0:1651531944.736059:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002ef35a72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+5:678830:x1731754467246336:12345-10.240.43.64@tcp:101:dd.0
00010000:00010000:1.0:1651531944.736068:0:206699:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531944.736079:0:206699:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001ee3405a/0x3234de053ca29b0 lrc: 2/0,0 mode: --/PW res: [0x34544:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db444a5c expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651531944.736091:0:206699:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34544:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:1.0:1651531944.736101:0:206699:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531944.736102:0:206699:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531944.736107:0:206699:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ee3405a/0x3234de053ca29b0 lrc: 3/0,0 mode: PW/PW res: [0x34544:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->5242879) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444a5c expref: 6 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531944.736115:0:206699:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001ee3405a/0x3234de053ca29b0 lrc: 3/0,0 mode: PW/PW res: [0x34544:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->5242879) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444a5c expref: 6 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531944.736120:0:206699:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001ee3405a, rc 0)
00000100:00100000:1.0:1651531944.736141:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002ef35a72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+6:678830:x1731754467246336:12345-10.240.43.64@tcp:101:dd.0 Request processed in 82us (125us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531944.736144:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44283
00000100:00100000:1.0:1651531944.758887:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531944.758898:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467246464
00002000:00100000:1.0:1651531944.758909:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x34544:0x0] (0->4194303)  req@0000000063869776 x1731754467246464/t0(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:410/0 lens 488/0 e 0 to 0 dl 1651531955 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0'
00002000:00100000:1.0:1651531944.758915:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000063869776 with x1731754467246464 ext(0->4194303)
00002000:00010000:1.0:1651531944.758917:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000063869776
00000100:00100000:1.0:1651531944.758929:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249521
00000100:00100000:1.0:1651531944.758931:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000063869776 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438146:x1731754467246464:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:0.0:1651531944.759281:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531944.759292:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467246528
00002000:00100000:0.0:1651531944.759302:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x34544:0x0] (4194304->5242879)  req@00000000c683c211 x1731754467246528/t0(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:410/0 lens 488/0 e 0 to 0 dl 1651531955 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0'
00002000:00100000:0.0:1651531944.759308:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000c683c211 with x1731754467246528 ext(4194304->5242879)
00002000:00010000:0.0:1651531944.759309:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000c683c211
00000100:00100000:0.0:1651531944.759320:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249522
00000100:00100000:0.0:1651531944.759322:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c683c211 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438148:x1731754467246528:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:1.0:1651531944.763297:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c683c211 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438148:x1731754467246528:12345-10.240.43.64@tcp:4:dd.0 Request processed in 3972us (4016us total) trans 21474869030 rc 0/0
00000100:00100000:1.0:1651531944.763302:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249522
00002000:00100000:1.0:1651531944.763305:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x34544:0x0] (4194304->5242879)  req@00000000c683c211 x1731754467246528/t21474869030(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:410/0 lens 488/448 e 0 to 0 dl 1651531955 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0'
00002000:00100000:1.0:1651531944.763310:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000c683c211 with x1731754467246528 ext(4194304->5242879)
00002000:00010000:1.0:1651531944.763322:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000c683c211
00000100:00100000:1.0:1651531944.765385:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000063869776 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438146:x1731754467246464:12345-10.240.43.64@tcp:4:dd.0 Request processed in 6453us (6498us total) trans 21474869031 rc 0/0
00000100:00100000:1.0:1651531944.765390:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249521
00002000:00100000:1.0:1651531944.765393:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x34544:0x0] (0->4194303)  req@0000000063869776 x1731754467246464/t21474869031(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:410/0 lens 488/448 e 0 to 0 dl 1651531955 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0'
00002000:00100000:1.0:1651531944.765397:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000063869776 with x1731754467246464 ext(0->4194303)
00002000:00010000:1.0:1651531944.765398:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000063869776
00000100:00100000:0.0:1651531944.789508:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531944.789534:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467246656
00000100:00100000:1.0:1651531944.789548:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44284
00000100:00100000:1.0:1651531944.789550:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003d9ef3c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754467246656:12345-10.240.43.64@tcp:16:dd.0
00000001:00080000:0.0:1651531944.920579:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869031 is committed
00000100:00100000:1.0:1651531944.920623:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003d9ef3c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467246656:12345-10.240.43.64@tcp:16:dd.0 Request processed in 131071us (131117us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531944.920628:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44284
00000100:00100000:0.0:1651531944.928612:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531944.928634:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467247040
00002000:00010000:1.0:1651531944.928642:0:216321:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 214340/0 (2097152->18446744073709551615)
00002000:00100000:1.0:1651531944.928643:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000f7006631 with x1731754467247040 ext(2097152->18446744073709551615)
00002000:00010000:1.0:1651531944.928648:0:216321:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000f7006631.
00000100:00100000:1.0:1651531944.928655:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249523
00000100:00100000:1.0:1651531944.928657:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f7006631 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438146:x1731754467247040:12345-10.240.43.64@tcp:10:truncate.0
00002000:00010000:1.0:1651531944.928973:0:216321:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x34544:0x0] updating lvb size from disk: 0 -> 2097152
00002000:00010000:1.0:1651531944.928975:0:216321:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x34544:0x0] updating lvb mtime from disk: 0 -> 1651531944
00002000:00010000:1.0:1651531944.928976:0:216321:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x34544:0x0] updating lvb atime from disk: 0 -> 0
00002000:00010000:1.0:1651531944.928977:0:216321:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x34544:0x0] updating lvb ctime from disk: 0 -> 1651531944
00002000:00010000:1.0:1651531944.928977:0:216321:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x34544:0x0] updating lvb blocks from disk: 0 -> 4096
00000100:00100000:1.0:1651531944.928992:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f7006631 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438146:x1731754467247040:12345-10.240.43.64@tcp:10:truncate.0 Request processed in 334us (381us total) trans 21474869032 rc 0/0
00000100:00100000:1.0:1651531944.928996:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249523
00002000:00010000:1.0:1651531944.928997:0:216321:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 214340/0 (2097152->18446744073709551615)
00002000:00100000:1.0:1651531944.928998:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000f7006631 with x1731754467247040 ext(2097152->18446744073709551615)
00002000:00010000:1.0:1651531944.928999:0:216321:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000f7006631.
00000100:00100000:0.0:1651531944.941466:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531944.941488:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467247360
00002000:00010000:1.0:1651531944.941495:0:166118:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 214340/0 (4097->18446744073709551615)
00002000:00100000:1.0:1651531944.941496:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000059e5b3a2 with x1731754467247360 ext(4097->18446744073709551615)
00002000:00010000:1.0:1651531944.941498:0:166118:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000059e5b3a2.
00000100:00100000:1.0:1651531944.941504:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249524
00000100:00100000:1.0:1651531944.941506:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000059e5b3a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438149:x1731754467247360:12345-10.240.43.64@tcp:10:truncate.0
00002000:00010000:1.0:1651531944.941743:0:166118:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x34544:0x0] updating lvb size from disk: 2097152 -> 4097
00002000:00010000:1.0:1651531944.941744:0:166118:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x34544:0x0] updating lvb mtime from disk: 1651531944 -> 1651531944
00002000:00010000:1.0:1651531944.941745:0:166118:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x34544:0x0] updating lvb atime from disk: 0 -> 0
00002000:00010000:1.0:1651531944.941746:0:166118:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x34544:0x0] updating lvb ctime from disk: 1651531944 -> 1651531944
00002000:00010000:1.0:1651531944.941747:0:166118:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x34544:0x0] updating lvb blocks from disk: 4096 -> 16
00000100:00100000:1.0:1651531944.941760:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000059e5b3a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467247360:12345-10.240.43.64@tcp:10:truncate.0 Request processed in 253us (295us total) trans 21474869033 rc 0/0
00000100:00100000:1.0:1651531944.941763:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249524
00002000:00010000:1.0:1651531944.941764:0:166118:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 214340/0 (4097->18446744073709551615)
00002000:00100000:1.0:1651531944.941765:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000059e5b3a2 with x1731754467247360 ext(4097->18446744073709551615)
00002000:00010000:1.0:1651531944.941767:0:166118:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000059e5b3a2.
00000100:00100000:0.0:1651531944.953210:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531944.953235:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467247616
00002000:00010000:1.0:1651531944.953241:0:216321:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 214340/0 (4000->18446744073709551615)
00002000:00100000:1.0:1651531944.953243:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000c4ea889e with x1731754467247616 ext(4000->18446744073709551615)
00002000:00010000:1.0:1651531944.953246:0:216321:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000c4ea889e.
00000100:00100000:1.0:1651531944.953252:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249525
00000100:00100000:1.0:1651531944.953253:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c4ea889e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467247616:12345-10.240.43.64@tcp:10:truncate.0
00002000:00010000:1.0:1651531944.953314:0:216321:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x34544:0x0] updating lvb size from disk: 4097 -> 4000
00002000:00010000:1.0:1651531944.953315:0:216321:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x34544:0x0] updating lvb mtime from disk: 1651531944 -> 1651531944
00002000:00010000:1.0:1651531944.953316:0:216321:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x34544:0x0] updating lvb atime from disk: 0 -> 0
00002000:00010000:1.0:1651531944.953317:0:216321:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x34544:0x0] updating lvb ctime from disk: 1651531944 -> 1651531944
00002000:00010000:1.0:1651531944.953318:0:216321:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x34544:0x0] updating lvb blocks from disk: 16 -> 8
00000100:00100000:1.0:1651531944.953330:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c4ea889e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754467247616:12345-10.240.43.64@tcp:10:truncate.0 Request processed in 76us (121us total) trans 21474869034 rc 0/0
00000100:00100000:1.0:1651531944.953333:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249525
00002000:00010000:1.0:1651531944.953335:0:216321:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 214340/0 (4000->18446744073709551615)
00002000:00100000:1.0:1651531944.953335:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000c4ea889e with x1731754467247616 ext(4000->18446744073709551615)
00002000:00010000:1.0:1651531944.953337:0:216321:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000c4ea889e.
00000100:00100000:0.0:1651531944.964834:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531944.964855:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467247872
00002000:00010000:1.0:1651531944.964861:0:166118:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 214340/0 (509->18446744073709551615)
00002000:00100000:1.0:1651531944.964862:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000a925fbf6 with x1731754467247872 ext(509->18446744073709551615)
00002000:00010000:1.0:1651531944.964865:0:166118:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000a925fbf6.
00000100:00100000:1.0:1651531944.964871:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249526
00000100:00100000:1.0:1651531944.964872:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a925fbf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438149:x1731754467247872:12345-10.240.43.64@tcp:10:truncate.0
00002000:00010000:1.0:1651531944.964921:0:166118:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x34544:0x0] updating lvb size from disk: 4000 -> 509
00002000:00010000:1.0:1651531944.964923:0:166118:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x34544:0x0] updating lvb mtime from disk: 1651531944 -> 1651531944
00002000:00010000:1.0:1651531944.964923:0:166118:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x34544:0x0] updating lvb atime from disk: 0 -> 0
00002000:00010000:1.0:1651531944.964924:0:166118:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x34544:0x0] updating lvb ctime from disk: 1651531944 -> 1651531944
00002000:00010000:1.0:1651531944.964926:0:166118:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x34544:0x0] updating lvb blocks from disk: 8 -> 8
00000100:00100000:1.0:1651531944.964939:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a925fbf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754467247872:12345-10.240.43.64@tcp:10:truncate.0 Request processed in 66us (106us total) trans 21474869035 rc 0/0
00000100:00100000:1.0:1651531944.964942:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249526
00002000:00010000:1.0:1651531944.964943:0:166118:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 214340/0 (509->18446744073709551615)
00002000:00100000:1.0:1651531944.964944:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000a925fbf6 with x1731754467247872 ext(509->18446744073709551615)
00002000:00010000:1.0:1651531944.964945:0:166118:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000a925fbf6.
00000100:00100000:0.0:1651531944.976436:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531944.976458:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467248128
00002000:00010000:1.0:1651531944.976464:0:216321:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 214340/0 (0->18446744073709551615)
00002000:00100000:1.0:1651531944.976465:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000003562cf4d with x1731754467248128 ext(0->18446744073709551615)
00002000:00010000:1.0:1651531944.976467:0:216321:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000003562cf4d.
00000100:00100000:1.0:1651531944.976473:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249527
00000100:00100000:1.0:1651531944.976475:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003562cf4d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438148:x1731754467248128:12345-10.240.43.64@tcp:10:truncate.0
00002000:00010000:1.0:1651531944.976510:0:216321:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x34544:0x0] updating lvb size from disk: 509 -> 0
00002000:00010000:1.0:1651531944.976511:0:216321:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x34544:0x0] updating lvb mtime from disk: 1651531944 -> 1651531944
00002000:00010000:1.0:1651531944.976512:0:216321:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x34544:0x0] updating lvb atime from disk: 0 -> 0
00002000:00010000:1.0:1651531944.976513:0:216321:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x34544:0x0] updating lvb ctime from disk: 1651531944 -> 1651531944
00002000:00010000:1.0:1651531944.976513:0:216321:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x34544:0x0] updating lvb blocks from disk: 8 -> 0
00000100:00100000:1.0:1651531944.976525:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003562cf4d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754467248128:12345-10.240.43.64@tcp:10:truncate.0 Request processed in 50us (90us total) trans 21474869036 rc 0/0
00000100:00100000:1.0:1651531944.976528:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249527
00002000:00010000:1.0:1651531944.976529:0:216321:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 214340/0 (0->18446744073709551615)
00002000:00100000:1.0:1651531944.976530:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000003562cf4d with x1731754467248128 ext(0->18446744073709551615)
00002000:00010000:1.0:1651531944.976531:0:216321:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000003562cf4d.
00000100:00100000:0.0:1651531944.988874:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531944.988898:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467248576
00002000:00010000:1.0:1651531944.988905:0:166118:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 214340/0 (327680->18446744073709551615)
00002000:00100000:1.0:1651531944.988906:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000009c4c564 with x1731754467248576 ext(327680->18446744073709551615)
00002000:00010000:1.0:1651531944.988908:0:166118:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000009c4c564.
00000100:00100000:1.0:1651531944.988913:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249528
00000100:00100000:1.0:1651531944.988915:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000009c4c564 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754467248576:12345-10.240.43.64@tcp:10:dd.0
00002000:00010000:1.0:1651531944.988937:0:166118:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x34544:0x0] updating lvb size from disk: 0 -> 327680
00002000:00010000:1.0:1651531944.988939:0:166118:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x34544:0x0] updating lvb mtime from disk: 1651531944 -> 1651531944
00002000:00010000:1.0:1651531944.988939:0:166118:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x34544:0x0] updating lvb atime from disk: 0 -> 0
00002000:00010000:1.0:1651531944.988940:0:166118:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x34544:0x0] updating lvb ctime from disk: 1651531944 -> 1651531944
00002000:00010000:1.0:1651531944.988941:0:166118:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x34544:0x0] updating lvb blocks from disk: 0 -> 0
00000100:00100000:1.0:1651531944.988952:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000009c4c564 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754467248576:12345-10.240.43.64@tcp:10:dd.0 Request processed in 36us (78us total) trans 21474869037 rc 0/0
00000100:00100000:1.0:1651531944.988955:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249528
00002000:00010000:1.0:1651531944.988956:0:166118:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 214340/0 (327680->18446744073709551615)
00002000:00100000:1.0:1651531944.988956:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000009c4c564 with x1731754467248576 ext(327680->18446744073709551615)
00002000:00010000:1.0:1651531944.988958:0:166118:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000009c4c564.
00000100:00100000:0.0:1651531944.989683:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531944.989706:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467248640
00002000:00100000:1.0:1651531944.989714:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x34544:0x0] (327680->393215)  req@00000000c0b460ab x1731754467248640/t0(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:405/0 lens 488/0 e 0 to 0 dl 1651531950 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0'
00002000:00100000:1.0:1651531944.989718:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000c0b460ab with x1731754467248640 ext(327680->393215)
00002000:00010000:1.0:1651531944.989720:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000c0b460ab
00000100:00100000:1.0:1651531944.989725:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249529
00000100:00100000:1.0:1651531944.989727:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c0b460ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438149:x1731754467248640:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:1.0:1651531944.990281:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c0b460ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754467248640:12345-10.240.43.64@tcp:4:dd.0 Request processed in 553us (598us total) trans 21474869038 rc 0/0
00000100:00100000:1.0:1651531944.990287:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249529
00002000:00100000:1.0:1651531944.990290:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x34544:0x0] (327680->393215)  req@00000000c0b460ab x1731754467248640/t21474869038(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:405/0 lens 488/448 e 0 to 0 dl 1651531950 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0'
00002000:00100000:1.0:1651531944.990294:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000c0b460ab with x1731754467248640 ext(327680->393215)
00002000:00010000:1.0:1651531944.990295:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000c0b460ab
00000100:00100000:0.0:1651531944.990781:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531944.990804:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467248768
00000100:00100000:1.0:1651531944.990813:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44285
00000100:00100000:1.0:1651531944.990814:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006e255cae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754467248768:12345-10.240.43.64@tcp:16:dd.0
00000001:00080000:0.0:1651531945.020034:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869038 is committed
00000100:00100000:1.0:1651531945.020070:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006e255cae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438148:x1731754467248768:12345-10.240.43.64@tcp:16:dd.0 Request processed in 29254us (29289us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531945.020073:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44285
00000100:00100000:0.0:1651531945.027758:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531945.027780:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467249216
00002000:00010000:1.0:1651531945.027785:0:216321:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 214340/0 (331775->18446744073709551615)
00002000:00100000:1.0:1651531945.027786:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000054ed0749 with x1731754467249216 ext(331775->18446744073709551615)
00002000:00010000:1.0:1651531945.027789:0:216321:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000054ed0749.
00000100:00100000:1.0:1651531945.027795:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249530
00000100:00100000:1.0:1651531945.027797:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000054ed0749 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467249216:12345-10.240.43.64@tcp:10:truncate.0
00002000:00010000:1.0:1651531945.027865:0:216321:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x34544:0x0] updating lvb size from disk: 327680 -> 331775
00002000:00010000:1.0:1651531945.027867:0:216321:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x34544:0x0] updating lvb mtime from disk: 1651531944 -> 1651531945
00002000:00010000:1.0:1651531945.027868:0:216321:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x34544:0x0] updating lvb atime from disk: 0 -> 0
00002000:00010000:1.0:1651531945.027868:0:216321:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x34544:0x0] updating lvb ctime from disk: 1651531944 -> 1651531945
00002000:00010000:1.0:1651531945.027869:0:216321:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x34544:0x0] updating lvb blocks from disk: 0 -> 8
00000100:00100000:1.0:1651531945.027882:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000054ed0749 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438149:x1731754467249216:12345-10.240.43.64@tcp:10:truncate.0 Request processed in 84us (124us total) trans 21474869039 rc 0/0
00000100:00100000:1.0:1651531945.027887:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249530
00002000:00010000:1.0:1651531945.027888:0:216321:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 214340/0 (331775->18446744073709551615)
00002000:00100000:1.0:1651531945.027889:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000054ed0749 with x1731754467249216 ext(331775->18446744073709551615)
00002000:00010000:1.0:1651531945.027891:0:216321:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000054ed0749.
00000100:00100000:0.0:1651531946.208496:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651531946.208514:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951225728
00000100:00100000:0.0:1651531946.208534:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 460
00000100:00100000:0.0:1651531946.208536:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a8bb9985 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951225728:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:0.0:1651531946.208549:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 28509632 pending 0 free 81283506176 avail 77107412992
00000100:00100000:0.0:1651531946.208579:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a8bb9985 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951225728:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 42us (85us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531946.208582:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 460
00000400:00000080:1.0:1651531946.356028:0:230976:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648
00000001:02000400:1.0:1651531946.356031:0:230976:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 318: Verify async readahead tunables ====== 22:52:26 (1651531946)
00000400:00000080:1.0:1651531947.786612:0:231194:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648
00000001:02000400:1.0:1651531947.786618:0:231194:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 319: lost lease lock on migrate error ===== 22:52:27 (1651531947)
00000400:00000080:1.0:1651531948.104850:0:231248:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648
00000001:02000400:1.0:1651531948.104852:0:231248:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity test_319 needs >= 2 MDTs
00000400:00000080:0.0:1651531948.455618:0:231302:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648
00000001:02000400:0.0:1651531948.455636:0:231302:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 398a: direct IO should cancel lock otherwise lockless ========================================================== 22:52:28 (1651531948)
00000100:00100000:0.0:1651531948.498167:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531948.498261:0:166103:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467250176
00000100:00100000:0.0:1651531948.498399:0:166103:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11099
00000100:00100000:0.0:1651531948.498406:0:166103:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003ffbc5dc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+7:667159:x1731754467250176:12345-10.240.43.64@tcp:103:ldlm_bl_02.0
00010000:00010000:0.0:1651531948.498444:0:166103:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531948.498513:0:166103:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ee3405a/0x3234de053ca29b0 lrc: 0/0,0 mode: --/PW res: [0x34544:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->5242879) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444a5c expref: 7 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531948.498541:0:166103:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651531948.498592:0:166103:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003ffbc5dc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+6:667159:x1731754467250176:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 186us (439us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531948.498603:0:166103:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11099
00000001:00080000:0.0:1651531950.226424:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869039 is committed
00000400:00000080:1.0:1651531950.241995:0:231520:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648
00000001:02000400:1.0:1651531950.241998:0:231520:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 398b: DIO and buffer IO race ============== 22:52:29 (1651531949)
00000100:00100000:0.0:1651531950.334433:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651531950.334473:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951225920
00000100:00100000:1.0:1651531950.334508:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 44286
00000100:00100000:1.0:1651531950.334511:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009acffcb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951225920:12345-10.240.43.61@tcp:6:osp-syn-1-0.0
00002000:00080000:1.0:1651531950.334589:0:166112:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:214340 count 1
00002000:00010000:1.0:1651531950.334609:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34544:0x0] initial LVB size: 331775, mtime: 0x627060a9, atime: 0x0, ctime: 0x627060a9, blocks: 0x8
00010000:00010000:1.0:1651531950.334617:0:166112:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dfdae7d6/0x3234de053ca29b7 lrc: 3/0,1 mode: --/PW res: [0x34544:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531950.334636:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531950.334640:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531950.334642:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dfdae7d6/0x3234de053ca29b7 lrc: 3/0,1 mode: PW/PW res: [0x34544:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531950.334664:0:166112:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dfdae7d6/0x3234de053ca29b7 lrc: 3/0,1 mode: PW/PW res: [0x34544:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531950.334672:0:166112:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dfdae7d6/0x3234de053ca29b7 lrc: 3/0,1 mode: PW/PW res: [0x34544:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531950.334676:0:166112:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dfdae7d6/0x3234de053ca29b7 lrc: 2/0,0 mode: PW/PW res: [0x34544:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531950.334940:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009acffcb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745951225920:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 429us (509us total) trans 21474869040 rc 0/0
00000100:00100000:1.0:1651531950.334944:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 44286
00010000:00010000:1.0:1651531950.334973:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dfdae7d6/0x3234de053ca29b7 lrc: 2/0,0 mode: PW/PW res: [0x34544:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531950.334994:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000dfdae7d6 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531950.335007:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dfdae7d6/0x3234de053ca29b7 lrc: 2/0,0 mode: PW/PW res: [0x34544:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531950.335018:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dfdae7d6/0x3234de053ca29b7 lrc: 3/0,0 mode: PW/PW res: [0x34544:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531950.335026:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dfdae7d6/0x3234de053ca29b7 lrc: 1/0,0 mode: --/PW res: [0x34544:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531950.335029:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dfdae7d6/0x3234de053ca29b7 lrc: 0/0,0 mode: --/PW res: [0x34544:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531950.364316:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531950.364339:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467252608
00000100:00100000:1.0:1651531950.364363:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44287
00000100:00100000:1.0:1651531950.364365:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d9e74b4c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+5:680965:x1731754467252608:12345-10.240.43.64@tcp:101:dd.0
00010000:00010000:1.0:1651531950.364377:0:206699:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531950.364394:0:206699:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dfdae7d6/0x3234de053ca29be lrc: 2/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db444b0b expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651531950.364401:0:206699:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34545:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:1.0:1651531950.364407:0:206699:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531950.364408:0:206699:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531950.364410:0:206699:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dfdae7d6/0x3234de053ca29be lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444b0b expref: 6 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531950.364416:0:206699:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000dfdae7d6/0x3234de053ca29be lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444b0b expref: 6 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531950.364421:0:206699:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000dfdae7d6, rc 0)
00000100:00100000:1.0:1651531950.364439:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d9e74b4c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+6:680965:x1731754467252608:12345-10.240.43.64@tcp:101:dd.0 Request processed in 73us (124us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531950.364442:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44287
00000100:00100000:0.0:1651531950.364721:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531950.364745:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467252736
00002000:00010000:1.0:1651531950.364759:0:166118:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 214341/0 (0->18446744073709551615)
00002000:00100000:1.0:1651531950.364760:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000d6486d55 with x1731754467252736 ext(0->18446744073709551615)
00002000:00010000:1.0:1651531950.364764:0:166118:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000d6486d55.
00000100:00100000:1.0:1651531950.364772:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249531
00000100:00100000:1.0:1651531950.364774:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438146:x1731754467252736:12345-10.240.43.64@tcp:10:dd.0
00002000:00010000:1.0:1651531950.364855:0:166118:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x34545:0x0] updating lvb size from disk: 0 -> 0
00002000:00010000:1.0:1651531950.364857:0:166118:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x34545:0x0] updating lvb mtime from disk: 0 -> 1651531950
00002000:00010000:1.0:1651531950.364859:0:166118:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x34545:0x0] updating lvb atime from disk: 0 -> 0
00002000:00010000:1.0:1651531950.364860:0:166118:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x34545:0x0] updating lvb ctime from disk: 0 -> 1651531950
00002000:00010000:1.0:1651531950.364861:0:166118:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x34545:0x0] updating lvb blocks from disk: 0 -> 0
00000100:00100000:1.0:1651531950.364878:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438146:x1731754467252736:12345-10.240.43.64@tcp:10:dd.0 Request processed in 103us (157us total) trans 21474869041 rc 0/0
00000100:00100000:1.0:1651531950.364881:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249531
00002000:00010000:1.0:1651531950.364882:0:166118:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 214341/0 (0->18446744073709551615)
00002000:00100000:1.0:1651531950.364883:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000d6486d55 with x1731754467252736 ext(0->18446744073709551615)
00002000:00010000:1.0:1651531950.364885:0:166118:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000d6486d55.
00000100:00100000:0.0:1651531950.406032:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531950.406054:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467252992
00002000:00100000:1.0:1651531950.406071:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x34545:0x0] (0->4194303)  req@00000000567318ba x1731754467252992/t0(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:411/0 lens 488/0 e 0 to 0 dl 1651531956 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0'
00002000:00100000:1.0:1651531950.406079:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000567318ba with x1731754467252992 ext(0->4194303)
00002000:00010000:1.0:1651531950.406081:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000567318ba
00000100:00100000:1.0:1651531950.406088:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249532
00000100:00100000:1.0:1651531950.406090:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000567318ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438146:x1731754467252992:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:1.0:1651531950.411843:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000567318ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438146:x1731754467252992:12345-10.240.43.64@tcp:4:dd.0 Request processed in 5750us (5810us total) trans 21474869042 rc 0/0
00000100:00100000:1.0:1651531950.411848:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249532
00002000:00100000:1.0:1651531950.411852:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x34545:0x0] (0->4194303)  req@00000000567318ba x1731754467252992/t21474869042(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:411/0 lens 488/448 e 0 to 0 dl 1651531956 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0'
00002000:00100000:1.0:1651531950.411856:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000567318ba with x1731754467252992 ext(0->4194303)
00002000:00010000:1.0:1651531950.411859:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000567318ba
00000100:00100000:0.0:1651531951.328152:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651531951.328167:0:182071:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951226048
00000100:00100000:0.0:1651531951.328187:0:182071:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 461
00000100:00100000:0.0:1651531951.328190:0:182071:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000035de0fa0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745951226048:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:0.0:1651531951.328216:0:182071:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 36947392 pending 4218880 free 81283506176 avail 77112795136
00000100:00100000:0.0:1651531951.328251:0:182071:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000035de0fa0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745951226048:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 60us (100us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531951.328260:0:182071:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 461
00000100:00100000:0.0:1651531953.110871:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531953.110895:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467253248
00002000:00100000:1.0:1651531953.110909:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x34545:0x0] (4194304->6291455)  req@00000000c43262d5 x1731754467253248/t0(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:414/0 lens 488/0 e 0 to 0 dl 1651531959 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0'
00002000:00100000:1.0:1651531953.110916:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000c43262d5 with x1731754467253248 ext(4194304->6291455)
00002000:00010000:1.0:1651531953.110918:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000c43262d5
00000100:00100000:1.0:1651531953.110926:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249533
00000100:00100000:1.0:1651531953.110928:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c43262d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438149:x1731754467253248:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:1.0:1651531953.124730:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c43262d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754467253248:12345-10.240.43.64@tcp:4:dd.0 Request processed in 13800us (13859us total) trans 21474869043 rc 0/0
00000100:00100000:1.0:1651531953.124735:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249533
00002000:00100000:1.0:1651531953.124738:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x34545:0x0] (4194304->6291455)  req@00000000c43262d5 x1731754467253248/t21474869043(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:414/0 lens 488/448 e 0 to 0 dl 1651531959 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0'
00002000:00100000:1.0:1651531953.124743:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000c43262d5 with x1731754467253248 ext(4194304->6291455)
00002000:00010000:1.0:1651531953.124744:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000c43262d5
00000100:00100000:0.0:1651531953.768175:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531953.768217:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467255104
00002000:00100000:1.0:1651531953.768239:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x34545:0x0] (274432->1007615)  req@00000000ffcc974c x1731754467255104/t0(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:414/0 lens 520/0 e 0 to 0 dl 1651531959 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:1.0:1651531953.768245:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000ffcc974c with x1731754467255104 ext(274432->1007615)
00002000:00010000:1.0:1651531953.768246:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000ffcc974c
00000100:00100000:1.0:1651531953.768256:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249534
00000100:00100000:1.0:1651531953.768258:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ffcc974c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438146:x1731754467255104:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651531953.768683:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ffcc974c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467255104:12345-10.240.43.64@tcp:4:fio.0 Request processed in 423us (508us total) trans 21474869044 rc 0/0
00000100:00100000:1.0:1651531953.768687:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249534
00002000:00100000:1.0:1651531953.768690:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x34545:0x0] (274432->1007615)  req@00000000ffcc974c x1731754467255104/t21474869044(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:414/0 lens 520/456 e 0 to 0 dl 1651531959 ref 1 fl Complete:/0/0 rc 0/0 job:'fio.0'
00002000:00100000:1.0:1651531953.768706:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000ffcc974c with x1731754467255104 ext(274432->1007615)
00002000:00010000:1.0:1651531953.768708:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000ffcc974c
00000100:00100000:0.0:1651531953.772308:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531953.772340:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467255488
00002000:00100000:1.0:1651531953.772349:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x34545:0x0] (4206592->6291455)  req@00000000f7096c29 x1731754467255488/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:414/0 lens 488/0 e 0 to 0 dl 1651531959 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:1.0:1651531953.772353:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000f7096c29 with x1731754467255488 ext(4206592->6291455)
00002000:00010000:1.0:1651531953.772355:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000f7096c29
00000100:00100000:1.0:1651531953.772365:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249535
00000100:00100000:1.0:1651531953.772367:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f7096c29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754467255488:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651531953.772488:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531953.773178:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467255424
00002000:00100000:0.0:1651531953.773189:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x34545:0x0] (0->4206591)  req@00000000cebf7380 x1731754467255424/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:414/0 lens 536/0 e 0 to 0 dl 1651531959 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:0.0:1651531953.773194:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000cebf7380 with x1731754467255424 ext(0->4206591)
00002000:00010000:0.0:1651531953.773195:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000cebf7380
00000100:00100000:0.0:1651531953.773270:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249536
00000100:00100000:0.0:1651531953.773273:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cebf7380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754467255424:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651531953.774897:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f7096c29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754467255488:12345-10.240.43.64@tcp:3:fio.0 Request processed in 2528us (2588us total) trans 0 rc 2084864/2084864
00000100:00100000:1.0:1651531953.774901:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249535
00002000:00100000:1.0:1651531953.774905:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x34545:0x0] (4206592->6291455)  req@00000000f7096c29 x1731754467255488/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:414/0 lens 488/440 e 0 to 0 dl 1651531959 ref 1 fl Complete:/0/0 rc 2084864/2084864 job:'fio.0'
00002000:00100000:1.0:1651531953.774909:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000f7096c29 with x1731754467255488 ext(4206592->6291455)
00002000:00010000:1.0:1651531953.774910:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000f7096c29
00000100:00100000:0.0:1651531953.778645:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cebf7380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754467255424:12345-10.240.43.64@tcp:3:fio.0 Request processed in 5371us (6156us total) trans 0 rc 4194304/4194304
00000100:00100000:0.0:1651531953.778650:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249536
00002000:00100000:0.0:1651531953.778653:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x34545:0x0] (0->4206591)  req@00000000cebf7380 x1731754467255424/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:414/0 lens 536/440 e 0 to 0 dl 1651531959 ref 1 fl Complete:/0/0 rc 4194304/4194304 job:'fio.0'
00002000:00100000:0.0:1651531953.778657:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000cebf7380 with x1731754467255424 ext(0->4206591)
00002000:00010000:0.0:1651531953.778659:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000cebf7380
00000100:00100000:0.0:1651531953.810660:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531953.810670:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467256192
00002000:00100000:0.0:1651531953.810680:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x34545:0x0] (0->1044479)  req@00000000bf4022bf x1731754467256192/t0(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:414/0 lens 1384/0 e 0 to 0 dl 1651531959 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:0.0:1651531953.810684:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000bf4022bf with x1731754467256192 ext(0->1044479)
00002000:00010000:0.0:1651531953.810686:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000bf4022bf
00000100:00100000:0.0:1651531953.810697:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249537
00000100:00100000:0.0:1651531953.810705:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bf4022bf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467256192:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651531953.813252:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bf4022bf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754467256192:12345-10.240.43.64@tcp:4:fio.0 Request processed in 2551us (2591us total) trans 21474869045 rc 0/0
00000100:00100000:0.0:1651531953.813256:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249537
00002000:00100000:0.0:1651531953.813259:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x34545:0x0] (0->1044479)  req@00000000bf4022bf x1731754467256192/t21474869045(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:414/0 lens 1384/672 e 0 to 0 dl 1651531959 ref 1 fl Complete:/0/0 rc 0/0 job:'fio.0'
00002000:00100000:0.0:1651531953.813264:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000bf4022bf with x1731754467256192 ext(0->1044479)
00002000:00010000:0.0:1651531953.813265:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000bf4022bf
00000100:00100000:0.0:1651531953.816190:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531953.816197:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467256448
00000100:00100000:1.0:1651531953.816211:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00002000:00100000:0.0:1651531953.816215:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x34545:0x0] (880640->1007615)  req@0000000043b0f16d x1731754467256448/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:414/0 lens 552/0 e 0 to 0 dl 1651531959 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:0.0:1651531953.816219:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000043b0f16d with x1731754467256448 ext(880640->1007615)
00002000:00010000:0.0:1651531953.816220:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000043b0f16d
00000100:00100000:1.0:1651531953.816233:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467256576
00000100:00100000:0.0:1651531953.816238:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249538
00000100:00100000:0.0:1651531953.816239:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000043b0f16d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754467256448:12345-10.240.43.64@tcp:3:fio.0
00002000:00100000:1.0:1651531953.816242:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x34545:0x0] (208896->880639)  req@00000000be87d738 x1731754467256576/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:414/0 lens 1112/0 e 0 to 0 dl 1651531959 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:1.0:1651531953.816247:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000be87d738 with x1731754467256576 ext(208896->880639)
00002000:00010000:1.0:1651531953.816249:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000be87d738
00000100:00100000:1.0:1651531953.816258:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249539
00000100:00100000:1.0:1651531953.816269:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000be87d738 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754467256576:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651531953.816520:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531953.816539:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467256768
00002000:00100000:0.0:1651531953.816548:0:192753:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x100010000:0x34545:0x0] (1011712->1048575)  req@00000000374facb9 x1731754467256768/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:414/0 lens 520/0 e 0 to 0 dl 1651531959 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:0.0:1651531953.816552:0:192753:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000374facb9 with x1731754467256768 ext(1011712->1048575)
00002000:00010000:0.0:1651531953.816553:0:192753:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000374facb9
00000100:00100000:0.0:1651531953.816568:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249540
00000100:00100000:0.0:1651531953.816570:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000374facb9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754467256768:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651531953.816849:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531953.816864:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467257024
00002000:00100000:0.0:1651531953.816877:0:216323:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x100010000:0x34545:0x0] (8192->208895)  req@0000000052213cb9 x1731754467257024/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:414/0 lens 648/0 e 0 to 0 dl 1651531959 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:0.0:1651531953.816881:0:216323:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000052213cb9 with x1731754467257024 ext(8192->208895)
00002000:00010000:0.0:1651531953.816882:0:216323:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000052213cb9
00000100:00100000:1.0:1651531953.816894:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000be87d738 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438148:x1731754467256576:12345-10.240.43.64@tcp:3:fio.0 Request processed in 624us (684us total) trans 0 rc 360448/360448
00000100:00100000:1.0:1651531953.816897:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249539
00002000:00100000:1.0:1651531953.816900:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x34545:0x0] (208896->880639)  req@00000000be87d738 x1731754467256576/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:414/0 lens 1112/440 e 0 to 0 dl 1651531959 ref 1 fl Complete:/0/0 rc 360448/360448 job:'fio.0'
00000100:00100000:0.0:1651531953.816903:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249541
00002000:00100000:1.0:1651531953.816904:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000be87d738 with x1731754467256576 ext(208896->880639)
00000100:00100000:0.0:1651531953.816905:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000052213cb9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754467257024:12345-10.240.43.64@tcp:3:fio.0
00002000:00010000:1.0:1651531953.816912:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000be87d738
00000100:00100000:0.0:1651531953.816944:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000374facb9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754467256768:12345-10.240.43.64@tcp:3:fio.0 Request processed in 373us (424us total) trans 0 rc 28672/28672
00000100:00100000:0.0:1651531953.816947:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249540
00002000:00100000:0.0:1651531953.816949:0:192753:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x100010000:0x34545:0x0] (1011712->1048575)  req@00000000374facb9 x1731754467256768/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:414/0 lens 520/440 e 0 to 0 dl 1651531959 ref 1 fl Complete:/0/0 rc 28672/28672 job:'fio.0'
00002000:00100000:0.0:1651531953.816954:0:192753:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000374facb9 with x1731754467256768 ext(1011712->1048575)
00000100:00100000:1.0:1651531953.816955:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000043b0f16d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754467256448:12345-10.240.43.64@tcp:3:fio.0 Request processed in 714us (765us total) trans 0 rc 86016/86016
00002000:00010000:0.0:1651531953.816956:0:192753:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000374facb9
00000100:00100000:1.0:1651531953.816958:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249538
00002000:00100000:1.0:1651531953.816960:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x34545:0x0] (880640->1007615)  req@0000000043b0f16d x1731754467256448/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:414/0 lens 552/440 e 0 to 0 dl 1651531959 ref 1 fl Complete:/0/0 rc 86016/86016 job:'fio.0'
00002000:00100000:1.0:1651531953.816964:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000043b0f16d with x1731754467256448 ext(880640->1007615)
00002000:00010000:1.0:1651531953.816965:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000043b0f16d
00000100:00100000:0.0:1651531953.817344:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000052213cb9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754467257024:12345-10.240.43.64@tcp:3:fio.0 Request processed in 437us (495us total) trans 0 rc 114688/114688
00000100:00100000:0.0:1651531953.817347:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249541
00002000:00100000:0.0:1651531953.817350:0:216323:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x100010000:0x34545:0x0] (8192->208895)  req@0000000052213cb9 x1731754467257024/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:414/0 lens 648/440 e 0 to 0 dl 1651531959 ref 1 fl Complete:/0/0 rc 114688/114688 job:'fio.0'
00002000:00100000:0.0:1651531953.817353:0:216323:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000052213cb9 with x1731754467257024 ext(8192->208895)
00002000:00010000:0.0:1651531953.817354:0:216323:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000052213cb9
00000100:00100000:1.0:1651531953.818659:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531953.818682:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467257664
00000100:00100000:0.0:1651531953.818696:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249542
00000100:00100000:0.0:1651531953.818698:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e4e3ecb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754467257664:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531953.818717:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a6553f30/0x3234de053ca29c5 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531953.818730:0:216323:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000dfdae7d6/0x3234de053ca29be lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444b0b expref: 15 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531953.818734:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531953.818735:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531953.818737:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a6553f30/0x3234de053ca29c5 lrc: 4/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [1003520->1007615] (req 1003520->1007615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531953.818782:0:216323:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000dfdae7d6/0x3234de053ca29be lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444b0b expref: 15 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531953.818796:0:216323:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dfdae7d6/0x3234de053ca29be lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444b0b expref: 15 pid: 206699 timeout: 22762 lvb_type: 0
00000100:00100000:0.0:1651531953.818812:0:216323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000b1a9136 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_010:lustre-OST0001_UUID:216323:1731745997345024:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531953.818856:0:216323:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f54ad06c going to sleep for 6 seconds
00000100:00100000:1.0:1651531953.820625:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531953.820646:0:216323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000b1a9136 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_010:lustre-OST0001_UUID:216323:1731745997345024:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651531953.820653:0:216323:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a6553f30/0x3234de053ca29c5 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [1003520->1007615] (req 1003520->1007615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531953.820664:0:169267:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467257728
00010000:00010000:0.0:1651531953.820670:0:169267:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dfdae7d6/0x3234de053ca29be lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444b0b expref: 16 pid: 206699 timeout: 22762 lvb_type: 0
00000100:00100000:0.0:1651531953.820685:0:169267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 85
00000100:00100000:0.0:1651531953.820687:0:169267:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008f994916 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754467257728:12345-10.240.43.64@tcp:103:ldlm_bl_01.0
00010000:00010000:0.0:1651531953.820692:0:169267:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00002000:00010000:0.0:1651531953.820696:0:169267:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x34545:0x0] updating lvb size from disk: 0 -> 6291456
00002000:00010000:0.0:1651531953.820698:0:169267:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x34545:0x0] updating lvb mtime from disk: 1651531950 -> 1651531953
00002000:00010000:0.0:1651531953.820699:0:169267:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x34545:0x0] updating lvb ctime from disk: 1651531950 -> 1651531953
00002000:00010000:0.0:1651531953.820700:0:169267:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x34545:0x0] updating lvb blocks from disk: 0 -> 12288
00010000:00010000:0.0:1651531953.820702:0:169267:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dfdae7d6/0x3234de053ca29be lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444b0b expref: 16 pid: 206699 timeout: 22762 lvb_type: 0
00010000:00010000:0.0:1651531953.820706:0:169267:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dfdae7d6/0x3234de053ca29be lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444b0b expref: 16 pid: 206699 timeout: 22762 lvb_type: 0
00010000:00010000:0.0:1651531953.820723:0:169267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dfdae7d6/0x3234de053ca29be lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444b0b expref: 16 pid: 206699 timeout: 22762 lvb_type: 0
00010000:00010000:0.0:1651531953.820728:0:169267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531953.820728:0:169267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531953.820730:0:169267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a6553f30/0x3234de053ca29c5 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [1003520->1007615] (req 1003520->1007615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531953.820733:0:169267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a6553f30/0x3234de053ca29c5 lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [1003520->1007615] (req 1003520->1007615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531953.820741:0:169267:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651531953.820751:0:169267:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008f994916 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754467257728:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 63us (126us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531953.820754:0:169267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 85
00010000:00010000:0.0:1651531953.820771:0:216323:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a6553f30/0x3234de053ca29c5 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [1003520->1007615] (req 1003520->1007615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531953.820775:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a6553f30/0x3234de053ca29c5 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [1003520->1007615] (req 1003520->1007615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531954.152920:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869046 is committed
00000001:00080000:0.0:1651531954.152927:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869040 is committed
00002000:00010000:0.0:1651531954.152939:0:216323:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x34545:0x0] updating lvb atime from disk: 0 -> 1651531953
00010000:00010000:0.0:1651531954.152942:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a6553f30/0x3234de053ca29c5 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [1003520->1007615] (req 1003520->1007615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.152950:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a6553f30/0x3234de053ca29c5 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [1003520->1007615] (req 1003520->1007615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531954.152973:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e4e3ecb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438148:x1731754467257664:12345-10.240.43.64@tcp:4:fio.0 Request processed in 334273us (334314us total) trans 21474869046 rc 0/0
00000100:00100000:0.0:1651531954.152976:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249542
00010000:00010000:1.0:1651531954.152977:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a6553f30/0x3234de053ca29c5 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [1003520->1007615] (req 1003520->1007615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.152983:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a6553f30 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531954.152985:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a6553f30/0x3234de053ca29c5 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [1003520->1007615] (req 1003520->1007615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.153001:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a6553f30/0x3234de053ca29c5 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [1003520->1007615] (req 1003520->1007615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.153008:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a6553f30/0x3234de053ca29c5 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [1003520->1007615] (req 1003520->1007615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.153010:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a6553f30/0x3234de053ca29c5 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [1003520->1007615] (req 1003520->1007615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531954.165931:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.165945:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.165952:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531954.165962:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467258240
00000100:00100000:0.0:1651531954.165967:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467258368
00000100:00100000:1.0:1651531954.165973:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467258496
00000100:00100000:0.0:1651531954.165986:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44288
00000100:00100000:0.0:1651531954.165988:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000b1a9136 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+7:680969:x1731754467258240:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651531954.165989:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44289
00000100:00100000:1.0:1651531954.165991:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000f4bed26 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+7:680972:x1731754467258368:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531954.165993:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531954.165995:0:206699:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531954.165999:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eba74384/0x3234de053ca29cc lrc: 2/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db444b58 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.166000:0:206699:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bfa41eae/0x3234de053ca29d3 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db444b5f expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00002000:00010000:0.0:1651531954.166005:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34545:0x0] initial LVB size: 6291456, mtime: 0x627060b1, atime: 0x627060b1, ctime: 0x627060b1, blocks: 0x3000
00010000:00010000:0.0:1651531954.166010:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531954.166011:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531954.166014:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eba74384/0x3234de053ca29cc lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 487424->491519) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444b58 expref: 9 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.166020:0:206699:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000eba74384/0x3234de053ca29cc lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 487424->491519) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444b58 expref: 9 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.166024:0:206699:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531954.166025:0:206699:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531954.166026:0:206699:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bfa41eae/0x3234de053ca29d3 lrc: 4/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444b5f expref: 9 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.166032:0:166112:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000eba74384/0x3234de053ca29cc lrc: 5/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 487424->491519) gid 0 flags: 0x70000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444b58 expref: 9 pid: 166112 timeout: 22762 lvb_type: 0
00010000:00010000:0.0:1651531954.166036:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000eba74384/0x3234de053ca29cc lrc: 5/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 487424->491519) gid 0 flags: 0x60000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444b58 expref: 9 pid: 166112 timeout: 22762 lvb_type: 0
00010000:00010000:1.0:1651531954.166039:0:206699:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000eba74384/0x3234de053ca29cc lrc: 5/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 487424->491519) gid 0 flags: 0x70000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444b58 expref: 9 pid: 166112 timeout: 22762 lvb_type: 0
00010000:00010000:1.0:1651531954.166056:0:206699:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000eba74384/0x3234de053ca29cc lrc: 5/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 487424->491519) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444b58 expref: 9 pid: 166112 timeout: 22762 lvb_type: 0
00000100:00100000:1.0:1651531954.166060:0:206699:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dce6a2c5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:206699:1731745997345088:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651531954.166060:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000eba74384, rc 0)
00000100:00100000:0.0:1651531954.166071:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000b1a9136 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+9:680969:x1731754467258240:12345-10.240.43.64@tcp:101:fio.0 Request processed in 83us (141us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531954.166073:0:206699:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fc7d2635 going to sleep for 6 seconds
00000100:00100000:0.0:1651531954.166074:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44288
00000100:00100000:0.0:1651531954.166080:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44290
00000100:00100000:0.0:1651531954.166082:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004237e3f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467258496:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531954.166084:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531954.166087:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000958e71ef/0x3234de053ca29da lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db444b6d expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531954.166100:0:166112:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001e61ed2d pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:166112:1731745997345152:10.240.43.64@tcp:106:
00000100:00100000:0.0:1651531954.166109:0:166112:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f54ad06c going to sleep for 6 seconds
00000100:00100000:1.0:1651531954.166377:0:206699:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dce6a2c5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:206699:1731745997345088:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651531954.166382:0:206699:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bfa41eae/0x3234de053ca29d3 lrc: 3/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444b5f expref: 9 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.166388:0:206699:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000bfa41eae, rc 0)
00000100:00100000:1.0:1651531954.166399:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000f4bed26 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+9:680972:x1731754467258368:12345-10.240.43.64@tcp:101:fio.0 Request processed in 408us (454us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531954.166403:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44289
00000100:00100000:0.0:1651531954.166508:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.166518:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467258816
00002000:00100000:0.0:1651531954.166526:0:216323:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x100010000:0x34545:0x0] (487424->491519)  req@000000007b76f7f6 x1731754467258816/t0(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 4584/0 e 0 to 0 dl 1651531960 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:0.0:1651531954.166530:0:216323:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000007b76f7f6 with x1731754467258816 ext(487424->491519)
00010000:00010000:0.0:1651531954.166533:0:216323:0:(ldlm_lockd.c:599:ldlm_refresh_waiting_lock()) ### refreshed to 81s ns: filter-lustre-OST0001_UUID lock: 00000000eba74384/0x3234de053ca29cc lrc: 5/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 487424->491519) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444b58 expref: 9 pid: 166112 timeout: 22762 lvb_type: 0
00002000:00010000:0.0:1651531954.166536:0:216323:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req 000000007b76f7f6
00000100:00100000:0.0:1651531954.166547:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 5
00000100:00100000:0.0:1651531954.166549:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007b76f7f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438146:x1731754467258816:12345-10.240.43.64@tcp:4:fio.0
00002000:00010000:0.0:1651531954.166646:0:166112:0:(ofd_lvb.c:284:ofd_lvbo_update()) res: [0x34545:0x0:0x0] updating lvb mtime: 1651531953 -> 1651531954
00002000:00010000:0.0:1651531954.166649:0:166112:0:(ofd_lvb.c:290:ofd_lvbo_update()) res: [0x34545:0x0:0x0] updating lvb atime: 1651531953 -> 1651531954
00002000:00010000:0.0:1651531954.166650:0:166112:0:(ofd_lvb.c:296:ofd_lvbo_update()) res: [0x34545:0x0:0x0] updating lvb ctime: 1651531953 -> 1651531954
00000100:00100000:0.0:1651531954.166653:0:166112:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001e61ed2d pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:166112:1731745997345152:10.240.43.64@tcp:106:
00010000:00010000:0.0:1651531954.166659:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000958e71ef/0x3234de053ca29da lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444b6d expref: 11 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531954.166663:0:166112:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000958e71ef/0x3234de053ca29da lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444b6d expref: 11 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531954.166667:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000958e71ef, rc 0)
00000100:00100000:0.0:1651531954.166678:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004237e3f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438146:x1731754467258496:12345-10.240.43.64@tcp:101:fio.0 Request processed in 596us (726us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531954.166681:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44290
00000100:00100000:0.0:1651531954.166740:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007b76f7f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438146:x1731754467258816:12345-10.240.43.64@tcp:4:fio.0 Request processed in 190us (232us total) trans 21474869047 rc 0/0
00000100:00100000:0.0:1651531954.166744:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 5
00002000:00100000:0.0:1651531954.166746:0:216323:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x100010000:0x34545:0x0] (487424->491519)  req@000000007b76f7f6 x1731754467258816/t21474869047(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 4584/448 e 0 to 0 dl 1651531960 ref 1 fl Complete:H/0/0 rc 0/0 job:'fio.0'
00002000:00100000:0.0:1651531954.166750:0:216323:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000007b76f7f6 with x1731754467258816 ext(487424->491519)
00010000:00010000:0.0:1651531954.166753:0:216323:0:(ldlm_lockd.c:599:ldlm_refresh_waiting_lock()) ### refreshed to 81s ns: filter-lustre-OST0001_UUID lock: 00000000eba74384/0x3234de053ca29cc lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 487424->491519) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444b58 expref: 9 pid: 166112 timeout: 22762 lvb_type: 0
00002000:00010000:0.0:1651531954.166756:0:216323:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req 000000007b76f7f6
00000100:00100000:0.0:1651531954.167040:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.167049:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467259008
00000100:00100000:0.0:1651531954.167061:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44291
00000100:00100000:0.0:1651531954.167064:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001e61ed2d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+9:680970:x1731754467259008:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531954.167068:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531954.167072:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000c9190a4/0x3234de053ca29e1 lrc: 2/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db444b89 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.167077:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531954.167078:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531954.167079:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000c9190a4/0x3234de053ca29e1 lrc: 3/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [884736->888831] (req 884736->888831) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444b89 expref: 10 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.167083:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000c9190a4/0x3234de053ca29e1 lrc: 3/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [884736->888831] (req 884736->888831) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444b89 expref: 10 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.167087:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000000c9190a4, rc 0)
00000100:00100000:0.0:1651531954.167101:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001e61ed2d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+10:680970:x1731754467259008:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (61us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531954.167104:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44291
00000100:00100000:0.0:1651531954.167364:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.167373:0:166103:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467259072
00010000:00010000:0.0:1651531954.167379:0:166103:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000eba74384/0x3234de053ca29cc lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 487424->491519) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444b58 expref: 10 pid: 166112 timeout: 22762 lvb_type: 0
00000100:00100000:0.0:1651531954.167387:0:166103:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 86
00000100:00100000:0.0:1651531954.167388:0:166103:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000052cf3c08 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438146:x1731754467259072:12345-10.240.43.64@tcp:103:ldlm_bl_03.0
00010000:00010000:0.0:1651531954.167391:0:166103:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531954.167395:0:166103:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000eba74384/0x3234de053ca29cc lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 487424->491519) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444b58 expref: 10 pid: 166112 timeout: 22762 lvb_type: 0
00010000:00010000:0.0:1651531954.167410:0:166103:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000eba74384/0x3234de053ca29cc lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 487424->491519) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444b58 expref: 10 pid: 166112 timeout: 22762 lvb_type: 0
00010000:00010000:0.0:1651531954.167416:0:166103:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eba74384/0x3234de053ca29cc lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 487424->491519) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444b58 expref: 10 pid: 166112 timeout: 22762 lvb_type: 0
00010000:00010000:0.0:1651531954.167421:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531954.167421:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531954.167423:0:166103:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bfa41eae/0x3234de053ca29d3 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->884735] (req 344064->348159) gid 0 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444b5f expref: 9 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.167427:0:166103:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bfa41eae/0x3234de053ca29d3 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->884735] (req 344064->348159) gid 0 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444b5f expref: 9 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.167430:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531954.167430:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531954.167432:0:166103:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000c9190a4/0x3234de053ca29e1 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [884736->18446744073709551615] (req 884736->888831) gid 0 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444b89 expref: 9 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.167434:0:166103:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000c9190a4/0x3234de053ca29e1 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [884736->18446744073709551615] (req 884736->888831) gid 0 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444b89 expref: 9 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.167443:0:166103:0:(ldlm_lockd.c:1067:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000c9190a4/0x3234de053ca29e1 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [884736->18446744073709551615] (req 884736->888831) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444b89 expref: 9 pid: 166112 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531954.167448:0:166103:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f99d9ea1 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:166103:1731745997345216:10.240.43.64@tcp:105:
00010000:00010000:0.0:1651531954.167469:0:166103:0:(ldlm_lockd.c:1067:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000bfa41eae/0x3234de053ca29d3 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->884735] (req 344064->348159) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444b5f expref: 9 pid: 206699 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531954.167480:0:166103:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000008e0501d pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:166103:1731745997345280:10.240.43.64@tcp:105:
00000100:00100000:0.0:1651531954.167487:0:166103:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f54ad06c going to sleep for 6 seconds
00000100:00100000:0.0:1651531954.168042:0:166103:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f99d9ea1 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:166103:1731745997345216:10.240.43.64@tcp:105:
00000100:00100000:0.0:1651531954.168045:0:166103:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000008e0501d pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:166103:1731745997345280:10.240.43.64@tcp:105:
00010000:00010000:0.0:1651531954.168049:0:166103:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651531954.168064:0:166103:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000052cf3c08 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438146:x1731754467259072:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 675us (700us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531954.168068:0:166103:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 86
00000100:00100000:0.0:1651531954.168750:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.168758:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467259648
00002000:00100000:0.0:1651531954.168764:0:216323:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x100010000:0x34545:0x0] (344064->884735)  req@0000000008e0501d x1731754467259648/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/0 e 0 to 0 dl 1651531960 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:0.0:1651531954.168769:0:216323:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000008e0501d with x1731754467259648 ext(344064->884735)
00002000:00010000:0.0:1651531954.168770:0:216323:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000008e0501d
00000100:00100000:0.0:1651531954.168782:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249543
00000100:00100000:0.0:1651531954.168784:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000008e0501d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754467259648:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651531954.169341:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000008e0501d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754467259648:12345-10.240.43.64@tcp:3:fio.0 Request processed in 556us (591us total) trans 0 rc 540672/540672
00000100:00100000:0.0:1651531954.169345:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249543
00002000:00100000:0.0:1651531954.169347:0:216323:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x100010000:0x34545:0x0] (344064->884735)  req@0000000008e0501d x1731754467259648/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/440 e 0 to 0 dl 1651531960 ref 1 fl Complete:/0/0 rc 540672/540672 job:'fio.0'
00002000:00100000:0.0:1651531954.169351:0:216323:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000008e0501d with x1731754467259648 ext(344064->884735)
00002000:00010000:0.0:1651531954.169361:0:216323:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000008e0501d
00000100:00100000:0.0:1651531954.196478:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.196487:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467260096
00000100:00100000:0.0:1651531954.196502:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249544
00000100:00100000:0.0:1651531954.196504:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f99d9ea1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754467260096:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531954.196512:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eba74384/0x3234de053ca29e8 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.196517:0:216323:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bfa41eae/0x3234de053ca29d3 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->884735] (req 344064->348159) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444b5f expref: 9 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.196520:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531954.196521:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531954.196522:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eba74384/0x3234de053ca29e8 lrc: 4/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.196529:0:216323:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bfa41eae/0x3234de053ca29d3 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->884735] (req 344064->348159) gid 0 flags: 0x50000000020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444b5f expref: 9 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.196533:0:216323:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bfa41eae/0x3234de053ca29d3 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->884735] (req 344064->348159) gid 0 flags: 0x70000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444b5f expref: 9 pid: 206699 timeout: 22762 lvb_type: 0
00000100:00100000:0.0:1651531954.196537:0:216323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009b569a7a pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_010:lustre-OST0001_UUID:216323:1731745997345344:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531954.196553:0:216323:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f54ad06c going to sleep for 6 seconds
00000100:00100000:0.0:1651531954.196785:0:216323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009b569a7a pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_010:lustre-OST0001_UUID:216323:1731745997345344:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651531954.196789:0:216323:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000eba74384/0x3234de053ca29e8 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531954.197026:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.197048:0:166103:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467260160
00010000:00010000:0.0:1651531954.197054:0:166103:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bfa41eae/0x3234de053ca29d3 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->884735] (req 344064->348159) gid 0 flags: 0x60000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444b5f expref: 10 pid: 206699 timeout: 22762 lvb_type: 0
00000100:00100000:0.0:1651531954.197063:0:166103:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 87
00000100:00100000:0.0:1651531954.197064:0:166103:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dce6a2c5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754467260160:12345-10.240.43.64@tcp:103:ldlm_bl_01.0
00010000:00010000:0.0:1651531954.197067:0:166103:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531954.197071:0:166103:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bfa41eae/0x3234de053ca29d3 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->884735] (req 344064->348159) gid 0 flags: 0x60000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444b5f expref: 10 pid: 206699 timeout: 22762 lvb_type: 0
00010000:00010000:0.0:1651531954.197075:0:166103:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bfa41eae/0x3234de053ca29d3 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->884735] (req 344064->348159) gid 0 flags: 0x50000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444b5f expref: 10 pid: 206699 timeout: 22762 lvb_type: 0
00010000:00010000:0.0:1651531954.197081:0:166103:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bfa41eae/0x3234de053ca29d3 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->884735] (req 344064->348159) gid 0 flags: 0x44801400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444b5f expref: 10 pid: 206699 timeout: 22762 lvb_type: 0
00010000:00010000:0.0:1651531954.197085:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531954.197085:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531954.197086:0:166103:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000eba74384/0x3234de053ca29e8 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.197089:0:166103:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eba74384/0x3234de053ca29e8 lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.197096:0:166103:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651531954.197105:0:166103:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dce6a2c5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438149:x1731754467260160:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 40us (80us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531954.197119:0:166103:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 87
00010000:00010000:0.0:1651531954.197127:0:216323:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000eba74384/0x3234de053ca29e8 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.197130:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eba74384/0x3234de053ca29e8 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531954.235251:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869048 is committed
00010000:00010000:0.0:1651531954.235266:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eba74384/0x3234de053ca29e8 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.235270:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eba74384/0x3234de053ca29e8 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531954.235291:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f99d9ea1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438148:x1731754467260096:12345-10.240.43.64@tcp:4:fio.0 Request processed in 38786us (38813us total) trans 21474869048 rc 0/0
00000100:00100000:0.0:1651531954.235295:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249544
00010000:00010000:0.0:1651531954.235302:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eba74384/0x3234de053ca29e8 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.235306:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000eba74384 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531954.235307:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eba74384/0x3234de053ca29e8 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.235310:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eba74384/0x3234de053ca29e8 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.235315:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eba74384/0x3234de053ca29e8 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.235327:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eba74384/0x3234de053ca29e8 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531954.235661:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.235670:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467260288
00000100:00100000:0.0:1651531954.235685:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249545
00000100:00100000:0.0:1651531954.235687:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009b569a7a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467260288:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531954.235694:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000958e71ef/0x3234de053ca29ef lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.235698:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531954.235699:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531954.235700:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000958e71ef/0x3234de053ca29ef lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [274432->278527] (req 274432->278527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.235704:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000958e71ef/0x3234de053ca29ef lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [274432->278527] (req 274432->278527) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531954.248390:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531954.248399:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467260736
00000100:00100000:1.0:1651531954.248416:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249546
00000100:00100000:1.0:1651531954.248418:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009078ca7d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438147:x1731754467260736:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531954.248425:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003dec1fa8/0x3234de053ca29f6 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.248430:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531954.248431:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531954.248432:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003dec1fa8/0x3234de053ca29f6 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [839680->843775] (req 839680->843775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.248441:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003dec1fa8/0x3234de053ca29f6 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [839680->843775] (req 839680->843775) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531954.249444:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.249453:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467261056
00000100:00100000:0.0:1651531954.249468:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249547
00000100:00100000:0.0:1651531954.249470:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002512e905 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754467261056:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531954.249478:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eba74384/0x3234de053ca29fd lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.249482:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531954.249483:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531954.249491:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eba74384/0x3234de053ca29fd lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [425984->430079] (req 425984->430079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.249495:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eba74384/0x3234de053ca29fd lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [425984->430079] (req 425984->430079) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531954.249756:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531954.249771:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.249778:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467261120
00000100:00100000:1.0:1651531954.249779:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467261312
00000100:00100000:0.0:1651531954.249790:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44292
00000100:00100000:0.0:1651531954.249792:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002d3e5ae4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:680971:x1731754467261120:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531954.249795:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651531954.249796:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44293
00000100:00100000:1.0:1651531954.249798:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000028779db6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+16:680972:x1731754467261312:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531954.249802:0:206699:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531954.249806:0:206699:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003e3ad07b/0x3234de053ca2a0b lrc: 2/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db444bc1 expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.249806:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000d9e7472/0x3234de053ca2a04 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db444bac expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.249813:0:206699:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531954.249813:0:206699:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531954.249816:0:206699:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003e3ad07b/0x3234de053ca2a0b lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [651264->839679] (req 651264->655359) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444bc1 expref: 18 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.249822:0:166112:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003e3ad07b/0x3234de053ca2a0b lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [651264->839679] (req 651264->655359) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444bc1 expref: 18 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.249826:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531954.249826:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531954.249827:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000d9e7472/0x3234de053ca2a04 lrc: 4/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [737280->741375] (req 737280->741375) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444bac expref: 18 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.249832:0:206699:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003e3ad07b/0x3234de053ca2a0b lrc: 5/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [651264->839679] (req 651264->655359) gid 0 flags: 0x70000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444bc1 expref: 18 pid: 206699 timeout: 22762 lvb_type: 0
00010000:00010000:1.0:1651531954.249836:0:206699:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003e3ad07b/0x3234de053ca2a0b lrc: 5/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [651264->839679] (req 651264->655359) gid 0 flags: 0x60000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444bc1 expref: 18 pid: 206699 timeout: 22762 lvb_type: 0
00010000:00010000:0.0:1651531954.249839:0:166112:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003e3ad07b/0x3234de053ca2a0b lrc: 5/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [651264->839679] (req 651264->655359) gid 0 flags: 0x70000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444bc1 expref: 18 pid: 206699 timeout: 22762 lvb_type: 0
00010000:00010000:0.0:1651531954.249843:0:166112:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003e3ad07b/0x3234de053ca2a0b lrc: 5/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [651264->839679] (req 651264->655359) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444bc1 expref: 18 pid: 206699 timeout: 22762 lvb_type: 0
00010000:00010000:1.0:1651531954.249846:0:206699:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003e3ad07b, rc 0)
00000100:00100000:0.0:1651531954.249847:0:166112:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003ffbc5dc pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:166112:1731745997345408:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531954.249859:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000028779db6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+18:680972:x1731754467261312:12345-10.240.43.64@tcp:101:fio.0 Request processed in 61us (88us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531954.249865:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44293
00000100:00100000:0.0:1651531954.249872:0:166112:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cd8a7e69 going to sleep for 6 seconds
00000100:00100000:1.0:1651531954.250421:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531954.250429:0:216322:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467261440
00000100:00100000:0.0:1651531954.250432:0:166112:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003ffbc5dc pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:166112:1731745997345408:10.240.43.64@tcp:104:
00002000:00100000:1.0:1651531954.250436:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34545:0x0] (651264->905215)  req@00000000add44b2e x1731754467261440/t0(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 520/0 e 0 to 0 dl 1651531960 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00010000:00010000:0.0:1651531954.250438:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000d9e7472/0x3234de053ca2a04 lrc: 3/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [737280->741375] (req 737280->741375) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444bac expref: 18 pid: 166112 timeout: 0 lvb_type: 0
00002000:00100000:1.0:1651531954.250440:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000add44b2e with x1731754467261440 ext(651264->905215)
00010000:00010000:0.0:1651531954.250443:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000000d9e7472, rc 0)
00010000:00010000:1.0:1651531954.250445:0:216322:0:(ldlm_lockd.c:599:ldlm_refresh_waiting_lock()) ### refreshed to 81s ns: filter-lustre-OST0001_UUID lock: 000000003e3ad07b/0x3234de053ca2a0b lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [651264->839679] (req 651264->655359) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444bc1 expref: 18 pid: 206699 timeout: 22762 lvb_type: 0
00002000:00010000:1.0:1651531954.250449:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req 00000000add44b2e
00000100:00100000:0.0:1651531954.250454:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002d3e5ae4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:680971:x1731754467261120:12345-10.240.43.64@tcp:101:fio.0 Request processed in 662us (699us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531954.250457:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44292
00000100:00100000:1.0:1651531954.250463:0:216322:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 6
00000100:00100000:1.0:1651531954.250465:0:216322:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000add44b2e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754467261440:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651531954.251261:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.251282:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467261760
00000100:00100000:0.0:1651531954.251295:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44294
00000100:00100000:0.0:1651531954.251297:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000670433b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:680970:x1731754467261760:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531954.251300:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531954.251304:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b59a05a3/0x3234de053ca2a12 lrc: 2/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db444bc8 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.251310:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531954.251311:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531954.251312:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b59a05a3/0x3234de053ca2a12 lrc: 3/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [667648->671743] (req 667648->671743) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444bc8 expref: 19 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.251316:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b59a05a3/0x3234de053ca2a12 lrc: 3/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [667648->671743] (req 667648->671743) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444bc8 expref: 19 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.251320:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b59a05a3, rc 0)
00000100:00100000:0.0:1651531954.251331:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000670433b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:680970:x1731754467261760:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (70us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531954.251336:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44294
00000100:00100000:1.0:1651531954.251676:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531954.251689:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531954.251696:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467261824
00000100:00100000:0.0:1651531954.251697:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467261888
00000100:00100000:0.0:1651531954.251707:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44295
00000100:00100000:0.0:1651531954.251709:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dccc50c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:680969:x1731754467261824:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531954.251712:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651531954.251714:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44296
00000100:00100000:1.0:1651531954.251716:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b67ad021 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:680972:x1731754467261888:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531954.251716:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f78aa55f/0x3234de053ca2a19 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db444bcf expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.251720:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531954.251722:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531954.251722:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531954.251724:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bfa41eae/0x3234de053ca2a20 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db444bd6 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.251725:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f78aa55f/0x3234de053ca2a19 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 11 type: EXT [339968->425983] (req 339968->344063) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444bcf expref: 21 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.251729:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f78aa55f/0x3234de053ca2a19 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [339968->425983] (req 339968->344063) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444bcf expref: 22 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.251731:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531954.251731:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531954.251733:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bfa41eae/0x3234de053ca2a20 lrc: 3/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [827392->831487] (req 827392->831487) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444bd6 expref: 22 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.251741:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bfa41eae/0x3234de053ca2a20 lrc: 3/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [827392->831487] (req 827392->831487) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444bd6 expref: 22 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.251741:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f78aa55f, rc 0)
00010000:00010000:1.0:1651531954.251746:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000bfa41eae, rc 0)
00000100:00100000:0.0:1651531954.251752:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dccc50c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+22:680969:x1731754467261824:12345-10.240.43.64@tcp:101:fio.0 Request processed in 42us (76us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531954.251754:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b67ad021 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+22:680972:x1731754467261888:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (65us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531954.251755:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44295
00000100:00100000:1.0:1651531954.251756:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44296
00000100:00100000:1.0:1651531954.252063:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531954.252071:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467262016
00002000:00100000:1.0:1651531954.252077:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x34545:0x0] (339968->425983)  req@00000000b10bc064 x1731754467262016/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/0 e 0 to 0 dl 1651531960 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:1.0:1651531954.252081:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000b10bc064 with x1731754467262016 ext(339968->425983)
00002000:00010000:1.0:1651531954.252082:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000b10bc064
00000100:00100000:1.0:1651531954.252094:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249548
00000100:00100000:1.0:1651531954.252096:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b10bc064 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438148:x1731754467262016:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651531954.252388:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b10bc064 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438148:x1731754467262016:12345-10.240.43.64@tcp:3:fio.0 Request processed in 290us (325us total) trans 0 rc 86016/86016
00000100:00100000:1.0:1651531954.252392:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249548
00002000:00100000:1.0:1651531954.252394:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x34545:0x0] (339968->425983)  req@00000000b10bc064 x1731754467262016/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/440 e 0 to 0 dl 1651531960 ref 1 fl Complete:/0/0 rc 86016/86016 job:'fio.0'
00002000:00100000:1.0:1651531954.252398:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000b10bc064 with x1731754467262016 ext(339968->425983)
00002000:00010000:1.0:1651531954.252399:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000b10bc064
00000100:00100000:1.0:1651531954.253836:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531954.253845:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467262400
00002000:00100000:1.0:1651531954.253851:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x34545:0x0] (958464->1048575)  req@0000000099b6616a x1731754467262400/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/0 e 0 to 0 dl 1651531960 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:1.0:1651531954.253855:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000099b6616a with x1731754467262400 ext(958464->1048575)
00002000:00010000:1.0:1651531954.253856:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000099b6616a
00000100:00100000:1.0:1651531954.253866:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249549
00000100:00100000:1.0:1651531954.253868:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000099b6616a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438148:x1731754467262400:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651531954.254175:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000099b6616a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438148:x1731754467262400:12345-10.240.43.64@tcp:3:fio.0 Request processed in 306us (338us total) trans 0 rc 90112/90112
00000100:00100000:1.0:1651531954.254178:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249549
00002000:00100000:1.0:1651531954.254180:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x34545:0x0] (958464->1048575)  req@0000000099b6616a x1731754467262400/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/440 e 0 to 0 dl 1651531960 ref 1 fl Complete:/0/0 rc 90112/90112 job:'fio.0'
00002000:00100000:1.0:1651531954.254184:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000099b6616a with x1731754467262400 ext(958464->1048575)
00002000:00010000:1.0:1651531954.254185:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000099b6616a
00000100:00100000:1.0:1651531954.254479:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531954.254487:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467262464
00000100:00100000:1.0:1651531954.254494:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44297
00000100:00100000:1.0:1651531954.254496:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a20162bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+21:680969:x1731754467262464:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531954.254499:0:206699:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531954.254503:0:206699:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dfdae7d6/0x3234de053ca2a27 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db444bdd expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.254509:0:206699:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531954.254510:0:206699:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531954.254511:0:206699:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dfdae7d6/0x3234de053ca2a27 lrc: 3/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 11 type: EXT [692224->696319] (req 692224->696319) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444bdd expref: 22 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.254528:0:206699:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000dfdae7d6/0x3234de053ca2a27 lrc: 3/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 11 type: EXT [692224->696319] (req 692224->696319) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444bdd expref: 22 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.254532:0:206699:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000dfdae7d6, rc 0)
00000100:00100000:1.0:1651531954.254547:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a20162bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+22:680969:x1731754467262464:12345-10.240.43.64@tcp:101:fio.0 Request processed in 50us (68us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531954.254549:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44297
00000001:00080000:0.0:1651531954.258504:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869049 is committed
00010000:00010000:0.0:1651531954.258518:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000958e71ef/0x3234de053ca29ef lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 11 type: EXT [274432->278527] (req 274432->278527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.258522:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000958e71ef/0x3234de053ca29ef lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 11 type: EXT [274432->278527] (req 274432->278527) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531954.258546:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009b569a7a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754467260288:12345-10.240.43.64@tcp:4:fio.0 Request processed in 22858us (22885us total) trans 21474869049 rc 0/0
00010000:00010000:1.0:1651531954.258549:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000958e71ef/0x3234de053ca29ef lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 11 type: EXT [274432->278527] (req 274432->278527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531954.258549:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249545
00010000:00010000:1.0:1651531954.258553:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000958e71ef already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531954.258555:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000958e71ef/0x3234de053ca29ef lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 11 type: EXT [274432->278527] (req 274432->278527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.258558:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000958e71ef/0x3234de053ca29ef lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 11 type: EXT [274432->278527] (req 274432->278527) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.258564:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000958e71ef/0x3234de053ca29ef lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 11 type: EXT [274432->278527] (req 274432->278527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.258567:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000958e71ef/0x3234de053ca29ef lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 11 type: EXT [274432->278527] (req 274432->278527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531954.291826:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869051 is committed
00010000:00010000:0.0:1651531954.291845:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eba74384/0x3234de053ca29fd lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [425984->430079] (req 425984->430079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.291849:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eba74384/0x3234de053ca29fd lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [425984->430079] (req 425984->430079) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.291862:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003dec1fa8/0x3234de053ca29f6 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [839680->843775] (req 839680->843775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.291867:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003dec1fa8/0x3234de053ca29f6 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [839680->843775] (req 839680->843775) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531954.291867:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002512e905 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754467261056:12345-10.240.43.64@tcp:4:fio.0 Request processed in 42396us (42424us total) trans 21474869051 rc 0/0
00000100:00100000:0.0:1651531954.291870:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249547
00000100:00100000:1.0:1651531954.291894:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009078ca7d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467260736:12345-10.240.43.64@tcp:4:fio.0 Request processed in 43475us (43504us total) trans 21474869050 rc 0/0
00000100:00100000:1.0:1651531954.291897:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249546
00010000:00010000:1.0:1651531954.291905:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eba74384/0x3234de053ca29fd lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [425984->430079] (req 425984->430079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.291908:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003dec1fa8/0x3234de053ca29f6 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 11 type: EXT [839680->843775] (req 839680->843775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.291912:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000003dec1fa8 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531954.291913:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003dec1fa8/0x3234de053ca29f6 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 11 type: EXT [839680->843775] (req 839680->843775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.291917:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003dec1fa8/0x3234de053ca29f6 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 11 type: EXT [839680->843775] (req 839680->843775) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.291923:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003dec1fa8/0x3234de053ca29f6 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 11 type: EXT [839680->843775] (req 839680->843775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.291925:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003dec1fa8/0x3234de053ca29f6 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 11 type: EXT [839680->843775] (req 839680->843775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.291930:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000eba74384 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531954.291936:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eba74384/0x3234de053ca29fd lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [425984->430079] (req 425984->430079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.291940:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eba74384/0x3234de053ca29fd lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [425984->430079] (req 425984->430079) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.291946:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eba74384/0x3234de053ca29fd lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [425984->430079] (req 425984->430079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.291949:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eba74384/0x3234de053ca29fd lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [425984->430079] (req 425984->430079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531954.292264:0:216322:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000add44b2e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754467261440:12345-10.240.43.64@tcp:4:fio.0 Request processed in 41797us (41842us total) trans 21474869052 rc 0/0
00000100:00100000:0.0:1651531954.292268:0:216322:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 6
00002000:00100000:0.0:1651531954.292271:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34545:0x0] (651264->905215)  req@00000000add44b2e x1731754467261440/t21474869052(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 520/456 e 0 to 0 dl 1651531960 ref 1 fl Complete:H/0/0 rc 0/0 job:'fio.0'
00002000:00100000:0.0:1651531954.292275:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000add44b2e with x1731754467261440 ext(651264->905215)
00010000:00010000:0.0:1651531954.292279:0:216322:0:(ldlm_lockd.c:599:ldlm_refresh_waiting_lock()) ### refreshed to 81s ns: filter-lustre-OST0001_UUID lock: 000000003e3ad07b/0x3234de053ca2a0b lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [651264->839679] (req 651264->655359) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444bc1 expref: 14 pid: 206699 timeout: 22762 lvb_type: 0
00002000:00010000:0.0:1651531954.292283:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req 00000000add44b2e
00000100:00100000:0.0:1651531954.292471:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.292479:0:216322:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467263040
00000100:00100000:0.0:1651531954.292496:0:216322:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249550
00000100:00100000:0.0:1651531954.292498:0:216322:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003ffbc5dc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754467263040:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531954.292506:0:216322:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000004233736c/0x3234de053ca2a2e lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.292510:0:216322:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531954.292511:0:216322:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531954.292512:0:216322:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004233736c/0x3234de053ca2a2e lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [212992->217087] (req 212992->217087) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.292516:0:216322:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004233736c/0x3234de053ca2a2e lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [212992->217087] (req 212992->217087) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.292529:0:216322:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000004233736c/0x3234de053ca2a2e lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [212992->217087] (req 212992->217087) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.292533:0:216322:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004233736c/0x3234de053ca2a2e lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [212992->217087] (req 212992->217087) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.292543:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004233736c/0x3234de053ca2a2e lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [212992->217087] (req 212992->217087) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.292547:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000004233736c already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531954.292548:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004233736c/0x3234de053ca2a2e lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [212992->217087] (req 212992->217087) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.292551:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004233736c/0x3234de053ca2a2e lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [212992->217087] (req 212992->217087) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531954.292558:0:216322:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003ffbc5dc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754467263040:12345-10.240.43.64@tcp:3:fio.0 Request processed in 59us (87us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531954.292561:0:216322:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249550
00010000:00010000:1.0:1651531954.292566:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004233736c/0x3234de053ca2a2e lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [212992->217087] (req 212992->217087) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.292569:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004233736c/0x3234de053ca2a2e lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [212992->217087] (req 212992->217087) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531954.292660:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.292669:0:169267:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467263104
00010000:00010000:0.0:1651531954.292674:0:169267:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003e3ad07b/0x3234de053ca2a0b lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [651264->839679] (req 651264->655359) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444bc1 expref: 14 pid: 206699 timeout: 22762 lvb_type: 0
00000100:00100000:0.0:1651531954.292682:0:169267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 88
00000100:00100000:0.0:1651531954.292684:0:169267:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ac545f3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754467263104:12345-10.240.43.64@tcp:103:ldlm_bl_01.0
00010000:00010000:0.0:1651531954.292687:0:169267:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531954.292691:0:169267:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003e3ad07b/0x3234de053ca2a0b lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [651264->839679] (req 651264->655359) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444bc1 expref: 14 pid: 206699 timeout: 22762 lvb_type: 0
00010000:00010000:0.0:1651531954.292695:0:169267:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003e3ad07b/0x3234de053ca2a0b lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [651264->839679] (req 651264->655359) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444bc1 expref: 14 pid: 206699 timeout: 22762 lvb_type: 0
00010000:00010000:0.0:1651531954.292701:0:169267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003e3ad07b/0x3234de053ca2a0b lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [651264->839679] (req 651264->655359) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444bc1 expref: 14 pid: 206699 timeout: 22762 lvb_type: 0
00010000:00010000:0.0:1651531954.292704:0:169267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531954.292705:0:169267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531954.292707:0:169267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000d9e7472/0x3234de053ca2a04 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [737280->827391] (req 737280->741375) gid 0 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444bac expref: 13 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.292712:0:169267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000d9e7472/0x3234de053ca2a04 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [737280->827391] (req 737280->741375) gid 0 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444bac expref: 13 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.292715:0:169267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531954.292716:0:169267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531954.292717:0:169267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b59a05a3/0x3234de053ca2a12 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [667648->692223] (req 667648->671743) gid 0 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444bc8 expref: 13 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.292720:0:169267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b59a05a3/0x3234de053ca2a12 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [667648->692223] (req 667648->671743) gid 0 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444bc8 expref: 13 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.292723:0:169267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531954.292723:0:169267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531954.292725:0:169267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bfa41eae/0x3234de053ca2a20 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [827392->884735] (req 827392->831487) gid 0 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444bd6 expref: 13 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.292728:0:169267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bfa41eae/0x3234de053ca2a20 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [827392->884735] (req 827392->831487) gid 0 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444bd6 expref: 13 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.292730:0:169267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531954.292731:0:169267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531954.292732:0:169267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000dfdae7d6/0x3234de053ca2a27 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [692224->884735] (req 692224->696319) gid 0 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444bdd expref: 13 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.292735:0:169267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dfdae7d6/0x3234de053ca2a27 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [692224->884735] (req 692224->696319) gid 0 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444bdd expref: 13 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.292743:0:169267:0:(ldlm_lockd.c:1067:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000dfdae7d6/0x3234de053ca2a27 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [692224->884735] (req 692224->696319) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444bdd expref: 13 pid: 206699 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531954.292747:0:169267:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000091075bf7 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:169267:1731745997345472:10.240.43.64@tcp:105:
00010000:00010000:0.0:1651531954.292762:0:169267:0:(ldlm_lockd.c:1067:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000bfa41eae/0x3234de053ca2a20 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [827392->884735] (req 827392->831487) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444bd6 expref: 13 pid: 166113 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531954.292766:0:169267:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b462545d pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:169267:1731745997345536:10.240.43.64@tcp:105:
00010000:00010000:0.0:1651531954.292772:0:169267:0:(ldlm_lockd.c:1067:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b59a05a3/0x3234de053ca2a12 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [667648->692223] (req 667648->671743) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444bc8 expref: 13 pid: 166112 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531954.292775:0:169267:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004d72f458 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:169267:1731745997345600:10.240.43.64@tcp:105:
00010000:00010000:0.0:1651531954.292793:0:169267:0:(ldlm_lockd.c:1067:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000d9e7472/0x3234de053ca2a04 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [737280->827391] (req 737280->741375) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444bac expref: 13 pid: 166112 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531954.292797:0:169267:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000080bc1e67 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:169267:1731745997345664:10.240.43.64@tcp:105:
00000100:00100000:0.0:1651531954.292802:0:169267:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f14111ff going to sleep for 6 seconds
00000100:00100000:0.0:1651531954.293486:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.293495:0:169267:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000091075bf7 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:169267:1731745997345472:10.240.43.64@tcp:105:
00000100:00100000:0.0:1651531954.293498:0:169267:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b462545d pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:169267:1731745997345536:10.240.43.64@tcp:105:
00000100:00100000:0.0:1651531954.293503:0:216322:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467263424
00002000:00100000:0.0:1651531954.293509:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34545:0x0] (692224->884735)  req@00000000dfff0362 x1731754467263424/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/0 e 0 to 0 dl 1651531960 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:0.0:1651531954.293514:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000dfff0362 with x1731754467263424 ext(692224->884735)
00002000:00010000:0.0:1651531954.293515:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000dfff0362
00000100:00100000:0.0:1651531954.293529:0:216322:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249551
00000100:00100000:0.0:1651531954.293531:0:216322:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dfff0362 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754467263424:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651531954.293738:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531954.293749:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467263616
00000100:00100000:1.0:1651531954.293769:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249552
00000100:00100000:1.0:1651531954.293771:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bcdb3319 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754467263616:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531954.293778:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ee3405a/0x3234de053ca2a35 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.293782:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531954.293783:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:0.0:1651531954.293783:0:169267:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004d72f458 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:169267:1731745997345600:10.240.43.64@tcp:105:
00010000:00010000:1.0:1651531954.293784:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ee3405a/0x3234de053ca2a35 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531954.293786:0:169267:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000080bc1e67 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:169267:1731745997345664:10.240.43.64@tcp:105:
00010000:00010000:1.0:1651531954.293788:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001ee3405a/0x3234de053ca2a35 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.293792:0:169267:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651531954.293800:0:169267:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ac545f3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754467263104:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 1115us (1141us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531954.293803:0:169267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 88
00000100:00100000:0.0:1651531954.293881:0:216322:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dfff0362 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754467263424:12345-10.240.43.64@tcp:3:fio.0 Request processed in 349us (395us total) trans 0 rc 192512/192512
00000100:00100000:0.0:1651531954.293885:0:216322:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249551
00002000:00100000:0.0:1651531954.293887:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34545:0x0] (692224->884735)  req@00000000dfff0362 x1731754467263424/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/440 e 0 to 0 dl 1651531960 ref 1 fl Complete:/0/0 rc 192512/192512 job:'fio.0'
00002000:00100000:0.0:1651531954.293891:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000dfff0362 with x1731754467263424 ext(692224->884735)
00002000:00010000:0.0:1651531954.293892:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000dfff0362
00000100:00100000:0.0:1651531954.294666:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.294676:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.294688:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.294698:0:216322:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467264256
00000100:00100000:1.0:1651531954.294701:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467264064
00000100:00100000:0.0:1651531954.294708:0:216322:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249553
00000100:00100000:0.0:1651531954.294710:0:216322:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f47fde78 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754467264256:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651531954.294717:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467264192
00010000:00010000:0.0:1651531954.294717:0:216322:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eba74384/0x3234de053ca2a3c lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531954.294725:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44298
00000100:00100000:1.0:1651531954.294727:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000080bc1e67 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+18:680972:x1731754467264064:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531954.294731:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531954.294732:0:216322:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531954.294732:0:216322:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531954.294733:0:216322:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eba74384/0x3234de053ca2a3c lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [167936->172031] (req 167936->172031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.294735:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ea9f3321/0x3234de053ca2a43 lrc: 2/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db444beb expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.294738:0:216322:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eba74384/0x3234de053ca2a3c lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 11 type: EXT [167936->172031] (req 167936->172031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.294747:0:166111:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f78aa55f/0x3234de053ca2a19 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [339968->425983] (req 339968->344063) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444bcf expref: 19 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.294750:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531954.294751:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531954.294752:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea9f3321/0x3234de053ca2a43 lrc: 4/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [360448->364543] (req 360448->364543) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444beb expref: 19 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.294759:0:166111:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f78aa55f/0x3234de053ca2a19 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [339968->425983] (req 339968->344063) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444bcf expref: 19 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.294763:0:166111:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f78aa55f/0x3234de053ca2a19 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [339968->425983] (req 339968->344063) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444bcf expref: 19 pid: 166112 timeout: 22762 lvb_type: 0
00000100:00100000:1.0:1651531954.294767:0:166111:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d76314b4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:166111:1731745997345728:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531954.294783:0:166111:0:(client.c:2492:ptlrpc_set_wait()) set 000000003731e840 going to sleep for 6 seconds
00000100:00100000:1.0:1651531954.294791:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44299
00000100:00100000:1.0:1651531954.294793:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004d72f458 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+21:680969:x1731754467264192:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531954.294795:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531954.294798:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008d0d3608/0x3234de053ca2a4a lrc: 2/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db444bf2 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.294804:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531954.294804:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531954.294807:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008d0d3608/0x3234de053ca2a4a lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 11 type: EXT [512000->667647] (req 512000->516095) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444bf2 expref: 22 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.294815:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008d0d3608/0x3234de053ca2a4a lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 11 type: EXT [512000->667647] (req 512000->516095) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444bf2 expref: 22 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.294819:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d0d3608, rc 0)
00000100:00100000:1.0:1651531954.294846:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004d72f458 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+22:680969:x1731754467264192:12345-10.240.43.64@tcp:101:fio.0 Request processed in 52us (157us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531954.294849:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44299
00000100:00100000:1.0:1651531954.295003:0:166111:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d76314b4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:166111:1731745997345728:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651531954.295008:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ea9f3321/0x3234de053ca2a43 lrc: 3/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 11 type: EXT [360448->364543] (req 360448->364543) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444beb expref: 21 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.295013:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ea9f3321, rc 0)
00000100:00100000:1.0:1651531954.295028:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000080bc1e67 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+21:680972:x1731754467264064:12345-10.240.43.64@tcp:101:fio.0 Request processed in 300us (352us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531954.295031:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44298
00000100:00100000:0.0:1651531954.295137:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.295145:0:169267:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467264448
00010000:00010000:0.0:1651531954.295151:0:169267:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f78aa55f/0x3234de053ca2a19 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 11 type: EXT [339968->425983] (req 339968->344063) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444bcf expref: 21 pid: 166112 timeout: 22762 lvb_type: 0
00000100:00100000:0.0:1651531954.295159:0:169267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 89
00000100:00100000:0.0:1651531954.295161:0:169267:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b462545d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438147:x1731754467264448:12345-10.240.43.64@tcp:103:ldlm_bl_04.0
00010000:00010000:0.0:1651531954.295164:0:169267:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531954.295167:0:169267:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f78aa55f/0x3234de053ca2a19 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 12 type: EXT [339968->425983] (req 339968->344063) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444bcf expref: 21 pid: 166112 timeout: 22762 lvb_type: 0
00010000:00010000:0.0:1651531954.295171:0:169267:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f78aa55f/0x3234de053ca2a19 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 12 type: EXT [339968->425983] (req 339968->344063) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444bcf expref: 21 pid: 166112 timeout: 22762 lvb_type: 0
00010000:00010000:0.0:1651531954.295177:0:169267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f78aa55f/0x3234de053ca2a19 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 12 type: EXT [339968->425983] (req 339968->344063) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444bcf expref: 21 pid: 166112 timeout: 22762 lvb_type: 0
00010000:00010000:0.0:1651531954.295181:0:169267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531954.295182:0:169267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531954.295195:0:169267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ea9f3321/0x3234de053ca2a43 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 11 type: EXT [360448->511999] (req 360448->364543) gid 0 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444beb expref: 20 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.295198:0:169267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea9f3321/0x3234de053ca2a43 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 11 type: EXT [360448->511999] (req 360448->364543) gid 0 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444beb expref: 20 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.295215:0:169267:0:(ldlm_lockd.c:1067:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ea9f3321/0x3234de053ca2a43 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 11 type: EXT [360448->511999] (req 360448->364543) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444beb expref: 20 pid: 166111 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531954.295220:0:169267:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000091075bf7 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:169267:1731745997345792:10.240.43.64@tcp:105:
00000100:00100000:0.0:1651531954.295251:0:169267:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f14111ff going to sleep for 6 seconds
00000100:00100000:0.0:1651531954.295378:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531954.295396:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467264512
00000100:00100000:1.0:1651531954.295403:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44300
00000100:00100000:1.0:1651531954.295405:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c62d1815 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+21:680970:x1731754467264512:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531954.295408:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531954.295412:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000378a069e/0x3234de053ca2a51 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db444c00 expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.295418:0:166111:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008d0d3608/0x3234de053ca2a4a lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 12 type: EXT [512000->667647] (req 512000->516095) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444bf2 expref: 22 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.295425:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531954.295426:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531954.295427:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000378a069e/0x3234de053ca2a51 lrc: 4/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 12 type: EXT [561152->565247] (req 561152->565247) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c00 expref: 22 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.295433:0:166111:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008d0d3608/0x3234de053ca2a4a lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 12 type: EXT [512000->667647] (req 512000->516095) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444bf2 expref: 22 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.295437:0:166111:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008d0d3608/0x3234de053ca2a4a lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 12 type: EXT [512000->667647] (req 512000->516095) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444bf2 expref: 22 pid: 166113 timeout: 22762 lvb_type: 0
00000100:00100000:1.0:1651531954.295441:0:166111:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d76314b4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:166111:1731745997345856:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531954.295456:0:166111:0:(client.c:2492:ptlrpc_set_wait()) set 000000003731e840 going to sleep for 6 seconds
00000100:00100000:0.0:1651531954.295699:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.295715:0:169267:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000091075bf7 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:169267:1731745997345792:10.240.43.64@tcp:105:
00000100:00100000:1.0:1651531954.295717:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467264640
00010000:00010000:0.0:1651531954.295719:0:169267:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1651531954.295728:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44301
00000100:00100000:1.0:1651531954.295729:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a9fc5082 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+23:680972:x1731754467264640:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531954.295733:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651531954.295733:0:169267:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b462545d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+23:438147:x1731754467264448:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 572us (597us total) trans 0 rc 0/0
00010000:00010000:1.0:1651531954.295736:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000df4fd81c/0x3234de053ca2a58 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db444c07 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531954.295737:0:169267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 89
00010000:00010000:1.0:1651531954.295741:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531954.295742:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531954.295744:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000df4fd81c/0x3234de053ca2a58 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 12 type: EXT [286720->360447] (req 286720->290815) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c07 expref: 23 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.295748:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000df4fd81c/0x3234de053ca2a58 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 12 type: EXT [286720->360447] (req 286720->290815) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c07 expref: 23 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.295762:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000df4fd81c, rc 0)
00000100:00100000:1.0:1651531954.295782:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a9fc5082 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+23:680972:x1731754467264640:12345-10.240.43.64@tcp:101:fio.0 Request processed in 52us (84us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531954.295785:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44301
00000100:00100000:1.0:1651531954.295878:0:166111:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d76314b4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:166111:1731745997345856:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531954.295879:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651531954.295883:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000378a069e/0x3234de053ca2a51 lrc: 3/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 12 type: EXT [561152->565247] (req 561152->565247) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c00 expref: 22 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.295888:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000378a069e, rc 0)
00000100:00100000:0.0:1651531954.295889:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531954.295906:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c62d1815 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+22:680970:x1731754467264512:12345-10.240.43.64@tcp:101:fio.0 Request processed in 500us (529us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531954.295909:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44300
00000100:00100000:1.0:1651531954.295914:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467264768
00000100:00100000:1.0:1651531954.295921:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44302
00000100:00100000:1.0:1651531954.295923:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cb694635 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+22:680969:x1731754467264768:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651531954.295930:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467264704
00010000:00010000:1.0:1651531954.295932:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531954.295936:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003ad4b055/0x3234de053ca2a5f lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db444c0e expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00002000:00100000:0.0:1651531954.295938:0:192753:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x100010000:0x34545:0x0] (360448->671743)  req@0000000091075bf7 x1731754467264704/t0(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 520/0 e 0 to 0 dl 1651531960 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00010000:00010000:1.0:1651531954.295942:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531954.295942:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531954.295944:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003ad4b055/0x3234de053ca2a5f lrc: 3/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 13 type: EXT [659456->663551] (req 659456->663551) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c0e expref: 24 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.295947:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003ad4b055/0x3234de053ca2a5f lrc: 3/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 13 type: EXT [659456->663551] (req 659456->663551) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c0e expref: 24 pid: 166111 timeout: 0 lvb_type: 0
00002000:00100000:0.0:1651531954.295953:0:192753:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000091075bf7 with x1731754467264704 ext(360448->671743)
00010000:00010000:0.0:1651531954.295960:0:192753:0:(ldlm_lockd.c:599:ldlm_refresh_waiting_lock()) ### refreshed to 81s ns: filter-lustre-OST0001_UUID lock: 000000008d0d3608/0x3234de053ca2a4a lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 14 type: EXT [512000->667647] (req 512000->516095) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444bf2 expref: 24 pid: 166113 timeout: 22762 lvb_type: 0
00010000:00010000:1.0:1651531954.295980:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003ad4b055, rc 0)
00002000:00010000:0.0:1651531954.295980:0:192753:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req 0000000091075bf7
00000100:00100000:0.0:1651531954.295988:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 7
00000100:00100000:1.0:1651531954.295992:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cb694635 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+24:680969:x1731754467264768:12345-10.240.43.64@tcp:101:fio.0 Request processed in 68us (102us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531954.295994:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44302
00000100:00100000:0.0:1651531954.295996:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000091075bf7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+24:438147:x1731754467264704:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651531954.296099:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.296106:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467264896
00002000:00100000:0.0:1651531954.296113:0:216323:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x100010000:0x34545:0x0] (286720->360447)  req@000000000053497d x1731754467264896/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/0 e 0 to 0 dl 1651531960 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:0.0:1651531954.296117:0:216323:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000000053497d with x1731754467264896 ext(286720->360447)
00002000:00010000:0.0:1651531954.296119:0:216323:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000000053497d
00000100:00100000:1.0:1651531954.296137:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249554
00000100:00100000:1.0:1651531954.296140:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000053497d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+25:438147:x1731754467264896:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651531954.296322:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000091075bf7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+27:438147:x1731754467264704:12345-10.240.43.64@tcp:4:fio.0 Request processed in 325us (442us total) trans 21474869055 rc 0/0
00000100:00100000:0.0:1651531954.296325:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 7
00002000:00100000:0.0:1651531954.296328:0:192753:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x100010000:0x34545:0x0] (360448->671743)  req@0000000091075bf7 x1731754467264704/t21474869055(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 520/456 e 0 to 0 dl 1651531960 ref 1 fl Complete:H/0/0 rc 0/0 job:'fio.0'
00002000:00100000:0.0:1651531954.296332:0:192753:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000091075bf7 with x1731754467264704 ext(360448->671743)
00010000:00010000:0.0:1651531954.296336:0:192753:0:(ldlm_lockd.c:599:ldlm_refresh_waiting_lock()) ### refreshed to 81s ns: filter-lustre-OST0001_UUID lock: 000000008d0d3608/0x3234de053ca2a4a lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 14 type: EXT [512000->667647] (req 512000->516095) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444bf2 expref: 27 pid: 166113 timeout: 22762 lvb_type: 0
00002000:00010000:0.0:1651531954.296340:0:192753:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req 0000000091075bf7
00000100:00100000:1.0:1651531954.296468:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000053497d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+25:438147:x1731754467264896:12345-10.240.43.64@tcp:3:fio.0 Request processed in 327us (369us total) trans 0 rc 73728/73728
00000100:00100000:1.0:1651531954.296471:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249554
00002000:00100000:1.0:1651531954.296474:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x34545:0x0] (286720->360447)  req@000000000053497d x1731754467264896/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/440 e 0 to 0 dl 1651531960 ref 1 fl Complete:/0/0 rc 73728/73728 job:'fio.0'
00002000:00100000:1.0:1651531954.296478:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000000053497d with x1731754467264896 ext(286720->360447)
00002000:00010000:1.0:1651531954.296480:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000000053497d
00000100:00100000:0.0:1651531954.296603:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.296610:0:169267:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467265088
00010000:00010000:0.0:1651531954.296615:0:169267:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008d0d3608/0x3234de053ca2a4a lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 13 type: EXT [512000->667647] (req 512000->516095) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444bf2 expref: 25 pid: 166113 timeout: 22762 lvb_type: 0
00000100:00100000:0.0:1651531954.296642:0:169267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 90
00000100:00100000:0.0:1651531954.296644:0:169267:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007d76765b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+25:438146:x1731754467265088:12345-10.240.43.64@tcp:103:ldlm_bl_03.0
00010000:00010000:0.0:1651531954.296647:0:169267:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531954.296651:0:169267:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008d0d3608/0x3234de053ca2a4a lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 14 type: EXT [512000->667647] (req 512000->516095) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444bf2 expref: 25 pid: 166113 timeout: 22762 lvb_type: 0
00010000:00010000:0.0:1651531954.296655:0:169267:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008d0d3608/0x3234de053ca2a4a lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 14 type: EXT [512000->667647] (req 512000->516095) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444bf2 expref: 25 pid: 166113 timeout: 22762 lvb_type: 0
00010000:00010000:0.0:1651531954.296661:0:169267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008d0d3608/0x3234de053ca2a4a lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 14 type: EXT [512000->667647] (req 512000->516095) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444bf2 expref: 25 pid: 166113 timeout: 22762 lvb_type: 0
00010000:00010000:0.0:1651531954.296665:0:169267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531954.296666:0:169267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531954.296668:0:169267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000378a069e/0x3234de053ca2a51 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 13 type: EXT [561152->659455] (req 561152->565247) gid 0 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c00 expref: 24 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.296671:0:169267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000378a069e/0x3234de053ca2a51 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 13 type: EXT [561152->659455] (req 561152->565247) gid 0 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c00 expref: 24 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.296674:0:169267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531954.296675:0:169267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531954.296676:0:169267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003ad4b055/0x3234de053ca2a5f lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 13 type: EXT [659456->667647] (req 659456->663551) gid 0 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c0e expref: 24 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.296679:0:169267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003ad4b055/0x3234de053ca2a5f lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 13 type: EXT [659456->667647] (req 659456->663551) gid 0 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c0e expref: 24 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.296695:0:169267:0:(ldlm_lockd.c:1067:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003ad4b055/0x3234de053ca2a5f lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 13 type: EXT [659456->667647] (req 659456->663551) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c0e expref: 24 pid: 166111 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531954.296699:0:169267:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009c93d7f2 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:169267:1731745997345920:10.240.43.64@tcp:105:
00010000:00010000:0.0:1651531954.296714:0:169267:0:(ldlm_lockd.c:1067:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000378a069e/0x3234de053ca2a51 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 13 type: EXT [561152->659455] (req 561152->565247) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c00 expref: 24 pid: 166111 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531954.296718:0:169267:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004d249e37 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:169267:1731745997345984:10.240.43.64@tcp:105:
00000100:00100000:0.0:1651531954.296723:0:169267:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f23eeb5f going to sleep for 6 seconds
00000100:00100000:0.0:1651531954.300844:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.300854:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.300862:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531954.300867:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467265216
00000100:00100000:0.0:1651531954.300869:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467265728
00002000:00100000:1.0:1651531954.300874:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x34545:0x0] (364544->511999)  req@00000000ffcdece2 x1731754467265216/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/0 e 0 to 0 dl 1651531960 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:0.0:1651531954.300877:0:192753:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x100010000:0x34545:0x0] (5242880->6291455)  req@000000007f998d3c x1731754467265728/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/0 e 0 to 0 dl 1651531960 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:1.0:1651531954.300878:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000ffcdece2 with x1731754467265216 ext(364544->511999)
00002000:00010000:1.0:1651531954.300879:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000ffcdece2
00002000:00100000:0.0:1651531954.300881:0:192753:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000007f998d3c with x1731754467265728 ext(5242880->6291455)
00002000:00010000:0.0:1651531954.300882:0:192753:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000007f998d3c
00000100:00100000:1.0:1651531954.300886:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467265664
00002000:00100000:1.0:1651531954.300890:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x34545:0x0] (1048576->5242879)  req@00000000942b56fd x1731754467265664/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/0 e 0 to 0 dl 1651531960 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:1.0:1651531954.300893:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000942b56fd with x1731754467265664 ext(1048576->5242879)
00002000:00010000:1.0:1651531954.300894:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000942b56fd
00000100:00100000:0.0:1651531954.300902:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249555
00000100:00100000:0.0:1651531954.300904:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ffcdece2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+27:438148:x1731754467265216:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651531954.300913:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249556
00000100:00100000:1.0:1651531954.300915:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007f998d3c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+27:438146:x1731754467265728:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651531954.300958:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249557
00000100:00100000:0.0:1651531954.300960:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000942b56fd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+29:438146:x1731754467265664:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651531954.301254:0:169267:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009c93d7f2 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:169267:1731745997345920:10.240.43.64@tcp:105:
00000100:00100000:0.0:1651531954.301257:0:169267:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004d249e37 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:169267:1731745997345984:10.240.43.64@tcp:105:
00010000:00010000:0.0:1651531954.301268:0:169267:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651531954.301275:0:169267:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007d76765b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+30:438146:x1731754467265088:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 4631us (4672us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531954.301278:0:169267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 90
00000100:00100000:0.0:1651531954.301477:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.301505:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.301534:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ffcdece2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+28:438148:x1731754467265216:12345-10.240.43.64@tcp:3:fio.0 Request processed in 630us (691us total) trans 0 rc 147456/147456
00000100:00100000:0.0:1651531954.301538:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249555
00002000:00100000:0.0:1651531954.301540:0:192753:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x100010000:0x34545:0x0] (364544->511999)  req@00000000ffcdece2 x1731754467265216/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/440 e 0 to 0 dl 1651531960 ref 1 fl Complete:/0/0 rc 147456/147456 job:'fio.0'
00002000:00100000:0.0:1651531954.301545:0:192753:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000ffcdece2 with x1731754467265216 ext(364544->511999)
00002000:00010000:0.0:1651531954.301546:0:192753:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000ffcdece2
00000100:00100000:0.0:1651531954.301552:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467265920
00002000:00100000:0.0:1651531954.301556:0:192753:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x100010000:0x34545:0x0] (561152->659455)  req@000000004d249e37 x1731754467265920/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/0 e 0 to 0 dl 1651531960 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:0.0:1651531954.301560:0:192753:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000004d249e37 with x1731754467265920 ext(561152->659455)
00002000:00010000:0.0:1651531954.301561:0:192753:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000004d249e37
00000100:00100000:0.0:1651531954.301568:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467266048
00002000:00100000:0.0:1651531954.301572:0:192753:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x100010000:0x34545:0x0] (659456->667647)  req@000000009c93d7f2 x1731754467266048/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/0 e 0 to 0 dl 1651531960 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:0.0:1651531954.301575:0:192753:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000009c93d7f2 with x1731754467266048 ext(659456->667647)
00002000:00010000:0.0:1651531954.301592:0:192753:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000009c93d7f2
00000100:00100000:0.0:1651531954.301600:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249558
00000100:00100000:0.0:1651531954.301602:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004d249e37 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+29:438148:x1731754467265920:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651531954.301649:0:176086:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249559
00000100:00100000:1.0:1651531954.301652:0:176086:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009c93d7f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+30:438149:x1731754467266048:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651531954.301717:0:176086:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009c93d7f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+30:438149:x1731754467266048:12345-10.240.43.64@tcp:3:fio.0 Request processed in 65us (213us total) trans 0 rc 8192/8192
00000100:00100000:1.0:1651531954.301721:0:176086:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249559
00002000:00100000:1.0:1651531954.301723:0:176086:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x100010000:0x34545:0x0] (659456->667647)  req@000000009c93d7f2 x1731754467266048/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/8632 e 0 to 0 dl 1651531960 ref 1 fl Complete:/0/0 rc 8192/8192 job:'fio.0'
00002000:00100000:1.0:1651531954.301727:0:176086:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000009c93d7f2 with x1731754467266048 ext(659456->667647)
00002000:00010000:1.0:1651531954.301728:0:176086:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000009c93d7f2
00000100:00100000:1.0:1651531954.302574:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007f998d3c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+28:438146:x1731754467265728:12345-10.240.43.64@tcp:3:fio.0 Request processed in 1641us (1702us total) trans 0 rc 1048576/1048576
00000100:00100000:1.0:1651531954.302577:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249556
00002000:00100000:1.0:1651531954.302580:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x34545:0x0] (5242880->6291455)  req@000000007f998d3c x1731754467265728/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/440 e 0 to 0 dl 1651531960 ref 1 fl Complete:/0/0 rc 1048576/1048576 job:'fio.0'
00002000:00100000:1.0:1651531954.302584:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000007f998d3c with x1731754467265728 ext(5242880->6291455)
00002000:00010000:1.0:1651531954.302585:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000007f998d3c
00000100:00100000:0.0:1651531954.304586:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000942b56fd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+26:438146:x1731754467265664:12345-10.240.43.64@tcp:3:fio.0 Request processed in 3625us (3722us total) trans 0 rc 4194304/4194304
00000100:00100000:0.0:1651531954.304590:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249557
00002000:00100000:0.0:1651531954.304592:0:192755:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x100010000:0x34545:0x0] (1048576->5242879)  req@00000000942b56fd x1731754467265664/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/440 e 0 to 0 dl 1651531960 ref 1 fl Complete:/0/0 rc 4194304/4194304 job:'fio.0'
00002000:00100000:0.0:1651531954.304602:0:192755:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000942b56fd with x1731754467265664 ext(1048576->5242879)
00002000:00010000:0.0:1651531954.304603:0:192755:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000942b56fd
00000100:00100000:0.0:1651531954.304627:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004d249e37 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+24:438148:x1731754467265920:12345-10.240.43.64@tcp:3:fio.0 Request processed in 3024us (3151us total) trans 0 rc 98304/98304
00000100:00100000:0.0:1651531954.304630:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249558
00002000:00100000:0.0:1651531954.304632:0:192753:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x100010000:0x34545:0x0] (561152->659455)  req@000000004d249e37 x1731754467265920/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/440 e 0 to 0 dl 1651531960 ref 1 fl Complete:/0/0 rc 98304/98304 job:'fio.0'
00002000:00100000:0.0:1651531954.304635:0:192753:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000004d249e37 with x1731754467265920 ext(561152->659455)
00002000:00010000:0.0:1651531954.304637:0:192753:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000004d249e37
00000100:00100000:0.0:1651531954.305889:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.305913:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467266432
00000100:00100000:0.0:1651531954.305934:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44303
00000100:00100000:0.0:1651531954.305937:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bb1457a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+24:680972:x1731754467266432:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531954.305943:0:206699:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531954.305949:0:206699:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f78aa55f/0x3234de053ca2a66 lrc: 2/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db444c1c expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.305959:0:206699:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000dfdae7d6/0x3234de053ca2a27 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 13 type: EXT [692224->884735] (req 692224->696319) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444bdd expref: 25 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.305976:0:206699:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bfa41eae/0x3234de053ca2a20 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 13 type: EXT [827392->884735] (req 827392->831487) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444bd6 expref: 25 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.305980:0:206699:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:0.0:1651531954.305980:0:206699:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:0.0:1651531954.305982:0:206699:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f78aa55f/0x3234de053ca2a66 lrc: 5/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 13 type: EXT [872448->876543] (req 872448->876543) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c1c expref: 25 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.305992:0:206699:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bfa41eae/0x3234de053ca2a20 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 13 type: EXT [827392->884735] (req 827392->831487) gid 0 flags: 0x50000000020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444bd6 expref: 25 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.305996:0:206699:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bfa41eae/0x3234de053ca2a20 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 13 type: EXT [827392->884735] (req 827392->831487) gid 0 flags: 0x70000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444bd6 expref: 25 pid: 166113 timeout: 22762 lvb_type: 0
00000100:00100000:0.0:1651531954.306000:0:206699:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004650255e pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:206699:1731745997346048:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651531954.306022:0:206699:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000dfdae7d6/0x3234de053ca2a27 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 13 type: EXT [692224->884735] (req 692224->696319) gid 0 flags: 0x50000000020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444bdd expref: 25 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.306026:0:206699:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dfdae7d6/0x3234de053ca2a27 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 13 type: EXT [692224->884735] (req 692224->696319) gid 0 flags: 0x70000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444bdd expref: 25 pid: 206699 timeout: 22762 lvb_type: 0
00000100:00100000:0.0:1651531954.306029:0:206699:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004a600aad pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:206699:1731745997346112:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531954.306035:0:206699:0:(client.c:2492:ptlrpc_set_wait()) set 0000000060d3a5ac going to sleep for 6 seconds
00000100:00100000:0.0:1651531954.306569:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.306577:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.306589:0:169267:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467266880
00010000:00010000:0.0:1651531954.306603:0:169267:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dfdae7d6/0x3234de053ca2a27 lrc: 5/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 13 type: EXT [692224->884735] (req 692224->696319) gid 0 flags: 0x60000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444bdd expref: 26 pid: 206699 timeout: 22762 lvb_type: 0
00000100:00100000:1.0:1651531954.306604:0:166103:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467266752
00000100:00100000:0.0:1651531954.306615:0:169267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 91
00010000:00010000:1.0:1651531954.306616:0:166103:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bfa41eae/0x3234de053ca2a20 lrc: 5/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 13 type: EXT [827392->884735] (req 827392->831487) gid 0 flags: 0x60000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444bd6 expref: 27 pid: 166113 timeout: 22762 lvb_type: 0
00000100:00100000:0.0:1651531954.306617:0:169267:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004fdbac20 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+27:438147:x1731754467266880:12345-10.240.43.64@tcp:103:ldlm_bl_01.0
00010000:00010000:0.0:1651531954.306620:0:169267:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531954.306625:0:169267:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dfdae7d6/0x3234de053ca2a27 lrc: 5/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 14 type: EXT [692224->884735] (req 692224->696319) gid 0 flags: 0x60000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444bdd expref: 27 pid: 206699 timeout: 22762 lvb_type: 0
00000100:00100000:1.0:1651531954.306629:0:166103:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 92
00000100:00100000:1.0:1651531954.306632:0:166103:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fbb38781 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+27:438147:x1731754467266752:12345-10.240.43.64@tcp:103:ldlm_bl_01.0
00010000:00010000:0.0:1651531954.306636:0:169267:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dfdae7d6/0x3234de053ca2a27 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 14 type: EXT [692224->884735] (req 692224->696319) gid 0 flags: 0x50000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444bdd expref: 27 pid: 206699 timeout: 22762 lvb_type: 0
00010000:00010000:1.0:1651531954.306642:0:166103:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531954.306644:0:169267:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1651531954.306646:0:166103:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bfa41eae/0x3234de053ca2a20 lrc: 5/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 14 type: EXT [827392->884735] (req 827392->831487) gid 0 flags: 0x60000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444bd6 expref: 27 pid: 166113 timeout: 22762 lvb_type: 0
00010000:00010000:1.0:1651531954.306650:0:166103:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bfa41eae/0x3234de053ca2a20 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 14 type: EXT [827392->884735] (req 827392->831487) gid 0 flags: 0x50000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444bd6 expref: 27 pid: 166113 timeout: 22762 lvb_type: 0
00000100:00100000:0.0:1651531954.306656:0:169267:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004fdbac20 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+27:438147:x1731754467266880:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 39us (88us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531954.306659:0:169267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 91
00010000:00010000:1.0:1651531954.306669:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531954.306669:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531954.306672:0:166103:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f78aa55f/0x3234de053ca2a66 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 14 type: EXT [872448->884735] (req 872448->876543) gid 0 flags: 0x50080000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c1c expref: 26 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.306673:0:206699:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bfa41eae/0x3234de053ca2a20 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [827392->884735] (req 827392->831487) gid 0 flags: 0x44801400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444bd6 expref: 26 pid: 166113 timeout: 22762 lvb_type: 0
00010000:00010000:1.0:1651531954.306676:0:166103:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f78aa55f/0x3234de053ca2a66 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [872448->884735] (req 872448->876543) gid 0 flags: 0x50080000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c1c expref: 26 pid: 206699 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531954.306677:0:206699:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004650255e pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:206699:1731745997346048:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651531954.306680:0:206699:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dfdae7d6/0x3234de053ca2a27 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 13 type: EXT [692224->884735] (req 692224->696319) gid 0 flags: 0x44801400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444bdd expref: 25 pid: 206699 timeout: 22762 lvb_type: 0
00000100:00100000:0.0:1651531954.306684:0:206699:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004a600aad pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:206699:1731745997346112:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651531954.306685:0:166103:0:(ldlm_lockd.c:1067:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f78aa55f/0x3234de053ca2a66 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 12 type: EXT [872448->884735] (req 872448->876543) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c1c expref: 24 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.306689:0:206699:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f78aa55f/0x3234de053ca2a66 lrc: 5/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 12 type: EXT [872448->884735] (req 872448->876543) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c1c expref: 24 pid: 206699 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531954.306690:0:166103:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d76314b4 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:166103:1731745997346176:10.240.43.64@tcp:105:
00010000:00010000:0.0:1651531954.306698:0:206699:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f78aa55f, rc 0)
00000100:00100000:1.0:1651531954.306700:0:166103:0:(client.c:2492:ptlrpc_set_wait()) set 000000001a1ce0e5 going to sleep for 6 seconds
00000100:00100000:0.0:1651531954.306705:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bb1457a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+24:680972:x1731754467266432:12345-10.240.43.64@tcp:101:fio.0 Request processed in 768us (816us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531954.306707:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44303
00000100:00100000:1.0:1651531954.306964:0:166103:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d76314b4 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:166103:1731745997346176:10.240.43.64@tcp:105:
00010000:00010000:1.0:1651531954.306969:0:166103:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1651531954.306978:0:166103:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fbb38781 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+23:438147:x1731754467266752:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 346us (401us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531954.306982:0:166103:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 92
00000100:00100000:0.0:1651531954.307442:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.307450:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467267200
00000100:00100000:0.0:1651531954.307463:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44304
00000100:00100000:0.0:1651531954.307465:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004a600aad pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+23:680969:x1731754467267200:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531954.307468:0:206699:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531954.307472:0:206699:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000958e71ef/0x3234de053ca2a6d lrc: 2/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db444c31 expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.307479:0:206699:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531954.307479:0:206699:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531954.307482:0:206699:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000958e71ef/0x3234de053ca2a6d lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 12 type: EXT [221184->286719] (req 221184->225279) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c31 expref: 24 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.307486:0:206699:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000958e71ef/0x3234de053ca2a6d lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 12 type: EXT [221184->286719] (req 221184->225279) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c31 expref: 24 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.307490:0:206699:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000958e71ef, rc 0)
00000100:00100000:0.0:1651531954.307504:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004a600aad pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+24:680969:x1731754467267200:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (63us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531954.307507:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44304
00000100:00100000:0.0:1651531954.307832:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.307839:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467267456
00000100:00100000:0.0:1651531954.307862:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44305
00000100:00100000:0.0:1651531954.307864:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004650255e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+24:680970:x1731754467267456:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531954.307867:0:206699:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531954.307871:0:206699:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a6553f30/0x3234de053ca2a74 lrc: 2/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db444c3f expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.307878:0:206699:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000958e71ef/0x3234de053ca2a6d lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 13 type: EXT [221184->286719] (req 221184->225279) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c31 expref: 25 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.307881:0:206699:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531954.307882:0:206699:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531954.307883:0:206699:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a6553f30/0x3234de053ca2a74 lrc: 4/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 13 type: EXT [249856->253951] (req 249856->253951) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c3f expref: 25 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.307890:0:206699:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000958e71ef/0x3234de053ca2a6d lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 13 type: EXT [221184->286719] (req 221184->225279) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c31 expref: 25 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.307893:0:206699:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000958e71ef/0x3234de053ca2a6d lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 13 type: EXT [221184->286719] (req 221184->225279) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c31 expref: 25 pid: 206699 timeout: 22762 lvb_type: 0
00000100:00100000:0.0:1651531954.307898:0:206699:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000070160f29 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:206699:1731745997346240:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531954.307913:0:206699:0:(client.c:2492:ptlrpc_set_wait()) set 0000000060d3a5ac going to sleep for 6 seconds
00000100:00100000:0.0:1651531954.308091:0:206699:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000070160f29 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:206699:1731745997346240:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651531954.308097:0:206699:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a6553f30/0x3234de053ca2a74 lrc: 3/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 13 type: EXT [249856->253951] (req 249856->253951) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c3f expref: 25 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.308102:0:206699:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a6553f30, rc 0)
00000100:00100000:0.0:1651531954.308126:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004650255e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+25:680970:x1731754467267456:12345-10.240.43.64@tcp:101:fio.0 Request processed in 261us (294us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531954.308129:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44305
00000100:00100000:0.0:1651531954.308234:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.308242:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467267520
00000100:00100000:0.0:1651531954.308255:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44306
00000100:00100000:0.0:1651531954.308257:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000070160f29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+25:680969:x1731754467267520:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531954.308260:0:206699:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531954.308264:0:206699:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004b7d0a41/0x3234de053ca2a7b lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db444c46 expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.308269:0:206699:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531954.308270:0:206699:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531954.308272:0:206699:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b7d0a41/0x3234de053ca2a7b lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 14 type: EXT [520192->667647] (req 520192->524287) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c46 expref: 26 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.308276:0:206699:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004b7d0a41/0x3234de053ca2a7b lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 14 type: EXT [520192->667647] (req 520192->524287) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c46 expref: 26 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.308281:0:206699:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004b7d0a41, rc 0)
00000100:00100000:0.0:1651531954.308292:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000070160f29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+26:680969:x1731754467267520:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (59us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531954.308295:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44306
00000100:00100000:0.0:1651531954.308450:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.308458:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.308464:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467267584
00002000:00100000:0.0:1651531954.308471:0:192753:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x100010000:0x34545:0x0] (221184->876543)  req@00000000457c9e90 x1731754467267584/t0(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 504/0 e 0 to 0 dl 1651531960 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:0.0:1651531954.308488:0:192753:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000457c9e90 with x1731754467267584 ext(221184->876543)
00010000:00010000:0.0:1651531954.308492:0:192753:0:(ldlm_lockd.c:599:ldlm_refresh_waiting_lock()) ### refreshed to 81s ns: filter-lustre-OST0001_UUID lock: 00000000958e71ef/0x3234de053ca2a6d lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [221184->286719] (req 221184->225279) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c31 expref: 26 pid: 206699 timeout: 22762 lvb_type: 0
00002000:00010000:0.0:1651531954.308496:0:192753:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req 00000000457c9e90
00000100:00100000:0.0:1651531954.308502:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 8
00000100:00100000:0.0:1651531954.308504:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000457c9e90 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+26:438148:x1731754467267584:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651531954.308535:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467267648
00000100:00100000:0.0:1651531954.308544:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44307
00000100:00100000:0.0:1651531954.308546:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000074ec16e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+28:680972:x1731754467267648:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531954.308549:0:206699:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531954.308552:0:206699:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003cf86247/0x3234de053ca2a82 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db444c4d expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.308558:0:206699:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531954.308559:0:206699:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531954.308561:0:206699:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003cf86247/0x3234de053ca2a82 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [40960->147455] (req 40960->45055) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c4d expref: 29 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.308565:0:206699:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003cf86247/0x3234de053ca2a82 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [40960->147455] (req 40960->45055) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c4d expref: 29 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.308569:0:206699:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003cf86247, rc 0)
00000100:00100000:0.0:1651531954.308578:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000074ec16e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+29:680972:x1731754467267648:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (120us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531954.308581:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44307
00000100:00100000:0.0:1651531954.308856:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000457c9e90 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+29:438148:x1731754467267584:12345-10.240.43.64@tcp:4:fio.0 Request processed in 351us (406us total) trans 21474869056 rc 0/0
00000100:00100000:0.0:1651531954.308860:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 8
00002000:00100000:0.0:1651531954.308869:0:192753:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x100010000:0x34545:0x0] (221184->876543)  req@00000000457c9e90 x1731754467267584/t21474869056(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 504/448 e 0 to 0 dl 1651531960 ref 1 fl Complete:H/0/0 rc 0/0 job:'fio.0'
00002000:00100000:0.0:1651531954.308873:0:192753:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000457c9e90 with x1731754467267584 ext(221184->876543)
00010000:00010000:0.0:1651531954.308877:0:192753:0:(ldlm_lockd.c:599:ldlm_refresh_waiting_lock()) ### refreshed to 81s ns: filter-lustre-OST0001_UUID lock: 00000000958e71ef/0x3234de053ca2a6d lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [221184->286719] (req 221184->225279) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c31 expref: 29 pid: 206699 timeout: 22762 lvb_type: 0
00002000:00010000:0.0:1651531954.308880:0:192753:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req 00000000457c9e90
00000100:00100000:1.0:1651531954.308948:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.308958:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467267904
00002000:00100000:0.0:1651531954.308966:0:192753:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x100010000:0x34545:0x0] (40960->147455)  req@00000000d76314b4 x1731754467267904/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/0 e 0 to 0 dl 1651531960 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:0.0:1651531954.308970:0:192753:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000d76314b4 with x1731754467267904 ext(40960->147455)
00002000:00010000:0.0:1651531954.308971:0:192753:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000d76314b4
00000100:00100000:0.0:1651531954.308976:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249560
00000100:00100000:0.0:1651531954.308978:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d76314b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+29:438147:x1731754467267904:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651531954.309043:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.309051:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467268032
00002000:00100000:0.0:1651531954.309057:0:192755:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x100010000:0x34545:0x0] (520192->561151)  req@0000000071261100 x1731754467268032/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/0 e 0 to 0 dl 1651531960 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:0.0:1651531954.309061:0:192755:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000071261100 with x1731754467268032 ext(520192->561151)
00002000:00010000:0.0:1651531954.309062:0:192755:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000071261100
00000100:00100000:0.0:1651531954.309070:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249561
00000100:00100000:0.0:1651531954.309072:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000071261100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+31:438149:x1731754467268032:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651531954.309168:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531954.309183:0:166103:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467268096
00010000:00010000:1.0:1651531954.309189:0:166103:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000958e71ef/0x3234de053ca2a6d lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [221184->286719] (req 221184->225279) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c31 expref: 33 pid: 206699 timeout: 22762 lvb_type: 0
00000100:00100000:1.0:1651531954.309197:0:166103:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 93
00000100:00100000:1.0:1651531954.309206:0:166103:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000329eeeee pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+33:438149:x1731754467268096:12345-10.240.43.64@tcp:103:ldlm_bl_04.0
00010000:00010000:1.0:1651531954.309210:0:166103:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1651531954.309213:0:166103:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000958e71ef/0x3234de053ca2a6d lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [221184->286719] (req 221184->225279) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c31 expref: 33 pid: 206699 timeout: 22762 lvb_type: 0
00010000:00010000:1.0:1651531954.309218:0:166103:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000958e71ef/0x3234de053ca2a6d lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [221184->286719] (req 221184->225279) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c31 expref: 33 pid: 206699 timeout: 22762 lvb_type: 0
00010000:00010000:1.0:1651531954.309237:0:166103:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000958e71ef/0x3234de053ca2a6d lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [221184->286719] (req 221184->225279) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c31 expref: 33 pid: 206699 timeout: 22762 lvb_type: 0
00010000:00010000:1.0:1651531954.309241:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531954.309242:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531954.309244:0:166103:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a6553f30/0x3234de053ca2a74 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [249856->286719] (req 249856->253951) gid 0 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c3f expref: 32 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.309248:0:166103:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a6553f30/0x3234de053ca2a74 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [249856->286719] (req 249856->253951) gid 0 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c3f expref: 32 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.309256:0:166103:0:(ldlm_lockd.c:1067:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a6553f30/0x3234de053ca2a74 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [249856->286719] (req 249856->253951) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c3f expref: 32 pid: 206699 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531954.309260:0:166103:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b97e3b28 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:166103:1731745997346304:10.240.43.64@tcp:105:
00000100:00100000:0.0:1651531954.309280:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d76314b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+31:438147:x1731754467267904:12345-10.240.43.64@tcp:3:fio.0 Request processed in 300us (332us total) trans 0 rc 106496/106496
00000100:00100000:0.0:1651531954.309283:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249560
00000100:00100000:1.0:1651531954.309284:0:166103:0:(client.c:2492:ptlrpc_set_wait()) set 000000001a1ce0e5 going to sleep for 6 seconds
00002000:00100000:0.0:1651531954.309296:0:192753:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x100010000:0x34545:0x0] (40960->147455)  req@00000000d76314b4 x1731754467267904/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/440 e 0 to 0 dl 1651531960 ref 1 fl Complete:/0/0 rc 106496/106496 job:'fio.0'
00002000:00100000:0.0:1651531954.309305:0:192753:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000d76314b4 with x1731754467267904 ext(40960->147455)
00002000:00010000:0.0:1651531954.309307:0:192753:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000d76314b4
00000100:00100000:0.0:1651531954.309360:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000071261100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+29:438149:x1731754467268032:12345-10.240.43.64@tcp:3:fio.0 Request processed in 287us (316us total) trans 0 rc 40960/40960
00000100:00100000:0.0:1651531954.309363:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249561
00002000:00100000:0.0:1651531954.309365:0:192755:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x100010000:0x34545:0x0] (520192->561151)  req@0000000071261100 x1731754467268032/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/440 e 0 to 0 dl 1651531960 ref 1 fl Complete:/0/0 rc 40960/40960 job:'fio.0'
00002000:00100000:0.0:1651531954.309369:0:192755:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000071261100 with x1731754467268032 ext(520192->561151)
00002000:00010000:0.0:1651531954.309370:0:192755:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000071261100
00000100:00100000:1.0:1651531954.309558:0:166103:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b97e3b28 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:166103:1731745997346304:10.240.43.64@tcp:105:
00010000:00010000:1.0:1651531954.309562:0:166103:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1651531954.309574:0:166103:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000329eeeee pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+28:438149:x1731754467268096:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 374us (406us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531954.309577:0:166103:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 93
00000100:00100000:1.0:1651531954.309707:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.309718:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467268224
00000100:00100000:0.0:1651531954.309729:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44308
00000100:00100000:0.0:1651531954.309730:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b97e3b28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+28:680970:x1731754467268224:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531954.309734:0:206699:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531954.309738:0:206699:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009dff3fc3/0x3234de053ca2a89 lrc: 2/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db444c5b expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.309745:0:206699:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000df4fd81c/0x3234de053ca2a58 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [286720->360447] (req 286720->290815) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c07 expref: 29 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.309748:0:206699:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531954.309757:0:206699:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531954.309758:0:206699:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009dff3fc3/0x3234de053ca2a89 lrc: 4/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [290816->294911] (req 290816->294911) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c5b expref: 29 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.309766:0:206699:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000df4fd81c/0x3234de053ca2a58 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [286720->360447] (req 286720->290815) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c07 expref: 29 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.309770:0:206699:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000df4fd81c/0x3234de053ca2a58 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [286720->360447] (req 286720->290815) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c07 expref: 29 pid: 166113 timeout: 22762 lvb_type: 0
00000100:00100000:0.0:1651531954.309775:0:206699:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000054c7264b pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:206699:1731745997346368:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531954.309787:0:206699:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f54ad06c going to sleep for 6 seconds
00000100:00100000:0.0:1651531954.309986:0:206699:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000054c7264b pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:206699:1731745997346368:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651531954.309992:0:206699:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009dff3fc3/0x3234de053ca2a89 lrc: 3/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [290816->294911] (req 290816->294911) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c5b expref: 29 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.309997:0:206699:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009dff3fc3, rc 0)
00000100:00100000:0.0:1651531954.310008:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b97e3b28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+29:680970:x1731754467268224:12345-10.240.43.64@tcp:101:fio.0 Request processed in 277us (301us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531954.310028:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44308
00000100:00100000:1.0:1651531954.310077:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.310086:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467268352
00000100:00100000:0.0:1651531954.310096:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44309
00000100:00100000:0.0:1651531954.310098:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002ae2aeac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+29:680971:x1731754467268352:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531954.310101:0:206699:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531954.310105:0:206699:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a0fea916/0x3234de053ca2a90 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db444c69 expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.310122:0:206699:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531954.310123:0:206699:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531954.310125:0:206699:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0fea916/0x3234de053ca2a90 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [212992->249855] (req 212992->217087) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c69 expref: 30 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.310130:0:206699:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a0fea916/0x3234de053ca2a90 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [212992->249855] (req 212992->217087) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c69 expref: 30 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.310134:0:206699:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a0fea916, rc 0)
00000100:00100000:1.0:1651531954.310171:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.310175:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002ae2aeac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+30:680971:x1731754467268352:12345-10.240.43.64@tcp:101:fio.0 Request processed in 76us (98us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531954.310178:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44309
00000100:00100000:1.0:1651531954.310209:0:166103:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467268416
00010000:00010000:1.0:1651531954.310215:0:166103:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000df4fd81c/0x3234de053ca2a58 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [286720->360447] (req 286720->290815) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c07 expref: 30 pid: 166113 timeout: 22762 lvb_type: 0
00000100:00100000:1.0:1651531954.310237:0:166103:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 94
00000100:00100000:1.0:1651531954.310239:0:166103:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f3a0807 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+30:438148:x1731754467268416:12345-10.240.43.64@tcp:103:ldlm_bl_02.0
00010000:00010000:1.0:1651531954.310242:0:166103:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1651531954.310246:0:166103:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000df4fd81c/0x3234de053ca2a58 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 17 type: EXT [286720->360447] (req 286720->290815) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c07 expref: 30 pid: 166113 timeout: 22762 lvb_type: 0
00010000:00010000:1.0:1651531954.310250:0:166103:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000df4fd81c/0x3234de053ca2a58 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 17 type: EXT [286720->360447] (req 286720->290815) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c07 expref: 30 pid: 166113 timeout: 22762 lvb_type: 0
00010000:00010000:1.0:1651531954.310256:0:166103:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000df4fd81c/0x3234de053ca2a58 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 17 type: EXT [286720->360447] (req 286720->290815) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c07 expref: 30 pid: 166113 timeout: 22762 lvb_type: 0
00010000:00010000:1.0:1651531954.310260:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531954.310261:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531954.310272:0:166103:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009dff3fc3/0x3234de053ca2a89 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [290816->360447] (req 290816->294911) gid 0 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c5b expref: 29 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.310275:0:166103:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009dff3fc3/0x3234de053ca2a89 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [290816->360447] (req 290816->294911) gid 0 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c5b expref: 29 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.310284:0:166103:0:(ldlm_lockd.c:1067:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000009dff3fc3/0x3234de053ca2a89 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [290816->360447] (req 290816->294911) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c5b expref: 29 pid: 206699 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531954.310288:0:166103:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008b42dfe9 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:166103:1731745997346432:10.240.43.64@tcp:105:
00000100:00100000:1.0:1651531954.310302:0:166103:0:(client.c:2492:ptlrpc_set_wait()) set 000000001a1ce0e5 going to sleep for 6 seconds
00000100:00100000:1.0:1651531954.310683:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.310702:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467268608
00002000:00100000:0.0:1651531954.310709:0:192755:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x100010000:0x34545:0x0] (802816->827391)  req@0000000052cf3c08 x1731754467268608/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/0 e 0 to 0 dl 1651531960 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:0.0:1651531954.310713:0:192755:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000052cf3c08 with x1731754467268608 ext(802816->827391)
00002000:00010000:0.0:1651531954.310715:0:192755:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000052cf3c08
00000100:00100000:0.0:1651531954.310720:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249562
00000100:00100000:0.0:1651531954.310722:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000052cf3c08 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+30:438147:x1731754467268608:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651531954.310812:0:166103:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008b42dfe9 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:166103:1731745997346432:10.240.43.64@tcp:105:
00010000:00010000:1.0:1651531954.310817:0:166103:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1651531954.310836:0:166103:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f3a0807 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+31:438148:x1731754467268416:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 596us (665us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531954.310839:0:166103:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 94
00000100:00100000:0.0:1651531954.310858:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.310878:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467268736
00002000:00100000:0.0:1651531954.310884:0:192753:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x100010000:0x34545:0x0] (212992->249855)  req@0000000054c7264b x1731754467268736/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/0 e 0 to 0 dl 1651531960 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:0.0:1651531954.310888:0:192753:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000054c7264b with x1731754467268736 ext(212992->249855)
00002000:00010000:0.0:1651531954.310889:0:192753:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000054c7264b
00000100:00100000:1.0:1651531954.310923:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249563
00000100:00100000:1.0:1651531954.310926:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000054c7264b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+31:438148:x1731754467268736:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651531954.310979:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000052cf3c08 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+31:438147:x1731754467268608:12345-10.240.43.64@tcp:3:fio.0 Request processed in 256us (296us total) trans 0 rc 24576/24576
00000100:00100000:0.0:1651531954.310982:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249562
00002000:00100000:0.0:1651531954.310985:0:192755:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x100010000:0x34545:0x0] (802816->827391)  req@0000000052cf3c08 x1731754467268608/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/440 e 0 to 0 dl 1651531960 ref 1 fl Complete:/0/0 rc 24576/24576 job:'fio.0'
00002000:00100000:0.0:1651531954.310988:0:192755:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000052cf3c08 with x1731754467268608 ext(802816->827391)
00002000:00010000:0.0:1651531954.310989:0:192755:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000052cf3c08
00000100:00100000:1.0:1651531954.311129:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000054c7264b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+29:438148:x1731754467268736:12345-10.240.43.64@tcp:3:fio.0 Request processed in 202us (270us total) trans 0 rc 36864/36864
00000100:00100000:1.0:1651531954.311132:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249563
00002000:00100000:1.0:1651531954.311134:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x34545:0x0] (212992->249855)  req@0000000054c7264b x1731754467268736/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/440 e 0 to 0 dl 1651531960 ref 1 fl Complete:/0/0 rc 36864/36864 job:'fio.0'
00002000:00100000:1.0:1651531954.311138:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000054c7264b with x1731754467268736 ext(212992->249855)
00002000:00010000:1.0:1651531954.311140:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000054c7264b
00000001:00080000:0.0:1651531954.357581:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869056 is committed
00010000:00010000:0.0:1651531954.357599:0:216322:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eba74384/0x3234de053ca2a3c lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [167936->172031] (req 167936->172031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.357603:0:216322:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eba74384/0x3234de053ca2a3c lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [167936->172031] (req 167936->172031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.357609:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ee3405a/0x3234de053ca2a35 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.357614:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001ee3405a/0x3234de053ca2a35 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531954.357620:0:216322:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f47fde78 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754467264256:12345-10.240.43.64@tcp:4:fio.0 Request processed in 62909us (62954us total) trans 21474869054 rc 0/0
00000100:00100000:0.0:1651531954.357623:0:216322:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249553
00000100:00100000:1.0:1651531954.357630:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bcdb3319 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754467263616:12345-10.240.43.64@tcp:4:fio.0 Request processed in 63858us (63892us total) trans 21474869053 rc 0/0
00010000:00010000:0.0:1651531954.357630:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eba74384/0x3234de053ca2a3c lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [167936->172031] (req 167936->172031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531954.357633:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249552
00010000:00010000:0.0:1651531954.357633:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000eba74384 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531954.357635:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eba74384/0x3234de053ca2a3c lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [167936->172031] (req 167936->172031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.357638:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eba74384/0x3234de053ca2a3c lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [167936->172031] (req 167936->172031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.357642:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001ee3405a/0x3234de053ca2a35 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.357644:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eba74384/0x3234de053ca2a3c lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [167936->172031] (req 167936->172031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.357645:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001ee3405a already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531954.357646:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001ee3405a/0x3234de053ca2a35 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.357649:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001ee3405a/0x3234de053ca2a35 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.357654:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001ee3405a/0x3234de053ca2a35 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.357657:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ee3405a/0x3234de053ca2a35 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.357657:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eba74384/0x3234de053ca2a3c lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [167936->172031] (req 167936->172031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531954.357681:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531954.357699:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467269888
00000100:00100000:1.0:1651531954.357715:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249564
00000100:00100000:1.0:1651531954.357717:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008b42dfe9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754467269888:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531954.357732:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000df4fd81c/0x3234de053ca2a97 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.357737:0:166118:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ea9f3321/0x3234de053ca2a43 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 14 type: EXT [360448->511999] (req 360448->364543) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444beb expref: 17 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.357740:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531954.357741:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531954.357742:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000df4fd81c/0x3234de053ca2a97 lrc: 4/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 14 type: EXT [372736->376831] (req 372736->376831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.357749:0:166118:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ea9f3321/0x3234de053ca2a43 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 14 type: EXT [360448->511999] (req 360448->364543) gid 0 flags: 0x50000000020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444beb expref: 17 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.357753:0:166118:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ea9f3321/0x3234de053ca2a43 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 14 type: EXT [360448->511999] (req 360448->364543) gid 0 flags: 0x70000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444beb expref: 17 pid: 166111 timeout: 22763 lvb_type: 0
00000100:00100000:1.0:1651531954.357757:0:166118:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dce6a2c5 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:166118:1731745997346496:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531954.357774:0:166118:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b0ded350 going to sleep for 6 seconds
00000100:00100000:1.0:1651531954.358045:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.358063:0:216322:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467270016
00000100:00100000:0.0:1651531954.358078:0:216322:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249565
00000100:00100000:0.0:1651531954.358079:0:216322:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ac545f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754467270016:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531954.358087:0:216322:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000002dfc67f7/0x3234de053ca2a9e lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.358091:0:216322:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531954.358092:0:216322:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531954.358093:0:216322:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002dfc67f7/0x3234de053ca2a9e lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [499712->503807] (req 499712->503807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.358096:0:216322:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002dfc67f7/0x3234de053ca2a9e lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [499712->503807] (req 499712->503807) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531954.358140:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531954.358167:0:166118:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dce6a2c5 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:166118:1731745997346496:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651531954.358172:0:166118:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000df4fd81c/0x3234de053ca2a97 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [372736->376831] (req 372736->376831) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531954.358179:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467270080
00000100:00100000:1.0:1651531954.358193:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249566
00000100:00100000:1.0:1651531954.358195:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000042195ef3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754467270080:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531954.358218:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca2aa5 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.358235:0:216321:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003cf86247/0x3234de053ca2a82 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [40960->147455] (req 40960->45055) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c4d expref: 19 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.358238:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531954.358239:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531954.358240:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca2aa5 lrc: 4/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [61440->65535] (req 61440->65535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.358247:0:216321:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003cf86247/0x3234de053ca2a82 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [40960->147455] (req 40960->45055) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c4d expref: 19 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.358251:0:216321:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003cf86247/0x3234de053ca2a82 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [40960->147455] (req 40960->45055) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c4d expref: 19 pid: 206699 timeout: 22763 lvb_type: 0
00000100:00100000:1.0:1651531954.358255:0:216321:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b462545d pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997346560:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531954.358268:0:216321:0:(client.c:2492:ptlrpc_set_wait()) set 000000001a1ce0e5 going to sleep for 6 seconds
00000100:00100000:1.0:1651531954.358323:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531954.358331:0:166103:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467270400
00010000:00010000:1.0:1651531954.358336:0:166103:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ea9f3321/0x3234de053ca2a43 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [360448->511999] (req 360448->364543) gid 0 flags: 0x60000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444beb expref: 20 pid: 166111 timeout: 22763 lvb_type: 0
00000100:00100000:1.0:1651531954.358344:0:166103:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 95
00000100:00100000:1.0:1651531954.358346:0:166103:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dce6a2c5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438148:x1731754467270400:12345-10.240.43.64@tcp:103:ldlm_bl_02.0
00010000:00010000:1.0:1651531954.358349:0:166103:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1651531954.358362:0:166103:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ea9f3321/0x3234de053ca2a43 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 17 type: EXT [360448->511999] (req 360448->364543) gid 0 flags: 0x60000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444beb expref: 20 pid: 166111 timeout: 22763 lvb_type: 0
00010000:00010000:1.0:1651531954.358366:0:166103:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ea9f3321/0x3234de053ca2a43 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 17 type: EXT [360448->511999] (req 360448->364543) gid 0 flags: 0x50000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444beb expref: 20 pid: 166111 timeout: 22763 lvb_type: 0
00010000:00010000:1.0:1651531954.358372:0:166103:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ea9f3321/0x3234de053ca2a43 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 17 type: EXT [360448->511999] (req 360448->364543) gid 0 flags: 0x44801400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444beb expref: 20 pid: 166111 timeout: 22763 lvb_type: 0
00010000:00010000:1.0:1651531954.358376:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531954.358377:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531954.358378:0:166103:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000df4fd81c/0x3234de053ca2a97 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [372736->376831] (req 372736->376831) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.358381:0:166103:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000df4fd81c/0x3234de053ca2a97 lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [372736->376831] (req 372736->376831) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.358384:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531954.358385:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531954.358385:0:166103:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002dfc67f7/0x3234de053ca2a9e lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [499712->503807] (req 499712->503807) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.358388:0:166103:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002dfc67f7/0x3234de053ca2a9e lrc: 4/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [499712->503807] (req 499712->503807) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.358401:0:166103:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1651531954.358409:0:216322:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002dfc67f7/0x3234de053ca2a9e lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [499712->503807] (req 499712->503807) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531954.358412:0:166103:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dce6a2c5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754467270400:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 66us (89us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531954.358415:0:166103:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 95
00010000:00010000:0.0:1651531954.358418:0:216322:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002dfc67f7/0x3234de053ca2a9e lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [499712->503807] (req 499712->503807) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.358423:0:166118:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000df4fd81c/0x3234de053ca2a97 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [372736->376831] (req 372736->376831) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.358433:0:216322:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000002dfc67f7/0x3234de053ca2a9e lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [499712->503807] (req 499712->503807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.358434:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000df4fd81c/0x3234de053ca2a97 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [372736->376831] (req 372736->376831) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.358436:0:216322:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002dfc67f7/0x3234de053ca2a9e lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [499712->503807] (req 499712->503807) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531954.358465:0:216322:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ac545f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754467270016:12345-10.240.43.64@tcp:3:fio.0 Request processed in 385us (420us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531954.358468:0:216322:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249565
00010000:00010000:1.0:1651531954.358512:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002dfc67f7/0x3234de053ca2a9e lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [499712->503807] (req 499712->503807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.358517:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002dfc67f7 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531954.358518:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002dfc67f7/0x3234de053ca2a9e lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [499712->503807] (req 499712->503807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.358521:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002dfc67f7/0x3234de053ca2a9e lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [499712->503807] (req 499712->503807) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.358539:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002dfc67f7/0x3234de053ca2a9e lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [499712->503807] (req 499712->503807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531954.358539:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651531954.358555:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002dfc67f7/0x3234de053ca2a9e lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [499712->503807] (req 499712->503807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531954.358563:0:166104:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467270464
00010000:00010000:1.0:1651531954.358569:0:166104:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003cf86247/0x3234de053ca2a82 lrc: 5/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 14 type: EXT [40960->147455] (req 40960->45055) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c4d expref: 20 pid: 206699 timeout: 22763 lvb_type: 0
00000100:00100000:1.0:1651531954.358576:0:166104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 96
00000100:00100000:1.0:1651531954.358577:0:166104:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004f13e53f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754467270464:12345-10.240.43.64@tcp:103:ldlm_bl_03.0
00010000:00010000:1.0:1651531954.358589:0:166104:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1651531954.358600:0:166104:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003cf86247/0x3234de053ca2a82 lrc: 5/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [40960->147455] (req 40960->45055) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c4d expref: 20 pid: 206699 timeout: 22763 lvb_type: 0
00010000:00010000:1.0:1651531954.358604:0:166104:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003cf86247/0x3234de053ca2a82 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [40960->147455] (req 40960->45055) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c4d expref: 20 pid: 206699 timeout: 22763 lvb_type: 0
00010000:00010000:1.0:1651531954.358610:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531954.358610:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531954.358611:0:166104:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca2aa5 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [61440->65535] (req 61440->65535) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.358614:0:166104:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca2aa5 lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [61440->65535] (req 61440->65535) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.358619:0:166104:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1651531954.358637:0:166104:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004f13e53f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438147:x1731754467270464:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 59us (98us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531954.358640:0:166104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 96
00010000:00010000:1.0:1651531954.358652:0:216321:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003cf86247/0x3234de053ca2a82 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 14 type: EXT [40960->147455] (req 40960->45055) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c4d expref: 19 pid: 206699 timeout: 22763 lvb_type: 0
00000100:00100000:1.0:1651531954.358665:0:216321:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b462545d pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997346560:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651531954.358669:0:216321:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca2aa5 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 13 type: EXT [61440->65535] (req 61440->65535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.358673:0:216321:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca2aa5 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 13 type: EXT [61440->65535] (req 61440->65535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.358675:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca2aa5 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 13 type: EXT [61440->65535] (req 61440->65535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531954.358811:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.358819:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467270528
00000100:00100000:0.0:1651531954.358833:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44310
00000100:00100000:0.0:1651531954.358834:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000892fc799 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+21:680970:x1731754467270528:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531954.358838:0:206699:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531954.358842:0:206699:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ce7f2d16/0x3234de053ca2aac lrc: 2/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db444c8c expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.358848:0:206699:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531954.358849:0:206699:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531954.358851:0:206699:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce7f2d16/0x3234de053ca2aac lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 14 type: EXT [454656->520191] (req 454656->458751) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c8c expref: 22 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.358856:0:206699:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ce7f2d16/0x3234de053ca2aac lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 14 type: EXT [454656->520191] (req 454656->458751) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c8c expref: 22 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.358860:0:206699:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ce7f2d16, rc 0)
00000100:00100000:0.0:1651531954.358872:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000892fc799 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+22:680970:x1731754467270528:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (62us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531954.358875:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44310
00000100:00100000:0.0:1651531954.361888:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.361896:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.361917:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467270912
00000100:00100000:1.0:1651531954.361922:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467271232
00000100:00100000:0.0:1651531954.361927:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44311
00000100:00100000:0.0:1651531954.361928:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a6b11c0f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+22:680970:x1731754467270912:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531954.361932:0:206699:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531954.361935:0:206699:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eba74384/0x3234de053ca2ab3 lrc: 2/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db444c9a expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.361941:0:206699:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531954.361942:0:206699:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:1.0:1651531954.361947:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44312
00000100:00100000:1.0:1651531954.361949:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a1321e85 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+24:680972:x1731754467271232:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531954.361951:0:206699:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eba74384/0x3234de053ca2ab3 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [180224->212991] (req 180224->184319) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c9a expref: 24 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.361953:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531954.361955:0:206699:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000eba74384/0x3234de053ca2ab3 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [180224->212991] (req 180224->184319) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c9a expref: 24 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.361957:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001ee3405a/0x3234de053ca2aba lrc: 2/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 17 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db444ca1 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.361959:0:206699:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000eba74384, rc 0)
00010000:00010000:1.0:1651531954.361965:0:166113:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a0fea916/0x3234de053ca2a90 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [212992->249855] (req 212992->217087) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c69 expref: 25 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.361968:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531954.361969:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00000100:00100000:0.0:1651531954.361972:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a6b11c0f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+25:680970:x1731754467270912:12345-10.240.43.64@tcp:101:fio.0 Request processed in 43us (85us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531954.361975:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44311
00010000:00010000:1.0:1651531954.361976:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ee3405a/0x3234de053ca2aba lrc: 4/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [225280->229375] (req 225280->229375) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444ca1 expref: 25 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.361984:0:166113:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a0fea916/0x3234de053ca2a90 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [212992->249855] (req 212992->217087) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c69 expref: 24 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.361988:0:166113:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a0fea916/0x3234de053ca2a90 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [212992->249855] (req 212992->217087) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c69 expref: 24 pid: 206699 timeout: 22763 lvb_type: 0
00000100:00100000:1.0:1651531954.361992:0:166113:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b462545d pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:166113:1731745997346624:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531954.362003:0:166113:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a751e6ad going to sleep for 6 seconds
00000100:00100000:1.0:1651531954.362261:0:166113:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b462545d pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:166113:1731745997346624:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651531954.362266:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001ee3405a/0x3234de053ca2aba lrc: 3/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [225280->229375] (req 225280->229375) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444ca1 expref: 24 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.362273:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001ee3405a, rc 0)
00000100:00100000:1.0:1651531954.362289:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a1321e85 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+24:680972:x1731754467271232:12345-10.240.43.64@tcp:101:fio.0 Request processed in 339us (393us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531954.362292:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44312
00000100:00100000:0.0:1651531954.362926:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531954.362944:0:166103:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467271872
00010000:00010000:1.0:1651531954.362950:0:166103:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a0fea916/0x3234de053ca2a90 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [212992->249855] (req 212992->217087) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c69 expref: 24 pid: 206699 timeout: 22763 lvb_type: 0
00000100:00100000:1.0:1651531954.362958:0:166103:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 97
00000100:00100000:1.0:1651531954.362959:0:166103:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004fdbac20 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+24:438146:x1731754467271872:12345-10.240.43.64@tcp:103:ldlm_bl_04.0
00010000:00010000:1.0:1651531954.362962:0:166103:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1651531954.362965:0:166103:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a0fea916/0x3234de053ca2a90 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 17 type: EXT [212992->249855] (req 212992->217087) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c69 expref: 24 pid: 206699 timeout: 22763 lvb_type: 0
00010000:00010000:1.0:1651531954.362969:0:166103:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a0fea916/0x3234de053ca2a90 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 17 type: EXT [212992->249855] (req 212992->217087) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c69 expref: 24 pid: 206699 timeout: 22763 lvb_type: 0
00010000:00010000:1.0:1651531954.362975:0:166103:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a0fea916/0x3234de053ca2a90 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 17 type: EXT [212992->249855] (req 212992->217087) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c69 expref: 24 pid: 206699 timeout: 22763 lvb_type: 0
00010000:00010000:1.0:1651531954.362980:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531954.362980:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531954.362982:0:166103:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001ee3405a/0x3234de053ca2aba lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [225280->249855] (req 225280->229375) gid 0 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444ca1 expref: 23 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.362986:0:166103:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ee3405a/0x3234de053ca2aba lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [225280->249855] (req 225280->229375) gid 0 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444ca1 expref: 23 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.362995:0:166103:0:(ldlm_lockd.c:1067:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000001ee3405a/0x3234de053ca2aba lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [225280->249855] (req 225280->229375) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444ca1 expref: 23 pid: 166113 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531954.362999:0:166103:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b462545d pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:166103:1731745997346688:10.240.43.64@tcp:105:
00000100:00100000:1.0:1651531954.363017:0:166103:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a751e6ad going to sleep for 6 seconds
00000100:00100000:1.0:1651531954.363295:0:166103:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b462545d pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:166103:1731745997346688:10.240.43.64@tcp:105:
00010000:00010000:1.0:1651531954.363299:0:166103:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1651531954.363311:0:166103:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004fdbac20 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+23:438146:x1731754467271872:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 351us (387us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531954.363315:0:166103:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 97
00000100:00100000:0.0:1651531954.367073:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.367082:0:216322:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467272512
00002000:00100000:0.0:1651531954.367089:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34545:0x0] (229376->249855)  req@00000000fe165042 x1731754467272512/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/0 e 0 to 0 dl 1651531960 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:0.0:1651531954.367093:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000fe165042 with x1731754467272512 ext(229376->249855)
00002000:00010000:0.0:1651531954.367094:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000fe165042
00000100:00100000:0.0:1651531954.367100:0:216322:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249567
00000100:00100000:0.0:1651531954.367101:0:216322:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fe165042 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+23:438149:x1731754467272512:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651531954.367386:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531954.367405:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467272576
00000100:00100000:1.0:1651531954.367416:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44313
00000100:00100000:1.0:1651531954.367418:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000000daaec4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+24:680972:x1731754467272576:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531954.367421:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651531954.367422:0:216322:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fe165042 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+24:438149:x1731754467272512:12345-10.240.43.64@tcp:3:fio.0 Request processed in 319us (349us total) trans 0 rc 20480/20480
00010000:00010000:1.0:1651531954.367425:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ea9f3321/0x3234de053ca2ac1 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db444cc4 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531954.367425:0:216322:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249567
00002000:00100000:0.0:1651531954.367428:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34545:0x0] (229376->249855)  req@00000000fe165042 x1731754467272512/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/440 e 0 to 0 dl 1651531960 ref 1 fl Complete:/0/0 rc 20480/20480 job:'fio.0'
00010000:00010000:1.0:1651531954.367431:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531954.367431:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00002000:00100000:0.0:1651531954.367431:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000fe165042 with x1731754467272512 ext(229376->249855)
00002000:00010000:0.0:1651531954.367433:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000fe165042
00010000:00010000:1.0:1651531954.367434:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea9f3321/0x3234de053ca2ac1 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [45056->61439] (req 45056->49151) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444cc4 expref: 25 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.367438:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ea9f3321/0x3234de053ca2ac1 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [45056->61439] (req 45056->49151) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444cc4 expref: 24 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.367446:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ea9f3321, rc 0)
00000100:00100000:1.0:1651531954.367454:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000000daaec4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+24:680972:x1731754467272576:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (69us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531954.367456:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44313
00000100:00100000:0.0:1651531954.367721:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.367728:0:216322:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467272704
00002000:00100000:0.0:1651531954.367735:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34545:0x0] (45056->61439)  req@00000000a4be4eb3 x1731754467272704/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/0 e 0 to 0 dl 1651531960 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:0.0:1651531954.367738:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000a4be4eb3 with x1731754467272704 ext(45056->61439)
00002000:00010000:0.0:1651531954.367740:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000a4be4eb3
00000100:00100000:0.0:1651531954.367745:0:216322:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249568
00000100:00100000:0.0:1651531954.367747:0:216322:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a4be4eb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+24:438147:x1731754467272704:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651531954.367773:0:216322:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a4be4eb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+24:438147:x1731754467272704:12345-10.240.43.64@tcp:3:fio.0 Request processed in 25us (52us total) trans 0 rc 16384/16384
00000100:00100000:0.0:1651531954.367776:0:216322:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249568
00002000:00100000:0.0:1651531954.367777:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34545:0x0] (45056->61439)  req@00000000a4be4eb3 x1731754467272704/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/16824 e 0 to 0 dl 1651531960 ref 1 fl Complete:/0/0 rc 16384/16384 job:'fio.0'
00002000:00100000:0.0:1651531954.367781:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000a4be4eb3 with x1731754467272704 ext(45056->61439)
00002000:00010000:0.0:1651531954.367782:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000a4be4eb3
00000100:00100000:0.0:1651531954.368286:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.368300:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467273088
00002000:00100000:0.0:1651531954.368306:0:192755:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x100010000:0x34545:0x0] (798720->802815)  req@00000000f6d16815 x1731754467273088/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/0 e 0 to 0 dl 1651531960 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:0.0:1651531954.368310:0:192755:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000f6d16815 with x1731754467273088 ext(798720->802815)
00002000:00010000:0.0:1651531954.368311:0:192755:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000f6d16815
00000100:00100000:0.0:1651531954.368316:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249569
00000100:00100000:0.0:1651531954.368318:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f6d16815 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+24:438146:x1731754467273088:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651531954.368338:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f6d16815 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+24:438146:x1731754467273088:12345-10.240.43.64@tcp:3:fio.0 Request processed in 19us (53us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531954.368341:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249569
00002000:00100000:0.0:1651531954.368343:0:192755:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x100010000:0x34545:0x0] (798720->802815)  req@00000000f6d16815 x1731754467273088/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/4536 e 0 to 0 dl 1651531960 ref 1 fl Complete:/0/0 rc 4096/4096 job:'fio.0'
00002000:00100000:0.0:1651531954.368346:0:192755:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000f6d16815 with x1731754467273088 ext(798720->802815)
00002000:00010000:0.0:1651531954.368347:0:192755:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000f6d16815
00000100:00100000:0.0:1651531954.368820:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531954.368836:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467273280
00000100:00100000:1.0:1651531954.368849:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44314
00000100:00100000:1.0:1651531954.368850:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000096080ff0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+24:680972:x1731754467273280:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531954.368854:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531954.368857:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000141899af/0x3234de053ca2ac8 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 17 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db444ce0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.368863:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531954.368863:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531954.368866:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000141899af/0x3234de053ca2ac8 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 17 type: EXT [729088->872447] (req 729088->733183) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444ce0 expref: 25 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.368870:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000141899af/0x3234de053ca2ac8 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 17 type: EXT [729088->872447] (req 729088->733183) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444ce0 expref: 25 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.368874:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000141899af, rc 0)
00000100:00100000:1.0:1651531954.368888:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000096080ff0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+25:680972:x1731754467273280:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (69us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531954.368891:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44314
00000100:00100000:0.0:1651531954.369220:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.369238:0:216322:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467273472
00002000:00100000:0.0:1651531954.369245:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34545:0x0] (729088->872447)  req@00000000fe30d552 x1731754467273472/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 504/0 e 0 to 0 dl 1651531960 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:0.0:1651531954.369249:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000fe30d552 with x1731754467273472 ext(729088->872447)
00002000:00010000:0.0:1651531954.369250:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000fe30d552
00000100:00100000:0.0:1651531954.369255:0:216322:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249570
00000100:00100000:0.0:1651531954.369257:0:216322:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fe30d552 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+25:438147:x1731754467273472:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651531954.369572:0:216322:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fe30d552 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+25:438147:x1731754467273472:12345-10.240.43.64@tcp:3:fio.0 Request processed in 314us (353us total) trans 0 rc 114688/114688
00000100:00100000:0.0:1651531954.369584:0:216322:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249570
00002000:00100000:0.0:1651531954.369587:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34545:0x0] (729088->872447)  req@00000000fe30d552 x1731754467273472/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 504/440 e 0 to 0 dl 1651531960 ref 1 fl Complete:/0/0 rc 114688/114688 job:'fio.0'
00002000:00100000:0.0:1651531954.369590:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000fe30d552 with x1731754467273472 ext(729088->872447)
00002000:00010000:0.0:1651531954.369591:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000fe30d552
00000100:00100000:0.0:1651531954.370933:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.370940:0:216322:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467274112
00002000:00100000:0.0:1651531954.370946:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34545:0x0] (315392->360447)  req@00000000e7e33f36 x1731754467274112/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/0 e 0 to 0 dl 1651531960 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:0.0:1651531954.370950:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000e7e33f36 with x1731754467274112 ext(315392->360447)
00002000:00010000:0.0:1651531954.370951:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000e7e33f36
00000100:00100000:0.0:1651531954.370956:0:216322:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249571
00000100:00100000:0.0:1651531954.370957:0:216322:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7e33f36 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+25:438146:x1731754467274112:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651531954.371343:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531954.371365:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467274240
00000100:00100000:0.0:1651531954.371370:0:216322:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7e33f36 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+26:438146:x1731754467274112:12345-10.240.43.64@tcp:3:fio.0 Request processed in 412us (438us total) trans 0 rc 45056/45056
00000100:00100000:1.0:1651531954.371375:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44315
00000100:00100000:1.0:1651531954.371377:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000067633646 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+26:680972:x1731754467274240:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651531954.371380:0:216322:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249571
00002000:00100000:0.0:1651531954.371382:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34545:0x0] (315392->360447)  req@00000000e7e33f36 x1731754467274112/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/440 e 0 to 0 dl 1651531960 ref 1 fl Complete:/0/0 rc 45056/45056 job:'fio.0'
00002000:00100000:0.0:1651531954.371386:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000e7e33f36 with x1731754467274112 ext(315392->360447)
00002000:00010000:0.0:1651531954.371387:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000e7e33f36
00010000:00010000:1.0:1651531954.371388:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531954.371392:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca2acf lrc: 2/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 18 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db444cf5 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.371397:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531954.371398:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531954.371400:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca2acf lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 18 type: EXT [0->45055] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444cf5 expref: 26 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.371404:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca2acf lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 18 type: EXT [0->45055] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444cf5 expref: 26 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.371408:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000077fc7eeb, rc 0)
00000100:00100000:1.0:1651531954.371429:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000067633646 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+26:680972:x1731754467274240:12345-10.240.43.64@tcp:101:fio.0 Request processed in 51us (86us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531954.371431:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44315
00000100:00100000:0.0:1651531954.371756:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531954.371777:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467274304
00000100:00100000:1.0:1651531954.371788:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44316
00000100:00100000:1.0:1651531954.371790:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004428780d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+26:680972:x1731754467274304:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531954.371793:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531954.371796:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9908e14/0x3234de053ca2ad6 lrc: 2/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db444cfc expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.371802:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531954.371803:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531954.371805:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9908e14/0x3234de053ca2ad6 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [704512->729087] (req 704512->708607) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444cfc expref: 27 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.371820:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e9908e14/0x3234de053ca2ad6 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [704512->729087] (req 704512->708607) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444cfc expref: 27 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.371824:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e9908e14, rc 0)
00000100:00100000:1.0:1651531954.371838:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004428780d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+27:680972:x1731754467274304:12345-10.240.43.64@tcp:101:fio.0 Request processed in 47us (82us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531954.371840:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44316
00000100:00100000:0.0:1651531954.371905:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531954.371924:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467274432
00000100:00100000:1.0:1651531954.371934:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44317
00000100:00100000:1.0:1651531954.371935:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000da46c1ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+27:680971:x1731754467274432:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531954.371938:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531954.371942:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dfdae7d6/0x3234de053ca2add lrc: 2/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db444d0a expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.371947:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531954.371948:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531954.371950:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dfdae7d6/0x3234de053ca2add lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [131072->180223] (req 131072->135167) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444d0a expref: 28 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.371954:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000dfdae7d6/0x3234de053ca2add lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [131072->180223] (req 131072->135167) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444d0a expref: 28 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.371958:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000dfdae7d6, rc 0)
00000100:00100000:1.0:1651531954.371971:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000da46c1ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+28:680971:x1731754467274432:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (67us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531954.371974:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44317
00000100:00100000:0.0:1651531954.372276:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531954.372305:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467274496
00000100:00100000:1.0:1651531954.372316:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44318
00000100:00100000:1.0:1651531954.372318:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c5ed8aca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+28:680970:x1731754467274496:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531954.372321:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531954.372324:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bfa41eae/0x3234de053ca2ae4 lrc: 2/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db444d11 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.372330:0:166113:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004b7d0a41/0x3234de053ca2a7b lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [520192->667647] (req 520192->524287) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c46 expref: 29 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.372333:0:166113:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003ad4b055/0x3234de053ca2a5f lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [659456->667647] (req 659456->663551) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c0e expref: 29 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.372336:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:1.0:1651531954.372337:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:1.0:1651531954.372338:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bfa41eae/0x3234de053ca2ae4 lrc: 5/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [659456->663551] (req 659456->663551) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444d11 expref: 29 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.372344:0:166113:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003ad4b055/0x3234de053ca2a5f lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [659456->667647] (req 659456->663551) gid 0 flags: 0x50000000020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c0e expref: 29 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.372348:0:166113:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003ad4b055/0x3234de053ca2a5f lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [659456->667647] (req 659456->663551) gid 0 flags: 0x70000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c0e expref: 29 pid: 166111 timeout: 22763 lvb_type: 0
00000100:00100000:1.0:1651531954.372352:0:166113:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b462545d pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:166113:1731745997346752:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651531954.372370:0:166113:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004b7d0a41/0x3234de053ca2a7b lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [520192->667647] (req 520192->524287) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c46 expref: 29 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.372385:0:166113:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004b7d0a41/0x3234de053ca2a7b lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [520192->667647] (req 520192->524287) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c46 expref: 29 pid: 206699 timeout: 22763 lvb_type: 0
00000100:00100000:1.0:1651531954.372389:0:166113:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007d76765b pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:166113:1731745997346816:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531954.372416:0:166113:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a751e6ad going to sleep for 6 seconds
00000100:00100000:0.0:1651531954.373322:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.373330:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531954.373340:0:166113:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b462545d pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:166113:1731745997346752:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531954.373341:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531954.373343:0:166113:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007d76765b pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:166113:1731745997346816:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531954.373350:0:216322:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467275008
00010000:00010000:1.0:1651531954.373353:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bfa41eae/0x3234de053ca2ae4 lrc: 3/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [659456->663551] (req 659456->663551) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444d11 expref: 30 pid: 166113 timeout: 0 lvb_type: 0
00002000:00100000:0.0:1651531954.373357:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34545:0x0] (671744->692223)  req@00000000cdee37d3 x1731754467275008/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/0 e 0 to 0 dl 1651531960 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00010000:00010000:1.0:1651531954.373359:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000bfa41eae, rc 0)
00002000:00100000:0.0:1651531954.373361:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000cdee37d3 with x1731754467275008 ext(671744->692223)
00002000:00010000:0.0:1651531954.373362:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000cdee37d3
00000100:00100000:0.0:1651531954.373368:0:216322:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249572
00000100:00100000:1.0:1651531954.373372:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c5ed8aca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+30:680970:x1731754467274496:12345-10.240.43.64@tcp:101:fio.0 Request processed in 1053us (1096us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531954.373374:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44318
00000100:00100000:0.0:1651531954.373375:0:216322:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cdee37d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+30:438148:x1731754467275008:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651531954.373383:0:166104:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467275136
00010000:00010000:1.0:1651531954.373388:0:166104:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004b7d0a41/0x3234de053ca2a7b lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [520192->667647] (req 520192->524287) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c46 expref: 30 pid: 206699 timeout: 22763 lvb_type: 0
00000100:00100000:1.0:1651531954.373396:0:166104:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467275072
00010000:00010000:1.0:1651531954.373399:0:166104:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003ad4b055/0x3234de053ca2a5f lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [659456->667647] (req 659456->663551) gid 0 flags: 0x60000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c0e expref: 32 pid: 166111 timeout: 22763 lvb_type: 0
00000100:00100000:1.0:1651531954.373406:0:166104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 98
00000100:00100000:1.0:1651531954.373408:0:166104:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008c209124 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+32:438147:x1731754467275136:12345-10.240.43.64@tcp:103:ldlm_bl_03.0
00000100:00100000:0.0:1651531954.373416:0:166102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 99
00000100:00100000:0.0:1651531954.373418:0:166102:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e2072256 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+32:438147:x1731754467275072:12345-10.240.43.64@tcp:103:ldlm_bl_03.0
00010000:00010000:1.0:1651531954.373420:0:166104:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531954.373422:0:166102:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1651531954.373424:0:166104:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004b7d0a41/0x3234de053ca2a7b lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 23 type: EXT [520192->667647] (req 520192->524287) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c46 expref: 32 pid: 206699 timeout: 22763 lvb_type: 0
00010000:00010000:0.0:1651531954.373426:0:166102:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003ad4b055/0x3234de053ca2a5f lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 24 type: EXT [659456->667647] (req 659456->663551) gid 0 flags: 0x60000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c0e expref: 32 pid: 166111 timeout: 22763 lvb_type: 0
00010000:00010000:1.0:1651531954.373428:0:166104:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004b7d0a41/0x3234de053ca2a7b lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 24 type: EXT [520192->667647] (req 520192->524287) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c46 expref: 32 pid: 206699 timeout: 22763 lvb_type: 0
00010000:00010000:0.0:1651531954.373432:0:166102:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003ad4b055/0x3234de053ca2a5f lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 23 type: EXT [659456->667647] (req 659456->663551) gid 0 flags: 0x50000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c0e expref: 32 pid: 166111 timeout: 22763 lvb_type: 0
00010000:00010000:1.0:1651531954.373438:0:166104:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004b7d0a41/0x3234de053ca2a7b lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 23 type: EXT [520192->667647] (req 520192->524287) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c46 expref: 32 pid: 206699 timeout: 22763 lvb_type: 0
00010000:00010000:1.0:1651531954.373443:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531954.373443:0:166102:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003ad4b055/0x3234de053ca2a5f lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [659456->667647] (req 659456->663551) gid 0 flags: 0x44801400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c0e expref: 31 pid: 166111 timeout: 22763 lvb_type: 0
00010000:00010000:1.0:1651531954.373444:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531954.373446:0:166104:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bfa41eae/0x3234de053ca2ae4 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 23 type: EXT [659456->667647] (req 659456->663551) gid 0 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444d11 expref: 31 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.373449:0:166104:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bfa41eae/0x3234de053ca2ae4 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [659456->667647] (req 659456->663551) gid 0 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444d11 expref: 30 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.373453:0:166102:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1651531954.373457:0:166104:0:(ldlm_lockd.c:1067:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000bfa41eae/0x3234de053ca2ae4 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [659456->667647] (req 659456->663551) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444d11 expref: 30 pid: 166113 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531954.373459:0:166102:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e2072256 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+30:438147:x1731754467275072:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 40us (118us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531954.373461:0:166104:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007d76765b pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:166104:1731745997346880:10.240.43.64@tcp:105:
00000100:00100000:0.0:1651531954.373462:0:166102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 99
00000100:00100000:1.0:1651531954.373470:0:166104:0:(client.c:2492:ptlrpc_set_wait()) set 000000003176d4e8 going to sleep for 6 seconds
00000100:00100000:0.0:1651531954.373667:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531954.373686:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467275200
00000100:00100000:1.0:1651531954.373698:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44319
00000100:00100000:1.0:1651531954.373700:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ca5b5d4b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+29:680971:x1731754467275200:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531954.373703:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651531954.373707:0:216322:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cdee37d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+29:438148:x1731754467275008:12345-10.240.43.64@tcp:3:fio.0 Request processed in 331us (385us total) trans 0 rc 20480/20480
00000100:00100000:0.0:1651531954.373710:0:216322:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249572
00002000:00100000:0.0:1651531954.373713:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34545:0x0] (671744->692223)  req@00000000cdee37d3 x1731754467275008/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/440 e 0 to 0 dl 1651531960 ref 1 fl Complete:/0/0 rc 20480/20480 job:'fio.0'
00002000:00100000:0.0:1651531954.373716:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000cdee37d3 with x1731754467275008 ext(671744->692223)
00002000:00010000:0.0:1651531954.373718:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000cdee37d3
00010000:00010000:1.0:1651531954.373720:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008d0d3608/0x3234de053ca2aeb lrc: 2/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db444d26 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.373734:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531954.373735:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531954.373737:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008d0d3608/0x3234de053ca2aeb lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [524288->561151] (req 524288->528383) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444d26 expref: 29 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.373742:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008d0d3608/0x3234de053ca2aeb lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [524288->561151] (req 524288->528383) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444d26 expref: 29 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.373745:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008d0d3608, rc 0)
00000100:00100000:1.0:1651531954.373754:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ca5b5d4b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+29:680971:x1731754467275200:12345-10.240.43.64@tcp:101:fio.0 Request processed in 54us (88us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531954.373757:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44319
00000100:00100000:1.0:1651531954.373806:0:166104:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007d76765b pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:166104:1731745997346880:10.240.43.64@tcp:105:
00010000:00010000:1.0:1651531954.373811:0:166104:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1651531954.373817:0:166104:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008c209124 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+28:438147:x1731754467275136:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 408us (487us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531954.373820:0:166104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 98
00000100:00100000:0.0:1651531954.374994:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531954.375012:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467275520
00000100:00100000:1.0:1651531954.375025:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44320
00000100:00100000:1.0:1651531954.375027:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008c209124 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+28:680970:x1731754467275520:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531954.375030:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531954.375034:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003e3ad07b/0x3234de053ca2af2 lrc: 2/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db444d3b expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.375041:0:166113:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000141899af/0x3234de053ca2ac8 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [729088->872447] (req 729088->733183) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444ce0 expref: 29 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.375053:0:166113:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000d9e7472/0x3234de053ca2a04 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [737280->827391] (req 737280->741375) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444bac expref: 29 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.375056:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:1.0:1651531954.375056:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:1.0:1651531954.375057:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003e3ad07b/0x3234de053ca2af2 lrc: 5/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [823296->827391] (req 823296->827391) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444d3b expref: 29 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.375064:0:166113:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000d9e7472/0x3234de053ca2a04 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [737280->827391] (req 737280->741375) gid 0 flags: 0x50000000020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444bac expref: 29 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.375068:0:166113:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000d9e7472/0x3234de053ca2a04 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [737280->827391] (req 737280->741375) gid 0 flags: 0x70000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444bac expref: 29 pid: 166112 timeout: 22763 lvb_type: 0
00000100:00100000:1.0:1651531954.375072:0:166113:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007d76765b pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:166113:1731745997346944:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651531954.375087:0:166113:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000141899af/0x3234de053ca2ac8 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [729088->872447] (req 729088->733183) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444ce0 expref: 29 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.375090:0:166113:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000141899af/0x3234de053ca2ac8 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [729088->872447] (req 729088->733183) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444ce0 expref: 29 pid: 166113 timeout: 22763 lvb_type: 0
00000100:00100000:1.0:1651531954.375094:0:166113:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000329eeeee pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:166113:1731745997347008:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531954.375099:0:166113:0:(client.c:2492:ptlrpc_set_wait()) set 000000003176d4e8 going to sleep for 6 seconds
00000100:00100000:1.0:1651531954.375470:0:166113:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007d76765b pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:166113:1731745997346944:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531954.375473:0:166113:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000329eeeee pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:166113:1731745997347008:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531954.375486:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651531954.375487:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003e3ad07b/0x3234de053ca2af2 lrc: 3/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [823296->827391] (req 823296->827391) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444d3b expref: 29 pid: 166113 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531954.375497:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651531954.375498:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003e3ad07b, rc 0)
00000100:00100000:0.0:1651531954.375505:0:169267:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467275712
00000100:00100000:1.0:1651531954.375508:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008c209124 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+30:680970:x1731754467275520:12345-10.240.43.64@tcp:101:fio.0 Request processed in 480us (515us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531954.375511:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44320
00010000:00010000:0.0:1651531954.375511:0:169267:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000141899af/0x3234de053ca2ac8 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [729088->872447] (req 729088->733183) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444ce0 expref: 30 pid: 166113 timeout: 22763 lvb_type: 0
00000100:00100000:1.0:1651531954.375519:0:166104:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467275776
00000100:00100000:0.0:1651531954.375520:0:169267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 100
00000100:00100000:0.0:1651531954.375522:0:169267:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ed4b797c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+30:438147:x1731754467275712:12345-10.240.43.64@tcp:103:ldlm_bl_03.0
00010000:00010000:1.0:1651531954.375523:0:166104:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000d9e7472/0x3234de053ca2a04 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [737280->827391] (req 737280->741375) gid 0 flags: 0x60000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444bac expref: 30 pid: 166112 timeout: 22763 lvb_type: 0
00010000:00010000:0.0:1651531954.375525:0:169267:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531954.375528:0:169267:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000141899af/0x3234de053ca2ac8 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [729088->872447] (req 729088->733183) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444ce0 expref: 30 pid: 166113 timeout: 22763 lvb_type: 0
00000100:00100000:1.0:1651531954.375530:0:166104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 101
00000100:00100000:1.0:1651531954.375532:0:166104:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008418aa1d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+30:438149:x1731754467275776:12345-10.240.43.64@tcp:103:ldlm_bl_02.0
00010000:00010000:0.0:1651531954.375532:0:169267:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000141899af/0x3234de053ca2ac8 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [729088->872447] (req 729088->733183) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444ce0 expref: 30 pid: 166113 timeout: 22763 lvb_type: 0
00010000:00010000:1.0:1651531954.375535:0:166104:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1651531954.375539:0:166104:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000d9e7472/0x3234de053ca2a04 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 24 type: EXT [737280->827391] (req 737280->741375) gid 0 flags: 0x60000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444bac expref: 30 pid: 166112 timeout: 22763 lvb_type: 0
00010000:00010000:0.0:1651531954.375539:0:169267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000141899af/0x3234de053ca2ac8 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 23 type: EXT [729088->872447] (req 729088->733183) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444ce0 expref: 30 pid: 166113 timeout: 22763 lvb_type: 0
00010000:00010000:1.0:1651531954.375543:0:166104:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000d9e7472/0x3234de053ca2a04 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 24 type: EXT [737280->827391] (req 737280->741375) gid 0 flags: 0x50000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444bac expref: 30 pid: 166112 timeout: 22763 lvb_type: 0
00010000:00010000:1.0:1651531954.375549:0:166104:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000d9e7472/0x3234de053ca2a04 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 24 type: EXT [737280->827391] (req 737280->741375) gid 0 flags: 0x44801400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444bac expref: 30 pid: 166112 timeout: 22763 lvb_type: 0
00010000:00010000:1.0:1651531954.375553:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531954.375554:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531954.375556:0:166104:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003e3ad07b/0x3234de053ca2af2 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [823296->872447] (req 823296->827391) gid 0 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444d3b expref: 28 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.375572:0:166104:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003e3ad07b/0x3234de053ca2af2 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [823296->872447] (req 823296->827391) gid 0 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444d3b expref: 28 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.375576:0:169267:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1651531954.375580:0:166104:0:(ldlm_lockd.c:1067:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003e3ad07b/0x3234de053ca2af2 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [823296->872447] (req 823296->827391) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444d3b expref: 28 pid: 166113 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531954.375584:0:169267:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ed4b797c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+28:438147:x1731754467275712:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 62us (99us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531954.375585:0:166104:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000329eeeee pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:166104:1731745997347072:10.240.43.64@tcp:105:
00000100:00100000:0.0:1651531954.375587:0:169267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 100
00000100:00100000:1.0:1651531954.375593:0:166104:0:(client.c:2492:ptlrpc_set_wait()) set 000000003176d4e8 going to sleep for 6 seconds
00000100:00100000:1.0:1651531954.375858:0:166104:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000329eeeee pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:166104:1731745997347072:10.240.43.64@tcp:105:
00010000:00010000:1.0:1651531954.375862:0:166104:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1651531954.375871:0:166104:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008418aa1d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+27:438149:x1731754467275776:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 338us (374us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531954.375874:0:166104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 101
00000100:00100000:0.0:1651531954.377344:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531954.377362:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467276224
00000100:00100000:1.0:1651531954.377377:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44321
00000100:00100000:1.0:1651531954.377379:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ba346551 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+27:680971:x1731754467276224:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531954.377382:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531954.377386:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003dec1fa8/0x3234de053ca2af9 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db444d50 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.377392:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531954.377392:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531954.377395:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003dec1fa8/0x3234de053ca2af9 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [102400->131071] (req 102400->106495) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444d50 expref: 28 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.377399:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003dec1fa8/0x3234de053ca2af9 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [102400->131071] (req 102400->106495) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444d50 expref: 28 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.377411:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003dec1fa8, rc 0)
00000100:00100000:1.0:1651531954.377422:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ba346551 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+28:680971:x1731754467276224:12345-10.240.43.64@tcp:101:fio.0 Request processed in 43us (79us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531954.377425:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44321
00000100:00100000:0.0:1651531954.377717:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.377725:0:216322:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467276352
00002000:00100000:0.0:1651531954.377731:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34545:0x0] (102400->131071)  req@00000000f17254d8 x1731754467276352/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/0 e 0 to 0 dl 1651531960 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:0.0:1651531954.377735:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000f17254d8 with x1731754467276352 ext(102400->131071)
00002000:00010000:0.0:1651531954.377736:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000f17254d8
00000100:00100000:0.0:1651531954.377741:0:216322:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249573
00000100:00100000:0.0:1651531954.377743:0:216322:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f17254d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+28:438147:x1731754467276352:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651531954.377954:0:216322:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f17254d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+28:438147:x1731754467276352:12345-10.240.43.64@tcp:3:fio.0 Request processed in 209us (236us total) trans 0 rc 28672/28672
00000100:00100000:0.0:1651531954.377957:0:216322:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249573
00002000:00100000:0.0:1651531954.377959:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34545:0x0] (102400->131071)  req@00000000f17254d8 x1731754467276352/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/440 e 0 to 0 dl 1651531960 ref 1 fl Complete:/0/0 rc 28672/28672 job:'fio.0'
00002000:00100000:0.0:1651531954.377963:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000f17254d8 with x1731754467276352 ext(102400->131071)
00002000:00010000:0.0:1651531954.377964:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000f17254d8
00000100:00100000:0.0:1651531954.378189:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531954.378215:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467276416
00000100:00100000:1.0:1651531954.378239:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44322
00000100:00100000:1.0:1651531954.378241:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a3e5dc72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+28:680971:x1731754467276416:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531954.378245:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531954.378255:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003ad4b055/0x3234de053ca2b00 lrc: 2/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db444d57 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.378262:0:166113:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000378a069e/0x3234de053ca2a51 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [561152->659455] (req 561152->565247) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c00 expref: 29 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.378265:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531954.378266:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531954.378266:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003ad4b055/0x3234de053ca2b00 lrc: 4/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [585728->589823] (req 585728->589823) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444d57 expref: 29 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.378273:0:166113:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000378a069e/0x3234de053ca2a51 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [561152->659455] (req 561152->565247) gid 0 flags: 0x50000000020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c00 expref: 29 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.378277:0:166113:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000378a069e/0x3234de053ca2a51 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [561152->659455] (req 561152->565247) gid 0 flags: 0x70000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c00 expref: 29 pid: 166111 timeout: 22763 lvb_type: 0
00000100:00100000:1.0:1651531954.378281:0:166113:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000329eeeee pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:166113:1731745997347136:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531954.378301:0:166113:0:(client.c:2492:ptlrpc_set_wait()) set 000000003176d4e8 going to sleep for 6 seconds
00000100:00100000:0.0:1651531954.378545:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531954.378557:0:166113:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000329eeeee pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:166113:1731745997347136:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651531954.378563:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003ad4b055/0x3234de053ca2b00 lrc: 3/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [585728->589823] (req 585728->589823) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444d57 expref: 29 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.378568:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003ad4b055, rc 0)
00000100:00100000:1.0:1651531954.378578:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a3e5dc72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+29:680971:x1731754467276416:12345-10.240.43.64@tcp:101:fio.0 Request processed in 336us (390us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531954.378580:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44322
00000100:00100000:1.0:1651531954.378588:0:166104:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467276480
00010000:00010000:1.0:1651531954.378592:0:166104:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000378a069e/0x3234de053ca2a51 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [561152->659455] (req 561152->565247) gid 0 flags: 0x60000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c00 expref: 29 pid: 166111 timeout: 22763 lvb_type: 0
00000100:00100000:1.0:1651531954.378599:0:166104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 102
00000100:00100000:1.0:1651531954.378600:0:166104:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005ad0bdd2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+29:438147:x1731754467276480:12345-10.240.43.64@tcp:103:ldlm_bl_04.0
00010000:00010000:1.0:1651531954.378603:0:166104:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1651531954.378606:0:166104:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000378a069e/0x3234de053ca2a51 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [561152->659455] (req 561152->565247) gid 0 flags: 0x60000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c00 expref: 29 pid: 166111 timeout: 22763 lvb_type: 0
00010000:00010000:1.0:1651531954.378610:0:166104:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000378a069e/0x3234de053ca2a51 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [561152->659455] (req 561152->565247) gid 0 flags: 0x50000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c00 expref: 29 pid: 166111 timeout: 22763 lvb_type: 0
00010000:00010000:1.0:1651531954.378615:0:166104:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000378a069e/0x3234de053ca2a51 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [561152->659455] (req 561152->565247) gid 0 flags: 0x44801400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c00 expref: 29 pid: 166111 timeout: 22763 lvb_type: 0
00010000:00010000:1.0:1651531954.378619:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531954.378629:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531954.378632:0:166104:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003ad4b055/0x3234de053ca2b00 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [585728->659455] (req 585728->589823) gid 0 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444d57 expref: 28 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.378635:0:166104:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003ad4b055/0x3234de053ca2b00 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [585728->659455] (req 585728->589823) gid 0 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444d57 expref: 28 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.378643:0:166104:0:(ldlm_lockd.c:1067:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003ad4b055/0x3234de053ca2b00 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [585728->659455] (req 585728->589823) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444d57 expref: 28 pid: 166113 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531954.378647:0:166104:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000329eeeee pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:166104:1731745997347200:10.240.43.64@tcp:105:
00000100:00100000:1.0:1651531954.378656:0:166104:0:(client.c:2492:ptlrpc_set_wait()) set 000000003176d4e8 going to sleep for 6 seconds
00000100:00100000:1.0:1651531954.378874:0:166104:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000329eeeee pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:166104:1731745997347200:10.240.43.64@tcp:105:
00010000:00010000:1.0:1651531954.378879:0:166104:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1651531954.378887:0:166104:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005ad0bdd2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+28:438147:x1731754467276480:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 286us (343us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531954.378890:0:166104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 102
00000100:00100000:0.0:1651531954.379170:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.379178:0:216322:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467276608
00002000:00100000:0.0:1651531954.379194:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34545:0x0] (204800->212991)  req@00000000bf97c5e4 x1731754467276608/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/0 e 0 to 0 dl 1651531960 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:0.0:1651531954.379198:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000bf97c5e4 with x1731754467276608 ext(204800->212991)
00002000:00010000:0.0:1651531954.379199:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000bf97c5e4
00000100:00100000:0.0:1651531954.379213:0:216322:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249574
00000100:00100000:0.0:1651531954.379214:0:216322:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bf97c5e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+28:438146:x1731754467276608:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651531954.379257:0:216322:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bf97c5e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+28:438146:x1731754467276608:12345-10.240.43.64@tcp:3:fio.0 Request processed in 42us (87us total) trans 0 rc 8192/8192
00000100:00100000:0.0:1651531954.379260:0:216322:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249574
00002000:00100000:0.0:1651531954.379262:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34545:0x0] (204800->212991)  req@00000000bf97c5e4 x1731754467276608/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/8632 e 0 to 0 dl 1651531960 ref 1 fl Complete:/0/0 rc 8192/8192 job:'fio.0'
00002000:00100000:0.0:1651531954.379266:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000bf97c5e4 with x1731754467276608 ext(204800->212991)
00002000:00010000:0.0:1651531954.379267:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000bf97c5e4
00000001:00080000:0.0:1651531954.425544:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869058 is committed
00010000:00010000:1.0:1651531954.425578:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000df4fd81c/0x3234de053ca2a97 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [372736->376831] (req 372736->376831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.425582:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000df4fd81c/0x3234de053ca2a97 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [372736->376831] (req 372736->376831) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531954.425604:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008b42dfe9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+23:438147:x1731754467269888:12345-10.240.43.64@tcp:4:fio.0 Request processed in 67886us (67923us total) trans 21474869057 rc 0/0
00000100:00100000:1.0:1651531954.425607:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249564
00010000:00010000:1.0:1651531954.425616:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000df4fd81c/0x3234de053ca2a97 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [372736->376831] (req 372736->376831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.425631:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000df4fd81c already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531954.425632:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000df4fd81c/0x3234de053ca2a97 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [372736->376831] (req 372736->376831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.425643:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000df4fd81c/0x3234de053ca2a97 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [372736->376831] (req 372736->376831) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.425653:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca2aa5 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [61440->65535] (req 61440->65535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.425658:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca2aa5 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [61440->65535] (req 61440->65535) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.425662:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000df4fd81c/0x3234de053ca2a97 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [372736->376831] (req 372736->376831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.425665:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000df4fd81c/0x3234de053ca2a97 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [372736->376831] (req 372736->376831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.425669:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca2aa5 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [61440->65535] (req 61440->65535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.425671:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006878f48a already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531954.425672:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca2aa5 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [61440->65535] (req 61440->65535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531954.425677:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000042195ef3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+22:438147:x1731754467270080:12345-10.240.43.64@tcp:4:fio.0 Request processed in 67481us (67537us total) trans 21474869058 rc 0/0
00010000:00010000:1.0:1651531954.425680:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca2aa5 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [61440->65535] (req 61440->65535) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531954.425680:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249566
00010000:00010000:1.0:1651531954.425684:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca2aa5 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [61440->65535] (req 61440->65535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.425687:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca2aa5 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [61440->65535] (req 61440->65535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531954.426006:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.426016:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467277376
00000100:00100000:0.0:1651531954.426031:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249575
00000100:00100000:0.0:1651531954.426040:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000021211ea5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+22:438147:x1731754467277376:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531954.426047:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d9e7472/0x3234de053ca2b07 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.426053:0:216321:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000c9190a4/0x3234de053ca29e1 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [884736->18446744073709551615] (req 884736->888831) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444b89 expref: 22 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.426057:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531954.426057:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531954.426058:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000d9e7472/0x3234de053ca2b07 lrc: 4/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [888832->892927] (req 888832->892927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.426066:0:216321:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000c9190a4/0x3234de053ca29e1 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [884736->18446744073709551615] (req 884736->888831) gid 0 flags: 0x50000000020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444b89 expref: 22 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.426070:0:216321:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000c9190a4/0x3234de053ca29e1 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [884736->18446744073709551615] (req 884736->888831) gid 0 flags: 0x70000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444b89 expref: 22 pid: 166112 timeout: 22763 lvb_type: 0
00000100:00100000:0.0:1651531954.426074:0:216321:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000026ff6271 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997347264:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531954.426086:0:216321:0:(client.c:2492:ptlrpc_set_wait()) set 0000000060d3a5ac going to sleep for 6 seconds
00000100:00100000:0.0:1651531954.427736:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.427749:0:216321:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000026ff6271 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997347264:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651531954.427754:0:216321:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000d9e7472/0x3234de053ca2b07 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [888832->892927] (req 888832->892927) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531954.427758:0:166104:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467277568
00010000:00010000:1.0:1651531954.427764:0:166104:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000c9190a4/0x3234de053ca29e1 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [884736->18446744073709551615] (req 884736->888831) gid 0 flags: 0x60000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444b89 expref: 23 pid: 166112 timeout: 22763 lvb_type: 0
00000100:00100000:1.0:1651531954.427773:0:166104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 103
00000100:00100000:1.0:1651531954.427774:0:166104:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001ae5624b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+23:438146:x1731754467277568:12345-10.240.43.64@tcp:103:ldlm_bl_01.0
00010000:00010000:1.0:1651531954.427778:0:166104:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1651531954.427781:0:166104:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000c9190a4/0x3234de053ca29e1 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [884736->18446744073709551615] (req 884736->888831) gid 0 flags: 0x60000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444b89 expref: 23 pid: 166112 timeout: 22763 lvb_type: 0
00010000:00010000:1.0:1651531954.427785:0:166104:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000c9190a4/0x3234de053ca29e1 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [884736->18446744073709551615] (req 884736->888831) gid 0 flags: 0x50000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444b89 expref: 23 pid: 166112 timeout: 22763 lvb_type: 0
00010000:00010000:1.0:1651531954.427791:0:166104:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000c9190a4/0x3234de053ca29e1 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [884736->18446744073709551615] (req 884736->888831) gid 0 flags: 0x44801400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444b89 expref: 23 pid: 166112 timeout: 22763 lvb_type: 0
00010000:00010000:1.0:1651531954.427795:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531954.427796:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531954.427797:0:166104:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000d9e7472/0x3234de053ca2b07 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [888832->892927] (req 888832->892927) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.427800:0:166104:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000d9e7472/0x3234de053ca2b07 lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [888832->892927] (req 888832->892927) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.427813:0:166104:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1651531954.427822:0:166104:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001ae5624b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+22:438146:x1731754467277568:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 47us (87us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531954.427826:0:166104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 103
00010000:00010000:0.0:1651531954.427826:0:216321:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000d9e7472/0x3234de053ca2b07 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 18 type: EXT [888832->892927] (req 888832->892927) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.427840:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000d9e7472/0x3234de053ca2b07 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 18 type: EXT [888832->892927] (req 888832->892927) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531954.451691:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531954.451715:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467278016
00002000:00100000:1.0:1651531954.451724:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x34545:0x0] (503808->520191)  req@0000000026ff6271 x1731754467278016/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/0 e 0 to 0 dl 1651531960 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:1.0:1651531954.451729:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000026ff6271 with x1731754467278016 ext(503808->520191)
00002000:00010000:1.0:1651531954.451730:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000026ff6271
00000100:00100000:1.0:1651531954.451740:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249576
00000100:00100000:1.0:1651531954.451742:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000026ff6271 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+24:438146:x1731754467278016:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651531954.451774:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000026ff6271 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+24:438146:x1731754467278016:12345-10.240.43.64@tcp:3:fio.0 Request processed in 31us (83us total) trans 0 rc 16384/16384
00000100:00100000:1.0:1651531954.451777:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249576
00002000:00100000:1.0:1651531954.451779:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x34545:0x0] (503808->520191)  req@0000000026ff6271 x1731754467278016/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/16824 e 0 to 0 dl 1651531960 ref 1 fl Complete:/0/0 rc 16384/16384 job:'fio.0'
00002000:00100000:1.0:1651531954.451783:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000026ff6271 with x1731754467278016 ext(503808->520191)
00002000:00010000:1.0:1651531954.451784:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000026ff6271
00000100:00100000:0.0:1651531954.451985:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531954.452013:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467278144
00000100:00100000:1.0:1651531954.452023:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44323
00000100:00100000:1.0:1651531954.452025:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b597647e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+24:680970:x1731754467278144:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531954.452028:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531954.452033:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca2b0e lrc: 2/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db444d6c expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.452039:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531954.452040:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531954.452043:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca2b0e lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [929792->18446744073709551615] (req 929792->933887) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444d6c expref: 25 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.452048:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca2b0e lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [929792->18446744073709551615] (req 929792->933887) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444d6c expref: 25 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.452052:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006878f48a, rc 0)
00000100:00100000:1.0:1651531954.452062:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b597647e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+25:680970:x1731754467278144:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (77us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531954.452065:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44323
00000100:00100000:0.0:1651531954.452483:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531954.452506:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467278272
00002000:00100000:1.0:1651531954.452513:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x34545:0x0] (532480->561151)  req@00000000f44eba0f x1731754467278272/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/0 e 0 to 0 dl 1651531960 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:1.0:1651531954.452517:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000f44eba0f with x1731754467278272 ext(532480->561151)
00002000:00010000:1.0:1651531954.452518:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000f44eba0f
00000100:00100000:1.0:1651531954.452528:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249577
00000100:00100000:1.0:1651531954.452530:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f44eba0f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+25:438147:x1731754467278272:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651531954.452751:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f44eba0f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+25:438147:x1731754467278272:12345-10.240.43.64@tcp:3:fio.0 Request processed in 220us (268us total) trans 0 rc 28672/28672
00000100:00100000:1.0:1651531954.452754:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249577
00002000:00100000:1.0:1651531954.452757:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x34545:0x0] (532480->561151)  req@00000000f44eba0f x1731754467278272/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/440 e 0 to 0 dl 1651531960 ref 1 fl Complete:/0/0 rc 28672/28672 job:'fio.0'
00002000:00100000:1.0:1651531954.452760:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000f44eba0f with x1731754467278272 ext(532480->561151)
00002000:00010000:1.0:1651531954.452762:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000f44eba0f
00000100:00100000:1.0:1651531954.454022:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.454022:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.454038:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467278720
00000100:00100000:1.0:1651531954.454040:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467278592
00000100:00100000:0.0:1651531954.454046:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44324
00000100:00100000:0.0:1651531954.454048:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000329eeeee pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+26:680969:x1731754467278720:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651531954.454053:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249578
00000100:00100000:1.0:1651531954.454055:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e3025285 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+26:438149:x1731754467278592:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531954.454058:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531954.454062:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000df4fd81c/0x3234de053ca2b15 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.454063:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004b7d0a41/0x3234de053ca2b1c lrc: 2/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db444d88 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.454068:0:166118:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ce7f2d16/0x3234de053ca2aac lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [454656->520191] (req 454656->458751) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c8c expref: 27 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.454071:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531954.454072:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531954.454072:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000df4fd81c/0x3234de053ca2b15 lrc: 4/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [458752->462847] (req 458752->462847) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.454077:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531954.454078:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531954.454080:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b7d0a41/0x3234de053ca2b1c lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [794624->823295] (req 794624->798719) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444d88 expref: 27 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.454085:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004b7d0a41/0x3234de053ca2b1c lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [794624->823295] (req 794624->798719) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444d88 expref: 27 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.454087:0:166118:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ce7f2d16/0x3234de053ca2aac lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [454656->520191] (req 454656->458751) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c8c expref: 27 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.454092:0:166118:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ce7f2d16/0x3234de053ca2aac lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [454656->520191] (req 454656->458751) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c8c expref: 27 pid: 206699 timeout: 22763 lvb_type: 0
00000100:00100000:1.0:1651531954.454096:0:166118:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001f3a0807 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:166118:1731745997347328:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651531954.454097:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004b7d0a41, rc 0)
00000100:00100000:1.0:1651531954.454108:0:166118:0:(client.c:2492:ptlrpc_set_wait()) set 000000001a1ce0e5 going to sleep for 6 seconds
00000100:00100000:0.0:1651531954.454108:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000329eeeee pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+27:680969:x1731754467278720:12345-10.240.43.64@tcp:101:fio.0 Request processed in 59us (86us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531954.454111:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44324
00000100:00100000:1.0:1651531954.454425:0:166118:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001f3a0807 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:166118:1731745997347328:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651531954.454430:0:166118:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000df4fd81c/0x3234de053ca2b15 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [458752->462847] (req 458752->462847) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531954.454639:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531954.454665:0:216322:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467278976
00002000:00100000:1.0:1651531954.454673:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34545:0x0] (0->933887)  req@00000000b733fd98 x1731754467278976/t0(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 744/0 e 0 to 0 dl 1651531960 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:1.0:1651531954.454678:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000b733fd98 with x1731754467278976 ext(0->933887)
00010000:00010000:1.0:1651531954.454681:0:216322:0:(ldlm_lockd.c:599:ldlm_refresh_waiting_lock()) ### refreshed to 81s ns: filter-lustre-OST0001_UUID lock: 00000000ce7f2d16/0x3234de053ca2aac lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [454656->520191] (req 454656->458751) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c8c expref: 27 pid: 206699 timeout: 22763 lvb_type: 0
00002000:00010000:1.0:1651531954.454685:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req 00000000b733fd98
00000100:00100000:1.0:1651531954.454691:0:216322:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 9
00000100:00100000:1.0:1651531954.454693:0:216322:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b733fd98 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+27:438149:x1731754467278976:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651531954.455512:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.455535:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467279232
00000100:00100000:0.0:1651531954.455547:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44325
00000100:00100000:0.0:1651531954.455548:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f3a0807 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+28:680971:x1731754467279232:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531954.455552:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531954.455556:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a0fea916/0x3234de053ca2b23 lrc: 2/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db444d96 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.455562:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531954.455563:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531954.455565:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0fea916/0x3234de053ca2b23 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [909312->929791] (req 909312->913407) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444d96 expref: 29 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.455570:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a0fea916/0x3234de053ca2b23 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [909312->929791] (req 909312->913407) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444d96 expref: 29 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.455574:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a0fea916, rc 0)
00000100:00100000:0.0:1651531954.455585:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f3a0807 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+29:680971:x1731754467279232:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (73us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531954.455587:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44325
00000100:00100000:1.0:1651531954.456047:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531954.456055:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467279424
00002000:00100000:1.0:1651531954.456061:0:192755:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x100010000:0x34545:0x0] (172032->180223)  req@000000007d76765b x1731754467279424/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/0 e 0 to 0 dl 1651531960 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:1.0:1651531954.456065:0:192755:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000007d76765b with x1731754467279424 ext(172032->180223)
00002000:00010000:1.0:1651531954.456066:0:192755:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000007d76765b
00000100:00100000:1.0:1651531954.456077:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249579
00000100:00100000:1.0:1651531954.456079:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007d76765b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+29:438149:x1731754467279424:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651531954.456107:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007d76765b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+29:438149:x1731754467279424:12345-10.240.43.64@tcp:3:fio.0 Request processed in 28us (60us total) trans 0 rc 8192/8192
00000100:00100000:1.0:1651531954.456110:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249579
00002000:00100000:1.0:1651531954.456112:0:192755:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x100010000:0x34545:0x0] (172032->180223)  req@000000007d76765b x1731754467279424/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/8632 e 0 to 0 dl 1651531960 ref 1 fl Complete:/0/0 rc 8192/8192 job:'fio.0'
00002000:00100000:1.0:1651531954.456116:0:192755:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000007d76765b with x1731754467279424 ext(172032->180223)
00002000:00010000:1.0:1651531954.456117:0:192755:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000007d76765b
00000100:00100000:1.0:1651531954.456680:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531954.456694:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531954.456702:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467279680
00000100:00100000:0.0:1651531954.456702:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467279552
00002000:00100000:1.0:1651531954.456709:0:192755:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x100010000:0x34545:0x0] (913408->929791)  req@00000000dce6a2c5 x1731754467279680/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/0 e 0 to 0 dl 1651531960 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00000100:00100000:0.0:1651531954.456713:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44326
00000100:00100000:0.0:1651531954.456714:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000067181b35 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+30:680971:x1731754467279552:12345-10.240.43.64@tcp:101:fio.0
00002000:00100000:1.0:1651531954.456718:0:192755:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000dce6a2c5 with x1731754467279680 ext(913408->929791)
00010000:00010000:0.0:1651531954.456718:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00002000:00010000:1.0:1651531954.456720:0:192755:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000dce6a2c5
00010000:00010000:0.0:1651531954.456721:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003cf86247/0x3234de053ca2b2a lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 23 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db444da4 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531954.456728:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249580
00000100:00100000:1.0:1651531954.456730:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dce6a2c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+30:438146:x1731754467279680:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531954.456733:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531954.456743:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531954.456745:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003cf86247/0x3234de053ca2b2a lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 23 type: EXT [434176->454655] (req 434176->438271) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444da4 expref: 31 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.456750:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003cf86247/0x3234de053ca2b2a lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 23 type: EXT [434176->454655] (req 434176->438271) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444da4 expref: 31 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.456754:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003cf86247, rc 0)
00000100:00100000:1.0:1651531954.456760:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dce6a2c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+31:438146:x1731754467279680:12345-10.240.43.64@tcp:3:fio.0 Request processed in 29us (65us total) trans 0 rc 16384/16384
00000100:00100000:1.0:1651531954.456763:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249580
00002000:00100000:1.0:1651531954.456765:0:192755:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x100010000:0x34545:0x0] (913408->929791)  req@00000000dce6a2c5 x1731754467279680/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/16824 e 0 to 0 dl 1651531960 ref 1 fl Complete:/0/0 rc 16384/16384 job:'fio.0'
00002000:00100000:1.0:1651531954.456768:0:192755:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000dce6a2c5 with x1731754467279680 ext(913408->929791)
00002000:00010000:1.0:1651531954.456769:0:192755:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000dce6a2c5
00000100:00100000:0.0:1651531954.456773:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000067181b35 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+31:680971:x1731754467279552:12345-10.240.43.64@tcp:101:fio.0 Request processed in 58us (94us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531954.456776:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44326
00000100:00100000:1.0:1651531954.457499:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531954.457520:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.457521:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467279872
00000100:00100000:1.0:1651531954.457534:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467280000
00002000:00100000:0.0:1651531954.457534:0:192753:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x100010000:0x34545:0x0] (434176->454655)  req@0000000028779db6 x1731754467279872/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/0 e 0 to 0 dl 1651531960 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:0.0:1651531954.457538:0:192753:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000028779db6 with x1731754467279872 ext(434176->454655)
00002000:00010000:0.0:1651531954.457539:0:192753:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000028779db6
00000100:00100000:1.0:1651531954.457542:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44327
00000100:00100000:1.0:1651531954.457543:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002d3e5ae4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+31:680969:x1731754467280000:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651531954.457548:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249581
00000100:00100000:0.0:1651531954.457550:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000028779db6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+31:438148:x1731754467279872:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531954.457552:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531954.457556:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000378a069e/0x3234de053ca2b31 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 24 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db444db2 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.457566:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531954.457567:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531954.457570:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000378a069e/0x3234de053ca2b31 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 24 type: EXT [561152->585727] (req 561152->565247) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444db2 expref: 33 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.457574:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000378a069e/0x3234de053ca2b31 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 24 type: EXT [561152->585727] (req 561152->565247) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444db2 expref: 33 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.457578:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000378a069e, rc 0)
00000100:00100000:1.0:1651531954.457588:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002d3e5ae4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+33:680969:x1731754467280000:12345-10.240.43.64@tcp:101:fio.0 Request processed in 44us (68us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531954.457591:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44327
00000100:00100000:0.0:1651531954.457958:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000028779db6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+31:438148:x1731754467279872:12345-10.240.43.64@tcp:3:fio.0 Request processed in 407us (459us total) trans 0 rc 20480/20480
00000100:00100000:0.0:1651531954.457961:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249581
00002000:00100000:0.0:1651531954.457964:0:192753:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x100010000:0x34545:0x0] (434176->454655)  req@0000000028779db6 x1731754467279872/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/440 e 0 to 0 dl 1651531960 ref 1 fl Complete:/0/0 rc 20480/20480 job:'fio.0'
00002000:00100000:0.0:1651531954.457968:0:192753:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000028779db6 with x1731754467279872 ext(434176->454655)
00002000:00010000:0.0:1651531954.457969:0:192753:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000028779db6
00000100:00100000:1.0:1651531954.458132:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.458146:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467280192
00002000:00100000:0.0:1651531954.458161:0:192753:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x100010000:0x34545:0x0] (561152->585727)  req@00000000670433b4 x1731754467280192/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/0 e 0 to 0 dl 1651531960 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:0.0:1651531954.458165:0:192753:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000670433b4 with x1731754467280192 ext(561152->585727)
00002000:00010000:0.0:1651531954.458166:0:192753:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000670433b4
00000100:00100000:0.0:1651531954.458176:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249582
00000100:00100000:0.0:1651531954.458177:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000670433b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+31:438147:x1731754467280192:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651531954.458405:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000670433b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+31:438147:x1731754467280192:12345-10.240.43.64@tcp:3:fio.0 Request processed in 226us (273us total) trans 0 rc 24576/24576
00000100:00100000:0.0:1651531954.458408:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249582
00002000:00100000:0.0:1651531954.458411:0:192753:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x100010000:0x34545:0x0] (561152->585727)  req@00000000670433b4 x1731754467280192/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/440 e 0 to 0 dl 1651531960 ref 1 fl Complete:/0/0 rc 24576/24576 job:'fio.0'
00002000:00100000:0.0:1651531954.458414:0:192753:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000670433b4 with x1731754467280192 ext(561152->585727)
00002000:00010000:0.0:1651531954.458415:0:192753:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000670433b4
00000100:00100000:1.0:1651531954.458507:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.458520:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467280448
00002000:00100000:0.0:1651531954.458527:0:192753:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x100010000:0x34545:0x0] (139264->172031)  req@00000000dccc50c6 x1731754467280448/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/0 e 0 to 0 dl 1651531960 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:0.0:1651531954.458531:0:192753:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000dccc50c6 with x1731754467280448 ext(139264->172031)
00002000:00010000:0.0:1651531954.458532:0:192753:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000dccc50c6
00000100:00100000:0.0:1651531954.458539:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249583
00000100:00100000:0.0:1651531954.458541:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dccc50c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+31:438149:x1731754467280448:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651531954.458796:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dccc50c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+31:438149:x1731754467280448:12345-10.240.43.64@tcp:3:fio.0 Request processed in 254us (289us total) trans 0 rc 32768/32768
00000100:00100000:0.0:1651531954.458799:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249583
00002000:00100000:0.0:1651531954.458801:0:192753:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x100010000:0x34545:0x0] (139264->172031)  req@00000000dccc50c6 x1731754467280448/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/440 e 0 to 0 dl 1651531960 ref 1 fl Complete:/0/0 rc 32768/32768 job:'fio.0'
00002000:00100000:0.0:1651531954.458813:0:192753:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000dccc50c6 with x1731754467280448 ext(139264->172031)
00002000:00010000:0.0:1651531954.458814:0:192753:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000dccc50c6
00000001:00080000:0.0:1651531954.462263:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869059 is committed
00010000:00010000:0.0:1651531954.462281:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d9e7472/0x3234de053ca2b07 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 24 type: EXT [888832->892927] (req 888832->892927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.462285:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000d9e7472/0x3234de053ca2b07 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 24 type: EXT [888832->892927] (req 888832->892927) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531954.462300:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000021211ea5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+29:438147:x1731754467277376:12345-10.240.43.64@tcp:4:fio.0 Request processed in 36260us (36294us total) trans 21474869059 rc 0/0
00000100:00100000:0.0:1651531954.462303:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249575
00010000:00010000:0.0:1651531954.462309:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000d9e7472/0x3234de053ca2b07 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 24 type: EXT [888832->892927] (req 888832->892927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.462313:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000d9e7472 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531954.462314:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000d9e7472/0x3234de053ca2b07 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 24 type: EXT [888832->892927] (req 888832->892927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.462317:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000d9e7472/0x3234de053ca2b07 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 24 type: EXT [888832->892927] (req 888832->892927) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.462322:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000d9e7472/0x3234de053ca2b07 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 24 type: EXT [888832->892927] (req 888832->892927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.462325:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000d9e7472/0x3234de053ca2b07 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 24 type: EXT [888832->892927] (req 888832->892927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531954.462894:0:216322:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b733fd98 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+29:438149:x1731754467278976:12345-10.240.43.64@tcp:4:fio.0 Request processed in 8199us (8254us total) trans 21474869060 rc 0/0
00000100:00100000:1.0:1651531954.462897:0:216322:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 9
00002000:00100000:1.0:1651531954.462900:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34545:0x0] (0->933887)  req@00000000b733fd98 x1731754467278976/t21474869060(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 744/512 e 0 to 0 dl 1651531960 ref 1 fl Complete:H/0/0 rc 0/0 job:'fio.0'
00002000:00100000:1.0:1651531954.462904:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000b733fd98 with x1731754467278976 ext(0->933887)
00010000:00010000:1.0:1651531954.462908:0:216322:0:(ldlm_lockd.c:599:ldlm_refresh_waiting_lock()) ### refreshed to 81s ns: filter-lustre-OST0001_UUID lock: 00000000ce7f2d16/0x3234de053ca2aac lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 24 type: EXT [454656->520191] (req 454656->458751) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c8c expref: 29 pid: 206699 timeout: 22763 lvb_type: 0
00002000:00010000:1.0:1651531954.462912:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req 00000000b733fd98
00000100:00100000:0.0:1651531954.463071:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531954.463094:0:216322:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467281088
00002000:00100000:1.0:1651531954.463103:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34545:0x0] (1048576->5242879)  req@00000000ba346551 x1731754467281088/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/0 e 0 to 0 dl 1651531960 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:1.0:1651531954.463106:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000ba346551 with x1731754467281088 ext(1048576->5242879)
00002000:00010000:1.0:1651531954.463108:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000ba346551
00000100:00100000:1.0:1651531954.463117:0:216322:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249584
00000100:00100000:1.0:1651531954.463119:0:216322:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ba346551 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+29:438149:x1731754467281088:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651531954.463308:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.463318:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.463328:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467281152
00002000:00100000:0.0:1651531954.463335:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x34545:0x0] (5242880->6291455)  req@00000000a3e5dc72 x1731754467281152/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/0 e 0 to 0 dl 1651531960 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:0.0:1651531954.463339:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000a3e5dc72 with x1731754467281152 ext(5242880->6291455)
00002000:00010000:0.0:1651531954.463340:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000a3e5dc72
00000100:00100000:0.0:1651531954.463346:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249585
00000100:00100000:0.0:1651531954.463347:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a3e5dc72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+31:438149:x1731754467281152:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651531954.464268:0:166103:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467281280
00010000:00010000:0.0:1651531954.464276:0:166103:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ce7f2d16/0x3234de053ca2aac lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 23 type: EXT [454656->520191] (req 454656->458751) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c8c expref: 33 pid: 206699 timeout: 22763 lvb_type: 0
00000100:00100000:0.0:1651531954.464288:0:166103:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 104
00000100:00100000:0.0:1651531954.464290:0:166103:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b597647e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+33:438148:x1731754467281280:12345-10.240.43.64@tcp:103:ldlm_bl_03.0
00010000:00010000:0.0:1651531954.464294:0:166103:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531954.464297:0:166103:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ce7f2d16/0x3234de053ca2aac lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 24 type: EXT [454656->520191] (req 454656->458751) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c8c expref: 33 pid: 206699 timeout: 22763 lvb_type: 0
00010000:00010000:0.0:1651531954.464302:0:166103:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ce7f2d16/0x3234de053ca2aac lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 24 type: EXT [454656->520191] (req 454656->458751) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c8c expref: 33 pid: 206699 timeout: 22763 lvb_type: 0
00010000:00010000:0.0:1651531954.464309:0:166103:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ce7f2d16/0x3234de053ca2aac lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 24 type: EXT [454656->520191] (req 454656->458751) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c8c expref: 33 pid: 206699 timeout: 22763 lvb_type: 0
00010000:00010000:0.0:1651531954.464315:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531954.464316:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531954.464317:0:166103:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000df4fd81c/0x3234de053ca2b15 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 23 type: EXT [458752->462847] (req 458752->462847) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.464320:0:166103:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000df4fd81c/0x3234de053ca2b15 lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 23 type: EXT [458752->462847] (req 458752->462847) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.464330:0:166103:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651531954.464339:0:166103:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b597647e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+32:438148:x1731754467281280:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 48us (1021us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531954.464342:0:166103:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 104
00010000:00010000:0.0:1651531954.464373:0:166118:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000df4fd81c/0x3234de053ca2b15 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [458752->462847] (req 458752->462847) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.464377:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000df4fd81c/0x3234de053ca2b15 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [458752->462847] (req 458752->462847) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531954.465920:0:216322:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ba346551 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+32:438149:x1731754467281088:12345-10.240.43.64@tcp:3:fio.0 Request processed in 2799us (2848us total) trans 0 rc 4194304/4194304
00000100:00100000:1.0:1651531954.465924:0:216322:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249584
00002000:00100000:1.0:1651531954.465927:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34545:0x0] (1048576->5242879)  req@00000000ba346551 x1731754467281088/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/440 e 0 to 0 dl 1651531960 ref 1 fl Complete:/0/0 rc 4194304/4194304 job:'fio.0'
00002000:00100000:1.0:1651531954.465931:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000ba346551 with x1731754467281088 ext(1048576->5242879)
00002000:00010000:1.0:1651531954.465933:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000ba346551
00000100:00100000:0.0:1651531954.466553:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a3e5dc72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+30:438149:x1731754467281152:12345-10.240.43.64@tcp:3:fio.0 Request processed in 3204us (3245us total) trans 0 rc 1048576/1048576
00000100:00100000:0.0:1651531954.466557:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249585
00002000:00100000:0.0:1651531954.466560:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x34545:0x0] (5242880->6291455)  req@00000000a3e5dc72 x1731754467281152/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/440 e 0 to 0 dl 1651531960 ref 1 fl Complete:/0/0 rc 1048576/1048576 job:'fio.0'
00002000:00100000:0.0:1651531954.466563:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000a3e5dc72 with x1731754467281152 ext(5242880->6291455)
00002000:00010000:0.0:1651531954.466565:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000a3e5dc72
00000100:00100000:0.0:1651531954.468882:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.468899:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531954.468909:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467282048
00000100:00100000:1.0:1651531954.468921:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467282112
00000100:00100000:1.0:1651531954.468925:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44328
00000100:00100000:1.0:1651531954.468928:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007a05c3e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+31:680971:x1731754467282048:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531954.468931:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651531954.468932:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44329
00000100:00100000:0.0:1651531954.468934:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005dd15341 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+31:680970:x1731754467282112:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531954.468936:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000141899af/0x3234de053ca2b38 lrc: 2/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 23 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db444de3 expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.468938:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531954.468942:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000d9e7472/0x3234de053ca2b3f lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 24 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db444dea expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.468944:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531954.468944:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531954.468947:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000141899af/0x3234de053ca2b38 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 24 type: EXT [401408->434175] (req 401408->405503) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444de3 expref: 33 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.468957:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531954.468957:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531954.468960:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000d9e7472/0x3234de053ca2b3f lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 24 type: EXT [475136->524287] (req 475136->479231) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444dea expref: 33 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.468965:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000141899af/0x3234de053ca2b38 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 25 type: EXT [401408->434175] (req 401408->405503) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444de3 expref: 33 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.468965:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000d9e7472/0x3234de053ca2b3f lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 25 type: EXT [475136->524287] (req 475136->479231) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444dea expref: 33 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.468969:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000000d9e7472, rc 0)
00010000:00010000:1.0:1651531954.468970:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000141899af, rc 0)
00000100:00100000:0.0:1651531954.468982:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005dd15341 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+33:680970:x1731754467282112:12345-10.240.43.64@tcp:101:fio.0 Request processed in 48us (83us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531954.468985:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44329
00000100:00100000:1.0:1651531954.468992:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007a05c3e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+32:680971:x1731754467282048:12345-10.240.43.64@tcp:101:fio.0 Request processed in 64us (110us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531954.468995:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44328
00000100:00100000:0.0:1651531954.469356:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.469363:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467282304
00002000:00100000:0.0:1651531954.469370:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x34545:0x0] (475136->524287)  req@000000002ef35a72 x1731754467282304/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/0 e 0 to 0 dl 1651531960 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:0.0:1651531954.469374:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000002ef35a72 with x1731754467282304 ext(475136->524287)
00002000:00010000:0.0:1651531954.469376:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000002ef35a72
00000100:00100000:0.0:1651531954.469388:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249586
00000100:00100000:0.0:1651531954.469390:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002ef35a72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+32:438147:x1731754467282304:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651531954.470063:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002ef35a72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+32:438147:x1731754467282304:12345-10.240.43.64@tcp:3:fio.0 Request processed in 672us (707us total) trans 0 rc 49152/49152
00000100:00100000:0.0:1651531954.470066:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249586
00002000:00100000:0.0:1651531954.470068:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x34545:0x0] (475136->524287)  req@000000002ef35a72 x1731754467282304/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/440 e 0 to 0 dl 1651531960 ref 1 fl Complete:/0/0 rc 49152/49152 job:'fio.0'
00002000:00100000:0.0:1651531954.470072:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000002ef35a72 with x1731754467282304 ext(475136->524287)
00002000:00010000:0.0:1651531954.470073:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000002ef35a72
00000100:00100000:0.0:1651531954.470445:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.470453:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467282688
00002000:00100000:0.0:1651531954.470459:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x34545:0x0] (1028096->1048575)  req@000000003d9ef3c1 x1731754467282688/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 504/0 e 0 to 0 dl 1651531960 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:0.0:1651531954.470463:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000003d9ef3c1 with x1731754467282688 ext(1028096->1048575)
00002000:00010000:0.0:1651531954.470464:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000003d9ef3c1
00000100:00100000:0.0:1651531954.470476:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249587
00000100:00100000:0.0:1651531954.470478:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003d9ef3c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+32:438147:x1731754467282688:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651531954.470665:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003d9ef3c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+32:438147:x1731754467282688:12345-10.240.43.64@tcp:3:fio.0 Request processed in 186us (220us total) trans 0 rc 16384/16384
00000100:00100000:0.0:1651531954.470669:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249587
00002000:00100000:0.0:1651531954.470671:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x34545:0x0] (1028096->1048575)  req@000000003d9ef3c1 x1731754467282688/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 504/440 e 0 to 0 dl 1651531960 ref 1 fl Complete:/0/0 rc 16384/16384 job:'fio.0'
00002000:00100000:0.0:1651531954.470674:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000003d9ef3c1 with x1731754467282688 ext(1028096->1048575)
00002000:00010000:0.0:1651531954.470676:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000003d9ef3c1
00000100:00100000:0.0:1651531954.470953:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531954.470974:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467282944
00000100:00100000:1.0:1651531954.470986:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44330
00000100:00100000:1.0:1651531954.470988:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006e255cae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+32:680970:x1731754467282944:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531954.470991:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531954.470995:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca2b46 lrc: 2/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 25 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db444e0d expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.471001:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531954.471002:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531954.471004:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca2b46 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 25 type: EXT [753664->794623] (req 753664->757759) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444e0d expref: 33 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.471008:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca2b46 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 25 type: EXT [753664->794623] (req 753664->757759) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444e0d expref: 33 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.471012:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f6135e30, rc 0)
00000100:00100000:1.0:1651531954.471026:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006e255cae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+33:680970:x1731754467282944:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (73us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531954.471029:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44330
00000100:00100000:0.0:1651531954.471786:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.471795:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467283392
00002000:00100000:0.0:1651531954.471801:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x34545:0x0] (413696->434175)  req@000000009acffcb8 x1731754467283392/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/0 e 0 to 0 dl 1651531960 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:0.0:1651531954.471805:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000009acffcb8 with x1731754467283392 ext(413696->434175)
00002000:00010000:0.0:1651531954.471806:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000009acffcb8
00000100:00100000:0.0:1651531954.471819:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249588
00000100:00100000:0.0:1651531954.471820:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009acffcb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+33:438146:x1731754467283392:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651531954.472007:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009acffcb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+33:438146:x1731754467283392:12345-10.240.43.64@tcp:3:fio.0 Request processed in 185us (221us total) trans 0 rc 20480/20480
00000100:00100000:0.0:1651531954.472010:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249588
00002000:00100000:0.0:1651531954.472013:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x34545:0x0] (413696->434175)  req@000000009acffcb8 x1731754467283392/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/440 e 0 to 0 dl 1651531960 ref 1 fl Complete:/0/0 rc 20480/20480 job:'fio.0'
00002000:00100000:0.0:1651531954.472016:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000009acffcb8 with x1731754467283392 ext(413696->434175)
00002000:00010000:0.0:1651531954.472017:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000009acffcb8
00000100:00100000:0.0:1651531954.472412:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531954.472433:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467283456
00000100:00100000:1.0:1651531954.472442:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44331
00000100:00100000:1.0:1651531954.472444:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d9e74b4c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+33:680970:x1731754467283456:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531954.472447:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531954.472451:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca2b4d lrc: 2/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 26 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db444e1b expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.472456:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531954.472457:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531954.472459:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca2b4d lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 26 type: EXT [729088->753663] (req 729088->733183) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444e1b expref: 34 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.472463:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca2b4d lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 26 type: EXT [729088->753663] (req 729088->733183) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444e1b expref: 34 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.472467:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f58aeba9, rc 0)
00000100:00100000:1.0:1651531954.472478:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d9e74b4c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+34:680970:x1731754467283456:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (67us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531954.472481:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44331
00000100:00100000:0.0:1651531954.473185:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.473193:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467283776
00002000:00100000:0.0:1651531954.473208:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x34545:0x0] (528384->532479)  req@000000000b1a9136 x1731754467283776/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/0 e 0 to 0 dl 1651531960 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:0.0:1651531954.473212:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000000b1a9136 with x1731754467283776 ext(528384->532479)
00002000:00010000:0.0:1651531954.473213:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000000b1a9136
00000100:00100000:0.0:1651531954.473234:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249589
00000100:00100000:0.0:1651531954.473236:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000b1a9136 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+34:438148:x1731754467283776:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651531954.473258:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000b1a9136 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+34:438148:x1731754467283776:12345-10.240.43.64@tcp:3:fio.0 Request processed in 22us (74us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531954.473270:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249589
00002000:00100000:0.0:1651531954.473272:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x34545:0x0] (528384->532479)  req@000000000b1a9136 x1731754467283776/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/4536 e 0 to 0 dl 1651531960 ref 1 fl Complete:/0/0 rc 4096/4096 job:'fio.0'
00002000:00100000:0.0:1651531954.473276:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000000b1a9136 with x1731754467283776 ext(528384->532479)
00002000:00010000:0.0:1651531954.473277:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000000b1a9136
00000100:00100000:0.0:1651531954.473659:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531954.473679:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467283904
00000100:00100000:1.0:1651531954.473690:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44332
00000100:00100000:1.0:1651531954.473692:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000f4bed26 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+34:680970:x1731754467283904:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531954.473695:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531954.473698:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca2b54 lrc: 2/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 27 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db444e3e expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.473704:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531954.473705:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531954.473709:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca2b54 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 27 type: EXT [69632->102399] (req 69632->73727) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444e3e expref: 35 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.473713:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca2b54 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 27 type: EXT [69632->102399] (req 69632->73727) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444e3e expref: 35 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.473717:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c8969b4f, rc 0)
00000100:00100000:1.0:1651531954.473730:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000f4bed26 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+35:680970:x1731754467283904:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (72us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531954.473733:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44332
00000100:00100000:0.0:1651531954.475559:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531954.475581:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467284288
00000100:00100000:1.0:1651531954.475592:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44333
00000100:00100000:1.0:1651531954.475594:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004237e3f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+35:680971:x1731754467284288:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531954.475596:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531954.475600:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca2b5b lrc: 2/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db444e4c expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.475605:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531954.475606:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531954.475608:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca2b5b lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [454656->458751] (req 454656->458751) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444e4c expref: 36 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.475612:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca2b5b lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [454656->458751] (req 454656->458751) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444e4c expref: 36 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.475616:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001cf49bf2, rc 0)
00000100:00100000:1.0:1651531954.475628:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004237e3f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+36:680971:x1731754467284288:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (71us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531954.475634:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44333
00000100:00100000:0.0:1651531954.476109:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.476117:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467284480
00002000:00100000:0.0:1651531954.476123:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x34545:0x0] (307200->315391)  req@000000001e61ed2d x1731754467284480/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/0 e 0 to 0 dl 1651531960 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:0.0:1651531954.476127:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000001e61ed2d with x1731754467284480 ext(307200->315391)
00002000:00010000:0.0:1651531954.476128:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000001e61ed2d
00000100:00100000:0.0:1651531954.476139:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249590
00000100:00100000:0.0:1651531954.476140:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001e61ed2d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+36:438146:x1731754467284480:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651531954.476165:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001e61ed2d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+36:438146:x1731754467284480:12345-10.240.43.64@tcp:3:fio.0 Request processed in 24us (56us total) trans 0 rc 8192/8192
00000100:00100000:0.0:1651531954.476168:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249590
00002000:00100000:0.0:1651531954.476169:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x34545:0x0] (307200->315391)  req@000000001e61ed2d x1731754467284480/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/8632 e 0 to 0 dl 1651531960 ref 1 fl Complete:/0/0 rc 8192/8192 job:'fio.0'
00002000:00100000:0.0:1651531954.476173:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000001e61ed2d with x1731754467284480 ext(307200->315391)
00002000:00010000:0.0:1651531954.476174:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000001e61ed2d
00000100:00100000:0.0:1651531954.477407:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.477414:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467284992
00002000:00100000:0.0:1651531954.477430:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x34545:0x0] (724992->753663)  req@0000000080bc1e67 x1731754467284992/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 504/0 e 0 to 0 dl 1651531960 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:0.0:1651531954.477434:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000080bc1e67 with x1731754467284992 ext(724992->753663)
00002000:00010000:0.0:1651531954.477437:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000080bc1e67
00000100:00100000:0.0:1651531954.477448:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249591
00000100:00100000:0.0:1651531954.477450:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000080bc1e67 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+36:438146:x1731754467284992:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651531954.477636:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000080bc1e67 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+36:438146:x1731754467284992:12345-10.240.43.64@tcp:3:fio.0 Request processed in 185us (229us total) trans 0 rc 20480/20480
00000100:00100000:0.0:1651531954.477639:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249591
00002000:00100000:0.0:1651531954.477642:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x34545:0x0] (724992->753663)  req@0000000080bc1e67 x1731754467284992/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 504/440 e 0 to 0 dl 1651531960 ref 1 fl Complete:/0/0 rc 20480/20480 job:'fio.0'
00002000:00100000:0.0:1651531954.477645:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000080bc1e67 with x1731754467284992 ext(724992->753663)
00002000:00010000:0.0:1651531954.477648:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000080bc1e67
00000100:00100000:0.0:1651531954.480140:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531954.480167:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467286080
00000100:00100000:1.0:1651531954.480180:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44334
00000100:00100000:1.0:1651531954.480182:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cb694635 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+36:680971:x1731754467286080:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531954.480185:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531954.480189:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca2b62 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 29 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db444e8b expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.480195:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531954.480196:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531954.480198:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca2b62 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 29 type: EXT [884736->909311] (req 884736->888831) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444e8b expref: 37 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.480210:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca2b62 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 29 type: EXT [884736->909311] (req 884736->888831) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444e8b expref: 37 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.480214:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000060a6272d, rc 0)
00000100:00100000:1.0:1651531954.480241:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cb694635 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+37:680971:x1731754467286080:12345-10.240.43.64@tcp:101:fio.0 Request processed in 59us (102us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531954.480244:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44334
00000100:00100000:0.0:1651531954.481193:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.481208:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467286336
00002000:00100000:0.0:1651531954.481215:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x34545:0x0] (884736->909311)  req@00000000a9fc5082 x1731754467286336/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/0 e 0 to 0 dl 1651531960 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:0.0:1651531954.481218:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000a9fc5082 with x1731754467286336 ext(884736->909311)
00002000:00010000:0.0:1651531954.481219:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000a9fc5082
00000100:00100000:0.0:1651531954.481242:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249592
00000100:00100000:0.0:1651531954.481244:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a9fc5082 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+37:438149:x1731754467286336:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651531954.481437:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a9fc5082 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+37:438149:x1731754467286336:12345-10.240.43.64@tcp:3:fio.0 Request processed in 191us (244us total) trans 0 rc 24576/24576
00000100:00100000:0.0:1651531954.481451:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249592
00002000:00100000:0.0:1651531954.481453:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x34545:0x0] (884736->909311)  req@00000000a9fc5082 x1731754467286336/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/440 e 0 to 0 dl 1651531960 ref 1 fl Complete:/0/0 rc 24576/24576 job:'fio.0'
00002000:00100000:0.0:1651531954.481457:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000a9fc5082 with x1731754467286336 ext(884736->909311)
00002000:00010000:0.0:1651531954.481458:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000a9fc5082
00000100:00100000:0.0:1651531954.481945:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.481953:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467286592
00002000:00100000:0.0:1651531954.481959:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x34545:0x0] (946176->1028095)  req@00000000c62d1815 x1731754467286592/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 536/0 e 0 to 0 dl 1651531960 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:0.0:1651531954.481963:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000c62d1815 with x1731754467286592 ext(946176->1028095)
00002000:00010000:0.0:1651531954.481964:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000c62d1815
00000100:00100000:0.0:1651531954.481974:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249593
00000100:00100000:0.0:1651531954.481976:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c62d1815 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+37:438146:x1731754467286592:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651531954.482254:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c62d1815 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+37:438146:x1731754467286592:12345-10.240.43.64@tcp:3:fio.0 Request processed in 276us (309us total) trans 0 rc 69632/69632
00000100:00100000:0.0:1651531954.482257:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249593
00002000:00100000:0.0:1651531954.482260:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x34545:0x0] (946176->1028095)  req@00000000c62d1815 x1731754467286592/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 536/440 e 0 to 0 dl 1651531960 ref 1 fl Complete:/0/0 rc 69632/69632 job:'fio.0'
00002000:00100000:0.0:1651531954.482263:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000c62d1815 with x1731754467286592 ext(946176->1028095)
00002000:00010000:0.0:1651531954.482264:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000c62d1815
00000100:00100000:0.0:1651531954.483041:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.483054:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.483062:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467286784
00000100:00100000:1.0:1651531954.483063:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467286848
00000100:00100000:1.0:1651531954.483073:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44335
00000100:00100000:1.0:1651531954.483075:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000096080ff0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+37:680970:x1731754467286848:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531954.483078:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531954.483082:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca2b69 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 30 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db444ea7 expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531954.483084:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44336
00000100:00100000:0.0:1651531954.483085:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000000daaec4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+38:680969:x1731754467286784:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531954.483089:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531954.483093:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531954.483093:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531954.483093:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ce7f2d16/0x3234de053ca2b70 lrc: 2/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 31 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db444ea0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.483096:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca2b69 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 32 type: EXT [466944->524287] (req 466944->471039) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444ea7 expref: 39 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.483101:0:166113:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003cf86247/0x3234de053ca2b2a lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 31 type: EXT [434176->454655] (req 434176->438271) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444da4 expref: 40 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.483105:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531954.483106:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531954.483107:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce7f2d16/0x3234de053ca2b70 lrc: 4/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 31 type: EXT [442368->446463] (req 442368->446463) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444ea0 expref: 40 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.483111:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca2b69 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 31 type: EXT [466944->524287] (req 466944->471039) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444ea7 expref: 40 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.483115:0:166113:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003cf86247/0x3234de053ca2b2a lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 31 type: EXT [434176->454655] (req 434176->438271) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444da4 expref: 40 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.483119:0:166113:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003cf86247/0x3234de053ca2b2a lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 31 type: EXT [434176->454655] (req 434176->438271) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444da4 expref: 40 pid: 166113 timeout: 22763 lvb_type: 0
00010000:00010000:1.0:1651531954.483124:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000022b2104e, rc 0)
00000100:00100000:0.0:1651531954.483124:0:166113:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000067633646 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:166113:1731745997347392:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531954.483136:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000096080ff0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+40:680970:x1731754467286848:12345-10.240.43.64@tcp:101:fio.0 Request processed in 60us (82us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531954.483139:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44335
00000100:00100000:0.0:1651531954.483142:0:166113:0:(client.c:2492:ptlrpc_set_wait()) set 0000000060d3a5ac going to sleep for 6 seconds
00000100:00100000:0.0:1651531954.483374:0:166113:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000067633646 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:166113:1731745997347392:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651531954.483380:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ce7f2d16/0x3234de053ca2b70 lrc: 3/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 31 type: EXT [442368->446463] (req 442368->446463) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444ea0 expref: 39 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.483385:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ce7f2d16, rc 0)
00000100:00100000:0.0:1651531954.483409:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000000daaec4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+39:680969:x1731754467286784:12345-10.240.43.64@tcp:101:fio.0 Request processed in 323us (369us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531954.483412:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44336
00000100:00100000:0.0:1651531954.483550:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.483558:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467286976
00002000:00100000:0.0:1651531954.483565:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x34545:0x0] (466944->475135)  req@0000000067633646 x1731754467286976/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/0 e 0 to 0 dl 1651531960 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:0.0:1651531954.483568:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000067633646 with x1731754467286976 ext(466944->475135)
00002000:00010000:0.0:1651531954.483569:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000067633646
00000100:00100000:0.0:1651531954.483580:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249594
00000100:00100000:0.0:1651531954.483581:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000067633646 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+39:438147:x1731754467286976:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651531954.483628:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000067633646 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+39:438147:x1731754467286976:12345-10.240.43.64@tcp:3:fio.0 Request processed in 46us (79us total) trans 0 rc 8192/8192
00000100:00100000:0.0:1651531954.483631:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249594
00002000:00100000:0.0:1651531954.483633:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x34545:0x0] (466944->475135)  req@0000000067633646 x1731754467286976/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/8632 e 0 to 0 dl 1651531960 ref 1 fl Complete:/0/0 rc 8192/8192 job:'fio.0'
00002000:00100000:0.0:1651531954.483637:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000067633646 with x1731754467286976 ext(466944->475135)
00002000:00010000:0.0:1651531954.483638:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000067633646
00000100:00100000:0.0:1651531954.484092:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.484100:0:166104:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467287168
00010000:00010000:0.0:1651531954.484105:0:166104:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003cf86247/0x3234de053ca2b2a lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 31 type: EXT [434176->454655] (req 434176->438271) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444da4 expref: 39 pid: 166113 timeout: 22763 lvb_type: 0
00000100:00100000:0.0:1651531954.484113:0:166104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 105
00000100:00100000:0.0:1651531954.484115:0:166104:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004428780d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+39:438149:x1731754467287168:12345-10.240.43.64@tcp:103:ldlm_bl_04.0
00010000:00010000:0.0:1651531954.484121:0:166104:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531954.484124:0:166104:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003cf86247/0x3234de053ca2b2a lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 32 type: EXT [434176->454655] (req 434176->438271) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444da4 expref: 39 pid: 166113 timeout: 22763 lvb_type: 0
00010000:00010000:0.0:1651531954.484128:0:166104:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003cf86247/0x3234de053ca2b2a lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 32 type: EXT [434176->454655] (req 434176->438271) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444da4 expref: 39 pid: 166113 timeout: 22763 lvb_type: 0
00010000:00010000:0.0:1651531954.484134:0:166104:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003cf86247/0x3234de053ca2b2a lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 32 type: EXT [434176->454655] (req 434176->438271) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444da4 expref: 39 pid: 166113 timeout: 22763 lvb_type: 0
00010000:00010000:0.0:1651531954.484138:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531954.484139:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531954.484141:0:166104:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ce7f2d16/0x3234de053ca2b70 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 31 type: EXT [442368->454655] (req 442368->446463) gid 0 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444ea0 expref: 38 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.484144:0:166104:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce7f2d16/0x3234de053ca2b70 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 31 type: EXT [442368->454655] (req 442368->446463) gid 0 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444ea0 expref: 38 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.484152:0:166104:0:(ldlm_lockd.c:1067:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ce7f2d16/0x3234de053ca2b70 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 31 type: EXT [442368->454655] (req 442368->446463) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444ea0 expref: 38 pid: 166113 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531954.484156:0:166104:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000da46c1ba pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:166104:1731745997347456:10.240.43.64@tcp:105:
00000100:00100000:0.0:1651531954.484173:0:166104:0:(client.c:2492:ptlrpc_set_wait()) set 0000000060d3a5ac going to sleep for 6 seconds
00000100:00100000:0.0:1651531954.484387:0:166104:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000da46c1ba pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:166104:1731745997347456:10.240.43.64@tcp:105:
00010000:00010000:0.0:1651531954.484391:0:166104:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651531954.484406:0:166104:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004428780d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+38:438149:x1731754467287168:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 290us (314us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531954.484412:0:166104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 105
00000100:00100000:0.0:1651531954.487258:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.487266:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467287808
00002000:00100000:0.0:1651531954.487272:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x34545:0x0] (651264->659455)  req@00000000da46c1ba x1731754467287808/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/0 e 0 to 0 dl 1651531960 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:0.0:1651531954.487276:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000da46c1ba with x1731754467287808 ext(651264->659455)
00002000:00010000:0.0:1651531954.487277:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000da46c1ba
00000100:00100000:0.0:1651531954.487288:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249595
00000100:00100000:0.0:1651531954.487289:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000da46c1ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+38:438149:x1731754467287808:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651531954.487317:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000da46c1ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+38:438149:x1731754467287808:12345-10.240.43.64@tcp:3:fio.0 Request processed in 27us (59us total) trans 0 rc 8192/8192
00000100:00100000:0.0:1651531954.487320:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249595
00002000:00100000:0.0:1651531954.487322:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x34545:0x0] (651264->659455)  req@00000000da46c1ba x1731754467287808/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/8632 e 0 to 0 dl 1651531960 ref 1 fl Complete:/0/0 rc 8192/8192 job:'fio.0'
00002000:00100000:0.0:1651531954.487326:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000da46c1ba with x1731754467287808 ext(651264->659455)
00002000:00010000:0.0:1651531954.487327:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000da46c1ba
00000100:00100000:0.0:1651531954.488556:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.488564:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467288320
00002000:00100000:0.0:1651531954.488570:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x34545:0x0] (708608->724991)  req@00000000c5ed8aca x1731754467288320/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/0 e 0 to 0 dl 1651531960 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:0.0:1651531954.488574:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000c5ed8aca with x1731754467288320 ext(708608->724991)
00002000:00010000:0.0:1651531954.488575:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000c5ed8aca
00000100:00100000:0.0:1651531954.488585:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249596
00000100:00100000:0.0:1651531954.488587:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c5ed8aca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+38:438146:x1731754467288320:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651531954.488616:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c5ed8aca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+38:438146:x1731754467288320:12345-10.240.43.64@tcp:3:fio.0 Request processed in 29us (60us total) trans 0 rc 16384/16384
00000100:00100000:0.0:1651531954.488619:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249596
00002000:00100000:0.0:1651531954.488621:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x34545:0x0] (708608->724991)  req@00000000c5ed8aca x1731754467288320/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/16824 e 0 to 0 dl 1651531960 ref 1 fl Complete:/0/0 rc 16384/16384 job:'fio.0'
00002000:00100000:0.0:1651531954.488625:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000c5ed8aca with x1731754467288320 ext(708608->724991)
00002000:00010000:0.0:1651531954.488626:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000c5ed8aca
00000100:00100000:0.0:1651531954.490526:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.490534:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467288832
00000100:00100000:0.0:1651531954.490546:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44337
00000100:00100000:0.0:1651531954.490548:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ca5b5d4b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+38:680971:x1731754467288832:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531954.490551:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531954.490555:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003cf86247/0x3234de053ca2b77 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 31 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db444ed1 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.490562:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531954.490563:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531954.490565:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003cf86247/0x3234de053ca2b77 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 31 type: EXT [462848->524287] (req 462848->466943) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444ed1 expref: 39 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.490569:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003cf86247/0x3234de053ca2b77 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 31 type: EXT [462848->524287] (req 462848->466943) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444ed1 expref: 39 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.490573:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003cf86247, rc 0)
00000100:00100000:0.0:1651531954.490587:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ca5b5d4b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+39:680971:x1731754467288832:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (61us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531954.490592:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44337
00000100:00100000:0.0:1651531954.491184:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.491192:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467289024
00002000:00100000:0.0:1651531954.491198:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x34545:0x0] (462848->466943)  req@000000008c209124 x1731754467289024/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/0 e 0 to 0 dl 1651531960 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:0.0:1651531954.491211:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000008c209124 with x1731754467289024 ext(462848->466943)
00002000:00010000:0.0:1651531954.491212:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000008c209124
00000100:00100000:0.0:1651531954.491234:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249597
00000100:00100000:0.0:1651531954.491236:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008c209124 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+39:438148:x1731754467289024:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651531954.491262:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008c209124 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+39:438148:x1731754467289024:12345-10.240.43.64@tcp:3:fio.0 Request processed in 25us (78us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531954.491265:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249597
00002000:00100000:0.0:1651531954.491267:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x34545:0x0] (462848->466943)  req@000000008c209124 x1731754467289024/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/4536 e 0 to 0 dl 1651531960 ref 1 fl Complete:/0/0 rc 4096/4096 job:'fio.0'
00002000:00100000:0.0:1651531954.491270:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000008c209124 with x1731754467289024 ext(462848->466943)
00002000:00010000:0.0:1651531954.491271:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000008c209124
00000100:00100000:0.0:1651531954.492568:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.492576:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467289344
00000100:00100000:0.0:1651531954.492588:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44338
00000100:00100000:0.0:1651531954.492589:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a20162bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+39:680969:x1731754467289344:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531954.492593:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531954.492597:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002dfc67f7/0x3234de053ca2b7e lrc: 2/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 32 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db444edf expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.492607:0:166113:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000d9e7472/0x3234de053ca2b3f lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 32 type: EXT [475136->524287] (req 475136->479231) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444dea expref: 40 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.492611:0:166113:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca2b69 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 32 type: EXT [466944->524287] (req 466944->471039) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444ea7 expref: 40 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.492614:0:166113:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003cf86247/0x3234de053ca2b77 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 32 type: EXT [462848->524287] (req 462848->466943) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444ed1 expref: 40 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.492616:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 3
00010000:00010000:0.0:1651531954.492617:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 3
00010000:00010000:0.0:1651531954.492618:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002dfc67f7/0x3234de053ca2b7e lrc: 6/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 32 type: EXT [491520->495615] (req 491520->495615) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444edf expref: 40 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.492625:0:166113:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003cf86247/0x3234de053ca2b77 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 32 type: EXT [462848->524287] (req 462848->466943) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444ed1 expref: 40 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.492629:0:166113:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003cf86247/0x3234de053ca2b77 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 32 type: EXT [462848->524287] (req 462848->466943) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444ed1 expref: 40 pid: 166113 timeout: 22763 lvb_type: 0
00000100:00100000:0.0:1651531954.492633:0:166113:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b97e3b28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:166113:1731745997347520:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651531954.492651:0:166113:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca2b69 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 32 type: EXT [466944->524287] (req 466944->471039) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444ea7 expref: 40 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.492655:0:166113:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca2b69 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 32 type: EXT [466944->524287] (req 466944->471039) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444ea7 expref: 40 pid: 166111 timeout: 22763 lvb_type: 0
00000100:00100000:0.0:1651531954.492662:0:166113:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002ae2aeac pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:166113:1731745997347584:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651531954.492670:0:166113:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000d9e7472/0x3234de053ca2b3f lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 32 type: EXT [475136->524287] (req 475136->479231) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444dea expref: 40 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.492673:0:166113:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000d9e7472/0x3234de053ca2b3f lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 32 type: EXT [475136->524287] (req 475136->479231) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444dea expref: 40 pid: 166112 timeout: 22763 lvb_type: 0
00000100:00100000:0.0:1651531954.492677:0:166113:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000329eeeee pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:166113:1731745997347648:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531954.492682:0:166113:0:(client.c:2492:ptlrpc_set_wait()) set 0000000060d3a5ac going to sleep for 6 seconds
00000100:00100000:0.0:1651531954.493081:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531954.493098:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467289408
00000100:00100000:0.0:1651531954.493098:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531954.493110:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44339
00000100:00100000:1.0:1651531954.493112:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f3a0807 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+41:680971:x1731754467289408:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531954.493116:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531954.493120:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca2b85 lrc: 2/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 33 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db444ee6 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531954.493123:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651531954.493127:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 3
00010000:00010000:1.0:1651531954.493127:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 3
00010000:00010000:1.0:1651531954.493129:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca2b85 lrc: 3/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 33 type: EXT [479232->483327] (req 479232->483327) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444ee6 expref: 42 pid: 166112 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531954.493131:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651531954.493132:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca2b85 lrc: 3/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 33 type: EXT [479232->483327] (req 479232->483327) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444ee6 expref: 42 pid: 166112 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531954.493139:0:166102:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467289536
00010000:00010000:1.0:1651531954.493141:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c806f265, rc 0)
00010000:00010000:0.0:1651531954.493144:0:166102:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003cf86247/0x3234de053ca2b77 lrc: 5/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 33 type: EXT [462848->524287] (req 462848->466943) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444ed1 expref: 43 pid: 166113 timeout: 22763 lvb_type: 0
00000100:00100000:1.0:1651531954.493152:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f3a0807 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+43:680971:x1731754467289408:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (71us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531954.493152:0:166102:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467289600
00000100:00100000:1.0:1651531954.493154:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44339
00010000:00010000:0.0:1651531954.493154:0:166102:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000d9e7472/0x3234de053ca2b3f lrc: 5/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 33 type: EXT [475136->524287] (req 475136->479231) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444dea expref: 44 pid: 166112 timeout: 22763 lvb_type: 0
00000100:00100000:0.0:1651531954.493159:0:166102:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467289472
00010000:00010000:0.0:1651531954.493161:0:166102:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca2b69 lrc: 5/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 33 type: EXT [466944->524287] (req 466944->471039) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444ea7 expref: 44 pid: 166111 timeout: 22763 lvb_type: 0
00000100:00100000:0.0:1651531954.493166:0:166102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 106
00000100:00100000:0.0:1651531954.493168:0:166102:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003b27b58b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+44:438148:x1731754467289536:12345-10.240.43.64@tcp:103:ldlm_bl_03.0
00010000:00010000:0.0:1651531954.493172:0:166102:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531954.493175:0:166102:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003cf86247/0x3234de053ca2b77 lrc: 5/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 34 type: EXT [462848->524287] (req 462848->466943) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444ed1 expref: 44 pid: 166113 timeout: 22763 lvb_type: 0
00010000:00010000:0.0:1651531954.493179:0:166102:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003cf86247/0x3234de053ca2b77 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 34 type: EXT [462848->524287] (req 462848->466943) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444ed1 expref: 44 pid: 166113 timeout: 22763 lvb_type: 0
00010000:00010000:0.0:1651531954.493186:0:166102:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651531954.493195:0:166102:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003b27b58b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+44:438148:x1731754467289536:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 26us (97us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531954.493198:0:166102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 106
00000100:00100000:1.0:1651531954.493208:0:166104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 107
00000100:00100000:1.0:1651531954.493211:0:166104:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fff66352 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+43:438146:x1731754467289600:12345-10.240.43.64@tcp:103:ldlm_bl_01.0
00010000:00010000:1.0:1651531954.493214:0:166104:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1651531954.493219:0:166104:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000d9e7472/0x3234de053ca2b3f lrc: 5/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 34 type: EXT [475136->524287] (req 475136->479231) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444dea expref: 43 pid: 166112 timeout: 22763 lvb_type: 0
00000100:00100000:0.0:1651531954.493219:0:166102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 108
00000100:00100000:0.0:1651531954.493221:0:166102:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008586382c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+43:438146:x1731754467289472:12345-10.240.43.64@tcp:103:ldlm_bl_01.0
00010000:00010000:1.0:1651531954.493234:0:166104:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000d9e7472/0x3234de053ca2b3f lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 34 type: EXT [475136->524287] (req 475136->479231) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444dea expref: 43 pid: 166112 timeout: 22763 lvb_type: 0
00010000:00010000:0.0:1651531954.493239:0:166102:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1651531954.493242:0:166104:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1651531954.493243:0:166102:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca2b69 lrc: 5/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 34 type: EXT [466944->524287] (req 466944->471039) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444ea7 expref: 43 pid: 166111 timeout: 22763 lvb_type: 0
00010000:00010000:0.0:1651531954.493247:0:166102:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca2b69 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 34 type: EXT [466944->524287] (req 466944->471039) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444ea7 expref: 43 pid: 166111 timeout: 22763 lvb_type: 0
00000100:00100000:1.0:1651531954.493249:0:166104:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fff66352 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+43:438146:x1731754467289600:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 38us (127us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531954.493252:0:166104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 107
00010000:00010000:0.0:1651531954.493253:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531954.493254:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531954.493256:0:166102:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002dfc67f7/0x3234de053ca2b7e lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 34 type: EXT [491520->524287] (req 491520->495615) gid 0 flags: 0x50080000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444edf expref: 42 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.493259:0:166102:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002dfc67f7/0x3234de053ca2b7e lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 34 type: EXT [491520->524287] (req 491520->495615) gid 0 flags: 0x50080000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444edf expref: 42 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.493264:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531954.493264:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531954.493266:0:166102:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca2b85 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 34 type: EXT [479232->491519] (req 479232->483327) gid 0 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444ee6 expref: 42 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.493269:0:166102:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca2b85 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 34 type: EXT [479232->491519] (req 479232->483327) gid 0 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444ee6 expref: 42 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.493270:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003cf86247/0x3234de053ca2b77 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 35 type: EXT [462848->524287] (req 462848->466943) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444ed1 expref: 42 pid: 166113 timeout: 22763 lvb_type: 0
00000100:00100000:1.0:1651531954.493274:0:166113:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b97e3b28 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:166113:1731745997347520:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651531954.493277:0:166102:0:(ldlm_lockd.c:1067:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca2b85 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 33 type: EXT [479232->491519] (req 479232->483327) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444ee6 expref: 41 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.493278:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca2b69 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 34 type: EXT [466944->524287] (req 466944->471039) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444ea7 expref: 41 pid: 166111 timeout: 22763 lvb_type: 0
00000100:00100000:0.0:1651531954.493281:0:166102:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000256ca88 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:166102:1731745997347712:10.240.43.64@tcp:105:
00000100:00100000:1.0:1651531954.493285:0:166113:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002ae2aeac pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:166113:1731745997347584:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651531954.493288:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000d9e7472/0x3234de053ca2b3f lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 32 type: EXT [475136->524287] (req 475136->479231) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444dea expref: 40 pid: 166112 timeout: 22763 lvb_type: 0
00000100:00100000:1.0:1651531954.493291:0:166113:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000329eeeee pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:166113:1731745997347648:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651531954.493292:0:166102:0:(ldlm_lockd.c:1067:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000002dfc67f7/0x3234de053ca2b7e lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 31 type: EXT [491520->524287] (req 491520->495615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444edf expref: 39 pid: 166113 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531954.493296:0:166102:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003ab8c993 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:166102:1731745997347776:10.240.43.64@tcp:105:
00010000:00010000:1.0:1651531954.493297:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002dfc67f7/0x3234de053ca2b7e lrc: 5/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 31 type: EXT [491520->524287] (req 491520->495615) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444edf expref: 39 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.493300:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002dfc67f7, rc 0)
00000100:00100000:0.0:1651531954.493300:0:166102:0:(client.c:2492:ptlrpc_set_wait()) set 000000007ac4e30e going to sleep for 6 seconds
00000100:00100000:1.0:1651531954.493307:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a20162bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+39:680969:x1731754467289344:12345-10.240.43.64@tcp:101:fio.0 Request processed in 717us (739us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531954.493309:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44338
00000100:00100000:0.0:1651531954.493608:0:166102:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000256ca88 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:166102:1731745997347712:10.240.43.64@tcp:105:
00000100:00100000:0.0:1651531954.493612:0:166102:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003ab8c993 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:166102:1731745997347776:10.240.43.64@tcp:105:
00010000:00010000:0.0:1651531954.493617:0:166102:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651531954.493626:0:166102:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008586382c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+38:438146:x1731754467289472:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 404us (494us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531954.493629:0:166102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 108
00000100:00100000:1.0:1651531954.495941:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531954.495949:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467290240
00000100:00100000:1.0:1651531954.495957:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44340
00000100:00100000:1.0:1651531954.495958:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b67ad021 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+38:680969:x1731754467290240:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531954.495961:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531954.495965:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca2b8c lrc: 2/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 31 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db444f02 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.495971:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531954.495972:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531954.495974:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca2b8c lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 31 type: EXT [65536->69631] (req 65536->69631) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444f02 expref: 39 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.495982:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca2b8c lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 31 type: EXT [65536->69631] (req 65536->69631) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444f02 expref: 39 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.495985:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f6ecb7e5, rc 0)
00000100:00100000:1.0:1651531954.496002:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b67ad021 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+39:680969:x1731754467290240:12345-10.240.43.64@tcp:101:fio.0 Request processed in 43us (61us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531954.496004:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44340
00000100:00100000:1.0:1651531954.496657:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.496680:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467290432
00002000:00100000:0.0:1651531954.496688:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x34545:0x0] (282624->286719)  req@00000000329eeeee x1731754467290432/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/0 e 0 to 0 dl 1651531960 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:0.0:1651531954.496693:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000329eeeee with x1731754467290432 ext(282624->286719)
00002000:00010000:0.0:1651531954.496694:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000329eeeee
00000100:00100000:0.0:1651531954.496704:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249598
00000100:00100000:0.0:1651531954.496706:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000329eeeee pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+39:438148:x1731754467290432:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651531954.496728:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000329eeeee pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+39:438148:x1731754467290432:12345-10.240.43.64@tcp:3:fio.0 Request processed in 22us (72us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531954.496731:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249598
00002000:00100000:0.0:1651531954.496733:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x34545:0x0] (282624->286719)  req@00000000329eeeee x1731754467290432/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/4536 e 0 to 0 dl 1651531960 ref 1 fl Complete:/0/0 rc 4096/4096 job:'fio.0'
00002000:00100000:0.0:1651531954.496737:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000329eeeee with x1731754467290432 ext(282624->286719)
00002000:00010000:0.0:1651531954.496738:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000329eeeee
00000100:00100000:1.0:1651531954.497750:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531954.497767:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467290496
00000100:00100000:1.0:1651531954.497774:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44341
00000100:00100000:1.0:1651531954.497776:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002ae2aeac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+39:680971:x1731754467290496:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531954.497779:0:206699:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531954.497783:0:206699:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca2b93 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 32 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db444f09 expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.497788:0:206699:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531954.497789:0:206699:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531954.497791:0:206699:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca2b93 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 32 type: EXT [217088->225279] (req 217088->221183) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444f09 expref: 40 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.497796:0:206699:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca2b93 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 32 type: EXT [217088->225279] (req 217088->221183) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444f09 expref: 40 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.497799:0:206699:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000eebd17a1, rc 0)
00000100:00100000:1.0:1651531954.497814:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002ae2aeac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+40:680971:x1731754467290496:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (65us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531954.497818:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44341
00000100:00100000:1.0:1651531954.498058:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.498069:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467290624
00002000:00100000:0.0:1651531954.498077:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x34545:0x0] (73728->102399)  req@00000000b97e3b28 x1731754467290624/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/0 e 0 to 0 dl 1651531960 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:0.0:1651531954.498080:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000b97e3b28 with x1731754467290624 ext(73728->102399)
00002000:00010000:0.0:1651531954.498082:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000b97e3b28
00000100:00100000:0.0:1651531954.498089:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249599
00000100:00100000:0.0:1651531954.498090:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b97e3b28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+40:438148:x1731754467290624:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651531954.498189:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531954.498197:0:216322:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467290752
00002000:00100000:1.0:1651531954.498211:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34545:0x0] (217088->225279)  req@00000000bb1457a9 x1731754467290752/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/0 e 0 to 0 dl 1651531960 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:1.0:1651531954.498216:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000bb1457a9 with x1731754467290752 ext(217088->225279)
00002000:00010000:1.0:1651531954.498217:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000bb1457a9
00000100:00100000:1.0:1651531954.498236:0:216322:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249600
00000100:00100000:1.0:1651531954.498238:0:216322:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bb1457a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+42:438148:x1731754467290752:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651531954.498267:0:216322:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bb1457a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+42:438148:x1731754467290752:12345-10.240.43.64@tcp:3:fio.0 Request processed in 28us (78us total) trans 0 rc 8192/8192
00000100:00100000:1.0:1651531954.498270:0:216322:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249600
00002000:00100000:1.0:1651531954.498272:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34545:0x0] (217088->225279)  req@00000000bb1457a9 x1731754467290752/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/8632 e 0 to 0 dl 1651531960 ref 1 fl Complete:/0/0 rc 8192/8192 job:'fio.0'
00002000:00100000:1.0:1651531954.498276:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000bb1457a9 with x1731754467290752 ext(217088->225279)
00002000:00010000:1.0:1651531954.498277:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000bb1457a9
00000100:00100000:0.0:1651531954.498304:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b97e3b28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+40:438148:x1731754467290624:12345-10.240.43.64@tcp:3:fio.0 Request processed in 213us (246us total) trans 0 rc 28672/28672
00000100:00100000:0.0:1651531954.498308:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249599
00002000:00100000:0.0:1651531954.498310:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x34545:0x0] (73728->102399)  req@00000000b97e3b28 x1731754467290624/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/440 e 0 to 0 dl 1651531960 ref 1 fl Complete:/0/0 rc 28672/28672 job:'fio.0'
00002000:00100000:0.0:1651531954.498318:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000b97e3b28 with x1731754467290624 ext(73728->102399)
00002000:00010000:0.0:1651531954.498319:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000b97e3b28
00000100:00100000:0.0:1651531954.499556:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.499576:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531954.499577:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467290816
00000100:00100000:0.0:1651531954.499584:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467290944
00000100:00100000:1.0:1651531954.499586:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44342
00000100:00100000:1.0:1651531954.499588:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003ab8c993 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+41:680969:x1731754467290816:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531954.499591:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00002000:00100000:0.0:1651531954.499591:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x34545:0x0] (819200->868351)  req@000000000256ca88 x1731754467290944/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 520/0 e 0 to 0 dl 1651531960 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00010000:00010000:1.0:1651531954.499595:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca2b9a lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 33 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db444f10 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00002000:00100000:0.0:1651531954.499595:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000000256ca88 with x1731754467290944 ext(819200->868351)
00002000:00010000:0.0:1651531954.499598:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000000256ca88
00000100:00100000:0.0:1651531954.499606:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249601
00000100:00100000:0.0:1651531954.499608:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000256ca88 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+42:438147:x1731754467290944:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531954.499610:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531954.499611:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531954.499614:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca2b9a lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 33 type: EXT [393216->401407] (req 393216->397311) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444f10 expref: 42 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.499618:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca2b9a lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 33 type: EXT [393216->401407] (req 393216->397311) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444f10 expref: 42 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.499622:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000022b2104e, rc 0)
00000100:00100000:1.0:1651531954.499640:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003ab8c993 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+43:680969:x1731754467290816:12345-10.240.43.64@tcp:101:fio.0 Request processed in 51us (85us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531954.499643:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44342
00000100:00100000:0.0:1651531954.499859:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000256ca88 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+41:438147:x1731754467290944:12345-10.240.43.64@tcp:3:fio.0 Request processed in 249us (282us total) trans 0 rc 36864/36864
00000100:00100000:0.0:1651531954.499862:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249601
00002000:00100000:0.0:1651531954.499865:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x34545:0x0] (819200->868351)  req@000000000256ca88 x1731754467290944/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 520/440 e 0 to 0 dl 1651531960 ref 1 fl Complete:/0/0 rc 36864/36864 job:'fio.0'
00002000:00100000:0.0:1651531954.499868:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000000256ca88 with x1731754467290944 ext(819200->868351)
00002000:00010000:0.0:1651531954.499871:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000000256ca88
00000100:00100000:0.0:1651531954.500164:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.500172:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467291072
00002000:00100000:0.0:1651531954.500178:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x34545:0x0] (393216->401407)  req@00000000ddbf8c22 x1731754467291072/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/0 e 0 to 0 dl 1651531960 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:0.0:1651531954.500182:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000ddbf8c22 with x1731754467291072 ext(393216->401407)
00002000:00010000:0.0:1651531954.500183:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000ddbf8c22
00000100:00100000:0.0:1651531954.500189:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249602
00000100:00100000:0.0:1651531954.500191:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ddbf8c22 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+41:438148:x1731754467291072:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651531954.500244:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ddbf8c22 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+41:438148:x1731754467291072:12345-10.240.43.64@tcp:3:fio.0 Request processed in 52us (80us total) trans 0 rc 8192/8192
00000100:00100000:0.0:1651531954.500247:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249602
00002000:00100000:0.0:1651531954.500249:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x34545:0x0] (393216->401407)  req@00000000ddbf8c22 x1731754467291072/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/8632 e 0 to 0 dl 1651531960 ref 1 fl Complete:/0/0 rc 8192/8192 job:'fio.0'
00002000:00100000:0.0:1651531954.500253:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000ddbf8c22 with x1731754467291072 ext(393216->401407)
00002000:00010000:0.0:1651531954.500254:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000ddbf8c22
00000100:00100000:0.0:1651531954.500585:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531954.500609:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467291264
00000100:00100000:1.0:1651531954.500619:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44343
00000100:00100000:1.0:1651531954.500620:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008dcbc4a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+41:680969:x1731754467291264:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531954.500623:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531954.500627:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca2ba1 lrc: 2/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 34 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db444f1e expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.500634:0:166113:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003dec1fa8/0x3234de053ca2af9 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 34 type: EXT [102400->131071] (req 102400->106495) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444d50 expref: 42 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.500637:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531954.500637:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531954.500638:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca2ba1 lrc: 4/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 34 type: EXT [126976->131071] (req 126976->131071) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444f1e expref: 42 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.500649:0:166113:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003dec1fa8/0x3234de053ca2af9 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 34 type: EXT [102400->131071] (req 102400->106495) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444d50 expref: 42 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.500653:0:166113:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003dec1fa8/0x3234de053ca2af9 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 34 type: EXT [102400->131071] (req 102400->106495) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444d50 expref: 42 pid: 166113 timeout: 22763 lvb_type: 0
00000100:00100000:1.0:1651531954.500658:0:166113:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004a600aad pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:166113:1731745997347840:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531954.500674:0:166113:0:(client.c:2492:ptlrpc_set_wait()) set 0000000030e02371 going to sleep for 6 seconds
00000100:00100000:1.0:1651531954.500909:0:166113:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004a600aad pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:166113:1731745997347840:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651531954.500914:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca2ba1 lrc: 3/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 34 type: EXT [126976->131071] (req 126976->131071) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444f1e expref: 42 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.500920:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008b0c325f, rc 0)
00000100:00100000:1.0:1651531954.500931:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008dcbc4a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+42:680969:x1731754467291264:12345-10.240.43.64@tcp:101:fio.0 Request processed in 310us (347us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531954.500934:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44343
00000100:00100000:0.0:1651531954.501360:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.501368:0:166102:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467291392
00010000:00010000:0.0:1651531954.501373:0:166102:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003dec1fa8/0x3234de053ca2af9 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 34 type: EXT [102400->131071] (req 102400->106495) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444d50 expref: 42 pid: 166113 timeout: 22763 lvb_type: 0
00000100:00100000:0.0:1651531954.501387:0:166102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 109
00000100:00100000:0.0:1651531954.501389:0:166102:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002e364765 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+42:438148:x1731754467291392:12345-10.240.43.64@tcp:103:ldlm_bl_03.0
00010000:00010000:0.0:1651531954.501392:0:166102:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531954.501395:0:166102:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003dec1fa8/0x3234de053ca2af9 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 35 type: EXT [102400->131071] (req 102400->106495) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444d50 expref: 42 pid: 166113 timeout: 22763 lvb_type: 0
00010000:00010000:0.0:1651531954.501399:0:166102:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003dec1fa8/0x3234de053ca2af9 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 35 type: EXT [102400->131071] (req 102400->106495) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444d50 expref: 42 pid: 166113 timeout: 22763 lvb_type: 0
00010000:00010000:0.0:1651531954.501406:0:166102:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003dec1fa8/0x3234de053ca2af9 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 35 type: EXT [102400->131071] (req 102400->106495) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444d50 expref: 42 pid: 166113 timeout: 22763 lvb_type: 0
00010000:00010000:0.0:1651531954.501415:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531954.501416:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531954.501418:0:166102:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca2ba1 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 34 type: EXT [126976->131071] (req 126976->131071) gid 0 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444f1e expref: 41 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.501421:0:166102:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca2ba1 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 34 type: EXT [126976->131071] (req 126976->131071) gid 0 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444f1e expref: 41 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.501429:0:166102:0:(ldlm_lockd.c:1067:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca2ba1 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 34 type: EXT [126976->131071] (req 126976->131071) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444f1e expref: 41 pid: 166113 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531954.501433:0:166102:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000de5b6d34 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:166102:1731745997347904:10.240.43.64@tcp:105:
00000100:00100000:0.0:1651531954.501445:0:166102:0:(client.c:2492:ptlrpc_set_wait()) set 000000007ac4e30e going to sleep for 6 seconds
00000100:00100000:0.0:1651531954.501683:0:166102:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000de5b6d34 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:166102:1731745997347904:10.240.43.64@tcp:105:
00010000:00010000:0.0:1651531954.501688:0:166102:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651531954.501696:0:166102:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002e364765 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+41:438148:x1731754467291392:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 306us (336us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531954.501699:0:166102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 109
00000100:00100000:0.0:1651531954.503648:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.503656:0:216322:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467292032
00002000:00100000:0.0:1651531954.503663:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34545:0x0] (782336->794623)  req@00000000de5b6d34 x1731754467292032/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/0 e 0 to 0 dl 1651531960 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:0.0:1651531954.503666:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000de5b6d34 with x1731754467292032 ext(782336->794623)
00002000:00010000:0.0:1651531954.503668:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000de5b6d34
00000100:00100000:0.0:1651531954.503673:0:216322:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249603
00000100:00100000:0.0:1651531954.503676:0:216322:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000de5b6d34 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+41:438149:x1731754467292032:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651531954.503700:0:216322:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000de5b6d34 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+41:438149:x1731754467292032:12345-10.240.43.64@tcp:3:fio.0 Request processed in 24us (53us total) trans 0 rc 12288/12288
00000100:00100000:0.0:1651531954.503703:0:216322:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249603
00002000:00100000:0.0:1651531954.503705:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34545:0x0] (782336->794623)  req@00000000de5b6d34 x1731754467292032/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/12728 e 0 to 0 dl 1651531960 ref 1 fl Complete:/0/0 rc 12288/12288 job:'fio.0'
00002000:00100000:0.0:1651531954.503708:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000de5b6d34 with x1731754467292032 ext(782336->794623)
00002000:00010000:0.0:1651531954.503709:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000de5b6d34
00000100:00100000:0.0:1651531954.505550:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531954.505574:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467292544
00000100:00100000:1.0:1651531954.505585:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44344
00000100:00100000:1.0:1651531954.505587:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000797d7ba8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+41:680969:x1731754467292544:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531954.505590:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531954.505594:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca2ba8 lrc: 2/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 34 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db444f41 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.505601:0:166113:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca2b62 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 34 type: EXT [884736->909311] (req 884736->888831) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444e8b expref: 42 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.505605:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531954.505606:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531954.505607:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca2ba8 lrc: 4/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 34 type: EXT [884736->888831] (req 884736->888831) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444f41 expref: 42 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.505613:0:166113:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca2b62 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 34 type: EXT [884736->909311] (req 884736->888831) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444e8b expref: 42 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.505617:0:166113:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca2b62 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 34 type: EXT [884736->909311] (req 884736->888831) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444e8b expref: 42 pid: 166111 timeout: 22763 lvb_type: 0
00000100:00100000:1.0:1651531954.505621:0:166113:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004a600aad pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:166113:1731745997347968:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531954.505637:0:166113:0:(client.c:2492:ptlrpc_set_wait()) set 0000000030e02371 going to sleep for 6 seconds
00000100:00100000:0.0:1651531954.505944:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.505951:0:166102:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467292608
00000100:00100000:1.0:1651531954.505954:0:166113:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004a600aad pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:166113:1731745997347968:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651531954.505957:0:166102:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca2b62 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 34 type: EXT [884736->909311] (req 884736->888831) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444e8b expref: 43 pid: 166111 timeout: 22763 lvb_type: 0
00010000:00010000:1.0:1651531954.505959:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca2ba8 lrc: 3/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 35 type: EXT [884736->888831] (req 884736->888831) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444f41 expref: 43 pid: 166113 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531954.505968:0:166102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 110
00010000:00010000:1.0:1651531954.505970:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009c5faf65, rc 0)
00000100:00100000:0.0:1651531954.505970:0:166102:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008ce37436 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+43:438147:x1731754467292608:12345-10.240.43.64@tcp:103:ldlm_bl_02.0
00010000:00010000:0.0:1651531954.505973:0:166102:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531954.505976:0:166102:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca2b62 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 35 type: EXT [884736->909311] (req 884736->888831) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444e8b expref: 43 pid: 166111 timeout: 22763 lvb_type: 0
00000100:00100000:1.0:1651531954.505983:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000797d7ba8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+43:680969:x1731754467292544:12345-10.240.43.64@tcp:101:fio.0 Request processed in 395us (433us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531954.505986:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44344
00010000:00010000:0.0:1651531954.505988:0:166102:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca2b62 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 35 type: EXT [884736->909311] (req 884736->888831) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444e8b expref: 43 pid: 166111 timeout: 22763 lvb_type: 0
00010000:00010000:0.0:1651531954.505995:0:166102:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca2b62 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 35 type: EXT [884736->909311] (req 884736->888831) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444e8b expref: 42 pid: 166111 timeout: 22763 lvb_type: 0
00010000:00010000:0.0:1651531954.506003:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531954.506004:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531954.506006:0:166102:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca2ba8 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 34 type: EXT [884736->909311] (req 884736->888831) gid 0 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444f41 expref: 41 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.506009:0:166102:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca2ba8 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 34 type: EXT [884736->909311] (req 884736->888831) gid 0 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444f41 expref: 41 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.506018:0:166102:0:(ldlm_lockd.c:1067:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca2ba8 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 34 type: EXT [884736->909311] (req 884736->888831) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444f41 expref: 41 pid: 166113 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531954.506022:0:166102:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000040ff83df pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:166102:1731745997348032:10.240.43.64@tcp:105:
00000100:00100000:0.0:1651531954.506031:0:166102:0:(client.c:2492:ptlrpc_set_wait()) set 000000007ac4e30e going to sleep for 6 seconds
00000100:00100000:0.0:1651531954.506273:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531954.506295:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467292672
00000100:00100000:1.0:1651531954.506306:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44345
00000100:00100000:1.0:1651531954.506308:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000041083123 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+42:680971:x1731754467292672:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531954.506311:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531954.506316:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca2baf lrc: 2/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 35 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db444f48 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.506322:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531954.506322:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531954.506325:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca2baf lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 35 type: EXT [466944->479231] (req 466944->471039) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444f48 expref: 43 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.506329:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca2baf lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 35 type: EXT [466944->479231] (req 466944->471039) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444f48 expref: 43 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.506333:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f2af03c8, rc 0)
00000100:00100000:1.0:1651531954.506346:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000041083123 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+43:680971:x1731754467292672:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (73us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531954.506348:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44345
00000100:00100000:0.0:1651531954.506390:0:166102:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000040ff83df pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:166102:1731745997348032:10.240.43.64@tcp:105:
00010000:00010000:0.0:1651531954.506395:0:166102:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651531954.506403:0:166102:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008ce37436 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+42:438147:x1731754467292608:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 432us (459us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531954.506406:0:166102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 110
00000100:00100000:0.0:1651531954.506705:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531954.506726:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467292736
00000100:00100000:1.0:1651531954.506737:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44346
00000100:00100000:1.0:1651531954.506739:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000040ff83df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+42:680971:x1731754467292736:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531954.506742:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531954.506745:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca2bb6 lrc: 2/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 35 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db444f4f expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.506751:0:166113:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000378a069e/0x3234de053ca2b31 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 35 type: EXT [561152->585727] (req 561152->565247) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444db2 expref: 43 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.506755:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531954.506755:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531954.506756:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca2bb6 lrc: 4/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 35 type: EXT [573440->577535] (req 573440->577535) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444f4f expref: 43 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.506766:0:166113:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000378a069e/0x3234de053ca2b31 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 35 type: EXT [561152->585727] (req 561152->565247) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444db2 expref: 43 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.506770:0:166113:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000378a069e/0x3234de053ca2b31 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 35 type: EXT [561152->585727] (req 561152->565247) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444db2 expref: 43 pid: 166113 timeout: 22763 lvb_type: 0
00000100:00100000:1.0:1651531954.506774:0:166113:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004a600aad pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:166113:1731745997348096:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531954.506789:0:166113:0:(client.c:2492:ptlrpc_set_wait()) set 0000000030e02371 going to sleep for 6 seconds
00000100:00100000:1.0:1651531954.506975:0:166113:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004a600aad pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:166113:1731745997348096:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651531954.506980:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca2bb6 lrc: 3/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 35 type: EXT [573440->577535] (req 573440->577535) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444f4f expref: 43 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.506985:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000000bb25cc, rc 0)
00000100:00100000:1.0:1651531954.506996:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000040ff83df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+43:680971:x1731754467292736:12345-10.240.43.64@tcp:101:fio.0 Request processed in 257us (292us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531954.506999:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44346
00000100:00100000:0.0:1651531954.507049:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531954.507070:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467292800
00000100:00100000:1.0:1651531954.507079:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44347
00000100:00100000:1.0:1651531954.507080:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008f997301 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+43:680969:x1731754467292800:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531954.507083:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531954.507087:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca2bbd lrc: 2/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 36 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db444f56 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.507092:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531954.507094:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531954.507096:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca2bbd lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 36 type: EXT [462848->466943] (req 462848->466943) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444f56 expref: 44 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.507101:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca2bbd lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 36 type: EXT [462848->466943] (req 462848->466943) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444f56 expref: 44 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.507105:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d3014069, rc 0)
00000100:00100000:1.0:1651531954.507116:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008f997301 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+44:680969:x1731754467292800:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (68us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531954.507119:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44347
00000100:00100000:0.0:1651531954.507168:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.507175:0:166102:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467292864
00010000:00010000:0.0:1651531954.507180:0:166102:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000378a069e/0x3234de053ca2b31 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 36 type: EXT [561152->585727] (req 561152->565247) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444db2 expref: 44 pid: 166113 timeout: 22763 lvb_type: 0
00000100:00100000:0.0:1651531954.507199:0:166102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 111
00000100:00100000:0.0:1651531954.507209:0:166102:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e438854c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+44:438149:x1731754467292864:12345-10.240.43.64@tcp:103:ldlm_bl_04.0
00010000:00010000:0.0:1651531954.507212:0:166102:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531954.507216:0:166102:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000378a069e/0x3234de053ca2b31 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 37 type: EXT [561152->585727] (req 561152->565247) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444db2 expref: 44 pid: 166113 timeout: 22763 lvb_type: 0
00010000:00010000:0.0:1651531954.507220:0:166102:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000378a069e/0x3234de053ca2b31 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 37 type: EXT [561152->585727] (req 561152->565247) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444db2 expref: 44 pid: 166113 timeout: 22763 lvb_type: 0
00010000:00010000:0.0:1651531954.507239:0:166102:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000378a069e/0x3234de053ca2b31 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 37 type: EXT [561152->585727] (req 561152->565247) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444db2 expref: 44 pid: 166113 timeout: 22763 lvb_type: 0
00010000:00010000:0.0:1651531954.507243:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531954.507244:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531954.507246:0:166102:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca2bb6 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 36 type: EXT [573440->585727] (req 573440->577535) gid 0 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444f4f expref: 43 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.507249:0:166102:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca2bb6 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 36 type: EXT [573440->585727] (req 573440->577535) gid 0 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444f4f expref: 43 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.507258:0:166102:0:(ldlm_lockd.c:1067:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca2bb6 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 36 type: EXT [573440->585727] (req 573440->577535) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444f4f expref: 43 pid: 166113 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531954.507262:0:166102:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ed4b797c pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:166102:1731745997348160:10.240.43.64@tcp:105:
00000100:00100000:0.0:1651531954.507273:0:166102:0:(client.c:2492:ptlrpc_set_wait()) set 000000007ac4e30e going to sleep for 6 seconds
00000100:00100000:0.0:1651531954.507491:0:166102:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ed4b797c pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:166102:1731745997348160:10.240.43.64@tcp:105:
00010000:00010000:0.0:1651531954.507496:0:166102:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651531954.507503:0:166102:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e438854c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+43:438149:x1731754467292864:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 294us (336us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531954.507506:0:166102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 111
00000100:00100000:0.0:1651531954.508455:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.508463:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.508470:0:216322:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467293312
00002000:00100000:0.0:1651531954.508476:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34545:0x0] (888832->909311)  req@00000000ed4b797c x1731754467293312/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/0 e 0 to 0 dl 1651531960 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:0.0:1651531954.508480:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000ed4b797c with x1731754467293312 ext(888832->909311)
00002000:00010000:0.0:1651531954.508481:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000ed4b797c
00000100:00100000:0.0:1651531954.508486:0:216322:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467293248
00002000:00100000:0.0:1651531954.508488:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34545:0x0] (24576->36863)  req@000000008418aa1d x1731754467293248/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/0 e 0 to 0 dl 1651531960 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:0.0:1651531954.508492:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000008418aa1d with x1731754467293248 ext(24576->36863)
00002000:00010000:0.0:1651531954.508493:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000008418aa1d
00000100:00100000:0.0:1651531954.508504:0:216322:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249604
00000100:00100000:0.0:1651531954.508506:0:216322:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ed4b797c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+44:438147:x1731754467293312:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651531954.508516:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249605
00000100:00100000:1.0:1651531954.508519:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008418aa1d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+45:438147:x1731754467293248:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651531954.508580:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008418aa1d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+45:438147:x1731754467293248:12345-10.240.43.64@tcp:3:fio.0 Request processed in 61us (116us total) trans 0 rc 12288/12288
00000100:00100000:1.0:1651531954.508583:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249605
00002000:00100000:1.0:1651531954.508586:0:192755:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x100010000:0x34545:0x0] (24576->36863)  req@000000008418aa1d x1731754467293248/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/12728 e 0 to 0 dl 1651531960 ref 1 fl Complete:/0/0 rc 12288/12288 job:'fio.0'
00002000:00100000:1.0:1651531954.508590:0:192755:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000008418aa1d with x1731754467293248 ext(24576->36863)
00002000:00010000:1.0:1651531954.508591:0:192755:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000008418aa1d
00000100:00100000:0.0:1651531954.508695:0:216322:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ed4b797c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+43:438147:x1731754467293312:12345-10.240.43.64@tcp:3:fio.0 Request processed in 188us (240us total) trans 0 rc 20480/20480
00000100:00100000:0.0:1651531954.508698:0:216322:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249604
00002000:00100000:0.0:1651531954.508701:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34545:0x0] (888832->909311)  req@00000000ed4b797c x1731754467293312/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/440 e 0 to 0 dl 1651531960 ref 1 fl Complete:/0/0 rc 20480/20480 job:'fio.0'
00002000:00100000:0.0:1651531954.508704:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000ed4b797c with x1731754467293312 ext(888832->909311)
00002000:00010000:0.0:1651531954.508706:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000ed4b797c
00000100:00100000:0.0:1651531954.510419:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531954.510442:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467293632
00000100:00100000:1.0:1651531954.510454:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44348
00000100:00100000:1.0:1651531954.510456:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005ad0bdd2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+43:680971:x1731754467293632:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531954.510459:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531954.510463:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002f2479f0/0x3234de053ca2bc4 lrc: 2/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 36 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db444f64 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.510472:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531954.510473:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531954.510475:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002f2479f0/0x3234de053ca2bc4 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 36 type: EXT [114688->126975] (req 114688->118783) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444f64 expref: 44 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.510480:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002f2479f0/0x3234de053ca2bc4 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 36 type: EXT [114688->126975] (req 114688->118783) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444f64 expref: 44 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.510483:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002f2479f0, rc 0)
00000100:00100000:1.0:1651531954.510497:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005ad0bdd2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+44:680971:x1731754467293632:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (79us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531954.510500:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44348
00000100:00100000:0.0:1651531954.511354:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531954.511376:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467293888
00000100:00100000:0.0:1651531954.511376:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.511384:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467293952
00000100:00100000:1.0:1651531954.511391:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44349
00000100:00100000:1.0:1651531954.511397:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001ae5624b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+45:680971:x1731754467293888:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651531954.511398:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44350
00000100:00100000:0.0:1651531954.511400:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b597647e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+45:680969:x1731754467293952:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531954.511401:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531954.511404:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000049c67f6a/0x3234de053ca2bcb lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 37 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db444f72 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.511404:0:206699:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531954.511408:0:206699:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000958e71ef/0x3234de053ca2bd2 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 38 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db444f79 expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.511410:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531954.511410:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531954.511412:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049c67f6a/0x3234de053ca2bcb lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 38 type: EXT [61440->65535] (req 61440->65535) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444f72 expref: 47 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.511417:0:206699:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531954.511417:0:206699:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531954.511420:0:206699:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000958e71ef/0x3234de053ca2bd2 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 38 type: EXT [360448->401407] (req 360448->364543) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444f79 expref: 47 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.511424:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000049c67f6a/0x3234de053ca2bcb lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 39 type: EXT [61440->65535] (req 61440->65535) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444f72 expref: 47 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.511424:0:206699:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000958e71ef/0x3234de053ca2bd2 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 39 type: EXT [360448->401407] (req 360448->364543) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444f79 expref: 47 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.511428:0:206699:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000958e71ef, rc 0)
00010000:00010000:1.0:1651531954.511432:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000049c67f6a, rc 0)
00000100:00100000:0.0:1651531954.511438:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b597647e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+47:680969:x1731754467293952:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (62us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531954.511440:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001ae5624b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+47:680971:x1731754467293888:12345-10.240.43.64@tcp:101:fio.0 Request processed in 42us (87us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531954.511441:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44350
00000100:00100000:1.0:1651531954.511443:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44349
00000100:00100000:0.0:1651531954.511746:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.511757:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.511771:0:216322:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467294144
00002000:00100000:0.0:1651531954.511777:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34545:0x0] (360448->393215)  req@000000004428780d x1731754467294144/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/0 e 0 to 0 dl 1651531960 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00000100:00100000:1.0:1651531954.511779:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467294080
00002000:00100000:0.0:1651531954.511785:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000004428780d with x1731754467294144 ext(360448->393215)
00002000:00100000:1.0:1651531954.511786:0:192755:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x100010000:0x34545:0x0] (61440->65535)  req@00000000e15376c0 x1731754467294080/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/0 e 0 to 0 dl 1651531960 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00010000:0.0:1651531954.511786:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000004428780d
00002000:00100000:1.0:1651531954.511790:0:192755:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000e15376c0 with x1731754467294080 ext(61440->65535)
00002000:00010000:1.0:1651531954.511791:0:192755:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000e15376c0
00000100:00100000:0.0:1651531954.511792:0:216322:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249606
00000100:00100000:0.0:1651531954.511793:0:216322:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004428780d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+47:438147:x1731754467294144:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651531954.511799:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249607
00000100:00100000:1.0:1651531954.511801:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e15376c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+47:438147:x1731754467294080:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651531954.511820:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e15376c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+48:438147:x1731754467294080:12345-10.240.43.64@tcp:3:fio.0 Request processed in 18us (63us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531954.511823:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249607
00002000:00100000:1.0:1651531954.511825:0:192755:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x100010000:0x34545:0x0] (61440->65535)  req@00000000e15376c0 x1731754467294080/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/4536 e 0 to 0 dl 1651531960 ref 1 fl Complete:/0/0 rc 4096/4096 job:'fio.0'
00002000:00100000:1.0:1651531954.511828:0:192755:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000e15376c0 with x1731754467294080 ext(61440->65535)
00002000:00010000:1.0:1651531954.511829:0:192755:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000e15376c0
00000100:00100000:0.0:1651531954.512014:0:216322:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004428780d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+46:438147:x1731754467294144:12345-10.240.43.64@tcp:3:fio.0 Request processed in 219us (268us total) trans 0 rc 32768/32768
00000100:00100000:0.0:1651531954.512017:0:216322:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249606
00002000:00100000:0.0:1651531954.512020:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34545:0x0] (360448->393215)  req@000000004428780d x1731754467294144/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/440 e 0 to 0 dl 1651531960 ref 1 fl Complete:/0/0 rc 32768/32768 job:'fio.0'
00002000:00100000:0.0:1651531954.512023:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000004428780d with x1731754467294144 ext(360448->393215)
00002000:00010000:0.0:1651531954.512025:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000004428780d
00000100:00100000:0.0:1651531954.515318:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.515325:0:216322:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467295040
00002000:00100000:0.0:1651531954.515332:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34545:0x0] (122880->126975)  req@00000000b5b5b4c0 x1731754467295040/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/0 e 0 to 0 dl 1651531960 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:0.0:1651531954.515335:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000b5b5b4c0 with x1731754467295040 ext(122880->126975)
00002000:00010000:0.0:1651531954.515337:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000b5b5b4c0
00000100:00100000:0.0:1651531954.515347:0:216322:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249608
00000100:00100000:0.0:1651531954.515349:0:216322:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b5b5b4c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+46:438147:x1731754467295040:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651531954.515371:0:216322:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b5b5b4c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+46:438147:x1731754467295040:12345-10.240.43.64@tcp:3:fio.0 Request processed in 21us (54us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531954.515374:0:216322:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249608
00002000:00100000:0.0:1651531954.515376:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34545:0x0] (122880->126975)  req@00000000b5b5b4c0 x1731754467295040/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/4536 e 0 to 0 dl 1651531960 ref 1 fl Complete:/0/0 rc 4096/4096 job:'fio.0'
00002000:00100000:0.0:1651531954.515380:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000b5b5b4c0 with x1731754467295040 ext(122880->126975)
00002000:00010000:0.0:1651531954.515381:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000b5b5b4c0
00000100:00100000:0.0:1651531954.515864:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.515872:0:216322:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467295168
00002000:00100000:0.0:1651531954.515878:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34545:0x0] (8192->24575)  req@000000002bdf9f80 x1731754467295168/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 504/0 e 0 to 0 dl 1651531960 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:0.0:1651531954.515882:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000002bdf9f80 with x1731754467295168 ext(8192->24575)
00002000:00010000:0.0:1651531954.515883:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000002bdf9f80
00000100:00100000:0.0:1651531954.515894:0:216322:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249609
00000100:00100000:0.0:1651531954.515896:0:216322:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002bdf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+46:438147:x1731754467295168:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651531954.516067:0:216322:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002bdf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+46:438147:x1731754467295168:12345-10.240.43.64@tcp:3:fio.0 Request processed in 170us (204us total) trans 0 rc 12288/12288
00000100:00100000:0.0:1651531954.516071:0:216322:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249609
00002000:00100000:0.0:1651531954.516073:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34545:0x0] (8192->24575)  req@000000002bdf9f80 x1731754467295168/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 504/440 e 0 to 0 dl 1651531960 ref 1 fl Complete:/0/0 rc 12288/12288 job:'fio.0'
00002000:00100000:0.0:1651531954.516076:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000002bdf9f80 with x1731754467295168 ext(8192->24575)
00002000:00010000:0.0:1651531954.516078:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000002bdf9f80
00000100:00100000:0.0:1651531954.517188:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.517195:0:216322:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467295552
00002000:00100000:0.0:1651531954.517209:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34545:0x0] (507904->524287)  req@00000000137fd3d9 x1731754467295552/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/0 e 0 to 0 dl 1651531960 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:0.0:1651531954.517213:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000137fd3d9 with x1731754467295552 ext(507904->524287)
00002000:00010000:0.0:1651531954.517214:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000137fd3d9
00000100:00100000:0.0:1651531954.517236:0:216322:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249610
00000100:00100000:0.0:1651531954.517238:0:216322:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000137fd3d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+46:438148:x1731754467295552:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651531954.517265:0:216322:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000137fd3d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+46:438148:x1731754467295552:12345-10.240.43.64@tcp:3:fio.0 Request processed in 26us (77us total) trans 0 rc 16384/16384
00000100:00100000:0.0:1651531954.517268:0:216322:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249610
00002000:00100000:0.0:1651531954.517270:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34545:0x0] (507904->524287)  req@00000000137fd3d9 x1731754467295552/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/16824 e 0 to 0 dl 1651531960 ref 1 fl Complete:/0/0 rc 16384/16384 job:'fio.0'
00002000:00100000:0.0:1651531954.517273:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000137fd3d9 with x1731754467295552 ext(507904->524287)
00002000:00010000:0.0:1651531954.517274:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000137fd3d9
00000100:00100000:0.0:1651531954.517956:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.517963:0:216322:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467295680
00002000:00100000:0.0:1651531954.517969:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34545:0x0] (622592->647167)  req@00000000da31c48f x1731754467295680/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 504/0 e 0 to 0 dl 1651531960 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:0.0:1651531954.517973:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000da31c48f with x1731754467295680 ext(622592->647167)
00002000:00010000:0.0:1651531954.517974:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000da31c48f
00000100:00100000:0.0:1651531954.517984:0:216322:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249611
00000100:00100000:0.0:1651531954.517986:0:216322:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000da31c48f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+46:438147:x1731754467295680:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651531954.518158:0:216322:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000da31c48f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+46:438147:x1731754467295680:12345-10.240.43.64@tcp:3:fio.0 Request processed in 171us (202us total) trans 0 rc 20480/20480
00000100:00100000:0.0:1651531954.518161:0:216322:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249611
00002000:00100000:0.0:1651531954.518163:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34545:0x0] (622592->647167)  req@00000000da31c48f x1731754467295680/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 504/440 e 0 to 0 dl 1651531960 ref 1 fl Complete:/0/0 rc 20480/20480 job:'fio.0'
00002000:00100000:0.0:1651531954.518166:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000da31c48f with x1731754467295680 ext(622592->647167)
00002000:00010000:0.0:1651531954.518168:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000da31c48f
00000100:00100000:0.0:1651531954.518522:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.518530:0:216322:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467295936
00002000:00100000:0.0:1651531954.518537:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34545:0x0] (200704->204799)  req@000000006c903446 x1731754467295936/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/0 e 0 to 0 dl 1651531960 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:0.0:1651531954.518540:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000006c903446 with x1731754467295936 ext(200704->204799)
00002000:00010000:0.0:1651531954.518541:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000006c903446
00000100:00100000:0.0:1651531954.518552:0:216322:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249612
00000100:00100000:0.0:1651531954.518553:0:216322:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006c903446 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+46:438147:x1731754467295936:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651531954.518575:0:216322:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006c903446 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+46:438147:x1731754467295936:12345-10.240.43.64@tcp:3:fio.0 Request processed in 21us (53us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531954.518578:0:216322:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249612
00002000:00100000:0.0:1651531954.518580:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34545:0x0] (200704->204799)  req@000000006c903446 x1731754467295936/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/4536 e 0 to 0 dl 1651531960 ref 1 fl Complete:/0/0 rc 4096/4096 job:'fio.0'
00002000:00100000:0.0:1651531954.518583:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000006c903446 with x1731754467295936 ext(200704->204799)
00002000:00010000:0.0:1651531954.518584:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000006c903446
00000100:00100000:0.0:1651531954.518941:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.518949:0:216322:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467296064
00002000:00100000:0.0:1651531954.518955:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34545:0x0] (118784->122879)  req@00000000880cd1d7 x1731754467296064/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/0 e 0 to 0 dl 1651531960 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:0.0:1651531954.518959:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000880cd1d7 with x1731754467296064 ext(118784->122879)
00002000:00010000:0.0:1651531954.518960:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000880cd1d7
00000100:00100000:0.0:1651531954.518970:0:216322:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249613
00000100:00100000:0.0:1651531954.518971:0:216322:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000880cd1d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+46:438147:x1731754467296064:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651531954.518993:0:216322:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000880cd1d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+46:438147:x1731754467296064:12345-10.240.43.64@tcp:3:fio.0 Request processed in 21us (52us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531954.519006:0:216322:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249613
00002000:00100000:0.0:1651531954.519008:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34545:0x0] (118784->122879)  req@00000000880cd1d7 x1731754467296064/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/4536 e 0 to 0 dl 1651531960 ref 1 fl Complete:/0/0 rc 4096/4096 job:'fio.0'
00002000:00100000:0.0:1651531954.519011:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000880cd1d7 with x1731754467296064 ext(118784->122879)
00002000:00010000:0.0:1651531954.519012:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000880cd1d7
00000100:00100000:0.0:1651531954.519477:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.519485:0:216322:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467296192
00002000:00100000:0.0:1651531954.519491:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34545:0x0] (196608->200703)  req@00000000f05c0b82 x1731754467296192/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/0 e 0 to 0 dl 1651531960 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:0.0:1651531954.519494:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000f05c0b82 with x1731754467296192 ext(196608->200703)
00002000:00010000:0.0:1651531954.519496:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000f05c0b82
00000100:00100000:0.0:1651531954.519506:0:216322:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249614
00000100:00100000:0.0:1651531954.519508:0:216322:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f05c0b82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+46:438147:x1731754467296192:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651531954.519529:0:216322:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f05c0b82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+46:438147:x1731754467296192:12345-10.240.43.64@tcp:3:fio.0 Request processed in 20us (53us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531954.519532:0:216322:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249614
00002000:00100000:0.0:1651531954.519534:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34545:0x0] (196608->200703)  req@00000000f05c0b82 x1731754467296192/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/4536 e 0 to 0 dl 1651531960 ref 1 fl Complete:/0/0 rc 4096/4096 job:'fio.0'
00002000:00100000:0.0:1651531954.519537:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000f05c0b82 with x1731754467296192 ext(196608->200703)
00002000:00010000:0.0:1651531954.519538:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000f05c0b82
00000100:00100000:0.0:1651531954.521057:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.521064:0:216322:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467296512
00002000:00100000:0.0:1651531954.521070:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34545:0x0] (602112->622591)  req@000000003a5ac9b4 x1731754467296512/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/0 e 0 to 0 dl 1651531960 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:0.0:1651531954.521085:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000003a5ac9b4 with x1731754467296512 ext(602112->622591)
00002000:00010000:0.0:1651531954.521087:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000003a5ac9b4
00000100:00100000:0.0:1651531954.521097:0:216322:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249615
00000100:00100000:0.0:1651531954.521098:0:216322:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003a5ac9b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+46:438146:x1731754467296512:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651531954.521292:0:216322:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003a5ac9b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+46:438146:x1731754467296512:12345-10.240.43.64@tcp:3:fio.0 Request processed in 192us (235us total) trans 0 rc 20480/20480
00000100:00100000:0.0:1651531954.521295:0:216322:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249615
00002000:00100000:0.0:1651531954.521297:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34545:0x0] (602112->622591)  req@000000003a5ac9b4 x1731754467296512/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/440 e 0 to 0 dl 1651531960 ref 1 fl Complete:/0/0 rc 20480/20480 job:'fio.0'
00002000:00100000:0.0:1651531954.521301:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000003a5ac9b4 with x1731754467296512 ext(602112->622591)
00002000:00010000:0.0:1651531954.521302:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000003a5ac9b4
00000100:00100000:0.0:1651531954.521648:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531954.521668:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467296576
00000100:00100000:1.0:1651531954.521677:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44351
00000100:00100000:1.0:1651531954.521678:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000295be4cd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+46:680971:x1731754467296576:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531954.521682:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531954.521685:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003f7e6a6f/0x3234de053ca2bd9 lrc: 2/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 39 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db444f95 expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.521692:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531954.521693:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531954.521695:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f7e6a6f/0x3234de053ca2bd9 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 39 type: EXT [692224->704511] (req 692224->696319) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444f95 expref: 47 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.521700:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003f7e6a6f/0x3234de053ca2bd9 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 39 type: EXT [692224->704511] (req 692224->696319) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444f95 expref: 47 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.521703:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003f7e6a6f, rc 0)
00000100:00100000:1.0:1651531954.521718:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000295be4cd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+47:680971:x1731754467296576:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (71us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531954.521721:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44351
00000100:00100000:0.0:1651531954.522079:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.522087:0:216322:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467296704
00002000:00100000:0.0:1651531954.522093:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34545:0x0] (135168->139263)  req@000000001eda4376 x1731754467296704/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/0 e 0 to 0 dl 1651531960 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:0.0:1651531954.522097:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000001eda4376 with x1731754467296704 ext(135168->139263)
00002000:00010000:0.0:1651531954.522098:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000001eda4376
00000100:00100000:0.0:1651531954.522109:0:216322:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249616
00000100:00100000:0.0:1651531954.522110:0:216322:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001eda4376 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+47:438146:x1731754467296704:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651531954.522132:0:216322:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001eda4376 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+47:438146:x1731754467296704:12345-10.240.43.64@tcp:3:fio.0 Request processed in 21us (53us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531954.522135:0:216322:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249616
00002000:00100000:0.0:1651531954.522145:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34545:0x0] (135168->139263)  req@000000001eda4376 x1731754467296704/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/4536 e 0 to 0 dl 1651531960 ref 1 fl Complete:/0/0 rc 4096/4096 job:'fio.0'
00002000:00100000:0.0:1651531954.522149:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000001eda4376 with x1731754467296704 ext(135168->139263)
00002000:00010000:0.0:1651531954.522150:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000001eda4376
00000100:00100000:0.0:1651531954.523563:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.523571:0:216322:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467296960
00002000:00100000:0.0:1651531954.523577:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34545:0x0] (409600->413695)  req@00000000530f55ca x1731754467296960/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/0 e 0 to 0 dl 1651531960 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:0.0:1651531954.523581:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000530f55ca with x1731754467296960 ext(409600->413695)
00002000:00010000:0.0:1651531954.523582:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000530f55ca
00000100:00100000:0.0:1651531954.523592:0:216322:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249617
00000100:00100000:0.0:1651531954.523594:0:216322:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000530f55ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+47:438146:x1731754467296960:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651531954.523614:0:216322:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000530f55ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+47:438146:x1731754467296960:12345-10.240.43.64@tcp:3:fio.0 Request processed in 20us (51us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531954.523617:0:216322:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249617
00002000:00100000:0.0:1651531954.523619:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34545:0x0] (409600->413695)  req@00000000530f55ca x1731754467296960/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/4536 e 0 to 0 dl 1651531960 ref 1 fl Complete:/0/0 rc 4096/4096 job:'fio.0'
00002000:00100000:0.0:1651531954.523622:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000530f55ca with x1731754467296960 ext(409600->413695)
00002000:00010000:0.0:1651531954.523623:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000530f55ca
00000100:00100000:0.0:1651531954.524708:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.524717:0:216322:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467297216
00002000:00100000:0.0:1651531954.524723:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34545:0x0] (765952->782335)  req@00000000b338475a x1731754467297216/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/0 e 0 to 0 dl 1651531960 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:0.0:1651531954.524727:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000b338475a with x1731754467297216 ext(765952->782335)
00002000:00010000:0.0:1651531954.524728:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000b338475a
00000100:00100000:0.0:1651531954.524745:0:216322:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249618
00000100:00100000:0.0:1651531954.524747:0:216322:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b338475a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+47:438146:x1731754467297216:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651531954.524772:0:216322:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b338475a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+47:438146:x1731754467297216:12345-10.240.43.64@tcp:3:fio.0 Request processed in 25us (64us total) trans 0 rc 16384/16384
00000100:00100000:0.0:1651531954.524775:0:216322:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249618
00002000:00100000:0.0:1651531954.524777:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34545:0x0] (765952->782335)  req@00000000b338475a x1731754467297216/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/16824 e 0 to 0 dl 1651531960 ref 1 fl Complete:/0/0 rc 16384/16384 job:'fio.0'
00002000:00100000:0.0:1651531954.524781:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000b338475a with x1731754467297216 ext(765952->782335)
00002000:00010000:0.0:1651531954.524782:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000b338475a
00000100:00100000:0.0:1651531954.529462:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531954.529482:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467297920
00000100:00100000:1.0:1651531954.529490:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44352
00000100:00100000:1.0:1651531954.529491:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c4db449c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+47:680971:x1731754467297920:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531954.529494:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531954.529498:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2f464ac/0x3234de053ca2be0 lrc: 2/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 40 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db444fb8 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.529504:0:166112:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ea9f3321/0x3234de053ca2ac1 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 40 type: EXT [45056->61439] (req 45056->49151) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444cc4 expref: 48 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.529507:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531954.529508:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531954.529509:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2f464ac/0x3234de053ca2be0 lrc: 4/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 40 type: EXT [45056->49151] (req 45056->49151) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444fb8 expref: 48 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.529519:0:166112:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ea9f3321/0x3234de053ca2ac1 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 40 type: EXT [45056->61439] (req 45056->49151) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444cc4 expref: 48 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.529523:0:166112:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ea9f3321/0x3234de053ca2ac1 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 40 type: EXT [45056->61439] (req 45056->49151) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444cc4 expref: 48 pid: 166113 timeout: 22763 lvb_type: 0
00000100:00100000:1.0:1651531954.529528:0:166112:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004a600aad pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:166112:1731745997348224:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531954.529545:0:166112:0:(client.c:2492:ptlrpc_set_wait()) set 0000000030e02371 going to sleep for 6 seconds
00000100:00100000:0.0:1651531954.529856:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531954.529863:0:166112:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004a600aad pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:166112:1731745997348224:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531954.529864:0:166102:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467297984
00010000:00010000:1.0:1651531954.529869:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e2f464ac/0x3234de053ca2be0 lrc: 3/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 40 type: EXT [45056->49151] (req 45056->49151) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444fb8 expref: 49 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.529870:0:166102:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ea9f3321/0x3234de053ca2ac1 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 41 type: EXT [45056->61439] (req 45056->49151) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444cc4 expref: 49 pid: 166113 timeout: 22763 lvb_type: 0
00010000:00010000:1.0:1651531954.529874:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e2f464ac, rc 0)
00000100:00100000:0.0:1651531954.529882:0:166102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 112
00000100:00100000:0.0:1651531954.529884:0:166102:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003ec7b6d9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+49:438146:x1731754467297984:12345-10.240.43.64@tcp:103:ldlm_bl_01.0
00010000:00010000:0.0:1651531954.529887:0:166102:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00000100:00100000:1.0:1651531954.529892:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c4db449c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+49:680971:x1731754467297920:12345-10.240.43.64@tcp:101:fio.0 Request processed in 400us (430us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531954.529895:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44352
00010000:00010000:0.0:1651531954.529896:0:166102:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ea9f3321/0x3234de053ca2ac1 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 41 type: EXT [45056->61439] (req 45056->49151) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444cc4 expref: 49 pid: 166113 timeout: 22763 lvb_type: 0
00010000:00010000:0.0:1651531954.529901:0:166102:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ea9f3321/0x3234de053ca2ac1 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 41 type: EXT [45056->61439] (req 45056->49151) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444cc4 expref: 48 pid: 166113 timeout: 22763 lvb_type: 0
00010000:00010000:0.0:1651531954.529907:0:166102:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ea9f3321/0x3234de053ca2ac1 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 41 type: EXT [45056->61439] (req 45056->49151) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444cc4 expref: 48 pid: 166113 timeout: 22763 lvb_type: 0
00010000:00010000:0.0:1651531954.529915:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531954.529916:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531954.529918:0:166102:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e2f464ac/0x3234de053ca2be0 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 40 type: EXT [45056->61439] (req 45056->49151) gid 0 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444fb8 expref: 47 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.529921:0:166102:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2f464ac/0x3234de053ca2be0 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 40 type: EXT [45056->61439] (req 45056->49151) gid 0 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444fb8 expref: 47 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.529929:0:166102:0:(ldlm_lockd.c:1067:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000e2f464ac/0x3234de053ca2be0 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 40 type: EXT [45056->61439] (req 45056->49151) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444fb8 expref: 47 pid: 166112 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531954.529934:0:166102:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000716edf16 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:166102:1731745997348288:10.240.43.64@tcp:105:
00000100:00100000:0.0:1651531954.529943:0:166102:0:(client.c:2492:ptlrpc_set_wait()) set 000000000b5c3114 going to sleep for 6 seconds
00000100:00100000:0.0:1651531954.530141:0:166102:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000716edf16 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:166102:1731745997348288:10.240.43.64@tcp:105:
00010000:00010000:0.0:1651531954.530146:0:166102:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651531954.530154:0:166102:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003ec7b6d9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+47:438146:x1731754467297984:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 270us (299us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531954.530157:0:166102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 112
00000100:00100000:0.0:1651531954.534438:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.534446:0:216322:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467298496
00002000:00100000:0.0:1651531954.534452:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34545:0x0] (471040->479231)  req@00000000716edf16 x1731754467298496/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/0 e 0 to 0 dl 1651531960 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:0.0:1651531954.534456:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000716edf16 with x1731754467298496 ext(471040->479231)
00002000:00010000:0.0:1651531954.534457:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000716edf16
00000100:00100000:0.0:1651531954.534470:0:216322:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249619
00000100:00100000:0.0:1651531954.534474:0:216322:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000716edf16 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+47:438147:x1731754467298496:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651531954.534500:0:216322:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000716edf16 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+47:438147:x1731754467298496:12345-10.240.43.64@tcp:3:fio.0 Request processed in 25us (62us total) trans 0 rc 8192/8192
00000100:00100000:0.0:1651531954.534503:0:216322:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249619
00002000:00100000:0.0:1651531954.534504:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34545:0x0] (471040->479231)  req@00000000716edf16 x1731754467298496/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/8632 e 0 to 0 dl 1651531960 ref 1 fl Complete:/0/0 rc 8192/8192 job:'fio.0'
00002000:00100000:0.0:1651531954.534508:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000716edf16 with x1731754467298496 ext(471040->479231)
00002000:00010000:0.0:1651531954.534509:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000716edf16
00000100:00100000:0.0:1651531954.535542:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531954.535563:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467298560
00000100:00100000:1.0:1651531954.535570:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44353
00000100:00100000:1.0:1651531954.535572:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000805c4fb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+47:680971:x1731754467298560:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531954.535575:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531954.535578:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000035e369e2/0x3234de053ca2be7 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 40 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db444fc6 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.535584:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531954.535587:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531954.535589:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000035e369e2/0x3234de053ca2be7 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 40 type: EXT [569344->573439] (req 569344->573439) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444fc6 expref: 48 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.535593:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000035e369e2/0x3234de053ca2be7 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 40 type: EXT [569344->573439] (req 569344->573439) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444fc6 expref: 48 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.535597:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000035e369e2, rc 0)
00000100:00100000:1.0:1651531954.535612:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000805c4fb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+48:680971:x1731754467298560:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (70us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531954.535614:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44353
00000100:00100000:0.0:1651531954.535914:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.535922:0:216322:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467298688
00002000:00100000:0.0:1651531954.535928:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34545:0x0] (569344->585727)  req@00000000de979b88 x1731754467298688/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 504/0 e 0 to 0 dl 1651531960 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:0.0:1651531954.535932:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000de979b88 with x1731754467298688 ext(569344->585727)
00002000:00010000:0.0:1651531954.535935:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000de979b88
00000100:00100000:0.0:1651531954.535946:0:216322:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249620
00000100:00100000:0.0:1651531954.535947:0:216322:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000de979b88 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+48:438147:x1731754467298688:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651531954.536124:0:216322:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000de979b88 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+48:438147:x1731754467298688:12345-10.240.43.64@tcp:3:fio.0 Request processed in 175us (210us total) trans 0 rc 12288/12288
00000100:00100000:0.0:1651531954.536128:0:216322:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249620
00002000:00100000:0.0:1651531954.536130:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34545:0x0] (569344->585727)  req@00000000de979b88 x1731754467298688/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 504/440 e 0 to 0 dl 1651531960 ref 1 fl Complete:/0/0 rc 12288/12288 job:'fio.0'
00002000:00100000:0.0:1651531954.536133:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000de979b88 with x1731754467298688 ext(569344->585727)
00002000:00010000:0.0:1651531954.536136:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000de979b88
00000100:00100000:0.0:1651531954.536989:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.536996:0:216322:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467298816
00002000:00100000:0.0:1651531954.537002:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34545:0x0] (757760->765951)  req@0000000074e2ae90 x1731754467298816/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/0 e 0 to 0 dl 1651531960 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:0.0:1651531954.537006:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000074e2ae90 with x1731754467298816 ext(757760->765951)
00002000:00010000:0.0:1651531954.537007:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000074e2ae90
00000100:00100000:0.0:1651531954.537019:0:216322:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249621
00000100:00100000:0.0:1651531954.537020:0:216322:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000074e2ae90 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+48:438147:x1731754467298816:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651531954.537045:0:216322:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000074e2ae90 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+48:438147:x1731754467298816:12345-10.240.43.64@tcp:3:fio.0 Request processed in 24us (56us total) trans 0 rc 8192/8192
00000100:00100000:0.0:1651531954.537047:0:216322:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249621
00002000:00100000:0.0:1651531954.537049:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34545:0x0] (757760->765951)  req@0000000074e2ae90 x1731754467298816/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/8632 e 0 to 0 dl 1651531960 ref 1 fl Complete:/0/0 rc 8192/8192 job:'fio.0'
00002000:00100000:0.0:1651531954.537052:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000074e2ae90 with x1731754467298816 ext(757760->765951)
00002000:00010000:0.0:1651531954.537053:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000074e2ae90
00000100:00100000:0.0:1651531954.537497:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531954.537517:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467298880
00000100:00100000:1.0:1651531954.537526:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44354
00000100:00100000:1.0:1651531954.537528:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f8a13c4e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+48:680971:x1731754467298880:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531954.537531:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531954.537535:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000083070e4b/0x3234de053ca2bee lrc: 2/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 41 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db444fcd expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.537541:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531954.537542:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531954.537544:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000083070e4b/0x3234de053ca2bee lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 41 type: EXT [565248->569343] (req 565248->569343) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444fcd expref: 49 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.537548:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000083070e4b/0x3234de053ca2bee lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 41 type: EXT [565248->569343] (req 565248->569343) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444fcd expref: 49 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.537552:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000083070e4b, rc 0)
00000100:00100000:1.0:1651531954.537567:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f8a13c4e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+49:680971:x1731754467298880:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (71us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531954.537571:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44354
00000100:00100000:0.0:1651531954.538182:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531954.538211:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467298944
00000100:00100000:1.0:1651531954.538218:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44355
00000100:00100000:1.0:1651531954.538220:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ed7e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+49:680971:x1731754467298944:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531954.538237:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531954.538240:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000007a8a843/0x3234de053ca2bf5 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 42 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db444fd4 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.538246:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531954.538247:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531954.538249:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000007a8a843/0x3234de053ca2bf5 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 42 type: EXT [561152->565247] (req 561152->565247) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444fd4 expref: 50 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.538253:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000007a8a843/0x3234de053ca2bf5 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 42 type: EXT [561152->565247] (req 561152->565247) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444fd4 expref: 50 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.538257:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000007a8a843, rc 0)
00000100:00100000:1.0:1651531954.538269:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ed7e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+50:680971:x1731754467298944:12345-10.240.43.64@tcp:101:fio.0 Request processed in 48us (88us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531954.538272:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44355
00000100:00100000:0.0:1651531954.538537:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.538545:0:216322:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467299072
00002000:00100000:0.0:1651531954.538551:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34545:0x0] (561152->565247)  req@000000002da972de x1731754467299072/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/0 e 0 to 0 dl 1651531960 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:0.0:1651531954.538555:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000002da972de with x1731754467299072 ext(561152->565247)
00002000:00010000:0.0:1651531954.538556:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000002da972de
00000100:00100000:0.0:1651531954.538566:0:216322:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249622
00000100:00100000:0.0:1651531954.538568:0:216322:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002da972de pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+50:438147:x1731754467299072:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651531954.538591:0:216322:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002da972de pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+50:438147:x1731754467299072:12345-10.240.43.64@tcp:3:fio.0 Request processed in 23us (54us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531954.538594:0:216322:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249622
00002000:00100000:0.0:1651531954.538596:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34545:0x0] (561152->565247)  req@000000002da972de x1731754467299072/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/4536 e 0 to 0 dl 1651531960 ref 1 fl Complete:/0/0 rc 4096/4096 job:'fio.0'
00002000:00100000:0.0:1651531954.538599:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000002da972de with x1731754467299072 ext(561152->565247)
00002000:00010000:0.0:1651531954.538600:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000002da972de
00000100:00100000:0.0:1651531954.543964:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531954.543984:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467299520
00000100:00100000:1.0:1651531954.543995:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44356
00000100:00100000:1.0:1651531954.543997:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000063553cfb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+50:680971:x1731754467299520:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531954.544000:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531954.544003:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cfb802a0/0x3234de053ca2bfc lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 43 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db444fdb expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.544013:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531954.544013:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531954.544015:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cfb802a0/0x3234de053ca2bfc lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 43 type: EXT [438272->442367] (req 438272->442367) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444fdb expref: 51 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.544019:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cfb802a0/0x3234de053ca2bfc lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 43 type: EXT [438272->442367] (req 438272->442367) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444fdb expref: 51 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.544023:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000cfb802a0, rc 0)
00000100:00100000:1.0:1651531954.544037:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000063553cfb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+51:680971:x1731754467299520:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (73us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531954.544039:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44356
00000100:00100000:0.0:1651531954.544337:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.544345:0:216322:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467299648
00002000:00100000:0.0:1651531954.544351:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34545:0x0] (438272->454655)  req@000000006b01e096 x1731754467299648/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 504/0 e 0 to 0 dl 1651531960 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:0.0:1651531954.544355:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000006b01e096 with x1731754467299648 ext(438272->454655)
00002000:00010000:0.0:1651531954.544358:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000006b01e096
00000100:00100000:0.0:1651531954.544368:0:216322:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249623
00000100:00100000:0.0:1651531954.544370:0:216322:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006b01e096 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+51:438147:x1731754467299648:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651531954.544543:0:216322:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006b01e096 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+51:438147:x1731754467299648:12345-10.240.43.64@tcp:3:fio.0 Request processed in 171us (206us total) trans 0 rc 12288/12288
00000100:00100000:0.0:1651531954.544546:0:216322:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249623
00002000:00100000:0.0:1651531954.544548:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34545:0x0] (438272->454655)  req@000000006b01e096 x1731754467299648/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 504/440 e 0 to 0 dl 1651531960 ref 1 fl Complete:/0/0 rc 12288/12288 job:'fio.0'
00002000:00100000:0.0:1651531954.544552:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000006b01e096 with x1731754467299648 ext(438272->454655)
00002000:00010000:0.0:1651531954.544555:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000006b01e096
00000100:00100000:0.0:1651531954.545843:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.545852:0:216322:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467299968
00002000:00100000:0.0:1651531954.545858:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34545:0x0] (184320->192511)  req@00000000c71c441b x1731754467299968/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/0 e 0 to 0 dl 1651531960 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:0.0:1651531954.545862:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000c71c441b with x1731754467299968 ext(184320->192511)
00002000:00010000:0.0:1651531954.545863:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000c71c441b
00000100:00100000:0.0:1651531954.545874:0:216322:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249624
00000100:00100000:0.0:1651531954.545876:0:216322:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c71c441b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+51:438147:x1731754467299968:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651531954.545900:0:216322:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c71c441b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+51:438147:x1731754467299968:12345-10.240.43.64@tcp:3:fio.0 Request processed in 24us (57us total) trans 0 rc 8192/8192
00000100:00100000:0.0:1651531954.545903:0:216322:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249624
00002000:00100000:0.0:1651531954.545905:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34545:0x0] (184320->192511)  req@00000000c71c441b x1731754467299968/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/8632 e 0 to 0 dl 1651531960 ref 1 fl Complete:/0/0 rc 8192/8192 job:'fio.0'
00002000:00100000:0.0:1651531954.545908:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000c71c441b with x1731754467299968 ext(184320->192511)
00002000:00010000:0.0:1651531954.545910:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000c71c441b
00000100:00100000:0.0:1651531954.551025:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.551033:0:216322:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467300480
00002000:00100000:0.0:1651531954.551039:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34545:0x0] (806912->815103)  req@000000007be3214f x1731754467300480/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/0 e 0 to 0 dl 1651531960 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:0.0:1651531954.551043:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000007be3214f with x1731754467300480 ext(806912->815103)
00002000:00010000:0.0:1651531954.551044:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000007be3214f
00000100:00100000:0.0:1651531954.551054:0:216322:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249625
00000100:00100000:0.0:1651531954.551056:0:216322:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007be3214f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+51:438146:x1731754467300480:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651531954.551081:0:216322:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007be3214f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+51:438146:x1731754467300480:12345-10.240.43.64@tcp:3:fio.0 Request processed in 25us (57us total) trans 0 rc 8192/8192
00000100:00100000:0.0:1651531954.551087:0:216322:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249625
00002000:00100000:0.0:1651531954.551089:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34545:0x0] (806912->815103)  req@000000007be3214f x1731754467300480/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/8632 e 0 to 0 dl 1651531960 ref 1 fl Complete:/0/0 rc 8192/8192 job:'fio.0'
00002000:00100000:0.0:1651531954.551092:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000007be3214f with x1731754467300480 ext(806912->815103)
00002000:00010000:0.0:1651531954.551093:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000007be3214f
00000100:00100000:0.0:1651531954.552905:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.552913:0:216322:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467300736
00002000:00100000:0.0:1651531954.552919:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34545:0x0] (933888->946175)  req@000000005570aec4 x1731754467300736/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 504/0 e 0 to 0 dl 1651531960 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:0.0:1651531954.552923:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000005570aec4 with x1731754467300736 ext(933888->946175)
00002000:00010000:0.0:1651531954.552924:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000005570aec4
00000100:00100000:0.0:1651531954.552935:0:216322:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249626
00000100:00100000:0.0:1651531954.552936:0:216322:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005570aec4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+51:438146:x1731754467300736:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651531954.553178:0:216322:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005570aec4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+51:438146:x1731754467300736:12345-10.240.43.64@tcp:3:fio.0 Request processed in 240us (273us total) trans 0 rc 8192/8192
00000100:00100000:0.0:1651531954.553181:0:216322:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249626
00002000:00100000:0.0:1651531954.553183:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34545:0x0] (933888->946175)  req@000000005570aec4 x1731754467300736/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 504/440 e 0 to 0 dl 1651531960 ref 1 fl Complete:/0/0 rc 8192/8192 job:'fio.0'
00002000:00100000:0.0:1651531954.553186:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000005570aec4 with x1731754467300736 ext(933888->946175)
00002000:00010000:0.0:1651531954.553188:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000005570aec4
00000100:00100000:0.0:1651531954.553470:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531954.553490:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467300800
00000100:00100000:1.0:1651531954.553500:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44357
00000100:00100000:1.0:1651531954.553502:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004bb4b5db pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+51:680971:x1731754467300800:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531954.553505:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531954.553520:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000768f2bc3/0x3234de053ca2c03 lrc: 2/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 44 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db444ff0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.553528:0:166112:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000958e71ef/0x3234de053ca2bd2 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 44 type: EXT [360448->401407] (req 360448->364543) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444f79 expref: 52 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.553531:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531954.553531:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531954.553532:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000768f2bc3/0x3234de053ca2c03 lrc: 4/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 44 type: EXT [372736->376831] (req 372736->376831) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444ff0 expref: 52 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.553543:0:166112:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000958e71ef/0x3234de053ca2bd2 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 44 type: EXT [360448->401407] (req 360448->364543) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444f79 expref: 52 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.553547:0:166112:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000958e71ef/0x3234de053ca2bd2 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 44 type: EXT [360448->401407] (req 360448->364543) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444f79 expref: 52 pid: 206699 timeout: 22763 lvb_type: 0
00000100:00100000:1.0:1651531954.553551:0:166112:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004a600aad pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:166112:1731745997348352:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531954.553568:0:166112:0:(client.c:2492:ptlrpc_set_wait()) set 0000000030e02371 going to sleep for 6 seconds
00000100:00100000:1.0:1651531954.553783:0:166112:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004a600aad pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:166112:1731745997348352:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651531954.553788:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000768f2bc3/0x3234de053ca2c03 lrc: 3/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 44 type: EXT [372736->376831] (req 372736->376831) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444ff0 expref: 52 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.553793:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000768f2bc3, rc 0)
00000100:00100000:1.0:1651531954.553805:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004bb4b5db pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+52:680971:x1731754467300800:12345-10.240.43.64@tcp:101:fio.0 Request processed in 302us (335us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531954.553807:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44357
00000100:00100000:0.0:1651531954.553865:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.553873:0:166102:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467300864
00010000:00010000:0.0:1651531954.553878:0:166102:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000958e71ef/0x3234de053ca2bd2 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 44 type: EXT [360448->401407] (req 360448->364543) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444f79 expref: 52 pid: 206699 timeout: 22763 lvb_type: 0
00000100:00100000:0.0:1651531954.553893:0:166102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 113
00000100:00100000:0.0:1651531954.553895:0:166102:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003d0ff310 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+52:438149:x1731754467300864:12345-10.240.43.64@tcp:103:ldlm_bl_04.0
00010000:00010000:0.0:1651531954.553898:0:166102:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531954.553902:0:166102:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000958e71ef/0x3234de053ca2bd2 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 45 type: EXT [360448->401407] (req 360448->364543) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444f79 expref: 52 pid: 206699 timeout: 22763 lvb_type: 0
00010000:00010000:0.0:1651531954.553906:0:166102:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000958e71ef/0x3234de053ca2bd2 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 45 type: EXT [360448->401407] (req 360448->364543) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444f79 expref: 52 pid: 206699 timeout: 22763 lvb_type: 0
00010000:00010000:0.0:1651531954.553913:0:166102:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000958e71ef/0x3234de053ca2bd2 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 45 type: EXT [360448->401407] (req 360448->364543) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444f79 expref: 52 pid: 206699 timeout: 22763 lvb_type: 0
00010000:00010000:0.0:1651531954.553917:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531954.553918:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531954.553920:0:166102:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000768f2bc3/0x3234de053ca2c03 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 44 type: EXT [372736->393215] (req 372736->376831) gid 0 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444ff0 expref: 51 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.553924:0:166102:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000768f2bc3/0x3234de053ca2c03 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 44 type: EXT [372736->393215] (req 372736->376831) gid 0 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444ff0 expref: 51 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.553935:0:166102:0:(ldlm_lockd.c:1067:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000768f2bc3/0x3234de053ca2c03 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 44 type: EXT [372736->393215] (req 372736->376831) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444ff0 expref: 51 pid: 166112 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531954.553939:0:166102:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cbff3255 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:166102:1731745997348416:10.240.43.64@tcp:105:
00000100:00100000:0.0:1651531954.553950:0:166102:0:(client.c:2492:ptlrpc_set_wait()) set 000000000b5c3114 going to sleep for 6 seconds
00000100:00100000:0.0:1651531954.554146:0:166102:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cbff3255 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:166102:1731745997348416:10.240.43.64@tcp:105:
00010000:00010000:0.0:1651531954.554151:0:166102:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651531954.554159:0:166102:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003d0ff310 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+51:438149:x1731754467300864:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 263us (294us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531954.554162:0:166102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 113
00000100:00100000:0.0:1651531954.555092:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.555100:0:216322:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467301120
00002000:00100000:0.0:1651531954.555106:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34545:0x0] (270336->278527)  req@00000000cbff3255 x1731754467301120/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/0 e 0 to 0 dl 1651531960 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:0.0:1651531954.555110:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000cbff3255 with x1731754467301120 ext(270336->278527)
00002000:00010000:0.0:1651531954.555111:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000cbff3255
00000100:00100000:0.0:1651531954.555124:0:216322:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249627
00000100:00100000:0.0:1651531954.555126:0:216322:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cbff3255 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+51:438146:x1731754467301120:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651531954.555152:0:216322:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cbff3255 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+51:438146:x1731754467301120:12345-10.240.43.64@tcp:3:fio.0 Request processed in 25us (61us total) trans 0 rc 8192/8192
00000100:00100000:0.0:1651531954.555155:0:216322:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249627
00002000:00100000:0.0:1651531954.555157:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34545:0x0] (270336->278527)  req@00000000cbff3255 x1731754467301120/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/8632 e 0 to 0 dl 1651531960 ref 1 fl Complete:/0/0 rc 8192/8192 job:'fio.0'
00002000:00100000:0.0:1651531954.555160:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000cbff3255 with x1731754467301120 ext(270336->278527)
00002000:00010000:0.0:1651531954.555161:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000cbff3255
00000001:00080000:0.0:1651531954.562422:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869061 is committed
00010000:00010000:0.0:1651531954.562436:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000df4fd81c/0x3234de053ca2b15 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 43 type: EXT [458752->462847] (req 458752->462847) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.562441:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000df4fd81c/0x3234de053ca2b15 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 43 type: EXT [458752->462847] (req 458752->462847) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531954.562463:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e3025285 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+46:438149:x1731754467278592:12345-10.240.43.64@tcp:4:fio.0 Request processed in 108407us (108441us total) trans 21474869061 rc 0/0
00000100:00100000:0.0:1651531954.562466:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249578
00010000:00010000:1.0:1651531954.562467:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000df4fd81c/0x3234de053ca2b15 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 43 type: EXT [458752->462847] (req 458752->462847) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.562471:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000df4fd81c already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531954.562473:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000df4fd81c/0x3234de053ca2b15 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 43 type: EXT [458752->462847] (req 458752->462847) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.562476:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000df4fd81c/0x3234de053ca2b15 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 43 type: EXT [458752->462847] (req 458752->462847) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.562486:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000df4fd81c/0x3234de053ca2b15 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 43 type: EXT [458752->462847] (req 458752->462847) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.562489:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000df4fd81c/0x3234de053ca2b15 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 43 type: EXT [458752->462847] (req 458752->462847) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531954.564341:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.564350:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.564357:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467301568
00000100:00100000:0.0:1651531954.564371:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467301632
00000100:00100000:0.0:1651531954.564377:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249628
00000100:00100000:0.0:1651531954.564379:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d3ae4aac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+47:438148:x1731754467301568:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651531954.564381:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249629
00000100:00100000:1.0:1651531954.564383:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c5fb44d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+47:438148:x1731754467301632:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531954.564386:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000958e71ef/0x3234de053ca2c0a lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 43 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.564391:0:166118:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e2f464ac/0x3234de053ca2be0 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 44 type: EXT [45056->61439] (req 45056->49151) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444fb8 expref: 47 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.564392:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000030d4a6f9/0x3234de053ca2c11 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 45 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.564395:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531954.564396:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531954.564396:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000958e71ef/0x3234de053ca2c0a lrc: 4/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 44 type: EXT [49152->53247] (req 49152->53247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.564402:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531954.564402:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531954.564404:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000030d4a6f9/0x3234de053ca2c11 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 44 type: EXT [397312->401407] (req 397312->401407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.564408:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000030d4a6f9/0x3234de053ca2c11 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 44 type: EXT [397312->401407] (req 397312->401407) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.564411:0:166118:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e2f464ac/0x3234de053ca2be0 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 44 type: EXT [45056->61439] (req 45056->49151) gid 0 flags: 0x50000000020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444fb8 expref: 47 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.564415:0:166118:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e2f464ac/0x3234de053ca2be0 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 44 type: EXT [45056->61439] (req 45056->49151) gid 0 flags: 0x70000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444fb8 expref: 47 pid: 166112 timeout: 22763 lvb_type: 0
00000100:00100000:0.0:1651531954.564419:0:166118:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f27573c4 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:166118:1731745997348480:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651531954.564421:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000030d4a6f9/0x3234de053ca2c11 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 44 type: EXT [397312->401407] (req 397312->401407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.564424:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000030d4a6f9/0x3234de053ca2c11 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 44 type: EXT [397312->401407] (req 397312->401407) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531954.564432:0:166118:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f23eeb5f going to sleep for 6 seconds
00000100:00100000:1.0:1651531954.564439:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c5fb44d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+47:438148:x1731754467301632:12345-10.240.43.64@tcp:3:fio.0 Request processed in 55us (89us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531954.564444:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249629
00010000:00010000:1.0:1651531954.564452:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000030d4a6f9/0x3234de053ca2c11 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 44 type: EXT [397312->401407] (req 397312->401407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.564455:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000030d4a6f9 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531954.564456:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000030d4a6f9/0x3234de053ca2c11 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 44 type: EXT [397312->401407] (req 397312->401407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.564459:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000030d4a6f9/0x3234de053ca2c11 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 44 type: EXT [397312->401407] (req 397312->401407) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.564464:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000030d4a6f9/0x3234de053ca2c11 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 44 type: EXT [397312->401407] (req 397312->401407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.564476:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000030d4a6f9/0x3234de053ca2c11 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 44 type: EXT [397312->401407] (req 397312->401407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531954.564479:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531954.564497:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467301760
00000100:00100000:1.0:1651531954.564513:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44358
00000100:00100000:1.0:1651531954.564515:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000312d9782 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+47:680969:x1731754467301760:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531954.564518:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531954.564522:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004e1f4768/0x3234de053ca2c18 lrc: 2/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 44 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445005 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.564527:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531954.564528:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531954.564530:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e1f4768/0x3234de053ca2c18 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 44 type: EXT [458752->462847] (req 458752->462847) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445005 expref: 48 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.564538:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004e1f4768/0x3234de053ca2c18 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 44 type: EXT [458752->462847] (req 458752->462847) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445005 expref: 48 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.564542:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004e1f4768, rc 0)
00000100:00100000:1.0:1651531954.564552:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000312d9782 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+48:680969:x1731754467301760:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (73us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531954.564554:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44358
00000100:00100000:0.0:1651531954.565668:0:166118:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f27573c4 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:166118:1731745997348480:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531954.565672:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651531954.565673:0:166118:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000958e71ef/0x3234de053ca2c0a lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 44 type: EXT [49152->53247] (req 49152->53247) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531954.565681:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467301952
00002000:00100000:1.0:1651531954.565688:0:192755:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x100010000:0x34545:0x0] (4096->1044479)  req@000000004a600aad x1731754467301952/t0(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 1464/0 e 0 to 0 dl 1651531960 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:1.0:1651531954.565692:0:192755:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000004a600aad with x1731754467301952 ext(4096->1044479)
00010000:00010000:1.0:1651531954.565697:0:192755:0:(ldlm_lockd.c:599:ldlm_refresh_waiting_lock()) ### refreshed to 81s ns: filter-lustre-OST0001_UUID lock: 00000000e2f464ac/0x3234de053ca2be0 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 45 type: EXT [45056->61439] (req 45056->49151) gid 0 flags: 0x60000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444fb8 expref: 48 pid: 166112 timeout: 22763 lvb_type: 0
00002000:00010000:1.0:1651531954.565701:0:192755:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req 000000004a600aad
00000100:00100000:1.0:1651531954.565713:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 10
00000100:00100000:1.0:1651531954.565715:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004a600aad pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+48:438147:x1731754467301952:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651531954.566208:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.566245:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467302016
00000100:00100000:0.0:1651531954.566253:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44359
00000100:00100000:0.0:1651531954.566255:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f27573c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+50:680969:x1731754467302016:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531954.566290:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531954.566294:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004233736c/0x3234de053ca2c1f lrc: 2/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 45 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44500c expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.566302:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531954.566302:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531954.566305:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004233736c/0x3234de053ca2c1f lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 45 type: EXT [434176->438271] (req 434176->438271) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44500c expref: 51 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.566309:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004233736c/0x3234de053ca2c1f lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 45 type: EXT [434176->438271] (req 434176->438271) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44500c expref: 51 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.566314:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004233736c, rc 0)
00000100:00100000:0.0:1651531954.566331:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f27573c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+51:680969:x1731754467302016:12345-10.240.43.64@tcp:101:fio.0 Request processed in 75us (131us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531954.566334:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44359
00000100:00100000:1.0:1651531954.567613:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004a600aad pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+51:438147:x1731754467301952:12345-10.240.43.64@tcp:4:fio.0 Request processed in 1896us (1941us total) trans 21474869062 rc 0/0
00000100:00100000:1.0:1651531954.567617:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 10
00002000:00100000:1.0:1651531954.567620:0:192755:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x100010000:0x34545:0x0] (4096->1044479)  req@000000004a600aad x1731754467301952/t21474869062(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 1464/688 e 0 to 0 dl 1651531960 ref 1 fl Complete:H/0/0 rc 0/0 job:'fio.0'
00002000:00100000:1.0:1651531954.567624:0:192755:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000004a600aad with x1731754467301952 ext(4096->1044479)
00010000:00010000:1.0:1651531954.567630:0:192755:0:(ldlm_lockd.c:599:ldlm_refresh_waiting_lock()) ### refreshed to 81s ns: filter-lustre-OST0001_UUID lock: 00000000e2f464ac/0x3234de053ca2be0 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 46 type: EXT [45056->61439] (req 45056->49151) gid 0 flags: 0x60000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444fb8 expref: 51 pid: 166112 timeout: 22763 lvb_type: 0
00002000:00010000:1.0:1651531954.567635:0:192755:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req 000000004a600aad
00000100:00100000:1.0:1651531954.568489:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.568507:0:166102:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467302144
00010000:00010000:0.0:1651531954.568514:0:166102:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e2f464ac/0x3234de053ca2be0 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 45 type: EXT [45056->61439] (req 45056->49151) gid 0 flags: 0x60000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444fb8 expref: 51 pid: 166112 timeout: 22763 lvb_type: 0
00000100:00100000:0.0:1651531954.568527:0:166102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 114
00000100:00100000:0.0:1651531954.568529:0:166102:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004650255e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+51:438146:x1731754467302144:12345-10.240.43.64@tcp:103:ldlm_bl_01.0
00010000:00010000:0.0:1651531954.568532:0:166102:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531954.568537:0:166102:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e2f464ac/0x3234de053ca2be0 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 46 type: EXT [45056->61439] (req 45056->49151) gid 0 flags: 0x60000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444fb8 expref: 51 pid: 166112 timeout: 22763 lvb_type: 0
00010000:00010000:0.0:1651531954.568541:0:166102:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e2f464ac/0x3234de053ca2be0 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 46 type: EXT [45056->61439] (req 45056->49151) gid 0 flags: 0x50000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444fb8 expref: 51 pid: 166112 timeout: 22763 lvb_type: 0
00010000:00010000:0.0:1651531954.568547:0:166102:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2f464ac/0x3234de053ca2be0 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 46 type: EXT [45056->61439] (req 45056->49151) gid 0 flags: 0x44801400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444fb8 expref: 51 pid: 166112 timeout: 22763 lvb_type: 0
00010000:00010000:0.0:1651531954.568551:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531954.568551:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531954.568552:0:166102:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000958e71ef/0x3234de053ca2c0a lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 45 type: EXT [49152->53247] (req 49152->53247) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.568555:0:166102:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000958e71ef/0x3234de053ca2c0a lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 45 type: EXT [49152->53247] (req 49152->53247) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.568563:0:166102:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651531954.568572:0:166102:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004650255e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+50:438146:x1731754467302144:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 42us (84us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531954.568575:0:166102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 114
00010000:00010000:0.0:1651531954.568581:0:166118:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000958e71ef/0x3234de053ca2c0a lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 44 type: EXT [49152->53247] (req 49152->53247) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.568588:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000958e71ef/0x3234de053ca2c0a lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 44 type: EXT [49152->53247] (req 49152->53247) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531954.570329:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.570347:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467302528
00000100:00100000:0.0:1651531954.570359:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44360
00000100:00100000:0.0:1651531954.570360:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000070160f29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+52:680972:x1731754467302528:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531954.570364:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531954.570368:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000d9e7472/0x3234de053ca2c26 lrc: 2/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 45 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445021 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.570375:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531954.570375:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531954.570378:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000d9e7472/0x3234de053ca2c26 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 45 type: EXT [53248->61439] (req 53248->57343) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445021 expref: 53 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.570383:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000d9e7472/0x3234de053ca2c26 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 45 type: EXT [53248->61439] (req 53248->57343) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445021 expref: 53 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.570386:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000000d9e7472, rc 0)
00000100:00100000:0.0:1651531954.570398:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000070160f29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+53:680972:x1731754467302528:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (69us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531954.570400:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44360
00000100:00100000:1.0:1651531954.570468:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531954.570476:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467302656
00002000:00100000:1.0:1651531954.570483:0:192755:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x100010000:0x34545:0x0] (487424->491519)  req@0000000074ec16e8 x1731754467302656/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/0 e 0 to 0 dl 1651531960 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:1.0:1651531954.570488:0:192755:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000074ec16e8 with x1731754467302656 ext(487424->491519)
00002000:00010000:1.0:1651531954.570489:0:192755:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000074ec16e8
00000100:00100000:1.0:1651531954.570499:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249630
00000100:00100000:1.0:1651531954.570501:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000074ec16e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+53:438146:x1731754467302656:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651531954.570526:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000074ec16e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+53:438146:x1731754467302656:12345-10.240.43.64@tcp:3:fio.0 Request processed in 24us (58us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531954.570529:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249630
00002000:00100000:1.0:1651531954.570531:0:192755:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x100010000:0x34545:0x0] (487424->491519)  req@0000000074ec16e8 x1731754467302656/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/4536 e 0 to 0 dl 1651531960 ref 1 fl Complete:/0/0 rc 4096/4096 job:'fio.0'
00002000:00100000:1.0:1651531954.570534:0:192755:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000074ec16e8 with x1731754467302656 ext(487424->491519)
00002000:00010000:1.0:1651531954.570536:0:192755:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000074ec16e8
00000100:00100000:1.0:1651531954.571186:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531954.571195:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467303040
00002000:00100000:1.0:1651531954.571211:0:192755:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x100010000:0x34545:0x0] (299008->303103)  req@00000000892fc799 x1731754467303040/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/0 e 0 to 0 dl 1651531960 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:1.0:1651531954.571219:0:192755:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000892fc799 with x1731754467303040 ext(299008->303103)
00002000:00010000:1.0:1651531954.571221:0:192755:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000892fc799
00000100:00100000:1.0:1651531954.571243:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249631
00000100:00100000:1.0:1651531954.571245:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000892fc799 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+53:438146:x1731754467303040:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651531954.571271:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000892fc799 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+53:438146:x1731754467303040:12345-10.240.43.64@tcp:3:fio.0 Request processed in 25us (86us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531954.571274:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249631
00002000:00100000:1.0:1651531954.571276:0:192755:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x100010000:0x34545:0x0] (299008->303103)  req@00000000892fc799 x1731754467303040/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/4536 e 0 to 0 dl 1651531960 ref 1 fl Complete:/0/0 rc 4096/4096 job:'fio.0'
00002000:00100000:1.0:1651531954.571279:0:192755:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000892fc799 with x1731754467303040 ext(299008->303103)
00002000:00010000:1.0:1651531954.571280:0:192755:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000892fc799
00000100:00100000:1.0:1651531954.573734:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531954.573741:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467303680
00002000:00100000:1.0:1651531954.573747:0:192755:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x100010000:0x34545:0x0] (376832->393215)  req@00000000a6b11c0f x1731754467303680/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/0 e 0 to 0 dl 1651531960 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:1.0:1651531954.573750:0:192755:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000a6b11c0f with x1731754467303680 ext(376832->393215)
00002000:00010000:1.0:1651531954.573752:0:192755:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000a6b11c0f
00000100:00100000:1.0:1651531954.573762:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249632
00000100:00100000:1.0:1651531954.573763:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a6b11c0f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+53:438146:x1731754467303680:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651531954.573790:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a6b11c0f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+53:438146:x1731754467303680:12345-10.240.43.64@tcp:3:fio.0 Request processed in 26us (57us total) trans 0 rc 16384/16384
00000100:00100000:1.0:1651531954.573793:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249632
00002000:00100000:1.0:1651531954.573795:0:192755:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x100010000:0x34545:0x0] (376832->393215)  req@00000000a6b11c0f x1731754467303680/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/16824 e 0 to 0 dl 1651531960 ref 1 fl Complete:/0/0 rc 16384/16384 job:'fio.0'
00002000:00100000:1.0:1651531954.573800:0:192755:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000a6b11c0f with x1731754467303680 ext(376832->393215)
00002000:00010000:1.0:1651531954.573801:0:192755:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000a6b11c0f
00000100:00100000:1.0:1651531954.575104:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531954.575112:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467303808
00002000:00100000:1.0:1651531954.575118:0:192755:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x100010000:0x34545:0x0] (880640->884735)  req@00000000a1321e85 x1731754467303808/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/0 e 0 to 0 dl 1651531960 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:1.0:1651531954.575121:0:192755:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000a1321e85 with x1731754467303808 ext(880640->884735)
00002000:00010000:1.0:1651531954.575123:0:192755:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000a1321e85
00000100:00100000:1.0:1651531954.575132:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249633
00000100:00100000:1.0:1651531954.575134:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a1321e85 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+53:438147:x1731754467303808:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651531954.575156:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a1321e85 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+53:438147:x1731754467303808:12345-10.240.43.64@tcp:3:fio.0 Request processed in 22us (52us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531954.575159:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249633
00002000:00100000:1.0:1651531954.575161:0:192755:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x100010000:0x34545:0x0] (880640->884735)  req@00000000a1321e85 x1731754467303808/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/4536 e 0 to 0 dl 1651531960 ref 1 fl Complete:/0/0 rc 4096/4096 job:'fio.0'
00002000:00100000:1.0:1651531954.575164:0:192755:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000a1321e85 with x1731754467303808 ext(880640->884735)
00002000:00010000:1.0:1651531954.575166:0:192755:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000a1321e85
00000100:00100000:1.0:1651531954.578130:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.578152:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467304000
00000100:00100000:0.0:1651531954.578164:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44361
00000100:00100000:0.0:1651531954.578166:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004f13e53f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+53:680969:x1731754467304000:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531954.578169:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531954.578174:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003cf86247/0x3234de053ca2c2d lrc: 2/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 46 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445052 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.578180:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531954.578181:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531954.578184:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003cf86247/0x3234de053ca2c2d lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 46 type: EXT [102400->114687] (req 102400->106495) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445052 expref: 54 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.578188:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003cf86247/0x3234de053ca2c2d lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 46 type: EXT [102400->114687] (req 102400->106495) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445052 expref: 54 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.578192:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003cf86247, rc 0)
00000100:00100000:0.0:1651531954.578211:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004f13e53f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+54:680969:x1731754467304000:12345-10.240.43.64@tcp:101:fio.0 Request processed in 44us (81us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531954.578214:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44361
00000001:00080000:0.0:1651531954.885439:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869063 is committed
00010000:00010000:0.0:1651531954.885456:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000958e71ef/0x3234de053ca2c0a lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 46 type: EXT [49152->53247] (req 49152->53247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.885460:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000958e71ef/0x3234de053ca2c0a lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 46 type: EXT [49152->53247] (req 49152->53247) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531954.885485:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d3ae4aac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+49:438148:x1731754467301568:12345-10.240.43.64@tcp:4:fio.0 Request processed in 321104us (321144us total) trans 21474869063 rc 0/0
00000100:00100000:0.0:1651531954.885488:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249628
00010000:00010000:0.0:1651531954.885496:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000958e71ef/0x3234de053ca2c0a lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 46 type: EXT [49152->53247] (req 49152->53247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.885500:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000958e71ef already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531954.885503:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000958e71ef/0x3234de053ca2c0a lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 46 type: EXT [49152->53247] (req 49152->53247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.885506:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000958e71ef/0x3234de053ca2c0a lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 46 type: EXT [49152->53247] (req 49152->53247) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.885511:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000958e71ef/0x3234de053ca2c0a lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 46 type: EXT [49152->53247] (req 49152->53247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.885514:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000958e71ef/0x3234de053ca2c0a lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 46 type: EXT [49152->53247] (req 49152->53247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531954.900867:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.900876:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467305152
00000100:00100000:0.0:1651531954.900891:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44362
00000100:00100000:0.0:1651531954.900893:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000eef74747 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+49:680969:x1731754467305152:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531954.900897:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531954.900902:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000958e71ef/0x3234de053ca2c34 lrc: 2/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 46 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445059 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.900909:0:166112:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cfb802a0/0x3234de053ca2bfc lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 46 type: EXT [438272->442367] (req 438272->442367) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444fdb expref: 50 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.900913:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531954.900913:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531954.900914:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000958e71ef/0x3234de053ca2c34 lrc: 4/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 46 type: EXT [438272->442367] (req 438272->442367) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445059 expref: 50 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.900922:0:166112:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cfb802a0/0x3234de053ca2bfc lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 46 type: EXT [438272->442367] (req 438272->442367) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444fdb expref: 50 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.900927:0:166112:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cfb802a0/0x3234de053ca2bfc lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 46 type: EXT [438272->442367] (req 438272->442367) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444fdb expref: 50 pid: 166112 timeout: 22763 lvb_type: 0
00000100:00100000:0.0:1651531954.900932:0:166112:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004105a3e3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:166112:1731745997348544:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531954.900949:0:166112:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f23eeb5f going to sleep for 6 seconds
00000100:00100000:0.0:1651531954.901151:0:166112:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004105a3e3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:166112:1731745997348544:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651531954.901157:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000958e71ef/0x3234de053ca2c34 lrc: 3/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 46 type: EXT [438272->442367] (req 438272->442367) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445059 expref: 50 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.901162:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000958e71ef, rc 0)
00000100:00100000:0.0:1651531954.901178:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000eef74747 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+50:680969:x1731754467305152:12345-10.240.43.64@tcp:101:fio.0 Request processed in 284us (311us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531954.901181:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44362
00000100:00100000:0.0:1651531954.901268:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.901275:0:166102:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467305216
00010000:00010000:0.0:1651531954.901281:0:166102:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cfb802a0/0x3234de053ca2bfc lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 46 type: EXT [438272->442367] (req 438272->442367) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444fdb expref: 50 pid: 166112 timeout: 22763 lvb_type: 0
00000100:00100000:0.0:1651531954.901296:0:166102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 115
00000100:00100000:0.0:1651531954.901298:0:166102:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004105a3e3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+50:438147:x1731754467305216:12345-10.240.43.64@tcp:103:ldlm_bl_05.0
00010000:00010000:0.0:1651531954.901301:0:166102:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531954.901305:0:166102:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cfb802a0/0x3234de053ca2bfc lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 47 type: EXT [438272->442367] (req 438272->442367) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444fdb expref: 50 pid: 166112 timeout: 22763 lvb_type: 0
00010000:00010000:0.0:1651531954.901313:0:166102:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cfb802a0/0x3234de053ca2bfc lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 47 type: EXT [438272->442367] (req 438272->442367) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444fdb expref: 50 pid: 166112 timeout: 22763 lvb_type: 0
00010000:00010000:0.0:1651531954.901319:0:166102:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cfb802a0/0x3234de053ca2bfc lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 47 type: EXT [438272->442367] (req 438272->442367) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444fdb expref: 50 pid: 166112 timeout: 22763 lvb_type: 0
00010000:00010000:0.0:1651531954.901323:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531954.901324:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531954.901345:0:166102:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000958e71ef/0x3234de053ca2c34 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 46 type: EXT [438272->442367] (req 438272->442367) gid 0 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445059 expref: 49 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.901350:0:166102:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000958e71ef/0x3234de053ca2c34 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 46 type: EXT [438272->442367] (req 438272->442367) gid 0 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445059 expref: 49 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.901359:0:166102:0:(ldlm_lockd.c:1067:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000958e71ef/0x3234de053ca2c34 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 46 type: EXT [438272->442367] (req 438272->442367) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445059 expref: 49 pid: 166112 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531954.901363:0:166102:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005d4138a1 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:166102:1731745997348608:10.240.43.64@tcp:105:
00000100:00100000:0.0:1651531954.901376:0:166102:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f23eeb5f going to sleep for 6 seconds
00000100:00100000:1.0:1651531954.901378:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531954.901401:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467305344
00000100:00100000:1.0:1651531954.901423:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249634
00000100:00100000:1.0:1651531954.901425:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004fdbac20 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+50:438149:x1731754467305344:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531954.901435:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000030d4a6f9/0x3234de053ca2c3b lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 47 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.901443:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531954.901443:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531954.901445:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000030d4a6f9/0x3234de053ca2c3b lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 47 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.901449:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000030d4a6f9/0x3234de053ca2c3b lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 47 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.901462:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000030d4a6f9/0x3234de053ca2c3b lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 47 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.901465:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000030d4a6f9/0x3234de053ca2c3b lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 47 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531954.901489:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004fdbac20 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+50:438149:x1731754467305344:12345-10.240.43.64@tcp:3:fio.0 Request processed in 63us (112us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531954.901493:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249634
00010000:00010000:1.0:1651531954.901500:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000030d4a6f9/0x3234de053ca2c3b lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 47 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.901504:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000030d4a6f9 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531954.901505:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000030d4a6f9/0x3234de053ca2c3b lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 47 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.901508:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000030d4a6f9/0x3234de053ca2c3b lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 47 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.901513:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000030d4a6f9/0x3234de053ca2c3b lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 47 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.901517:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000030d4a6f9/0x3234de053ca2c3b lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 47 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531954.901936:0:166102:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005d4138a1 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:166102:1731745997348608:10.240.43.64@tcp:105:
00010000:00010000:0.0:1651531954.901940:0:166102:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651531954.901955:0:166102:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004105a3e3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+49:438147:x1731754467305216:12345-10.240.43.64@tcp:103:ldlm_bl_05.0 Request processed in 656us (688us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531954.901958:0:166102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 115
00000100:00100000:0.0:1651531954.902422:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.902429:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467305792
00002000:00100000:0.0:1651531954.902439:0:192755:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x100010000:0x34545:0x0] (57344->61439)  req@000000005d4138a1 x1731754467305792/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/0 e 0 to 0 dl 1651531960 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:0.0:1651531954.902443:0:192755:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000005d4138a1 with x1731754467305792 ext(57344->61439)
00002000:00010000:0.0:1651531954.902445:0:192755:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000005d4138a1
00000100:00100000:0.0:1651531954.902458:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249635
00000100:00100000:0.0:1651531954.902459:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005d4138a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+49:438147:x1731754467305792:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651531954.902488:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005d4138a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+49:438147:x1731754467305792:12345-10.240.43.64@tcp:3:fio.0 Request processed in 27us (66us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531954.902491:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249635
00002000:00100000:0.0:1651531954.902493:0:192755:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x100010000:0x34545:0x0] (57344->61439)  req@000000005d4138a1 x1731754467305792/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/4536 e 0 to 0 dl 1651531960 ref 1 fl Complete:/0/0 rc 4096/4096 job:'fio.0'
00002000:00100000:0.0:1651531954.902497:0:192755:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000005d4138a1 with x1731754467305792 ext(57344->61439)
00002000:00010000:0.0:1651531954.902498:0:192755:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000005d4138a1
00000100:00100000:0.0:1651531954.912309:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651531954.912317:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951226304
00000100:00100000:0.0:1651531954.912339:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 61
00000100:00100000:0.0:1651531954.912341:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000018762a77 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951226304:12345-10.240.43.61@tcp:400:kworker/u4:2.0
00000100:00100000:0.0:1651531954.912365:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000018762a77 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951226304:12345-10.240.43.61@tcp:400:kworker/u4:2.0 Request processed in 23us (56us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531954.912368:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 61
00000100:00100000:0.0:1651531954.995740:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.995749:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467306624
00000100:00100000:0.0:1651531954.995765:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249636
00000100:00100000:0.0:1651531954.995766:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000088b946fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+49:438147:x1731754467306624:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531954.995776:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000c9190a4/0x3234de053ca2c42 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 46 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.995782:0:192755:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000dfdae7d6/0x3234de053ca2add lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 46 type: EXT [131072->180223] (req 131072->135167) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444d0a expref: 49 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.995786:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531954.995786:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531954.995787:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000c9190a4/0x3234de053ca2c42 lrc: 4/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 46 type: EXT [163840->167935] (req 163840->167935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.995795:0:192755:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000dfdae7d6/0x3234de053ca2add lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 46 type: EXT [131072->180223] (req 131072->135167) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444d0a expref: 49 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.995799:0:192755:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dfdae7d6/0x3234de053ca2add lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 46 type: EXT [131072->180223] (req 131072->135167) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444d0a expref: 49 pid: 166113 timeout: 22763 lvb_type: 0
00000100:00100000:0.0:1651531954.995803:0:192755:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000089022d6 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0001_UUID:192755:1731745997348672:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531954.995820:0:192755:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f23eeb5f going to sleep for 6 seconds
00000100:00100000:0.0:1651531954.996038:0:192755:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000089022d6 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0001_UUID:192755:1731745997348672:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651531954.996043:0:192755:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000c9190a4/0x3234de053ca2c42 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 46 type: EXT [163840->167935] (req 163840->167935) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531954.996168:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.996190:0:166102:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467306688
00010000:00010000:0.0:1651531954.996197:0:166102:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dfdae7d6/0x3234de053ca2add lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 46 type: EXT [131072->180223] (req 131072->135167) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444d0a expref: 50 pid: 166113 timeout: 22763 lvb_type: 0
00000100:00100000:0.0:1651531954.996215:0:166102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 116
00000100:00100000:0.0:1651531954.996219:0:166102:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004d72f458 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+50:438147:x1731754467306688:12345-10.240.43.64@tcp:103:ldlm_bl_05.0
00010000:00010000:0.0:1651531954.996233:0:166102:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531954.996237:0:166102:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dfdae7d6/0x3234de053ca2add lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 47 type: EXT [131072->180223] (req 131072->135167) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444d0a expref: 50 pid: 166113 timeout: 22763 lvb_type: 0
00010000:00010000:0.0:1651531954.996241:0:166102:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dfdae7d6/0x3234de053ca2add lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 47 type: EXT [131072->180223] (req 131072->135167) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444d0a expref: 50 pid: 166113 timeout: 22763 lvb_type: 0
00010000:00010000:0.0:1651531954.996248:0:166102:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dfdae7d6/0x3234de053ca2add lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 47 type: EXT [131072->180223] (req 131072->135167) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444d0a expref: 50 pid: 166113 timeout: 22763 lvb_type: 0
00010000:00010000:0.0:1651531954.996252:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531954.996253:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531954.996253:0:166102:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000c9190a4/0x3234de053ca2c42 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 46 type: EXT [163840->167935] (req 163840->167935) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.996257:0:166102:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000c9190a4/0x3234de053ca2c42 lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 46 type: EXT [163840->167935] (req 163840->167935) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.996264:0:166102:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651531954.996273:0:166102:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004d72f458 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+49:438147:x1731754467306688:12345-10.240.43.64@tcp:103:ldlm_bl_05.0 Request processed in 54us (106us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531954.996276:0:166102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 116
00010000:00010000:0.0:1651531954.996282:0:192755:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000c9190a4/0x3234de053ca2c42 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 45 type: EXT [163840->167935] (req 163840->167935) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.996286:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000c9190a4/0x3234de053ca2c42 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 45 type: EXT [163840->167935] (req 163840->167935) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531954.997175:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531954.997184:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467307200
00000100:00100000:1.0:1651531954.997209:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249637
00000100:00100000:1.0:1651531954.997211:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b462545d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+51:438146:x1731754467307200:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531954.997219:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000030d4a6f9/0x3234de053ca2c49 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 46 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.997238:0:166118:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca2ba8 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 46 type: EXT [884736->909311] (req 884736->888831) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444f41 expref: 51 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.997241:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531954.997242:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531954.997243:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000030d4a6f9/0x3234de053ca2c49 lrc: 4/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 46 type: EXT [897024->901119] (req 897024->901119) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.997251:0:166118:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca2ba8 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 46 type: EXT [884736->909311] (req 884736->888831) gid 0 flags: 0x50000000020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444f41 expref: 51 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531954.997255:0:166118:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca2ba8 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 46 type: EXT [884736->909311] (req 884736->888831) gid 0 flags: 0x70000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444f41 expref: 51 pid: 166113 timeout: 22763 lvb_type: 0
00000100:00100000:1.0:1651531954.997260:0:166118:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006c46ca95 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:166118:1731745997348736:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531954.997280:0:166118:0:(client.c:2492:ptlrpc_set_wait()) set 0000000030e02371 going to sleep for 6 seconds
00000100:00100000:1.0:1651531954.998099:0:166118:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006c46ca95 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:166118:1731745997348736:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651531954.998104:0:166118:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000030d4a6f9/0x3234de053ca2c49 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 46 type: EXT [897024->901119] (req 897024->901119) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531954.998142:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.998150:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467307584
00002000:00100000:0.0:1651531954.998158:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x34545:0x0] (53248->1036287)  req@00000000089022d6 x1731754467307584/t0(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 904/0 e 0 to 0 dl 1651531960 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:0.0:1651531954.998162:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000089022d6 with x1731754467307584 ext(53248->1036287)
00010000:00010000:0.0:1651531954.998168:0:216321:0:(ldlm_lockd.c:599:ldlm_refresh_waiting_lock()) ### refreshed to 81s ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca2ba8 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 47 type: EXT [884736->909311] (req 884736->888831) gid 0 flags: 0x60000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444f41 expref: 52 pid: 166113 timeout: 22763 lvb_type: 0
00002000:00010000:0.0:1651531954.998172:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req 00000000089022d6
00000100:00100000:0.0:1651531954.998177:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11
00000100:00100000:0.0:1651531954.998179:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000089022d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+52:438147:x1731754467307584:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651531954.998400:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.998418:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467307648
00000100:00100000:0.0:1651531954.998431:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44363
00000100:00100000:0.0:1651531954.998433:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006c46ca95 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+53:680972:x1731754467307648:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531954.998436:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531954.998441:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca2c50 lrc: 2/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 47 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445091 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.998448:0:166112:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000007a8a843/0x3234de053ca2bf5 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 47 type: EXT [561152->565247] (req 561152->565247) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444fd4 expref: 54 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.998451:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531954.998452:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531954.998453:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca2c50 lrc: 4/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 47 type: EXT [561152->565247] (req 561152->565247) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445091 expref: 54 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.998464:0:166112:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000007a8a843/0x3234de053ca2bf5 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 47 type: EXT [561152->565247] (req 561152->565247) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444fd4 expref: 54 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.998468:0:166112:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000007a8a843/0x3234de053ca2bf5 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 47 type: EXT [561152->565247] (req 561152->565247) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444fd4 expref: 54 pid: 166112 timeout: 22763 lvb_type: 0
00000100:00100000:0.0:1651531954.998472:0:166112:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000062fcd425 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:166112:1731745997348800:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531954.998485:0:166112:0:(client.c:2492:ptlrpc_set_wait()) set 0000000067135940 going to sleep for 6 seconds
00000100:00100000:0.0:1651531954.998684:0:166112:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000062fcd425 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:166112:1731745997348800:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651531954.998690:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca2c50 lrc: 3/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 47 type: EXT [561152->565247] (req 561152->565247) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445091 expref: 54 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531954.998696:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000060a6272d, rc 0)
00000100:00100000:0.0:1651531954.998706:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006c46ca95 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+54:680972:x1731754467307648:12345-10.240.43.64@tcp:101:fio.0 Request processed in 272us (307us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531954.998709:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44363
00000100:00100000:1.0:1651531954.998774:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.998785:0:166102:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467307776
00010000:00010000:0.0:1651531954.998791:0:166102:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000007a8a843/0x3234de053ca2bf5 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 47 type: EXT [561152->565247] (req 561152->565247) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444fd4 expref: 54 pid: 166112 timeout: 22763 lvb_type: 0
00000100:00100000:0.0:1651531954.998802:0:166102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 117
00000100:00100000:0.0:1651531954.998803:0:166102:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000e33e11e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+54:438146:x1731754467307776:12345-10.240.43.64@tcp:103:ldlm_bl_03.0
00010000:00010000:0.0:1651531954.998807:0:166102:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531954.998810:0:166102:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000007a8a843/0x3234de053ca2bf5 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 48 type: EXT [561152->565247] (req 561152->565247) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444fd4 expref: 54 pid: 166112 timeout: 22763 lvb_type: 0
00010000:00010000:0.0:1651531954.998815:0:166102:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000007a8a843/0x3234de053ca2bf5 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 48 type: EXT [561152->565247] (req 561152->565247) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444fd4 expref: 54 pid: 166112 timeout: 22763 lvb_type: 0
00010000:00010000:0.0:1651531954.998821:0:166102:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000007a8a843/0x3234de053ca2bf5 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 48 type: EXT [561152->565247] (req 561152->565247) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444fd4 expref: 54 pid: 166112 timeout: 22763 lvb_type: 0
00010000:00010000:0.0:1651531954.998825:0:166102:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651531954.998835:0:166102:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000e33e11e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+53:438146:x1731754467307776:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 31us (61us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531954.998838:0:166102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 117
00000100:00100000:1.0:1651531954.999740:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531954.999758:0:216322:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467308224
00002000:00100000:0.0:1651531954.999766:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34545:0x0] (393216->401407)  req@000000003158b8a7 x1731754467308224/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/0 e 0 to 0 dl 1651531960 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:0.0:1651531954.999770:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000003158b8a7 with x1731754467308224 ext(393216->401407)
00002000:00010000:0.0:1651531954.999771:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000003158b8a7
00000100:00100000:0.0:1651531954.999777:0:216322:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249638
00000100:00100000:0.0:1651531954.999779:0:216322:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003158b8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+53:438148:x1731754467308224:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651531954.999817:0:216322:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003158b8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+53:438148:x1731754467308224:12345-10.240.43.64@tcp:3:fio.0 Request processed in 37us (77us total) trans 0 rc 8192/8192
00000100:00100000:0.0:1651531954.999820:0:216322:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249638
00002000:00100000:0.0:1651531954.999822:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34545:0x0] (393216->401407)  req@000000003158b8a7 x1731754467308224/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 488/8632 e 0 to 0 dl 1651531960 ref 1 fl Complete:/0/0 rc 8192/8192 job:'fio.0'
00002000:00100000:0.0:1651531954.999826:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000003158b8a7 with x1731754467308224 ext(393216->401407)
00002000:00010000:0.0:1651531954.999827:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000003158b8a7
00000100:00100000:1.0:1651531955.002552:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531955.002569:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467308928
00000100:00100000:0.0:1651531955.002583:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44364
00000100:00100000:0.0:1651531955.002584:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000053de45f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+53:680970:x1731754467308928:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531955.002588:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531955.002592:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dfdae7d6/0x3234de053ca2c57 lrc: 2/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 47 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4450b4 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.002599:0:166112:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000049c67f6a/0x3234de053ca2bcb lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 47 type: EXT [61440->65535] (req 61440->65535) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444f72 expref: 54 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.002603:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531955.002603:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531955.002604:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dfdae7d6/0x3234de053ca2c57 lrc: 4/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 47 type: EXT [61440->65535] (req 61440->65535) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4450b4 expref: 54 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.002611:0:166112:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000049c67f6a/0x3234de053ca2bcb lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 47 type: EXT [61440->65535] (req 61440->65535) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444f72 expref: 54 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.002615:0:166112:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000049c67f6a/0x3234de053ca2bcb lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 47 type: EXT [61440->65535] (req 61440->65535) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444f72 expref: 54 pid: 166113 timeout: 22763 lvb_type: 0
00000100:00100000:0.0:1651531955.002619:0:166112:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000062fcd425 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:166112:1731745997348864:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531955.002631:0:166112:0:(client.c:2492:ptlrpc_set_wait()) set 0000000067135940 going to sleep for 6 seconds
00000100:00100000:0.0:1651531955.002850:0:166112:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000062fcd425 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:166112:1731745997348864:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651531955.002856:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000dfdae7d6/0x3234de053ca2c57 lrc: 3/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 47 type: EXT [61440->65535] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4450b4 expref: 54 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.002861:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000dfdae7d6, rc 0)
00000100:00100000:0.0:1651531955.002873:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000053de45f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+54:680970:x1731754467308928:12345-10.240.43.64@tcp:101:fio.0 Request processed in 288us (321us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531955.002876:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44364
00000100:00100000:1.0:1651531955.002951:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531955.002961:0:166102:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467309056
00010000:00010000:0.0:1651531955.002967:0:166102:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000049c67f6a/0x3234de053ca2bcb lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 47 type: EXT [61440->65535] (req 61440->65535) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444f72 expref: 54 pid: 166113 timeout: 22763 lvb_type: 0
00000100:00100000:0.0:1651531955.002977:0:166102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 118
00000100:00100000:0.0:1651531955.002979:0:166102:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cc11a3b9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+54:438146:x1731754467309056:12345-10.240.43.64@tcp:103:ldlm_bl_05.0
00010000:00010000:0.0:1651531955.002982:0:166102:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531955.002985:0:166102:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000049c67f6a/0x3234de053ca2bcb lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 48 type: EXT [61440->65535] (req 61440->65535) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444f72 expref: 54 pid: 166113 timeout: 22763 lvb_type: 0
00010000:00010000:0.0:1651531955.002989:0:166102:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000049c67f6a/0x3234de053ca2bcb lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 48 type: EXT [61440->65535] (req 61440->65535) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444f72 expref: 54 pid: 166113 timeout: 22763 lvb_type: 0
00010000:00010000:0.0:1651531955.002995:0:166102:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000049c67f6a/0x3234de053ca2bcb lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 48 type: EXT [61440->65535] (req 61440->65535) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444f72 expref: 54 pid: 166113 timeout: 22763 lvb_type: 0
00010000:00010000:0.0:1651531955.003000:0:166102:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651531955.003009:0:166102:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cc11a3b9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+53:438146:x1731754467309056:12345-10.240.43.64@tcp:103:ldlm_bl_05.0 Request processed in 30us (59us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531955.003012:0:166102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 118
00000001:00080000:0.0:1651531955.069262:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869064 is committed
00010000:00010000:0.0:1651531955.069278:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000c9190a4/0x3234de053ca2c42 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 46 type: EXT [163840->167935] (req 163840->167935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.069282:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000c9190a4/0x3234de053ca2c42 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 46 type: EXT [163840->167935] (req 163840->167935) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531955.069305:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000088b946fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+50:438147:x1731754467306624:12345-10.240.43.64@tcp:4:fio.0 Request processed in 73537us (73565us total) trans 21474869064 rc 0/0
00000100:00100000:0.0:1651531955.069308:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249636
00010000:00010000:1.0:1651531955.069311:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000c9190a4/0x3234de053ca2c42 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 46 type: EXT [163840->167935] (req 163840->167935) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531955.069316:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000000c9190a4 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531955.069317:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000c9190a4/0x3234de053ca2c42 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 46 type: EXT [163840->167935] (req 163840->167935) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531955.069321:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000c9190a4/0x3234de053ca2c42 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 46 type: EXT [163840->167935] (req 163840->167935) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531955.069328:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000c9190a4/0x3234de053ca2c42 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 46 type: EXT [163840->167935] (req 163840->167935) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531955.069331:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000c9190a4/0x3234de053ca2c42 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 46 type: EXT [163840->167935] (req 163840->167935) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531955.070171:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000089022d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+51:438147:x1731754467307584:12345-10.240.43.64@tcp:4:fio.0 Request processed in 71990us (72029us total) trans 21474869065 rc 0/0
00000100:00100000:0.0:1651531955.070175:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11
00002000:00100000:0.0:1651531955.070178:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x34545:0x0] (53248->1036287)  req@00000000089022d6 x1731754467307584/t21474869065(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:415/0 lens 904/552 e 0 to 0 dl 1651531960 ref 1 fl Complete:H/0/0 rc 0/0 job:'fio.0'
00002000:00100000:0.0:1651531955.070183:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000089022d6 with x1731754467307584 ext(53248->1036287)
00010000:00010000:0.0:1651531955.070188:0:216321:0:(ldlm_lockd.c:599:ldlm_refresh_waiting_lock()) ### refreshed to 81s ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca2ba8 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 46 type: EXT [884736->909311] (req 884736->888831) gid 0 flags: 0x60000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444f41 expref: 51 pid: 166113 timeout: 22763 lvb_type: 0
00002000:00010000:0.0:1651531955.070192:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req 00000000089022d6
00000100:00100000:0.0:1651531955.070221:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531955.070278:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467309376
00000100:00100000:0.0:1651531955.070289:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249639
00000100:00100000:0.0:1651531955.070290:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000062fcd425 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+51:438147:x1731754467309376:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531955.070298:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000df4fd81c/0x3234de053ca2c5e lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 46 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.070303:0:216321:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca2b0e lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 46 type: EXT [929792->18446744073709551615] (req 929792->933887) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444d6c expref: 51 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.070306:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531955.070309:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531955.070310:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000df4fd81c/0x3234de053ca2c5e lrc: 4/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 46 type: EXT [999424->1003519] (req 999424->1003519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.070317:0:216321:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca2b0e lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 46 type: EXT [929792->18446744073709551615] (req 929792->933887) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444d6c expref: 51 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.070321:0:216321:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca2b0e lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 46 type: EXT [929792->18446744073709551615] (req 929792->933887) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444d6c expref: 51 pid: 166113 timeout: 22763 lvb_type: 0
00000100:00100000:0.0:1651531955.070326:0:216321:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000fd0719da pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997348928:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531955.070337:0:216321:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f54ad06c going to sleep for 6 seconds
00000100:00100000:0.0:1651531955.070806:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531955.070809:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531955.070819:0:166102:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467309632
00010000:00010000:0.0:1651531955.070825:0:166102:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca2ba8 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 46 type: EXT [884736->909311] (req 884736->888831) gid 0 flags: 0x60000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444f41 expref: 52 pid: 166113 timeout: 22763 lvb_type: 0
00000100:00100000:0.0:1651531955.070839:0:166102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 119
00000100:00100000:0.0:1651531955.070841:0:166102:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c6cd3250 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+52:438146:x1731754467309632:12345-10.240.43.64@tcp:103:ldlm_bl_02.0
00010000:00010000:0.0:1651531955.070844:0:166102:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531955.070848:0:166102:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca2ba8 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 47 type: EXT [884736->909311] (req 884736->888831) gid 0 flags: 0x60000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444f41 expref: 52 pid: 166113 timeout: 22763 lvb_type: 0
00010000:00010000:0.0:1651531955.070853:0:166102:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca2ba8 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 47 type: EXT [884736->909311] (req 884736->888831) gid 0 flags: 0x50000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444f41 expref: 52 pid: 166113 timeout: 22763 lvb_type: 0
00010000:00010000:0.0:1651531955.070859:0:166102:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca2ba8 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 47 type: EXT [884736->909311] (req 884736->888831) gid 0 flags: 0x44801400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444f41 expref: 52 pid: 166113 timeout: 22763 lvb_type: 0
00010000:00010000:0.0:1651531955.070866:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531955.070867:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531955.070868:0:166102:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000030d4a6f9/0x3234de053ca2c49 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 46 type: EXT [897024->901119] (req 897024->901119) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.070871:0:166102:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000030d4a6f9/0x3234de053ca2c49 lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 46 type: EXT [897024->901119] (req 897024->901119) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.070875:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531955.070875:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531955.070877:0:166102:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca2c50 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 46 type: EXT [561152->565247] (req 561152->565247) gid 0 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445091 expref: 51 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.070880:0:166102:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca2c50 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 46 type: EXT [561152->565247] (req 561152->565247) gid 0 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445091 expref: 51 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.070883:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531955.070883:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531955.070885:0:166102:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000dfdae7d6/0x3234de053ca2c57 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 46 type: EXT [61440->65535] (req 61440->65535) gid 0 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4450b4 expref: 51 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.070888:0:166102:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dfdae7d6/0x3234de053ca2c57 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 46 type: EXT [61440->65535] (req 61440->65535) gid 0 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4450b4 expref: 51 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.070896:0:166102:0:(ldlm_lockd.c:1067:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000dfdae7d6/0x3234de053ca2c57 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 46 type: EXT [61440->65535] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4450b4 expref: 51 pid: 166112 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531955.070900:0:166102:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000fff66352 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:166102:1731745997348992:10.240.43.64@tcp:105:
00010000:00010000:0.0:1651531955.070915:0:166102:0:(ldlm_lockd.c:1067:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca2c50 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 46 type: EXT [561152->565247] (req 561152->565247) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445091 expref: 51 pid: 166112 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531955.070919:0:166102:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008586382c pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:166102:1731745997349056:10.240.43.64@tcp:105:
00000100:00100000:0.0:1651531955.070957:0:166102:0:(client.c:2492:ptlrpc_set_wait()) set 0000000067135940 going to sleep for 6 seconds
00000100:00100000:0.0:1651531955.070965:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467309568
00000100:00100000:0.0:1651531955.070976:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249640
00000100:00100000:0.0:1651531955.070978:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000081813f11 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+52:438148:x1731754467309568:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531955.070984:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea9f3321/0x3234de053ca2c65 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 47 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.070995:0:192755:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca2b9a lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 47 type: EXT [393216->401407] (req 393216->397311) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444f10 expref: 52 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.070998:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531955.070999:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531955.071000:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea9f3321/0x3234de053ca2c65 lrc: 4/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 47 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531955.071003:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651531955.071007:0:192755:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca2b9a lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 47 type: EXT [393216->401407] (req 393216->397311) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444f10 expref: 52 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.071016:0:192755:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca2b9a lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 47 type: EXT [393216->401407] (req 393216->397311) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444f10 expref: 52 pid: 166113 timeout: 22763 lvb_type: 0
00000100:00100000:0.0:1651531955.071021:0:192755:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002e364765 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0001_UUID:192755:1731745997349120:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531955.071034:0:192755:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fadbf296 going to sleep for 6 seconds
00010000:00010000:1.0:1651531955.071041:0:166118:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000030d4a6f9/0x3234de053ca2c49 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 47 type: EXT [897024->901119] (req 897024->901119) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531955.071042:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467309760
00010000:00010000:1.0:1651531955.071045:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000030d4a6f9/0x3234de053ca2c49 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 47 type: EXT [897024->901119] (req 897024->901119) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00002000:00100000:0.0:1651531955.071048:0:192753:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x100010000:0x34545:0x0] (122880->1019903)  req@000000007af2a59c x1731754467309760/t0(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:416/0 lens 520/0 e 0 to 0 dl 1651531961 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:0.0:1651531955.071052:0:192753:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000007af2a59c with x1731754467309760 ext(122880->1019903)
00010000:00010000:0.0:1651531955.071056:0:192753:0:(ldlm_lockd.c:599:ldlm_refresh_waiting_lock()) ### refreshed to 81s ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca2b0e lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 48 type: EXT [929792->18446744073709551615] (req 929792->933887) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444d6c expref: 53 pid: 166113 timeout: 22763 lvb_type: 0
00002000:00010000:0.0:1651531955.071060:0:192753:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req 000000007af2a59c
00000100:00100000:0.0:1651531955.071068:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 12
00000100:00100000:0.0:1651531955.071070:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007af2a59c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+53:438146:x1731754467309760:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651531955.071088:0:216321:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000fd0719da pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997348928:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651531955.071093:0:216321:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000df4fd81c/0x3234de053ca2c5e lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 47 type: EXT [999424->1003519] (req 999424->1003519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531955.071281:0:166102:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000fff66352 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:166102:1731745997348992:10.240.43.64@tcp:105:
00000100:00100000:0.0:1651531955.071284:0:166102:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008586382c pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:166102:1731745997349056:10.240.43.64@tcp:105:
00010000:00010000:0.0:1651531955.071289:0:166102:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651531955.071299:0:166102:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c6cd3250 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+55:438146:x1731754467309632:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 457us (494us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531955.071319:0:166102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 119
00000100:00100000:0.0:1651531955.071342:0:192755:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002e364765 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0001_UUID:192755:1731745997349120:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651531955.071346:0:192755:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ea9f3321/0x3234de053ca2c65 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 46 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531955.071522:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531955.071534:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467309824
00000100:00100000:0.0:1651531955.071546:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44365
00000100:00100000:0.0:1651531955.071547:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000028e5e6f5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+55:680969:x1731754467309824:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531955.071551:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531955.071555:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000378a069e/0x3234de053ca2c6c lrc: 2/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 47 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4450c9 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.071561:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531955.071562:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531955.071563:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000378a069e/0x3234de053ca2c6c lrc: 3/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 47 type: EXT [978944->983039] (req 978944->983039) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4450c9 expref: 56 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.071567:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000378a069e/0x3234de053ca2c6c lrc: 3/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 47 type: EXT [978944->983039] (req 978944->983039) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4450c9 expref: 56 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.071571:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000378a069e, rc 0)
00000100:00100000:0.0:1651531955.071582:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000028e5e6f5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+56:680969:x1731754467309824:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (61us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531955.071585:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44365
00000100:00100000:1.0:1651531955.071638:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531955.071649:0:166102:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467309888
00010000:00010000:0.0:1651531955.071654:0:166102:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca2b9a lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 47 type: EXT [393216->401407] (req 393216->397311) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444f10 expref: 56 pid: 166113 timeout: 22763 lvb_type: 0
00000100:00100000:0.0:1651531955.071665:0:166102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 120
00000100:00100000:0.0:1651531955.071667:0:166102:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b511a08e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+56:438146:x1731754467309888:12345-10.240.43.64@tcp:103:ldlm_bl_05.0
00010000:00010000:0.0:1651531955.071670:0:166102:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531955.071673:0:166102:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca2b9a lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 48 type: EXT [393216->401407] (req 393216->397311) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444f10 expref: 56 pid: 166113 timeout: 22763 lvb_type: 0
00010000:00010000:0.0:1651531955.071681:0:166102:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca2b9a lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 48 type: EXT [393216->401407] (req 393216->397311) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444f10 expref: 56 pid: 166113 timeout: 22763 lvb_type: 0
00010000:00010000:0.0:1651531955.071687:0:166102:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca2b9a lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 48 type: EXT [393216->401407] (req 393216->397311) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444f10 expref: 56 pid: 166113 timeout: 22763 lvb_type: 0
00010000:00010000:0.0:1651531955.071691:0:166102:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651531955.071701:0:166102:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b511a08e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+55:438146:x1731754467309888:12345-10.240.43.64@tcp:103:ldlm_bl_05.0 Request processed in 33us (62us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531955.071703:0:166102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 120
00000100:00100000:1.0:1651531955.072009:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531955.072027:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467309952
00000100:00100000:0.0:1651531955.072040:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44366
00000100:00100000:0.0:1651531955.072041:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000042b96101 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+55:680970:x1731754467309952:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531955.072045:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531955.072048:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003dec1fa8/0x3234de053ca2c73 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 47 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4450d0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.072054:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531955.072055:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531955.072057:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003dec1fa8/0x3234de053ca2c73 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 47 type: EXT [49152->53247] (req 49152->53247) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4450d0 expref: 56 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.072061:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003dec1fa8/0x3234de053ca2c73 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 47 type: EXT [49152->53247] (req 49152->53247) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4450d0 expref: 56 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.072066:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003dec1fa8, rc 0)
00000100:00100000:0.0:1651531955.072078:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000042b96101 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+56:680970:x1731754467309952:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (70us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531955.072081:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44366
00000100:00100000:1.0:1651531955.072431:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531955.072439:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467310272
00002000:00100000:1.0:1651531955.072447:0:216323:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x100010000:0x34545:0x0] (49152->53247)  req@00000000382dd5f3 x1731754467310272/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:416/0 lens 488/0 e 0 to 0 dl 1651531961 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:1.0:1651531955.072452:0:216323:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000382dd5f3 with x1731754467310272 ext(49152->53247)
00002000:00010000:1.0:1651531955.072454:0:216323:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000382dd5f3
00000100:00100000:1.0:1651531955.072463:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249641
00000100:00100000:1.0:1651531955.072466:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000382dd5f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+56:438148:x1731754467310272:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651531955.072492:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000382dd5f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+56:438148:x1731754467310272:12345-10.240.43.64@tcp:3:fio.0 Request processed in 26us (61us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531955.072495:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249641
00002000:00100000:1.0:1651531955.072497:0:216323:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x100010000:0x34545:0x0] (49152->53247)  req@00000000382dd5f3 x1731754467310272/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:416/0 lens 488/4536 e 0 to 0 dl 1651531961 ref 1 fl Complete:/0/0 rc 4096/4096 job:'fio.0'
00002000:00100000:1.0:1651531955.072501:0:216323:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000382dd5f3 with x1731754467310272 ext(49152->53247)
00002000:00010000:1.0:1651531955.072503:0:216323:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000382dd5f3
00000100:00100000:1.0:1651531955.076333:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531955.076346:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531955.076354:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467311040
00000100:00100000:1.0:1651531955.076355:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467311104
00000100:00100000:0.0:1651531955.076365:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44367
00000100:00100000:0.0:1651531955.076372:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006cc45165 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+57:680970:x1731754467311040:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651531955.076374:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44368
00000100:00100000:1.0:1651531955.076376:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000416f774b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+57:680972:x1731754467311104:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531955.076376:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531955.076379:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca2c7a lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 48 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4450f3 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531955.076380:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531955.076384:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f253fba8/0x3234de053ca2c81 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 49 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4450fa expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.076385:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531955.076386:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531955.076389:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca2c7a lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 49 type: EXT [159744->180223] (req 159744->163839) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4450f3 expref: 59 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531955.076393:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531955.076394:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531955.076397:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f253fba8/0x3234de053ca2c81 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 49 type: EXT [167936->180223] (req 167936->172031) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4450fa expref: 59 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531955.076402:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f253fba8/0x3234de053ca2c81 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 50 type: EXT [167936->180223] (req 167936->172031) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4450fa expref: 59 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.076402:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca2c7a lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 50 type: EXT [159744->180223] (req 159744->163839) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4450f3 expref: 59 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.076406:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000022b2104e, rc 0)
00010000:00010000:1.0:1651531955.076407:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f253fba8, rc 0)
00000100:00100000:1.0:1651531955.076417:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000416f774b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+59:680972:x1731754467311104:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (71us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531955.076417:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006cc45165 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+59:680970:x1731754467311040:12345-10.240.43.64@tcp:101:fio.0 Request processed in 49us (84us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531955.076420:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44367
00000100:00100000:1.0:1651531955.076421:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44368
00000100:00100000:1.0:1651531955.076742:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531955.076750:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467311232
00002000:00100000:1.0:1651531955.076756:0:216323:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x100010000:0x34545:0x0] (159744->180223)  req@00000000d687ef16 x1731754467311232/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:416/0 lens 488/0 e 0 to 0 dl 1651531961 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:1.0:1651531955.076760:0:216323:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000d687ef16 with x1731754467311232 ext(159744->180223)
00002000:00010000:1.0:1651531955.076761:0:216323:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000d687ef16
00000100:00100000:1.0:1651531955.076771:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249642
00000100:00100000:1.0:1651531955.076773:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d687ef16 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+58:438147:x1731754467311232:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651531955.076986:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d687ef16 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+58:438147:x1731754467311232:12345-10.240.43.64@tcp:3:fio.0 Request processed in 211us (244us total) trans 0 rc 20480/20480
00000100:00100000:1.0:1651531955.076989:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249642
00002000:00100000:1.0:1651531955.076992:0:216323:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x100010000:0x34545:0x0] (159744->180223)  req@00000000d687ef16 x1731754467311232/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:416/0 lens 488/440 e 0 to 0 dl 1651531961 ref 1 fl Complete:/0/0 rc 20480/20480 job:'fio.0'
00002000:00100000:1.0:1651531955.076996:0:216323:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000d687ef16 with x1731754467311232 ext(159744->180223)
00002000:00010000:1.0:1651531955.076997:0:216323:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000d687ef16
00000100:00100000:1.0:1651531955.078298:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531955.078305:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467311552
00000100:00100000:1.0:1651531955.078317:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44369
00000100:00100000:1.0:1651531955.078319:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004bc6d4f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+58:680972:x1731754467311552:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531955.078322:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531955.078326:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000369400b3/0x3234de053ca2c88 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 50 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44510f expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531955.078332:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531955.078333:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531955.078335:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000369400b3/0x3234de053ca2c88 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 50 type: EXT [397312->401407] (req 397312->401407) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44510f expref: 59 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531955.078339:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000369400b3/0x3234de053ca2c88 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 50 type: EXT [397312->401407] (req 397312->401407) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44510f expref: 59 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531955.078344:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000369400b3, rc 0)
00000100:00100000:1.0:1651531955.078357:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004bc6d4f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+59:680972:x1731754467311552:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (60us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531955.078363:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44369
00000100:00100000:1.0:1651531955.078642:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531955.078649:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467311680
00002000:00100000:1.0:1651531955.078655:0:216323:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x100010000:0x34545:0x0] (397312->401407)  req@00000000b28fd010 x1731754467311680/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:416/0 lens 488/0 e 0 to 0 dl 1651531961 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:1.0:1651531955.078659:0:216323:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000b28fd010 with x1731754467311680 ext(397312->401407)
00002000:00010000:1.0:1651531955.078660:0:216323:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000b28fd010
00000100:00100000:1.0:1651531955.078670:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249643
00000100:00100000:1.0:1651531955.078672:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b28fd010 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+59:438146:x1731754467311680:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651531955.078695:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b28fd010 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+59:438146:x1731754467311680:12345-10.240.43.64@tcp:3:fio.0 Request processed in 23us (54us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531955.078698:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249643
00002000:00100000:1.0:1651531955.078700:0:216323:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x100010000:0x34545:0x0] (397312->401407)  req@00000000b28fd010 x1731754467311680/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:416/0 lens 488/4536 e 0 to 0 dl 1651531961 ref 1 fl Complete:/0/0 rc 4096/4096 job:'fio.0'
00002000:00100000:1.0:1651531955.078703:0:216323:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000b28fd010 with x1731754467311680 ext(397312->401407)
00002000:00010000:1.0:1651531955.078704:0:216323:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000b28fd010
00000100:00100000:1.0:1651531955.079976:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531955.079984:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467312064
00000100:00100000:1.0:1651531955.079995:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44370
00000100:00100000:1.0:1651531955.079997:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a4f44993 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+59:680970:x1731754467312064:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531955.080000:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531955.080004:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b93c49e9/0x3234de053ca2c8f lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 51 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445124 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531955.080014:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531955.080014:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531955.080017:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b93c49e9/0x3234de053ca2c8f lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 51 type: EXT [892928->897023] (req 892928->897023) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445124 expref: 60 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531955.080021:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b93c49e9/0x3234de053ca2c8f lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 51 type: EXT [892928->897023] (req 892928->897023) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445124 expref: 60 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531955.080025:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b93c49e9, rc 0)
00000100:00100000:1.0:1651531955.080038:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a4f44993 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+60:680970:x1731754467312064:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (63us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531955.080041:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44370
00000100:00100000:1.0:1651531955.080313:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531955.080321:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467312320
00002000:00100000:1.0:1651531955.080327:0:216323:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x100010000:0x34545:0x0] (892928->897023)  req@00000000c2711b20 x1731754467312320/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:416/0 lens 488/0 e 0 to 0 dl 1651531961 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:1.0:1651531955.080330:0:216323:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000c2711b20 with x1731754467312320 ext(892928->897023)
00002000:00010000:1.0:1651531955.080331:0:216323:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000c2711b20
00000100:00100000:1.0:1651531955.080339:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249644
00000100:00100000:1.0:1651531955.080341:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c2711b20 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+60:438149:x1731754467312320:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651531955.080362:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c2711b20 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+60:438149:x1731754467312320:12345-10.240.43.64@tcp:3:fio.0 Request processed in 21us (50us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531955.080365:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249644
00002000:00100000:1.0:1651531955.080367:0:216323:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x100010000:0x34545:0x0] (892928->897023)  req@00000000c2711b20 x1731754467312320/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:416/0 lens 488/4536 e 0 to 0 dl 1651531961 ref 1 fl Complete:/0/0 rc 4096/4096 job:'fio.0'
00002000:00100000:1.0:1651531955.080375:0:216323:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000c2711b20 with x1731754467312320 ext(892928->897023)
00002000:00010000:1.0:1651531955.080376:0:216323:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000c2711b20
00000100:00100000:1.0:1651531955.087673:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531955.087683:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467313664
00000100:00100000:1.0:1651531955.087696:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44371
00000100:00100000:1.0:1651531955.087698:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000036c8d608 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+60:680970:x1731754467313664:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531955.087702:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531955.087706:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000049c67f6a/0x3234de053ca2c96 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 52 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44515c expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531955.087712:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531955.087713:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531955.087716:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049c67f6a/0x3234de053ca2c96 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 52 type: EXT [212992->225279] (req 212992->217087) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44515c expref: 61 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531955.087720:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000049c67f6a/0x3234de053ca2c96 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 52 type: EXT [212992->225279] (req 212992->217087) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44515c expref: 61 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531955.087725:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000049c67f6a, rc 0)
00000100:00100000:1.0:1651531955.087739:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000036c8d608 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+61:680970:x1731754467313664:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (66us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531955.087742:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44371
00000100:00100000:1.0:1651531955.088037:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531955.088046:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467313792
00002000:00100000:1.0:1651531955.088052:0:216323:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x100010000:0x34545:0x0] (212992->217087)  req@00000000b61f7c2c x1731754467313792/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:416/0 lens 488/0 e 0 to 0 dl 1651531961 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:1.0:1651531955.088060:0:216323:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000b61f7c2c with x1731754467313792 ext(212992->217087)
00002000:00010000:1.0:1651531955.088061:0:216323:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000b61f7c2c
00000100:00100000:1.0:1651531955.088071:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249645
00000100:00100000:1.0:1651531955.088073:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b61f7c2c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+61:438149:x1731754467313792:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651531955.088096:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b61f7c2c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+61:438149:x1731754467313792:12345-10.240.43.64@tcp:3:fio.0 Request processed in 23us (59us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531955.088099:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249645
00002000:00100000:1.0:1651531955.088101:0:216323:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x100010000:0x34545:0x0] (212992->217087)  req@00000000b61f7c2c x1731754467313792/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:416/0 lens 488/4536 e 0 to 0 dl 1651531961 ref 1 fl Complete:/0/0 rc 4096/4096 job:'fio.0'
00002000:00100000:1.0:1651531955.088104:0:216323:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000b61f7c2c with x1731754467313792 ext(212992->217087)
00002000:00010000:1.0:1651531955.088105:0:216323:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000b61f7c2c
00000100:00100000:1.0:1651531955.089368:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531955.089377:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467313984
00000100:00100000:1.0:1651531955.089389:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44372
00000100:00100000:1.0:1651531955.089391:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b9b21392 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+61:680970:x1731754467313984:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531955.089394:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531955.089398:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000007a8a843/0x3234de053ca2c9d lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 53 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445171 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531955.089404:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531955.089405:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531955.089407:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000007a8a843/0x3234de053ca2c9d lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 53 type: EXT [905216->909311] (req 905216->909311) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445171 expref: 62 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531955.089411:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000007a8a843/0x3234de053ca2c9d lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 53 type: EXT [905216->909311] (req 905216->909311) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445171 expref: 62 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531955.089417:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000007a8a843, rc 0)
00000100:00100000:1.0:1651531955.089430:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b9b21392 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+62:680970:x1731754467313984:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (63us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531955.089433:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44372
00000100:00100000:1.0:1651531955.089723:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531955.089730:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467314112
00002000:00100000:1.0:1651531955.089736:0:216323:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x100010000:0x34545:0x0] (905216->909311)  req@0000000049b9e4c5 x1731754467314112/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:416/0 lens 488/0 e 0 to 0 dl 1651531961 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:1.0:1651531955.089740:0:216323:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000049b9e4c5 with x1731754467314112 ext(905216->909311)
00002000:00010000:1.0:1651531955.089741:0:216323:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000049b9e4c5
00000100:00100000:1.0:1651531955.089751:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249646
00000100:00100000:1.0:1651531955.089752:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000049b9e4c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+62:438149:x1731754467314112:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651531955.089775:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000049b9e4c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+62:438149:x1731754467314112:12345-10.240.43.64@tcp:3:fio.0 Request processed in 22us (53us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531955.089778:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249646
00002000:00100000:1.0:1651531955.089780:0:216323:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x100010000:0x34545:0x0] (905216->909311)  req@0000000049b9e4c5 x1731754467314112/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:416/0 lens 488/4536 e 0 to 0 dl 1651531961 ref 1 fl Complete:/0/0 rc 4096/4096 job:'fio.0'
00002000:00100000:1.0:1651531955.089783:0:216323:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000049b9e4c5 with x1731754467314112 ext(905216->909311)
00002000:00010000:1.0:1651531955.089785:0:216323:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000049b9e4c5
00000100:00100000:1.0:1651531955.093811:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531955.093819:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467314624
00000100:00100000:1.0:1651531955.093831:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44373
00000100:00100000:1.0:1651531955.093833:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f6619aeb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+62:680970:x1731754467314624:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531955.093838:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531955.093841:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cfb802a0/0x3234de053ca2ca4 lrc: 2/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 54 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44517f expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531955.093847:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531955.093848:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531955.093849:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cfb802a0/0x3234de053ca2ca4 lrc: 3/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 54 type: EXT [995328->999423] (req 995328->999423) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44517f expref: 63 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531955.093853:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cfb802a0/0x3234de053ca2ca4 lrc: 3/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 54 type: EXT [995328->999423] (req 995328->999423) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44517f expref: 63 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531955.093857:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000cfb802a0, rc 0)
00000100:00100000:1.0:1651531955.093870:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f6619aeb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+63:680970:x1731754467314624:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (60us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531955.093873:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44373
00000001:00080000:0.0:1651531955.169233:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869066 is committed
00010000:00010000:1.0:1651531955.169271:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000030d4a6f9/0x3234de053ca2c49 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 54 type: EXT [897024->901119] (req 897024->901119) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531955.169275:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000030d4a6f9/0x3234de053ca2c49 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 54 type: EXT [897024->901119] (req 897024->901119) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.169297:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000030d4a6f9/0x3234de053ca2c49 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 54 type: EXT [897024->901119] (req 897024->901119) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531955.169299:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b462545d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+59:438146:x1731754467307200:12345-10.240.43.64@tcp:4:fio.0 Request processed in 172087us (172124us total) trans 21474869066 rc 0/0
00000100:00100000:1.0:1651531955.169302:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249637
00010000:00010000:0.0:1651531955.169302:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000030d4a6f9 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531955.169303:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000030d4a6f9/0x3234de053ca2c49 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 54 type: EXT [897024->901119] (req 897024->901119) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.169309:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000030d4a6f9/0x3234de053ca2c49 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 54 type: EXT [897024->901119] (req 897024->901119) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.169315:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000030d4a6f9/0x3234de053ca2c49 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 54 type: EXT [897024->901119] (req 897024->901119) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.169318:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000030d4a6f9/0x3234de053ca2c49 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 54 type: EXT [897024->901119] (req 897024->901119) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531955.169634:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007af2a59c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+59:438146:x1731754467309760:12345-10.240.43.64@tcp:4:fio.0 Request processed in 98563us (98630us total) trans 21474869067 rc 0/0
00000100:00100000:0.0:1651531955.169639:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 12
00002000:00100000:0.0:1651531955.169642:0:192753:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x100010000:0x34545:0x0] (122880->1019903)  req@000000007af2a59c x1731754467309760/t21474869067(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:416/0 lens 520/456 e 0 to 0 dl 1651531961 ref 1 fl Complete:H/0/0 rc 0/0 job:'fio.0'
00002000:00100000:0.0:1651531955.169646:0:192753:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000007af2a59c with x1731754467309760 ext(122880->1019903)
00010000:00010000:0.0:1651531955.169652:0:192753:0:(ldlm_lockd.c:599:ldlm_refresh_waiting_lock()) ### refreshed to 81s ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca2b0e lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 54 type: EXT [929792->18446744073709551615] (req 929792->933887) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444d6c expref: 59 pid: 166113 timeout: 22763 lvb_type: 0
00002000:00010000:0.0:1651531955.169656:0:192753:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req 000000007af2a59c
00000100:00100000:0.0:1651531955.172477:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531955.172497:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531955.172499:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467314880
00000100:00100000:0.0:1651531955.172506:0:166102:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467314944
00000100:00100000:1.0:1651531955.172511:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44374
00000100:00100000:1.0:1651531955.172513:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002e364765 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+60:680972:x1731754467314880:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531955.172518:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531955.172518:0:166102:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca2b0e lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 53 type: EXT [929792->18446744073709551615] (req 929792->933887) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444d6c expref: 60 pid: 166113 timeout: 22763 lvb_type: 0
00010000:00010000:1.0:1651531955.172522:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2f464ac/0x3234de053ca2cab lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445186 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531955.172530:0:166102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 121
00010000:00010000:1.0:1651531955.172534:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00000100:00100000:0.0:1651531955.172534:0:166102:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008586382c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+61:438147:x1731754467314944:12345-10.240.43.64@tcp:103:ldlm_bl_03.0
00010000:00010000:1.0:1651531955.172535:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531955.172537:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2f464ac/0x3234de053ca2cab lrc: 3/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 54 type: EXT [966656->970751] (req 966656->970751) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445186 expref: 61 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.172537:0:166102:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00002000:00010000:0.0:1651531955.172541:0:166102:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x34545:0x0] updating lvb mtime from disk: 1651531954 -> 1651531955
00002000:00010000:0.0:1651531955.172542:0:166102:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x34545:0x0] updating lvb ctime from disk: 1651531954 -> 1651531955
00010000:00010000:0.0:1651531955.172544:0:166102:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca2b0e lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [929792->18446744073709551615] (req 929792->933887) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444d6c expref: 61 pid: 166113 timeout: 22763 lvb_type: 0
00010000:00010000:1.0:1651531955.172545:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e2f464ac/0x3234de053ca2cab lrc: 3/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 56 type: EXT [966656->970751] (req 966656->970751) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445186 expref: 61 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.172548:0:166102:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca2b0e lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 56 type: EXT [929792->18446744073709551615] (req 929792->933887) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444d6c expref: 61 pid: 166113 timeout: 22763 lvb_type: 0
00010000:00010000:1.0:1651531955.172555:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531955.172555:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531955.172555:0:166102:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006878f48a/0x3234de053ca2b0e lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [929792->18446744073709551615] (req 929792->933887) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444d6c expref: 61 pid: 166113 timeout: 22763 lvb_type: 0
00010000:00010000:1.0:1651531955.172556:0:166113:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000df4fd81c/0x3234de053ca2c5e lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 56 type: EXT [999424->1003519] (req 999424->1003519) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531955.172559:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000df4fd81c/0x3234de053ca2c5e lrc: 4/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 54 type: EXT [999424->1003519] (req 999424->1003519) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531955.172563:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531955.172564:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531955.172564:0:166113:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ea9f3321/0x3234de053ca2c65 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 54 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531955.172567:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea9f3321/0x3234de053ca2c65 lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 54 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531955.172570:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531955.172571:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531955.172573:0:166113:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000378a069e/0x3234de053ca2c6c lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 54 type: EXT [978944->995327] (req 978944->983039) gid 0 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4450c9 expref: 60 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531955.172577:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000378a069e/0x3234de053ca2c6c lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 54 type: EXT [978944->995327] (req 978944->983039) gid 0 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4450c9 expref: 60 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531955.172580:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531955.172580:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531955.172581:0:166113:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cfb802a0/0x3234de053ca2ca4 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 54 type: EXT [995328->999423] (req 995328->999423) gid 0 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44517f expref: 60 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531955.172584:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cfb802a0/0x3234de053ca2ca4 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 54 type: EXT [995328->999423] (req 995328->999423) gid 0 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44517f expref: 60 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531955.172587:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531955.172588:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531955.172589:0:166113:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e2f464ac/0x3234de053ca2cab lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 54 type: EXT [966656->978943] (req 966656->970751) gid 0 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445186 expref: 60 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531955.172592:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2f464ac/0x3234de053ca2cab lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 54 type: EXT [966656->978943] (req 966656->970751) gid 0 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445186 expref: 60 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.172596:0:166102:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1651531955.172599:0:166113:0:(ldlm_lockd.c:1067:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000e2f464ac/0x3234de053ca2cab lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 53 type: EXT [966656->978943] (req 966656->970751) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445186 expref: 60 pid: 166113 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531955.172603:0:166113:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b9b21392 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:166113:1731745997349184:10.240.43.64@tcp:105:
00000100:00100000:0.0:1651531955.172607:0:166102:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008586382c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+60:438147:x1731754467314944:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 73us (110us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531955.172610:0:166102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 121
00010000:00010000:1.0:1651531955.172622:0:166113:0:(ldlm_lockd.c:1067:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000cfb802a0/0x3234de053ca2ca4 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 53 type: EXT [995328->999423] (req 995328->999423) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44517f expref: 59 pid: 166113 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531955.172629:0:166113:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c23d4946 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:166113:1731745997349248:10.240.43.64@tcp:105:
00010000:00010000:1.0:1651531955.172636:0:166113:0:(ldlm_lockd.c:1067:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000378a069e/0x3234de053ca2c6c lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 53 type: EXT [978944->995327] (req 978944->983039) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4450c9 expref: 59 pid: 166112 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531955.172639:0:166113:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000aee22df4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:166113:1731745997349312:10.240.43.64@tcp:105:
00000100:00100000:1.0:1651531955.172658:0:166113:0:(client.c:2492:ptlrpc_set_wait()) set 0000000030e02371 going to sleep for 6 seconds
00010000:00010000:1.0:1651531955.172668:0:192755:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ea9f3321/0x3234de053ca2c65 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 53 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531955.172671:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ea9f3321/0x3234de053ca2c65 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 53 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.172677:0:216321:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000df4fd81c/0x3234de053ca2c5e lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 53 type: EXT [999424->1003519] (req 999424->1003519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.172682:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000df4fd81c/0x3234de053ca2c5e lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 53 type: EXT [999424->1003519] (req 999424->1003519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.172695:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000df4fd81c/0x3234de053ca2c5e lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 53 type: EXT [999424->1003519] (req 999424->1003519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.172699:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000df4fd81c/0x3234de053ca2c5e lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 53 type: EXT [999424->1003519] (req 999424->1003519) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531955.172734:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000062fcd425 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+60:438147:x1731754467309376:12345-10.240.43.64@tcp:3:fio.0 Request processed in 102442us (102512us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531955.172737:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249639
00010000:00010000:1.0:1651531955.172742:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000df4fd81c/0x3234de053ca2c5e lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 53 type: EXT [999424->1003519] (req 999424->1003519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531955.172746:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000df4fd81c already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531955.172747:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000df4fd81c/0x3234de053ca2c5e lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 53 type: EXT [999424->1003519] (req 999424->1003519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531955.172751:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000df4fd81c/0x3234de053ca2c5e lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 53 type: EXT [999424->1003519] (req 999424->1003519) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531955.172757:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000df4fd81c/0x3234de053ca2c5e lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 53 type: EXT [999424->1003519] (req 999424->1003519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531955.172759:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000df4fd81c/0x3234de053ca2c5e lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 53 type: EXT [999424->1003519] (req 999424->1003519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531955.172977:0:166113:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b9b21392 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:166113:1731745997349184:10.240.43.64@tcp:105:
00000100:00100000:1.0:1651531955.172980:0:166113:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c23d4946 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:166113:1731745997349248:10.240.43.64@tcp:105:
00000100:00100000:1.0:1651531955.172990:0:166113:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000aee22df4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:166113:1731745997349312:10.240.43.64@tcp:105:
00010000:00010000:1.0:1651531955.172995:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e2f464ac, rc 0)
00000100:00100000:1.0:1651531955.173013:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002e364765 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+60:680972:x1731754467314880:12345-10.240.43.64@tcp:101:fio.0 Request processed in 499us (537us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531955.173016:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44374
00000100:00100000:0.0:1651531955.174028:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531955.174042:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531955.174045:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467315392
00000100:00100000:0.0:1651531955.174050:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531955.174062:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467315648
00000100:00100000:1.0:1651531955.174069:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44375
00000100:00100000:1.0:1651531955.174071:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fff66352 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+61:680969:x1731754467315392:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531955.174075:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651531955.174075:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44376
00000100:00100000:0.0:1651531955.174077:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e438854c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+61:680970:x1731754467315648:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531955.174079:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000c9190a4/0x3234de053ca2cb2 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 53 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44518d expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.174082:0:206699:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531955.174085:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531955.174085:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531955.174086:0:206699:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca2cb9 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 54 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445194 expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531955.174087:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000c9190a4/0x3234de053ca2cb2 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [1003520->18446744073709551615] (req 1003520->1007615) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44518d expref: 62 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.174092:0:206699:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531955.174093:0:206699:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531955.174096:0:206699:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca2cb9 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 54 type: EXT [897024->909311] (req 897024->901119) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445194 expref: 63 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531955.174101:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000c9190a4/0x3234de053ca2cb2 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [1003520->18446744073709551615] (req 1003520->1007615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44518d expref: 63 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.174101:0:206699:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca2cb9 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [897024->909311] (req 897024->901119) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445194 expref: 63 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531955.174105:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000000c9190a4, rc 0)
00010000:00010000:0.0:1651531955.174105:0:206699:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009c5faf65, rc 0)
00000100:00100000:1.0:1651531955.174115:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fff66352 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+63:680969:x1731754467315392:12345-10.240.43.64@tcp:101:fio.0 Request processed in 43us (88us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531955.174115:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e438854c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+63:680970:x1731754467315648:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (64us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531955.174117:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44376
00000100:00100000:1.0:1651531955.174119:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44375
00000100:00100000:0.0:1651531955.174126:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467315520
00002000:00100000:0.0:1651531955.174132:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x34545:0x0] (966656->978943)  req@000000008ce37436 x1731754467315520/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:416/0 lens 488/0 e 0 to 0 dl 1651531961 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:0.0:1651531955.174138:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000008ce37436 with x1731754467315520 ext(966656->978943)
00002000:00010000:0.0:1651531955.174139:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000008ce37436
00000100:00100000:0.0:1651531955.174144:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249647
00000100:00100000:0.0:1651531955.174146:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008ce37436 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+62:438148:x1731754467315520:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651531955.174171:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008ce37436 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+62:438148:x1731754467315520:12345-10.240.43.64@tcp:3:fio.0 Request processed in 24us (128us total) trans 0 rc 12288/12288
00000100:00100000:0.0:1651531955.174174:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249647
00002000:00100000:0.0:1651531955.174175:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x34545:0x0] (966656->978943)  req@000000008ce37436 x1731754467315520/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:416/0 lens 488/12728 e 0 to 0 dl 1651531961 ref 1 fl Complete:/0/0 rc 12288/12288 job:'fio.0'
00002000:00100000:0.0:1651531955.174179:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000008ce37436 with x1731754467315520 ext(966656->978943)
00002000:00010000:0.0:1651531955.174180:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000008ce37436
00000100:00100000:1.0:1651531955.174471:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531955.174483:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467315776
00002000:00100000:0.0:1651531955.174491:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x34545:0x0] (897024->905215)  req@00000000aee22df4 x1731754467315776/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:416/0 lens 488/0 e 0 to 0 dl 1651531961 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:0.0:1651531955.174495:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000aee22df4 with x1731754467315776 ext(897024->905215)
00002000:00010000:0.0:1651531955.174496:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000aee22df4
00000100:00100000:1.0:1651531955.174500:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531955.174507:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467315904
00002000:00100000:0.0:1651531955.174511:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x34545:0x0] (1003520->1048575)  req@00000000c23d4946 x1731754467315904/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:416/0 lens 488/0 e 0 to 0 dl 1651531961 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00000100:00100000:1.0:1651531955.174513:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249648
00002000:00100000:0.0:1651531955.174514:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000c23d4946 with x1731754467315904 ext(1003520->1048575)
00000100:00100000:1.0:1651531955.174515:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aee22df4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+63:438146:x1731754467315776:12345-10.240.43.64@tcp:3:fio.0
00002000:00010000:0.0:1651531955.174515:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000c23d4946
00000100:00100000:0.0:1651531955.174522:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249649
00000100:00100000:0.0:1651531955.174523:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c23d4946 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+63:438149:x1731754467315904:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651531955.174547:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aee22df4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+64:438146:x1731754467315776:12345-10.240.43.64@tcp:3:fio.0 Request processed in 31us (75us total) trans 0 rc 8192/8192
00000100:00100000:1.0:1651531955.174550:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249648
00002000:00100000:1.0:1651531955.174552:0:192753:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x100010000:0x34545:0x0] (897024->905215)  req@00000000aee22df4 x1731754467315776/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:416/0 lens 488/8632 e 0 to 0 dl 1651531961 ref 1 fl Complete:/0/0 rc 8192/8192 job:'fio.0'
00002000:00100000:1.0:1651531955.174556:0:192753:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000aee22df4 with x1731754467315776 ext(897024->905215)
00002000:00010000:1.0:1651531955.174558:0:192753:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000aee22df4
00000100:00100000:0.0:1651531955.174755:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c23d4946 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+62:438149:x1731754467315904:12345-10.240.43.64@tcp:3:fio.0 Request processed in 231us (262us total) trans 0 rc 45056/45056
00000100:00100000:0.0:1651531955.174759:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249649
00002000:00100000:0.0:1651531955.174761:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x34545:0x0] (1003520->1048575)  req@00000000c23d4946 x1731754467315904/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:416/0 lens 488/440 e 0 to 0 dl 1651531961 ref 1 fl Complete:/0/0 rc 45056/45056 job:'fio.0'
00002000:00100000:0.0:1651531955.174765:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000c23d4946 with x1731754467315904 ext(1003520->1048575)
00002000:00010000:0.0:1651531955.174766:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000c23d4946
00000100:00100000:1.0:1651531955.175517:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531955.175525:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467316416
00000100:00100000:1.0:1651531955.175537:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44377
00000100:00100000:1.0:1651531955.175539:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b9b21392 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+62:680970:x1731754467316416:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531955.175543:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531955.175547:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca2cc0 lrc: 2/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4451a2 expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531955.175554:0:166111:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca2c7a lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [159744->180223] (req 159744->163839) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4450f3 expref: 63 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531955.175557:0:166111:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f253fba8/0x3234de053ca2c81 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [167936->180223] (req 167936->172031) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4450fa expref: 63 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531955.175561:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:1.0:1651531955.175562:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:1.0:1651531955.175563:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca2cc0 lrc: 5/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [172032->176127] (req 172032->176127) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4451a2 expref: 63 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531955.175570:0:166111:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f253fba8/0x3234de053ca2c81 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [167936->180223] (req 167936->172031) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4450fa expref: 63 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531955.175574:0:166111:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f253fba8/0x3234de053ca2c81 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [167936->180223] (req 167936->172031) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4450fa expref: 63 pid: 166111 timeout: 22763 lvb_type: 0
00000100:00100000:1.0:1651531955.175578:0:166111:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000941ac345 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:166111:1731745997349376:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651531955.175596:0:166111:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca2c7a lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [159744->180223] (req 159744->163839) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4450f3 expref: 63 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531955.175600:0:166111:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca2c7a lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [159744->180223] (req 159744->163839) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4450f3 expref: 63 pid: 166112 timeout: 22763 lvb_type: 0
00000100:00100000:1.0:1651531955.175604:0:166111:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005e4b6deb pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:166111:1731745997349440:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531955.175609:0:166111:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ec524534 going to sleep for 6 seconds
00000100:00100000:1.0:1651531955.175866:0:166111:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000941ac345 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:166111:1731745997349376:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531955.176013:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531955.176021:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531955.176024:0:166111:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005e4b6deb pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:166111:1731745997349440:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531955.176027:0:169267:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467316544
00010000:00010000:1.0:1651531955.176029:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca2cc0 lrc: 3/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [172032->176127] (req 172032->176127) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4451a2 expref: 64 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.176033:0:169267:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f253fba8/0x3234de053ca2c81 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 56 type: EXT [167936->180223] (req 167936->172031) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4450fa expref: 64 pid: 166111 timeout: 22763 lvb_type: 0
00010000:00010000:1.0:1651531955.176039:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d44eb74d, rc 0)
00000100:00100000:0.0:1651531955.176044:0:169267:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467316608
00010000:00010000:0.0:1651531955.176047:0:169267:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca2c7a lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [159744->180223] (req 159744->163839) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4450f3 expref: 65 pid: 166112 timeout: 22763 lvb_type: 0
00000100:00100000:0.0:1651531955.176055:0:169267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 122
00000100:00100000:0.0:1651531955.176057:0:169267:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003ab8c993 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+65:438148:x1731754467316544:12345-10.240.43.64@tcp:103:ldlm_bl_04.0
00010000:00010000:0.0:1651531955.176060:0:169267:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00000100:00100000:1.0:1651531955.176061:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b9b21392 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+65:680970:x1731754467316416:12345-10.240.43.64@tcp:101:fio.0 Request processed in 521us (544us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531955.176064:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44377
00010000:00010000:0.0:1651531955.176064:0:169267:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f253fba8/0x3234de053ca2c81 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 56 type: EXT [167936->180223] (req 167936->172031) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4450fa expref: 65 pid: 166111 timeout: 22763 lvb_type: 0
00010000:00010000:0.0:1651531955.176068:0:169267:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f253fba8/0x3234de053ca2c81 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 56 type: EXT [167936->180223] (req 167936->172031) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4450fa expref: 64 pid: 166111 timeout: 22763 lvb_type: 0
00000100:00100000:1.0:1651531955.176073:0:166103:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 123
00000100:00100000:1.0:1651531955.176074:0:166103:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008dcbc4a5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+64:438146:x1731754467316608:12345-10.240.43.64@tcp:103:ldlm_bl_03.0
00010000:00010000:1.0:1651531955.176078:0:166103:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531955.176078:0:169267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f253fba8/0x3234de053ca2c81 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 56 type: EXT [167936->180223] (req 167936->172031) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4450fa expref: 64 pid: 166111 timeout: 22763 lvb_type: 0
00010000:00010000:1.0:1651531955.176082:0:166103:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca2c7a lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 56 type: EXT [159744->180223] (req 159744->163839) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4450f3 expref: 63 pid: 166112 timeout: 22763 lvb_type: 0
00010000:00010000:0.0:1651531955.176083:0:169267:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1651531955.176086:0:166103:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca2c7a lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [159744->180223] (req 159744->163839) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4450f3 expref: 63 pid: 166112 timeout: 22763 lvb_type: 0
00000100:00100000:0.0:1651531955.176090:0:169267:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003ab8c993 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+63:438148:x1731754467316544:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 33us (78us total) trans 0 rc 0/0
00010000:00010000:1.0:1651531955.176092:0:166103:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca2c7a lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [159744->180223] (req 159744->163839) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4450f3 expref: 63 pid: 166112 timeout: 22763 lvb_type: 0
00000100:00100000:0.0:1651531955.176093:0:169267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 122
00010000:00010000:1.0:1651531955.176096:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531955.176097:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531955.176099:0:166103:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca2cc0 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 54 type: EXT [172032->180223] (req 172032->176127) gid 0 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4451a2 expref: 61 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531955.176102:0:166103:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca2cc0 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 54 type: EXT [172032->180223] (req 172032->176127) gid 0 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4451a2 expref: 61 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531955.176109:0:166103:0:(ldlm_lockd.c:1067:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca2cc0 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 54 type: EXT [172032->180223] (req 172032->176127) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4451a2 expref: 61 pid: 166111 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531955.176115:0:166103:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005e4b6deb pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:166103:1731745997349504:10.240.43.64@tcp:105:
00000100:00100000:1.0:1651531955.176122:0:166103:0:(client.c:2492:ptlrpc_set_wait()) set 000000001a1ce0e5 going to sleep for 6 seconds
00000100:00100000:1.0:1651531955.176350:0:166103:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005e4b6deb pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:166103:1731745997349504:10.240.43.64@tcp:105:
00010000:00010000:1.0:1651531955.176354:0:166103:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1651531955.176363:0:166103:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008dcbc4a5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+61:438146:x1731754467316608:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 288us (342us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531955.176366:0:166103:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 123
00000100:00100000:0.0:1651531955.177236:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531955.177247:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467316864
00000100:00100000:0.0:1651531955.177255:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44378
00000100:00100000:0.0:1651531955.177256:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000797d7ba8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+61:680972:x1731754467316864:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531955.177260:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531955.177264:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000030d4a6f9/0x3234de053ca2cc7 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 54 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4451b7 expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.177270:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531955.177271:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531955.177273:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000030d4a6f9/0x3234de053ca2cc7 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 54 type: EXT [143360->172031] (req 143360->147455) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4451b7 expref: 62 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.177278:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000030d4a6f9/0x3234de053ca2cc7 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 54 type: EXT [143360->172031] (req 143360->147455) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4451b7 expref: 62 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.177282:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000030d4a6f9, rc 0)
00000100:00100000:0.0:1651531955.177296:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000797d7ba8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+62:680972:x1731754467316864:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (74us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531955.177302:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44378
00000100:00100000:0.0:1651531955.177587:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531955.177594:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467316928
00000100:00100000:0.0:1651531955.177600:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44379
00000100:00100000:0.0:1651531955.177602:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000041083123 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+62:680969:x1731754467316928:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531955.177605:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531955.177612:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a4cc8a0d/0x3234de053ca2cce lrc: 2/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4451be expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.177619:0:166112:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000007a8a843/0x3234de053ca2c9d lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [905216->909311] (req 905216->909311) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445171 expref: 63 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.177622:0:166112:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca2cb9 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [897024->909311] (req 897024->901119) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445194 expref: 63 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.177625:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:0.0:1651531955.177626:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:0.0:1651531955.177626:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a4cc8a0d/0x3234de053ca2cce lrc: 5/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [905216->909311] (req 905216->909311) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4451be expref: 63 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.177633:0:166112:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca2cb9 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [897024->909311] (req 897024->901119) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445194 expref: 63 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.177637:0:166112:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca2cb9 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [897024->909311] (req 897024->901119) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445194 expref: 63 pid: 206699 timeout: 22763 lvb_type: 0
00000100:00100000:0.0:1651531955.177641:0:166112:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000040ff83df pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:166112:1731745997349568:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651531955.177664:0:166112:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000007a8a843/0x3234de053ca2c9d lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [905216->909311] (req 905216->909311) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445171 expref: 63 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.177668:0:166112:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000007a8a843/0x3234de053ca2c9d lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [905216->909311] (req 905216->909311) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445171 expref: 63 pid: 166113 timeout: 22763 lvb_type: 0
00000100:00100000:0.0:1651531955.177672:0:166112:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008f997301 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:166112:1731745997349632:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531955.177677:0:166112:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f14111ff going to sleep for 6 seconds
00000100:00100000:0.0:1651531955.178553:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531955.178562:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467317056
00002000:00100000:0.0:1651531955.178568:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x34545:0x0] (143360->172031)  req@0000000070160f29 x1731754467317056/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:416/0 lens 488/0 e 0 to 0 dl 1651531961 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:0.0:1651531955.178572:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000070160f29 with x1731754467317056 ext(143360->172031)
00002000:00010000:0.0:1651531955.178573:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000070160f29
00000100:00100000:0.0:1651531955.178585:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249650
00000100:00100000:0.0:1651531955.178587:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000070160f29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+64:438148:x1731754467317056:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651531955.178758:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531955.178769:0:166103:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467317248
00000100:00100000:0.0:1651531955.178769:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651531955.178775:0:166103:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000007a8a843/0x3234de053ca2c9d lrc: 5/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [905216->909311] (req 905216->909311) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445171 expref: 66 pid: 166113 timeout: 22763 lvb_type: 0
00000100:00100000:0.0:1651531955.178795:0:166104:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467317312
00000100:00100000:1.0:1651531955.178798:0:166103:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 124
00000100:00100000:1.0:1651531955.178800:0:166103:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004f13e53f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+67:438147:x1731754467317248:12345-10.240.43.64@tcp:103:ldlm_bl_02.0
00010000:00010000:0.0:1651531955.178801:0:166104:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca2cb9 lrc: 5/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [897024->909311] (req 897024->901119) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445194 expref: 67 pid: 206699 timeout: 22763 lvb_type: 0
00010000:00010000:1.0:1651531955.178803:0:166103:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1651531955.178807:0:166103:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000007a8a843/0x3234de053ca2c9d lrc: 5/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 56 type: EXT [905216->909311] (req 905216->909311) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445171 expref: 67 pid: 166113 timeout: 22763 lvb_type: 0
00010000:00010000:1.0:1651531955.178810:0:166103:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000007a8a843/0x3234de053ca2c9d lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 56 type: EXT [905216->909311] (req 905216->909311) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445171 expref: 67 pid: 166113 timeout: 22763 lvb_type: 0
00000100:00100000:0.0:1651531955.178810:0:166104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 125
00000100:00100000:0.0:1651531955.178812:0:166104:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004650255e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+67:438149:x1731754467317312:12345-10.240.43.64@tcp:103:ldlm_bl_01.0
00010000:00010000:0.0:1651531955.178815:0:166104:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1651531955.178817:0:166103:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1651531955.178820:0:166104:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca2cb9 lrc: 5/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 56 type: EXT [897024->909311] (req 897024->901119) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445194 expref: 67 pid: 206699 timeout: 22763 lvb_type: 0
00010000:00010000:0.0:1651531955.178823:0:166104:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca2cb9 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 56 type: EXT [897024->909311] (req 897024->901119) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445194 expref: 67 pid: 206699 timeout: 22763 lvb_type: 0
00000100:00100000:1.0:1651531955.178830:0:166103:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004f13e53f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+67:438147:x1731754467317248:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 29us (72us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531955.178833:0:166103:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 124
00010000:00010000:0.0:1651531955.178836:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531955.178837:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531955.178839:0:166104:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a4cc8a0d/0x3234de053ca2cce lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 56 type: EXT [905216->909311] (req 905216->909311) gid 0 flags: 0x50080000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4451be expref: 66 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.178842:0:166104:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a4cc8a0d/0x3234de053ca2cce lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 56 type: EXT [905216->909311] (req 905216->909311) gid 0 flags: 0x50080000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4451be expref: 66 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.178850:0:166104:0:(ldlm_lockd.c:1067:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a4cc8a0d/0x3234de053ca2cce lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 56 type: EXT [905216->909311] (req 905216->909311) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4451be expref: 66 pid: 166112 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531955.178854:0:166104:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004d72f458 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:166104:1731745997349696:10.240.43.64@tcp:105:
00000100:00100000:0.0:1651531955.178870:0:166104:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f5c446d6 going to sleep for 6 seconds
00010000:00010000:0.0:1651531955.178881:0:166112:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca2cb9 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 56 type: EXT [897024->909311] (req 897024->901119) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445194 expref: 66 pid: 206699 timeout: 22763 lvb_type: 0
00000100:00100000:0.0:1651531955.178885:0:166112:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000040ff83df pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:166112:1731745997349568:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651531955.178888:0:166112:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000007a8a843/0x3234de053ca2c9d lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [905216->909311] (req 905216->909311) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445171 expref: 65 pid: 166113 timeout: 22763 lvb_type: 0
00000100:00100000:0.0:1651531955.178891:0:166112:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008f997301 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:166112:1731745997349632:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651531955.178898:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a4cc8a0d/0x3234de053ca2cce lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 54 type: EXT [905216->909311] (req 905216->909311) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4451be expref: 64 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.178902:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a4cc8a0d, rc 0)
00000100:00100000:0.0:1651531955.178915:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000041083123 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+64:680969:x1731754467316928:12345-10.240.43.64@tcp:101:fio.0 Request processed in 1312us (1328us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531955.178918:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44379
00000100:00100000:0.0:1651531955.178938:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000070160f29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+62:438148:x1731754467317056:12345-10.240.43.64@tcp:3:fio.0 Request processed in 351us (386us total) trans 0 rc 28672/28672
00000100:00100000:0.0:1651531955.178942:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249650
00002000:00100000:0.0:1651531955.178944:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x34545:0x0] (143360->172031)  req@0000000070160f29 x1731754467317056/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:416/0 lens 488/440 e 0 to 0 dl 1651531961 ref 1 fl Complete:/0/0 rc 28672/28672 job:'fio.0'
00002000:00100000:0.0:1651531955.178947:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000070160f29 with x1731754467317056 ext(143360->172031)
00002000:00010000:0.0:1651531955.178949:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000070160f29
00000100:00100000:0.0:1651531955.179120:0:166104:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004d72f458 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:166104:1731745997349696:10.240.43.64@tcp:105:
00010000:00010000:0.0:1651531955.179124:0:166104:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651531955.179139:0:166104:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004650255e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+61:438149:x1731754467317312:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 326us (369us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531955.179142:0:166104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 125
00000100:00100000:0.0:1651531955.179678:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531955.179686:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467317440
00002000:00100000:0.0:1651531955.179692:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x34545:0x0] (663552->667647)  req@000000004d72f458 x1731754467317440/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:416/0 lens 488/0 e 0 to 0 dl 1651531961 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:0.0:1651531955.179696:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000004d72f458 with x1731754467317440 ext(663552->667647)
00002000:00010000:0.0:1651531955.179698:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000004d72f458
00000100:00100000:0.0:1651531955.179711:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249651
00000100:00100000:0.0:1651531955.179712:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004d72f458 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+61:438149:x1731754467317440:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651531955.179739:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004d72f458 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+61:438149:x1731754467317440:12345-10.240.43.64@tcp:3:fio.0 Request processed in 26us (61us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531955.179742:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249651
00002000:00100000:0.0:1651531955.179744:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x34545:0x0] (663552->667647)  req@000000004d72f458 x1731754467317440/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:416/0 lens 488/4536 e 0 to 0 dl 1651531961 ref 1 fl Complete:/0/0 rc 4096/4096 job:'fio.0'
00002000:00100000:0.0:1651531955.179747:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000004d72f458 with x1731754467317440 ext(663552->667647)
00002000:00010000:0.0:1651531955.179749:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000004d72f458
00000100:00100000:0.0:1651531955.180052:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531955.180060:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467317632
00002000:00100000:0.0:1651531955.180066:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x34545:0x0] (110592->114687)  req@000000008f997301 x1731754467317632/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:416/0 lens 488/0 e 0 to 0 dl 1651531961 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:0.0:1651531955.180070:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000008f997301 with x1731754467317632 ext(110592->114687)
00002000:00010000:0.0:1651531955.180071:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000008f997301
00000100:00100000:0.0:1651531955.180081:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249652
00000100:00100000:0.0:1651531955.180082:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008f997301 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+61:438149:x1731754467317632:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651531955.180109:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008f997301 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+61:438149:x1731754467317632:12345-10.240.43.64@tcp:3:fio.0 Request processed in 26us (58us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531955.180112:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249652
00002000:00100000:0.0:1651531955.180114:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x34545:0x0] (110592->114687)  req@000000008f997301 x1731754467317632/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:416/0 lens 488/4536 e 0 to 0 dl 1651531961 ref 1 fl Complete:/0/0 rc 4096/4096 job:'fio.0'
00002000:00100000:0.0:1651531955.180118:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000008f997301 with x1731754467317632 ext(110592->114687)
00002000:00010000:0.0:1651531955.180119:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000008f997301
00000100:00100000:0.0:1651531955.181099:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531955.181107:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467317824
00000100:00100000:0.0:1651531955.181113:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44380
00000100:00100000:0.0:1651531955.181115:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000040ff83df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+61:680972:x1731754467317824:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531955.181119:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531955.181123:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003e4793c3/0x3234de053ca2cd5 lrc: 2/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 54 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4451cc expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.181135:0:166112:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000030d4a6f9/0x3234de053ca2cc7 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 54 type: EXT [143360->172031] (req 143360->147455) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4451b7 expref: 62 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.181138:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531955.181139:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531955.181140:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003e4793c3/0x3234de053ca2cd5 lrc: 4/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 54 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4451cc expref: 62 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.181147:0:166112:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000030d4a6f9/0x3234de053ca2cc7 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 54 type: EXT [143360->172031] (req 143360->147455) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4451b7 expref: 62 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.181150:0:166112:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000030d4a6f9/0x3234de053ca2cc7 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 54 type: EXT [143360->172031] (req 143360->147455) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4451b7 expref: 62 pid: 166111 timeout: 22763 lvb_type: 0
00000100:00100000:0.0:1651531955.181154:0:166112:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006c46ca95 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:166112:1731745997349760:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531955.181172:0:166112:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f5c446d6 going to sleep for 6 seconds
00000100:00100000:0.0:1651531955.181360:0:166112:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006c46ca95 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:166112:1731745997349760:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651531955.181366:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003e4793c3/0x3234de053ca2cd5 lrc: 3/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 54 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4451cc expref: 62 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.181375:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003e4793c3, rc 0)
00000100:00100000:0.0:1651531955.181390:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000040ff83df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+62:680972:x1731754467317824:12345-10.240.43.64@tcp:101:fio.0 Request processed in 274us (292us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531955.181394:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44380
00000100:00100000:0.0:1651531955.181623:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531955.181630:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467317952
00000100:00100000:0.0:1651531955.181636:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44381
00000100:00100000:0.0:1651531955.181638:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006c46ca95 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+62:680969:x1731754467317952:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531955.181641:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531955.181645:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007d2b2323/0x3234de053ca2cdc lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4451da expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.181650:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531955.181651:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531955.181653:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007d2b2323/0x3234de053ca2cdc lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [942080->978943] (req 942080->946175) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4451da expref: 63 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.181658:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007d2b2323/0x3234de053ca2cdc lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [942080->978943] (req 942080->946175) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4451da expref: 63 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.181662:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007d2b2323, rc 0)
00000100:00100000:0.0:1651531955.181678:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006c46ca95 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+63:680969:x1731754467317952:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (56us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531955.181681:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44381
00000100:00100000:0.0:1651531955.181717:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531955.181725:0:166104:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467318016
00010000:00010000:0.0:1651531955.181730:0:166104:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000030d4a6f9/0x3234de053ca2cc7 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [143360->172031] (req 143360->147455) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4451b7 expref: 63 pid: 166111 timeout: 22763 lvb_type: 0
00000100:00100000:0.0:1651531955.181737:0:166104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 126
00000100:00100000:0.0:1651531955.181739:0:166104:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000053de45f6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+63:438149:x1731754467318016:12345-10.240.43.64@tcp:103:ldlm_bl_04.0
00010000:00010000:0.0:1651531955.181742:0:166104:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531955.181745:0:166104:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000030d4a6f9/0x3234de053ca2cc7 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 56 type: EXT [143360->172031] (req 143360->147455) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4451b7 expref: 63 pid: 166111 timeout: 22763 lvb_type: 0
00010000:00010000:0.0:1651531955.181749:0:166104:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000030d4a6f9/0x3234de053ca2cc7 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 56 type: EXT [143360->172031] (req 143360->147455) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4451b7 expref: 63 pid: 166111 timeout: 22763 lvb_type: 0
00010000:00010000:0.0:1651531955.181755:0:166104:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000030d4a6f9/0x3234de053ca2cc7 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 56 type: EXT [143360->172031] (req 143360->147455) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4451b7 expref: 63 pid: 166111 timeout: 22763 lvb_type: 0
00010000:00010000:0.0:1651531955.181759:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531955.181759:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531955.181761:0:166104:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003e4793c3/0x3234de053ca2cd5 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [147456->172031] (req 147456->151551) gid 0 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4451cc expref: 62 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.181765:0:166104:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003e4793c3/0x3234de053ca2cd5 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [147456->172031] (req 147456->151551) gid 0 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4451cc expref: 62 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.181772:0:166104:0:(ldlm_lockd.c:1067:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003e4793c3/0x3234de053ca2cd5 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [147456->172031] (req 147456->151551) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4451cc expref: 62 pid: 166112 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531955.181776:0:166104:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000e33e11e pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:166104:1731745997349824:10.240.43.64@tcp:105:
00000100:00100000:0.0:1651531955.181792:0:166104:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f5c446d6 going to sleep for 6 seconds
00000100:00100000:0.0:1651531955.181991:0:166104:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000e33e11e pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:166104:1731745997349824:10.240.43.64@tcp:105:
00010000:00010000:0.0:1651531955.181995:0:166104:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651531955.182024:0:166104:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000053de45f6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+62:438149:x1731754467318016:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 283us (306us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531955.182027:0:166104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 126
00000100:00100000:0.0:1651531955.182042:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531955.182049:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467318144
00002000:00100000:0.0:1651531955.182055:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x34545:0x0] (942080->966655)  req@000000000e33e11e x1731754467318144/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:416/0 lens 488/0 e 0 to 0 dl 1651531961 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:0.0:1651531955.182059:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000000e33e11e with x1731754467318144 ext(942080->966655)
00002000:00010000:0.0:1651531955.182060:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000000e33e11e
00000100:00100000:0.0:1651531955.182069:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249653
00000100:00100000:0.0:1651531955.182070:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000e33e11e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+62:438149:x1731754467318144:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651531955.182259:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000e33e11e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+62:438149:x1731754467318144:12345-10.240.43.64@tcp:3:fio.0 Request processed in 188us (217us total) trans 0 rc 24576/24576
00000100:00100000:0.0:1651531955.182263:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249653
00002000:00100000:0.0:1651531955.182265:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x34545:0x0] (942080->966655)  req@000000000e33e11e x1731754467318144/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:416/0 lens 488/440 e 0 to 0 dl 1651531961 ref 1 fl Complete:/0/0 rc 24576/24576 job:'fio.0'
00002000:00100000:0.0:1651531955.182269:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000000e33e11e with x1731754467318144 ext(942080->966655)
00002000:00010000:0.0:1651531955.182270:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000000e33e11e
00000100:00100000:0.0:1651531955.188514:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531955.188522:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467318848
00000100:00100000:0.0:1651531955.188530:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44382
00000100:00100000:0.0:1651531955.188531:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cc11a3b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+62:680969:x1731754467318848:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531955.188535:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531955.188540:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000064aa83ac/0x3234de053ca2ce3 lrc: 2/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4451ef expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.188546:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531955.188547:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531955.188549:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000064aa83ac/0x3234de053ca2ce3 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [131072->147455] (req 131072->135167) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4451ef expref: 63 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.188554:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000064aa83ac/0x3234de053ca2ce3 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [131072->147455] (req 131072->135167) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4451ef expref: 63 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.188558:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000064aa83ac, rc 0)
00000100:00100000:0.0:1651531955.188575:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cc11a3b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+63:680969:x1731754467318848:12345-10.240.43.64@tcp:101:fio.0 Request processed in 43us (61us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531955.188578:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44382
00000100:00100000:0.0:1651531955.189000:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531955.189009:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467318976
00002000:00100000:0.0:1651531955.189015:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x34545:0x0] (135168->147455)  req@00000000312d9782 x1731754467318976/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:416/0 lens 488/0 e 0 to 0 dl 1651531961 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:0.0:1651531955.189019:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000312d9782 with x1731754467318976 ext(135168->147455)
00002000:00010000:0.0:1651531955.189020:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000312d9782
00000100:00100000:0.0:1651531955.189030:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249654
00000100:00100000:0.0:1651531955.189032:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000312d9782 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+63:438147:x1731754467318976:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651531955.189064:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000312d9782 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+63:438147:x1731754467318976:12345-10.240.43.64@tcp:3:fio.0 Request processed in 31us (65us total) trans 0 rc 12288/12288
00000100:00100000:0.0:1651531955.189067:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249654
00002000:00100000:0.0:1651531955.189069:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x34545:0x0] (135168->147455)  req@00000000312d9782 x1731754467318976/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:416/0 lens 488/12728 e 0 to 0 dl 1651531961 ref 1 fl Complete:/0/0 rc 12288/12288 job:'fio.0'
00002000:00100000:0.0:1651531955.189074:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000312d9782 with x1731754467318976 ext(135168->147455)
00002000:00010000:0.0:1651531955.189075:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000312d9782
00000100:00100000:0.0:1651531955.189586:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531955.189594:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467319040
00000100:00100000:0.0:1651531955.189601:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44383
00000100:00100000:0.0:1651531955.189603:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f27573c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+63:680969:x1731754467319040:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531955.189606:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531955.189610:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c4c045e/0x3234de053ca2cea lrc: 2/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 56 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4451f6 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.189617:0:166112:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007d2b2323/0x3234de053ca2cdc lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 56 type: EXT [942080->978943] (req 942080->946175) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4451da expref: 64 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.189620:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531955.189621:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531955.189622:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c4c045e/0x3234de053ca2cea lrc: 4/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 56 type: EXT [946176->950271] (req 946176->950271) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4451f6 expref: 64 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.189629:0:166112:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007d2b2323/0x3234de053ca2cdc lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 56 type: EXT [942080->978943] (req 942080->946175) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4451da expref: 64 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.189632:0:166112:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007d2b2323/0x3234de053ca2cdc lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 56 type: EXT [942080->978943] (req 942080->946175) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4451da expref: 64 pid: 166112 timeout: 22763 lvb_type: 0
00000100:00100000:0.0:1651531955.189637:0:166112:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000eef74747 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:166112:1731745997349888:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531955.189653:0:166112:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f5c446d6 going to sleep for 6 seconds
00000100:00100000:0.0:1651531955.189940:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531955.189947:0:166104:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467319104
00010000:00010000:0.0:1651531955.189953:0:166104:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007d2b2323/0x3234de053ca2cdc lrc: 5/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 56 type: EXT [942080->978943] (req 942080->946175) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4451da expref: 65 pid: 166112 timeout: 22763 lvb_type: 0
00000100:00100000:0.0:1651531955.189960:0:166104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 127
00000100:00100000:0.0:1651531955.189962:0:166104:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000002830b34 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+65:438146:x1731754467319104:12345-10.240.43.64@tcp:103:ldlm_bl_03.0
00010000:00010000:0.0:1651531955.189965:0:166104:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531955.189968:0:166104:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007d2b2323/0x3234de053ca2cdc lrc: 5/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 57 type: EXT [942080->978943] (req 942080->946175) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4451da expref: 65 pid: 166112 timeout: 22763 lvb_type: 0
00010000:00010000:0.0:1651531955.189972:0:166104:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007d2b2323/0x3234de053ca2cdc lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 57 type: EXT [942080->978943] (req 942080->946175) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4451da expref: 65 pid: 166112 timeout: 22763 lvb_type: 0
00010000:00010000:0.0:1651531955.189978:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531955.189979:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531955.189981:0:166104:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003c4c045e/0x3234de053ca2cea lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 57 type: EXT [946176->966655] (req 946176->950271) gid 0 flags: 0x50080000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4451f6 expref: 65 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.189984:0:166104:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c4c045e/0x3234de053ca2cea lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 57 type: EXT [946176->966655] (req 946176->950271) gid 0 flags: 0x50080000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4451f6 expref: 65 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.189992:0:166104:0:(ldlm_lockd.c:1067:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003c4c045e/0x3234de053ca2cea lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 57 type: EXT [946176->966655] (req 946176->950271) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4451f6 expref: 65 pid: 166112 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531955.189996:0:166104:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000018762a77 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:166104:1731745997349952:10.240.43.64@tcp:105:
00000100:00100000:0.0:1651531955.190013:0:166104:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f54ad06c going to sleep for 6 seconds
00010000:00010000:0.0:1651531955.190023:0:166112:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007d2b2323/0x3234de053ca2cdc lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 57 type: EXT [942080->978943] (req 942080->946175) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4451da expref: 65 pid: 166112 timeout: 22763 lvb_type: 0
00000100:00100000:0.0:1651531955.190028:0:166112:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000eef74747 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:166112:1731745997349888:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651531955.190033:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003c4c045e/0x3234de053ca2cea lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 56 type: EXT [946176->966655] (req 946176->950271) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4451f6 expref: 64 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.190037:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003c4c045e, rc 0)
00000100:00100000:0.0:1651531955.190045:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f27573c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+64:680969:x1731754467319040:12345-10.240.43.64@tcp:101:fio.0 Request processed in 442us (460us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531955.190048:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44383
00000100:00100000:0.0:1651531955.190253:0:166104:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000018762a77 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:166104:1731745997349952:10.240.43.64@tcp:105:
00010000:00010000:0.0:1651531955.190258:0:166104:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651531955.190267:0:166104:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000002830b34 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+63:438146:x1731754467319104:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 305us (327us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531955.190270:0:166104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 127
00000001:00080000:0.0:1651531955.312132:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869068 is committed
00010000:00010000:1.0:1651531955.312165:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea9f3321/0x3234de053ca2c65 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531955.312170:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ea9f3321/0x3234de053ca2c65 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531955.312187:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000081813f11 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+58:438148:x1731754467309568:12345-10.240.43.64@tcp:4:fio.0 Request processed in 241208us (241378us total) trans 21474869068 rc 0/0
00000100:00100000:1.0:1651531955.312190:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249640
00010000:00010000:1.0:1651531955.312198:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ea9f3321/0x3234de053ca2c65 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531955.312214:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000ea9f3321 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531955.312215:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea9f3321/0x3234de053ca2c65 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531955.312218:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea9f3321/0x3234de053ca2c65 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531955.312239:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ea9f3321/0x3234de053ca2c65 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531955.312242:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ea9f3321/0x3234de053ca2c65 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531955.313047:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531955.313065:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467319488
00000100:00100000:1.0:1651531955.313081:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249655
00000100:00100000:1.0:1651531955.313083:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000018762a77 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+58:438148:x1731754467319488:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531955.313094:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca2cf1 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531955.313098:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531955.313099:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531955.313100:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca2cf1 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [49152->53247] (req 49152->53247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531955.313104:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca2cf1 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [49152->53247] (req 49152->53247) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531955.313116:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca2cf1 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [49152->53247] (req 49152->53247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531955.313119:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca2cf1 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [49152->53247] (req 49152->53247) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531955.313139:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000018762a77 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+58:438148:x1731754467319488:12345-10.240.43.64@tcp:3:fio.0 Request processed in 54us (92us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531955.313141:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249655
00010000:00010000:0.0:1651531955.313142:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca2cf1 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [49152->53247] (req 49152->53247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.313146:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001e36c601 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531955.313147:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca2cf1 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [49152->53247] (req 49152->53247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.313151:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca2cf1 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [49152->53247] (req 49152->53247) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.313160:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca2cf1 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [49152->53247] (req 49152->53247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.313163:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca2cf1 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [49152->53247] (req 49152->53247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531955.314440:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531955.314450:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467319744
00002000:00100000:1.0:1651531955.314459:0:192755:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x100010000:0x34545:0x0] (61440->999423)  req@00000000eef74747 x1731754467319744/t0(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:416/0 lens 1048/0 e 0 to 0 dl 1651531961 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:1.0:1651531955.314463:0:192755:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000eef74747 with x1731754467319744 ext(61440->999423)
00002000:00010000:1.0:1651531955.314468:0:192755:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000eef74747
00000100:00100000:1.0:1651531955.314479:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249656
00000100:00100000:1.0:1651531955.314480:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000eef74747 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+58:438149:x1731754467319744:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651531955.315406:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000eef74747 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+60:438149:x1731754467319744:12345-10.240.43.64@tcp:4:fio.0 Request processed in 924us (965us total) trans 21474869069 rc 0/0
00000100:00100000:1.0:1651531955.315409:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249656
00002000:00100000:1.0:1651531955.315412:0:192755:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x100010000:0x34545:0x0] (61440->999423)  req@00000000eef74747 x1731754467319744/t21474869069(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:416/0 lens 1048/584 e 0 to 0 dl 1651531961 ref 1 fl Complete:/0/0 rc 0/0 job:'fio.0'
00002000:00100000:1.0:1651531955.315417:0:192755:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000eef74747 with x1731754467319744 ext(61440->999423)
00002000:00010000:1.0:1651531955.315421:0:192755:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000eef74747
00000100:00100000:0.0:1651531955.316417:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531955.316438:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467320448
00000100:00100000:1.0:1651531955.316454:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249657
00000100:00100000:1.0:1651531955.316456:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004105a3e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+60:438148:x1731754467320448:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531955.316466:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca2cf8 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531955.316471:0:192755:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003cf86247/0x3234de053ca2c2d lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [102400->114687] (req 102400->106495) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445052 expref: 60 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531955.316474:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531955.316475:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531955.316476:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca2cf8 lrc: 4/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [106496->110591] (req 106496->110591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531955.316483:0:192755:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003cf86247/0x3234de053ca2c2d lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [102400->114687] (req 102400->106495) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445052 expref: 60 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531955.316487:0:192755:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003cf86247/0x3234de053ca2c2d lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [102400->114687] (req 102400->106495) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445052 expref: 60 pid: 166112 timeout: 22763 lvb_type: 0
00000100:00100000:1.0:1651531955.316495:0:192755:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005e4b6deb pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0001_UUID:192755:1731745997350016:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531955.316508:0:192755:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ec524534 going to sleep for 6 seconds
00000100:00100000:0.0:1651531955.317031:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531955.317034:0:192755:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005e4b6deb pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0001_UUID:192755:1731745997350016:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651531955.317039:0:192755:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca2cf8 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [106496->110591] (req 106496->110591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531955.317039:0:166104:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467320704
00010000:00010000:0.0:1651531955.317046:0:166104:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003cf86247/0x3234de053ca2c2d lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [102400->114687] (req 102400->106495) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445052 expref: 61 pid: 166112 timeout: 22763 lvb_type: 0
00000100:00100000:0.0:1651531955.317054:0:166104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 128
00000100:00100000:0.0:1651531955.317056:0:166104:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c6cd3250 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+61:438147:x1731754467320704:12345-10.240.43.64@tcp:103:ldlm_bl_03.0
00010000:00010000:0.0:1651531955.317059:0:166104:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531955.317063:0:166104:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003cf86247/0x3234de053ca2c2d lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 56 type: EXT [102400->114687] (req 102400->106495) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445052 expref: 61 pid: 166112 timeout: 22763 lvb_type: 0
00010000:00010000:0.0:1651531955.317067:0:166104:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003cf86247/0x3234de053ca2c2d lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 56 type: EXT [102400->114687] (req 102400->106495) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445052 expref: 61 pid: 166112 timeout: 22763 lvb_type: 0
00010000:00010000:0.0:1651531955.317073:0:166104:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003cf86247/0x3234de053ca2c2d lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 56 type: EXT [102400->114687] (req 102400->106495) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445052 expref: 61 pid: 166112 timeout: 22763 lvb_type: 0
00010000:00010000:0.0:1651531955.317077:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531955.317079:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531955.317080:0:166104:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca2cf8 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [106496->110591] (req 106496->110591) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.317083:0:166104:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca2cf8 lrc: 4/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [106496->110591] (req 106496->110591) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.317096:0:166104:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651531955.317105:0:166104:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c6cd3250 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+60:438147:x1731754467320704:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 48us (74us total) trans 0 rc 0/0
00010000:00010000:1.0:1651531955.317108:0:192755:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca2cf8 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 54 type: EXT [106496->110591] (req 106496->110591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531955.317108:0:166104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 128
00010000:00010000:1.0:1651531955.317112:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca2cf8 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 54 type: EXT [106496->110591] (req 106496->110591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531955.317125:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca2cf8 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 54 type: EXT [106496->110591] (req 106496->110591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531955.317129:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca2cf8 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 54 type: EXT [106496->110591] (req 106496->110591) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.317143:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca2cf8 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 54 type: EXT [106496->110591] (req 106496->110591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.317147:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006da7a892 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531955.317148:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca2cf8 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 54 type: EXT [106496->110591] (req 106496->110591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.317151:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca2cf8 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 54 type: EXT [106496->110591] (req 106496->110591) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531955.317156:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004105a3e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+59:438148:x1731754467320448:12345-10.240.43.64@tcp:3:fio.0 Request processed in 700us (739us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531955.317160:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249657
00010000:00010000:0.0:1651531955.317163:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca2cf8 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 54 type: EXT [106496->110591] (req 106496->110591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.317166:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca2cf8 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 54 type: EXT [106496->110591] (req 106496->110591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531955.318711:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531955.318744:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467321472
00002000:00100000:1.0:1651531955.318753:0:192755:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x100010000:0x34545:0x0] (151552->167935)  req@00000000fd0719da x1731754467321472/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:416/0 lens 488/0 e 0 to 0 dl 1651531961 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:1.0:1651531955.318758:0:192755:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000fd0719da with x1731754467321472 ext(151552->167935)
00002000:00010000:1.0:1651531955.318761:0:192755:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000fd0719da
00000100:00100000:1.0:1651531955.318771:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249658
00000100:00100000:1.0:1651531955.318773:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fd0719da pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+59:438146:x1731754467321472:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651531955.318808:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fd0719da pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+59:438146:x1731754467321472:12345-10.240.43.64@tcp:3:fio.0 Request processed in 34us (97us total) trans 0 rc 16384/16384
00000100:00100000:1.0:1651531955.318811:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249658
00002000:00100000:1.0:1651531955.318813:0:192755:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x100010000:0x34545:0x0] (151552->167935)  req@00000000fd0719da x1731754467321472/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:416/0 lens 488/16824 e 0 to 0 dl 1651531961 ref 1 fl Complete:/0/0 rc 16384/16384 job:'fio.0'
00002000:00100000:1.0:1651531955.318817:0:192755:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000fd0719da with x1731754467321472 ext(151552->167935)
00002000:00010000:1.0:1651531955.318818:0:192755:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000fd0719da
00000100:00100000:0.0:1651531955.321333:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531955.321357:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467321984
00002000:00100000:1.0:1651531955.321363:0:192755:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x100010000:0x34545:0x0] (970752->978943)  req@000000008586382c x1731754467321984/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:416/0 lens 488/0 e 0 to 0 dl 1651531961 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:1.0:1651531955.321367:0:192755:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000008586382c with x1731754467321984 ext(970752->978943)
00002000:00010000:1.0:1651531955.321368:0:192755:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000008586382c
00000100:00100000:1.0:1651531955.321377:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249659
00000100:00100000:1.0:1651531955.321379:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008586382c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+59:438146:x1731754467321984:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651531955.321406:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008586382c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+59:438146:x1731754467321984:12345-10.240.43.64@tcp:3:fio.0 Request processed in 26us (73us total) trans 0 rc 8192/8192
00000100:00100000:1.0:1651531955.321409:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249659
00002000:00100000:1.0:1651531955.321411:0:192755:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x100010000:0x34545:0x0] (970752->978943)  req@000000008586382c x1731754467321984/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:416/0 lens 488/8632 e 0 to 0 dl 1651531961 ref 1 fl Complete:/0/0 rc 8192/8192 job:'fio.0'
00002000:00100000:1.0:1651531955.321415:0:192755:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000008586382c with x1731754467321984 ext(970752->978943)
00002000:00010000:1.0:1651531955.321416:0:192755:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000008586382c
00000100:00100000:0.0:1651531955.322548:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531955.322557:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467322560
00000100:00100000:0.0:1651531955.322565:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44384
00000100:00100000:0.0:1651531955.322567:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003ab8c993 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+59:680970:x1731754467322560:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531955.322571:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531955.322575:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007d2b2323/0x3234de053ca2cff lrc: 2/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 54 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44523c expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.322581:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531955.322582:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531955.322584:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007d2b2323/0x3234de053ca2cff lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 54 type: EXT [102400->114687] (req 102400->106495) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44523c expref: 60 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.322589:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007d2b2323/0x3234de053ca2cff lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 54 type: EXT [102400->114687] (req 102400->106495) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44523c expref: 60 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.322593:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007d2b2323, rc 0)
00000100:00100000:0.0:1651531955.322602:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003ab8c993 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+60:680970:x1731754467322560:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (55us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531955.322605:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44384
00000100:00100000:0.0:1651531955.324406:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531955.324413:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467322880
00000100:00100000:0.0:1651531955.324420:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44385
00000100:00100000:0.0:1651531955.324422:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008dcbc4a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+60:680970:x1731754467322880:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531955.324425:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531955.324438:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000049e48890/0x3234de053ca2d06 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445251 expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.324445:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531955.324447:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531955.324449:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049e48890/0x3234de053ca2d06 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [999424->18446744073709551615] (req 999424->1003519) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445251 expref: 61 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.324453:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000049e48890/0x3234de053ca2d06 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [999424->18446744073709551615] (req 999424->1003519) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445251 expref: 61 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.324457:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000049e48890, rc 0)
00000100:00100000:0.0:1651531955.324467:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008dcbc4a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+61:680970:x1731754467322880:12345-10.240.43.64@tcp:101:fio.0 Request processed in 45us (62us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531955.324470:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44385
00000100:00100000:0.0:1651531955.867159:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531955.867184:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467323072
00002000:00100000:1.0:1651531955.867194:0:192755:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x100010000:0x34545:0x0] (24576->843775)  req@000000004f13e53f x1731754467323072/t0(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:416/0 lens 600/0 e 0 to 0 dl 1651531961 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:1.0:1651531955.867199:0:192755:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000004f13e53f with x1731754467323072 ext(24576->843775)
00002000:00010000:1.0:1651531955.867218:0:192755:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000004f13e53f
00000100:00100000:1.0:1651531955.867251:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249660
00000100:00100000:1.0:1651531955.867253:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004f13e53f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+61:438148:x1731754467323072:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651531955.867281:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531955.867314:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467323200
00000100:00100000:0.0:1651531955.867328:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249661
00000100:00100000:0.0:1651531955.867330:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004650255e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+63:438147:x1731754467323200:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531955.867338:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd6ff34d/0x3234de053ca2d0d lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 56 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.867343:0:216321:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca2acf lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 56 type: EXT [0->45055] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444cf5 expref: 63 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.867347:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531955.867347:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531955.867348:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd6ff34d/0x3234de053ca2d0d lrc: 4/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 56 type: EXT [28672->32767] (req 28672->32767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.867370:0:216321:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca2acf lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 56 type: EXT [0->45055] (req 0->4095) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444cf5 expref: 63 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.867379:0:216321:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca2acf lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 56 type: EXT [0->45055] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444cf5 expref: 63 pid: 166113 timeout: 22764 lvb_type: 0
00000100:00100000:0.0:1651531955.867383:0:216321:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000053de45f6 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997350080:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531955.867396:0:216321:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f54ad06c going to sleep for 6 seconds
00000100:00100000:1.0:1651531955.867729:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004f13e53f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+64:438148:x1731754467323072:12345-10.240.43.64@tcp:4:fio.0 Request processed in 474us (570us total) trans 21474869070 rc 0/0
00000100:00100000:1.0:1651531955.867733:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249660
00002000:00100000:1.0:1651531955.867736:0:192755:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x100010000:0x34545:0x0] (24576->843775)  req@000000004f13e53f x1731754467323072/t21474869070(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:416/0 lens 600/472 e 0 to 0 dl 1651531961 ref 1 fl Complete:/0/0 rc 0/0 job:'fio.0'
00002000:00100000:1.0:1651531955.867740:0:192755:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000004f13e53f with x1731754467323072 ext(24576->843775)
00010000:00010000:1.0:1651531955.867745:0:192755:0:(ldlm_lockd.c:599:ldlm_refresh_waiting_lock()) ### refreshed to 81s ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca2acf lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 57 type: EXT [0->45055] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444cf5 expref: 64 pid: 166113 timeout: 22764 lvb_type: 0
00002000:00010000:1.0:1651531955.867750:0:192755:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req 000000004f13e53f
00000100:00100000:0.0:1651531955.867849:0:216321:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000053de45f6 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997350080:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651531955.867854:0:216321:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fd6ff34d/0x3234de053ca2d0d lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 56 type: EXT [28672->32767] (req 28672->32767) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531955.868000:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531955.868023:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467323520
00002000:00100000:1.0:1651531955.868030:0:192755:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x100010000:0x34545:0x0] (999424->1003519)  req@0000000053de45f6 x1731754467323520/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:416/0 lens 488/0 e 0 to 0 dl 1651531961 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:1.0:1651531955.868034:0:192755:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000053de45f6 with x1731754467323520 ext(999424->1003519)
00002000:00010000:1.0:1651531955.868036:0:192755:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000053de45f6
00000100:00100000:1.0:1651531955.868041:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249662
00000100:00100000:1.0:1651531955.868043:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000053de45f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+64:438146:x1731754467323520:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651531955.868073:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000053de45f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+64:438146:x1731754467323520:12345-10.240.43.64@tcp:3:fio.0 Request processed in 29us (73us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531955.868076:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249662
00002000:00100000:1.0:1651531955.868078:0:192755:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x100010000:0x34545:0x0] (999424->1003519)  req@0000000053de45f6 x1731754467323520/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:416/0 lens 488/4536 e 0 to 0 dl 1651531961 ref 1 fl Complete:/0/0 rc 4096/4096 job:'fio.0'
00002000:00100000:1.0:1651531955.868082:0:192755:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000053de45f6 with x1731754467323520 ext(999424->1003519)
00002000:00010000:1.0:1651531955.868083:0:192755:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000053de45f6
00000100:00100000:0.0:1651531955.868128:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531955.868157:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531955.868160:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467323776
00000100:00100000:0.0:1651531955.868166:0:169267:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467323712
00000100:00100000:1.0:1651531955.868170:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249663
00000100:00100000:1.0:1651531955.868172:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000805c4fb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+65:438147:x1731754467323776:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531955.868172:0:169267:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca2acf lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 56 type: EXT [0->45055] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444cf5 expref: 65 pid: 166113 timeout: 22764 lvb_type: 0
00010000:00010000:1.0:1651531955.868179:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca2d14 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 57 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531955.868180:0:169267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 129
00000100:00100000:0.0:1651531955.868182:0:169267:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f8a13c4e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+65:438148:x1731754467323712:12345-10.240.43.64@tcp:103:ldlm_bl_03.0
00010000:00010000:1.0:1651531955.868184:0:216323:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008d0d3608/0x3234de053ca2aeb lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 57 type: EXT [524288->561151] (req 524288->528383) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444d26 expref: 65 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.868185:0:169267:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1651531955.868188:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531955.868189:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531955.868189:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca2d14 lrc: 4/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 58 type: EXT [540672->544767] (req 540672->544767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.868220:0:169267:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca2acf lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 58 type: EXT [0->45055] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444cf5 expref: 65 pid: 166113 timeout: 22764 lvb_type: 0
00010000:00010000:1.0:1651531955.868233:0:216323:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008d0d3608/0x3234de053ca2aeb lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 59 type: EXT [524288->561151] (req 524288->528383) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444d26 expref: 65 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531955.868238:0:216323:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008d0d3608/0x3234de053ca2aeb lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 58 type: EXT [524288->561151] (req 524288->528383) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444d26 expref: 65 pid: 166113 timeout: 22764 lvb_type: 0
00000100:00100000:1.0:1651531955.868247:0:216323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005e4b6deb pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_010:lustre-OST0001_UUID:216323:1731745997350144:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651531955.868247:0:169267:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca2acf lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 58 type: EXT [0->45055] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444cf5 expref: 65 pid: 166113 timeout: 22764 lvb_type: 0
00010000:00010000:0.0:1651531955.868258:0:169267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000077fc7eeb/0x3234de053ca2acf lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 58 type: EXT [0->45055] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444cf5 expref: 65 pid: 166113 timeout: 22764 lvb_type: 0
00000100:00100000:1.0:1651531955.868262:0:216323:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ec524534 going to sleep for 6 seconds
00010000:00010000:0.0:1651531955.868267:0:169267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531955.868268:0:169267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531955.868269:0:169267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fd6ff34d/0x3234de053ca2d0d lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 57 type: EXT [28672->32767] (req 28672->32767) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.868272:0:169267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd6ff34d/0x3234de053ca2d0d lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 57 type: EXT [28672->32767] (req 28672->32767) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.868279:0:169267:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651531955.868288:0:169267:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f8a13c4e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+64:438148:x1731754467323712:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 106us (131us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531955.868291:0:169267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 129
00010000:00010000:0.0:1651531955.868299:0:216321:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fd6ff34d/0x3234de053ca2d0d lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 56 type: EXT [28672->32767] (req 28672->32767) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.868302:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fd6ff34d/0x3234de053ca2d0d lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 56 type: EXT [28672->32767] (req 28672->32767) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531955.868645:0:216323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005e4b6deb pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_010:lustre-OST0001_UUID:216323:1731745997350144:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651531955.868650:0:216323:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca2d14 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 56 type: EXT [540672->544767] (req 540672->544767) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531955.868754:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531955.868762:0:169267:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467323904
00010000:00010000:0.0:1651531955.868768:0:169267:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008d0d3608/0x3234de053ca2aeb lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 56 type: EXT [524288->561151] (req 524288->528383) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444d26 expref: 66 pid: 166113 timeout: 22764 lvb_type: 0
00000100:00100000:0.0:1651531955.868780:0:169267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 130
00000100:00100000:0.0:1651531955.868781:0:169267:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ed7e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+66:438147:x1731754467323904:12345-10.240.43.64@tcp:103:ldlm_bl_04.0
00010000:00010000:0.0:1651531955.868786:0:169267:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531955.868789:0:169267:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008d0d3608/0x3234de053ca2aeb lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 57 type: EXT [524288->561151] (req 524288->528383) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444d26 expref: 66 pid: 166113 timeout: 22764 lvb_type: 0
00010000:00010000:0.0:1651531955.868793:0:169267:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008d0d3608/0x3234de053ca2aeb lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 57 type: EXT [524288->561151] (req 524288->528383) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444d26 expref: 66 pid: 166113 timeout: 22764 lvb_type: 0
00010000:00010000:0.0:1651531955.868799:0:169267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008d0d3608/0x3234de053ca2aeb lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 57 type: EXT [524288->561151] (req 524288->528383) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444d26 expref: 66 pid: 166113 timeout: 22764 lvb_type: 0
00010000:00010000:0.0:1651531955.868803:0:169267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531955.868804:0:169267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531955.868805:0:169267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca2d14 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 56 type: EXT [540672->544767] (req 540672->544767) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.868808:0:169267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca2d14 lrc: 4/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 56 type: EXT [540672->544767] (req 540672->544767) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.868817:0:169267:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1651531955.868822:0:216323:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca2d14 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [540672->544767] (req 540672->544767) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531955.868826:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca2d14 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [540672->544767] (req 540672->544767) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531955.868827:0:169267:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ed7e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+65:438147:x1731754467323904:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 45us (74us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531955.868830:0:169267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 130
00010000:00010000:1.0:1651531955.868838:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca2d14 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [540672->544767] (req 540672->544767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531955.868841:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca2d14 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [540672->544767] (req 540672->544767) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.868860:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca2d14 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [540672->544767] (req 540672->544767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.868864:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c2b76533 already unused, calling callback (0000000049fddea7)
00000100:00100000:1.0:1651531955.868869:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000805c4fb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+64:438147:x1731754467323776:12345-10.240.43.64@tcp:3:fio.0 Request processed in 696us (741us total) trans 0 rc 4096/4096
00010000:00010000:0.0:1651531955.868870:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca2d14 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [540672->544767] (req 540672->544767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531955.868872:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249663
00010000:00010000:0.0:1651531955.868878:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca2d14 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [540672->544767] (req 540672->544767) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.868883:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca2d14 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [540672->544767] (req 540672->544767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.868885:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca2d14 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [540672->544767] (req 540672->544767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531955.869722:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531955.869742:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467324032
00000100:00100000:1.0:1651531955.869752:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249664
00000100:00100000:1.0:1651531955.869754:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000063553cfb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+64:438148:x1731754467324032:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531955.869761:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca2d1b lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531955.869767:0:216323:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca2b93 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [217088->225279] (req 217088->221183) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444f09 expref: 64 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531955.869771:0:216323:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000049c67f6a/0x3234de053ca2c96 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [212992->225279] (req 212992->217087) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44515c expref: 64 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531955.869774:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:1.0:1651531955.869774:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:1.0:1651531955.869775:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca2d1b lrc: 5/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531955.869782:0:216323:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000049c67f6a/0x3234de053ca2c96 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [212992->225279] (req 212992->217087) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44515c expref: 64 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531955.869786:0:216323:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000049c67f6a/0x3234de053ca2c96 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [212992->225279] (req 212992->217087) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44515c expref: 64 pid: 166113 timeout: 22764 lvb_type: 0
00000100:00100000:1.0:1651531955.869790:0:216323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005e4b6deb pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_010:lustre-OST0001_UUID:216323:1731745997350208:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651531955.869809:0:216323:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca2b93 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [217088->225279] (req 217088->221183) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444f09 expref: 64 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531955.869813:0:216323:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca2b93 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [217088->225279] (req 217088->221183) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444f09 expref: 64 pid: 206699 timeout: 22764 lvb_type: 0
00000100:00100000:1.0:1651531955.869817:0:216323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000941ac345 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_010:lustre-OST0001_UUID:216323:1731745997350272:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531955.869822:0:216323:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ec524534 going to sleep for 6 seconds
00000100:00100000:1.0:1651531955.870070:0:216323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005e4b6deb pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_010:lustre-OST0001_UUID:216323:1731745997350208:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531955.870074:0:216323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000941ac345 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_010:lustre-OST0001_UUID:216323:1731745997350272:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651531955.870078:0:216323:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca2d1b lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531955.870179:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531955.870187:0:169267:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467324544
00010000:00010000:0.0:1651531955.870193:0:169267:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000049c67f6a/0x3234de053ca2c96 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [212992->225279] (req 212992->217087) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44515c expref: 65 pid: 166113 timeout: 22764 lvb_type: 0
00000100:00100000:1.0:1651531955.870216:0:166104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 131
00000100:00100000:1.0:1651531955.870218:0:166104:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004bb4b5db pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+65:438147:x1731754467324544:12345-10.240.43.64@tcp:103:ldlm_bl_05.0
00010000:00010000:1.0:1651531955.870232:0:166104:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1651531955.870237:0:166104:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000049c67f6a/0x3234de053ca2c96 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 56 type: EXT [212992->225279] (req 212992->217087) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44515c expref: 65 pid: 166113 timeout: 22764 lvb_type: 0
00010000:00010000:1.0:1651531955.870241:0:166104:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000049c67f6a/0x3234de053ca2c96 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 56 type: EXT [212992->225279] (req 212992->217087) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44515c expref: 65 pid: 166113 timeout: 22764 lvb_type: 0
00000100:00100000:0.0:1651531955.870247:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651531955.870248:0:166104:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000049c67f6a/0x3234de053ca2c96 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 56 type: EXT [212992->225279] (req 212992->217087) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44515c expref: 65 pid: 166113 timeout: 22764 lvb_type: 0
00010000:00010000:1.0:1651531955.870252:0:166104:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651531955.870253:0:169267:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467324608
00010000:00010000:0.0:1651531955.870258:0:169267:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca2b93 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 54 type: EXT [217088->225279] (req 217088->221183) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444f09 expref: 65 pid: 206699 timeout: 22764 lvb_type: 0
00000100:00100000:1.0:1651531955.870265:0:166104:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004bb4b5db pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+65:438147:x1731754467324544:12345-10.240.43.64@tcp:103:ldlm_bl_05.0 Request processed in 46us (86us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531955.870269:0:166104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 131
00000100:00100000:0.0:1651531955.870271:0:169267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 132
00000100:00100000:0.0:1651531955.870273:0:169267:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003ec7b6d9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+64:438149:x1731754467324608:12345-10.240.43.64@tcp:103:ldlm_bl_03.0
00010000:00010000:0.0:1651531955.870277:0:169267:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531955.870280:0:169267:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca2b93 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [217088->225279] (req 217088->221183) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444f09 expref: 64 pid: 206699 timeout: 22764 lvb_type: 0
00010000:00010000:0.0:1651531955.870284:0:169267:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca2b93 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [217088->225279] (req 217088->221183) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444f09 expref: 64 pid: 206699 timeout: 22764 lvb_type: 0
00010000:00010000:0.0:1651531955.870292:0:169267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca2b93 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [217088->225279] (req 217088->221183) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444f09 expref: 64 pid: 206699 timeout: 22764 lvb_type: 0
00010000:00010000:0.0:1651531955.870297:0:169267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531955.870298:0:169267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531955.870299:0:169267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca2d1b lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 54 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.870302:0:169267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca2d1b lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 54 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.870312:0:169267:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1651531955.870315:0:216323:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca2d1b lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 53 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531955.870319:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca2d1b lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 53 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531955.870320:0:169267:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003ec7b6d9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+63:438149:x1731754467324608:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 46us (74us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531955.870323:0:169267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 132
00000100:00100000:0.0:1651531955.870734:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531955.870754:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467324864
00000100:00100000:1.0:1651531955.870765:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249665
00000100:00100000:1.0:1651531955.870766:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cb694635 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+65:438146:x1731754467324864:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531955.870773:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2d22 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 54 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531955.870778:0:192755:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000eba74384/0x3234de053ca2ab3 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 54 type: EXT [180224->212991] (req 180224->184319) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c9a expref: 65 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531955.870782:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531955.870782:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531955.870783:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2d22 lrc: 4/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 54 type: EXT [184320->188415] (req 184320->188415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531955.870790:0:192755:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000eba74384/0x3234de053ca2ab3 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 54 type: EXT [180224->212991] (req 180224->184319) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c9a expref: 65 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531955.870794:0:192755:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000eba74384/0x3234de053ca2ab3 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 54 type: EXT [180224->212991] (req 180224->184319) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c9a expref: 65 pid: 206699 timeout: 22764 lvb_type: 0
00000100:00100000:1.0:1651531955.870798:0:192755:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000941ac345 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0001_UUID:192755:1731745997350336:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531955.870816:0:192755:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fd6047a1 going to sleep for 6 seconds
00000100:00100000:0.0:1651531955.871630:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531955.871636:0:192755:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000941ac345 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0001_UUID:192755:1731745997350336:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531955.871638:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651531955.871641:0:192755:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2d22 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 54 type: EXT [184320->188415] (req 184320->188415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531955.871648:0:166102:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467325248
00010000:00010000:0.0:1651531955.871653:0:166102:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000eba74384/0x3234de053ca2ab3 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [180224->212991] (req 180224->184319) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c9a expref: 66 pid: 206699 timeout: 22764 lvb_type: 0
00000100:00100000:1.0:1651531955.871658:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467325312
00000100:00100000:0.0:1651531955.871661:0:166102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 133
00000100:00100000:0.0:1651531955.871663:0:166102:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000096080ff0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+67:438147:x1731754467325248:12345-10.240.43.64@tcp:103:ldlm_bl_01.0
00010000:00010000:0.0:1651531955.871666:0:166102:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00000100:00100000:1.0:1651531955.871668:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249666
00002000:00010000:0.0:1651531955.871668:0:166102:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x34545:0x0] updating lvb atime from disk: 1651531954 -> 1651531955
00000100:00100000:1.0:1651531955.871669:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000000daaec4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+67:438149:x1731754467325312:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531955.871670:0:166102:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000eba74384/0x3234de053ca2ab3 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [180224->212991] (req 180224->184319) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c9a expref: 67 pid: 206699 timeout: 22764 lvb_type: 0
00010000:00010000:0.0:1651531955.871676:0:166102:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000eba74384/0x3234de053ca2ab3 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [180224->212991] (req 180224->184319) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c9a expref: 67 pid: 206699 timeout: 22764 lvb_type: 0
00010000:00010000:1.0:1651531955.871678:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca2d29 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 57 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.871682:0:166102:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eba74384/0x3234de053ca2ab3 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 56 type: EXT [180224->212991] (req 180224->184319) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c9a expref: 67 pid: 206699 timeout: 22764 lvb_type: 0
00010000:00010000:1.0:1651531955.871683:0:166118:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003e4793c3/0x3234de053ca2cd5 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 57 type: EXT [147456->172031] (req 147456->151551) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4451cc expref: 67 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531955.871686:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531955.871687:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531955.871688:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca2d29 lrc: 4/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [163840->167935] (req 163840->167935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.871691:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531955.871692:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531955.871693:0:166102:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2d22 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [184320->188415] (req 184320->188415) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.871697:0:166102:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2d22 lrc: 4/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [184320->188415] (req 184320->188415) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531955.871703:0:166118:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003e4793c3/0x3234de053ca2cd5 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [147456->172031] (req 147456->151551) gid 0 flags: 0x50000000020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4451cc expref: 66 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.871706:0:166102:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1651531955.871713:0:166118:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003e4793c3/0x3234de053ca2cd5 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 54 type: EXT [147456->172031] (req 147456->151551) gid 0 flags: 0x70000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4451cc expref: 66 pid: 166112 timeout: 22764 lvb_type: 0
00000100:00100000:0.0:1651531955.871715:0:166102:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000096080ff0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+66:438147:x1731754467325248:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 52us (86us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531955.871717:0:166118:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000941ac345 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:166118:1731745997350400:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531955.871718:0:166102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 133
00000100:00100000:1.0:1651531955.871726:0:166118:0:(client.c:2492:ptlrpc_set_wait()) set 00000000996f1fed going to sleep for 6 seconds
00010000:00010000:1.0:1651531955.871732:0:192755:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2d22 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 54 type: EXT [184320->188415] (req 184320->188415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531955.871735:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2d22 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 54 type: EXT [184320->188415] (req 184320->188415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531955.871757:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2d22 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 54 type: EXT [184320->188415] (req 184320->188415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531955.871760:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2d22 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 54 type: EXT [184320->188415] (req 184320->188415) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531955.871782:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cb694635 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+65:438146:x1731754467324864:12345-10.240.43.64@tcp:3:fio.0 Request processed in 1014us (1048us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531955.871785:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249665
00010000:00010000:0.0:1651531955.871787:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2d22 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 54 type: EXT [184320->188415] (req 184320->188415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.871791:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a8889a80 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531955.871792:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2d22 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 54 type: EXT [184320->188415] (req 184320->188415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.871796:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2d22 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 54 type: EXT [184320->188415] (req 184320->188415) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.871807:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2d22 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 54 type: EXT [184320->188415] (req 184320->188415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.871810:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2d22 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 54 type: EXT [184320->188415] (req 184320->188415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531955.872154:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531955.872164:0:166118:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000941ac345 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:166118:1731745997350400:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651531955.872168:0:166118:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca2d29 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 53 type: EXT [163840->167935] (req 163840->167935) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531955.872175:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467325632
00000100:00100000:1.0:1651531955.872184:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249667
00000100:00100000:1.0:1651531955.872186:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ca5b5d4b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+65:438146:x1731754467325632:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531955.872192:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca2d30 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 54 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531955.872196:0:192755:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e9908e14/0x3234de053ca2ad6 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 54 type: EXT [704512->729087] (req 704512->708607) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444cfc expref: 65 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531955.872199:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531955.872210:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531955.872211:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca2d30 lrc: 4/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 54 type: EXT [708608->712703] (req 708608->712703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531955.872232:0:192755:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e9908e14/0x3234de053ca2ad6 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 54 type: EXT [704512->729087] (req 704512->708607) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444cfc expref: 65 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531955.872236:0:192755:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e9908e14/0x3234de053ca2ad6 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 54 type: EXT [704512->729087] (req 704512->708607) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444cfc expref: 65 pid: 166113 timeout: 22764 lvb_type: 0
00000100:00100000:1.0:1651531955.872240:0:192755:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000941ac345 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0001_UUID:192755:1731745997350464:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531955.872254:0:192755:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ec524534 going to sleep for 6 seconds
00000100:00100000:0.0:1651531955.872279:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531955.872302:0:169267:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467325824
00010000:00010000:0.0:1651531955.872308:0:169267:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003e4793c3/0x3234de053ca2cd5 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 54 type: EXT [147456->172031] (req 147456->151551) gid 0 flags: 0x60000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4451cc expref: 66 pid: 166112 timeout: 22764 lvb_type: 0
00000100:00100000:0.0:1651531955.872316:0:169267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 134
00000100:00100000:0.0:1651531955.872318:0:169267:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b3339927 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+66:438147:x1731754467325824:12345-10.240.43.64@tcp:103:ldlm_bl_05.0
00010000:00010000:0.0:1651531955.872321:0:169267:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531955.872324:0:169267:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003e4793c3/0x3234de053ca2cd5 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [147456->172031] (req 147456->151551) gid 0 flags: 0x60000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4451cc expref: 66 pid: 166112 timeout: 22764 lvb_type: 0
00010000:00010000:0.0:1651531955.872328:0:169267:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003e4793c3/0x3234de053ca2cd5 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [147456->172031] (req 147456->151551) gid 0 flags: 0x50000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4451cc expref: 66 pid: 166112 timeout: 22764 lvb_type: 0
00010000:00010000:0.0:1651531955.872334:0:169267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003e4793c3/0x3234de053ca2cd5 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [147456->172031] (req 147456->151551) gid 0 flags: 0x44801400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4451cc expref: 66 pid: 166112 timeout: 22764 lvb_type: 0
00010000:00010000:0.0:1651531955.872338:0:169267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531955.872338:0:169267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531955.872341:0:169267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca2d29 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 54 type: EXT [163840->167935] (req 163840->167935) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.872344:0:169267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca2d29 lrc: 4/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 54 type: EXT [163840->167935] (req 163840->167935) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.872356:0:169267:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1651531955.872363:0:166118:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca2d29 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 53 type: EXT [163840->167935] (req 163840->167935) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531955.872366:0:169267:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b3339927 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+65:438147:x1731754467325824:12345-10.240.43.64@tcp:103:ldlm_bl_05.0 Request processed in 47us (87us total) trans 0 rc 0/0
00010000:00010000:1.0:1651531955.872367:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca2d29 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 53 type: EXT [163840->167935] (req 163840->167935) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531955.872369:0:169267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 134
00010000:00010000:1.0:1651531955.872379:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca2d29 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 53 type: EXT [163840->167935] (req 163840->167935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531955.872382:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca2d29 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 53 type: EXT [163840->167935] (req 163840->167935) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531955.872395:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000000daaec4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+64:438149:x1731754467325312:12345-10.240.43.64@tcp:3:fio.0 Request processed in 725us (756us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531955.872398:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249666
00010000:00010000:1.0:1651531955.872405:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca2d29 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 53 type: EXT [163840->167935] (req 163840->167935) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531955.872415:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000968553c1 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531955.872418:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca2d29 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 53 type: EXT [163840->167935] (req 163840->167935) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531955.872421:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca2d29 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 53 type: EXT [163840->167935] (req 163840->167935) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531955.872431:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca2d29 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 53 type: EXT [163840->167935] (req 163840->167935) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531955.872434:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca2d29 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 53 type: EXT [163840->167935] (req 163840->167935) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531955.872455:0:192755:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000941ac345 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0001_UUID:192755:1731745997350464:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651531955.872459:0:192755:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca2d30 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 52 type: EXT [708608->712703] (req 708608->712703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531955.872593:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531955.872601:0:166102:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467325952
00010000:00010000:0.0:1651531955.872607:0:166102:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e9908e14/0x3234de053ca2ad6 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 52 type: EXT [704512->729087] (req 704512->708607) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444cfc expref: 64 pid: 166113 timeout: 22764 lvb_type: 0
00000100:00100000:0.0:1651531955.872614:0:166102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 135
00000100:00100000:0.0:1651531955.872616:0:166102:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000096080ff0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+64:438146:x1731754467325952:12345-10.240.43.64@tcp:103:ldlm_bl_02.0
00010000:00010000:0.0:1651531955.872619:0:166102:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531955.872622:0:166102:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e9908e14/0x3234de053ca2ad6 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 53 type: EXT [704512->729087] (req 704512->708607) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444cfc expref: 64 pid: 166113 timeout: 22764 lvb_type: 0
00010000:00010000:0.0:1651531955.872626:0:166102:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e9908e14/0x3234de053ca2ad6 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 53 type: EXT [704512->729087] (req 704512->708607) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444cfc expref: 64 pid: 166113 timeout: 22764 lvb_type: 0
00010000:00010000:0.0:1651531955.872631:0:166102:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9908e14/0x3234de053ca2ad6 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 53 type: EXT [704512->729087] (req 704512->708607) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444cfc expref: 64 pid: 166113 timeout: 22764 lvb_type: 0
00010000:00010000:0.0:1651531955.872635:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531955.872637:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531955.872638:0:166102:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca2d30 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 52 type: EXT [708608->712703] (req 708608->712703) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.872641:0:166102:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca2d30 lrc: 4/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 52 type: EXT [708608->712703] (req 708608->712703) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.872654:0:166102:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1651531955.872661:0:192755:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca2d30 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 51 type: EXT [708608->712703] (req 708608->712703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531955.872664:0:166102:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000096080ff0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+63:438146:x1731754467325952:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 47us (72us total) trans 0 rc 0/0
00010000:00010000:1.0:1651531955.872665:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca2d30 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 51 type: EXT [708608->712703] (req 708608->712703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531955.872666:0:166102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 135
00010000:00010000:1.0:1651531955.872676:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca2d30 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 51 type: EXT [708608->712703] (req 708608->712703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531955.872679:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca2d30 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 51 type: EXT [708608->712703] (req 708608->712703) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.872698:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca2d30 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 51 type: EXT [708608->712703] (req 708608->712703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.872702:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b4c8742a already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531955.872703:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca2d30 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 51 type: EXT [708608->712703] (req 708608->712703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531955.872706:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ca5b5d4b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+62:438146:x1731754467325632:12345-10.240.43.64@tcp:3:fio.0 Request processed in 520us (553us total) trans 0 rc 4096/4096
00010000:00010000:0.0:1651531955.872711:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca2d30 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 51 type: EXT [708608->712703] (req 708608->712703) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531955.872712:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249667
00010000:00010000:0.0:1651531955.872716:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca2d30 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 51 type: EXT [708608->712703] (req 708608->712703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.872719:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca2d30 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 51 type: EXT [708608->712703] (req 708608->712703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531955.873083:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531955.873094:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467326080
00000100:00100000:1.0:1651531955.873103:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249668
00000100:00100000:1.0:1651531955.873105:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c6cd3250 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+62:438149:x1731754467326080:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651531955.873105:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651531955.873117:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca2d37 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 51 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531955.873122:0:192755:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b59a05a3/0x3234de053ca2a12 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 51 type: EXT [667648->692223] (req 667648->671743) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444bc8 expref: 62 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531955.873126:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531955.873126:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531955.873127:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca2d37 lrc: 4/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 51 type: EXT [679936->684031] (req 679936->684031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531955.873133:0:192755:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b59a05a3/0x3234de053ca2a12 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 51 type: EXT [667648->692223] (req 667648->671743) gid 0 flags: 0x50000000020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444bc8 expref: 62 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531955.873137:0:192755:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b59a05a3/0x3234de053ca2a12 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 51 type: EXT [667648->692223] (req 667648->671743) gid 0 flags: 0x70000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444bc8 expref: 62 pid: 166112 timeout: 22764 lvb_type: 0
00000100:00100000:1.0:1651531955.873141:0:192755:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000941ac345 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0001_UUID:192755:1731745997350528:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531955.873158:0:192755:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ec524534 going to sleep for 6 seconds
00000100:00100000:1.0:1651531955.873164:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467326208
00000100:00100000:1.0:1651531955.873175:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249669
00000100:00100000:1.0:1651531955.873176:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f8a13c4e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+63:438147:x1731754467326208:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531955.873184:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca2d3e lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 52 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531955.873189:0:192753:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009dff3fc3/0x3234de053ca2a89 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 52 type: EXT [290816->360447] (req 290816->294911) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c5b expref: 63 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531955.873200:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531955.873210:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531955.873211:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca2d3e lrc: 4/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 52 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531955.873218:0:192753:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009dff3fc3/0x3234de053ca2a89 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 52 type: EXT [290816->360447] (req 290816->294911) gid 0 flags: 0x50000000020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c5b expref: 63 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531955.873221:0:192753:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009dff3fc3/0x3234de053ca2a89 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 52 type: EXT [290816->360447] (req 290816->294911) gid 0 flags: 0x70000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c5b expref: 63 pid: 206699 timeout: 22764 lvb_type: 0
00000100:00100000:1.0:1651531955.873235:0:192753:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005e4b6deb pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:192753:1731745997350592:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531955.873252:0:192753:0:(client.c:2492:ptlrpc_set_wait()) set 000000002ddea5d6 going to sleep for 6 seconds
00000100:00100000:0.0:1651531955.873464:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531955.873470:0:192755:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000941ac345 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0001_UUID:192755:1731745997350528:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531955.873473:0:169267:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467326336
00010000:00010000:1.0:1651531955.873474:0:192755:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca2d37 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 52 type: EXT [679936->684031] (req 679936->684031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.873479:0:169267:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b59a05a3/0x3234de053ca2a12 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 52 type: EXT [667648->692223] (req 667648->671743) gid 0 flags: 0x60000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444bc8 expref: 64 pid: 166112 timeout: 22764 lvb_type: 0
00000100:00100000:0.0:1651531955.873487:0:169267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 136
00000100:00100000:0.0:1651531955.873488:0:169267:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ed7e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+64:438146:x1731754467326336:12345-10.240.43.64@tcp:103:ldlm_bl_04.0
00010000:00010000:0.0:1651531955.873491:0:169267:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531955.873494:0:169267:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b59a05a3/0x3234de053ca2a12 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 53 type: EXT [667648->692223] (req 667648->671743) gid 0 flags: 0x60000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444bc8 expref: 64 pid: 166112 timeout: 22764 lvb_type: 0
00010000:00010000:0.0:1651531955.873498:0:169267:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b59a05a3/0x3234de053ca2a12 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 53 type: EXT [667648->692223] (req 667648->671743) gid 0 flags: 0x50000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444bc8 expref: 64 pid: 166112 timeout: 22764 lvb_type: 0
00010000:00010000:0.0:1651531955.873504:0:169267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b59a05a3/0x3234de053ca2a12 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 53 type: EXT [667648->692223] (req 667648->671743) gid 0 flags: 0x44801400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444bc8 expref: 64 pid: 166112 timeout: 22764 lvb_type: 0
00010000:00010000:0.0:1651531955.873508:0:169267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531955.873509:0:169267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531955.873510:0:169267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca2d37 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 52 type: EXT [679936->684031] (req 679936->684031) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.873513:0:169267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca2d37 lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 52 type: EXT [679936->684031] (req 679936->684031) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.873523:0:169267:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1651531955.873525:0:192755:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca2d37 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 51 type: EXT [679936->684031] (req 679936->684031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531955.873528:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca2d37 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 51 type: EXT [679936->684031] (req 679936->684031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531955.873532:0:169267:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ed7e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+63:438146:x1731754467326336:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 43us (68us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531955.873535:0:169267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 136
00000100:00100000:0.0:1651531955.873622:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531955.873623:0:192753:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005e4b6deb pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:192753:1731745997350592:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651531955.873627:0:192753:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca2d3e lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 51 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531955.873629:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467326400
00002000:00100000:0.0:1651531955.873636:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x34545:0x0] (270336->929791)  req@000000004bb4b5db x1731754467326400/t0(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:416/0 lens 536/0 e 0 to 0 dl 1651531961 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:0.0:1651531955.873640:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000004bb4b5db with x1731754467326400 ext(270336->929791)
00010000:00010000:0.0:1651531955.873644:0:166118:0:(ldlm_lockd.c:599:ldlm_refresh_waiting_lock()) ### refreshed to 81s ns: filter-lustre-OST0001_UUID lock: 000000009dff3fc3/0x3234de053ca2a89 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 52 type: EXT [290816->360447] (req 290816->294911) gid 0 flags: 0x60000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c5b expref: 65 pid: 206699 timeout: 22764 lvb_type: 0
00002000:00010000:0.0:1651531955.873649:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req 000000004bb4b5db
00000100:00100000:0.0:1651531955.873655:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 13
00000100:00100000:0.0:1651531955.873657:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004bb4b5db pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+65:438146:x1731754467326400:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651531955.874893:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531955.874902:0:216322:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467326976
00002000:00100000:0.0:1651531955.874908:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34545:0x0] (962560->970751)  req@000000003ec7b6d9 x1731754467326976/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:416/0 lens 488/0 e 0 to 0 dl 1651531961 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:0.0:1651531955.874912:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000003ec7b6d9 with x1731754467326976 ext(962560->970751)
00002000:00010000:0.0:1651531955.874915:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000003ec7b6d9
00000100:00100000:0.0:1651531955.874926:0:216322:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249670
00000100:00100000:0.0:1651531955.874928:0:216322:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003ec7b6d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+66:438149:x1731754467326976:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651531955.874956:0:216322:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003ec7b6d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+66:438149:x1731754467326976:12345-10.240.43.64@tcp:3:fio.0 Request processed in 27us (63us total) trans 0 rc 8192/8192
00000100:00100000:0.0:1651531955.874959:0:216322:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249670
00002000:00100000:0.0:1651531955.874961:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34545:0x0] (962560->970751)  req@000000003ec7b6d9 x1731754467326976/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:416/0 lens 488/8632 e 0 to 0 dl 1651531961 ref 1 fl Complete:/0/0 rc 8192/8192 job:'fio.0'
00002000:00100000:0.0:1651531955.874965:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000003ec7b6d9 with x1731754467326976 ext(962560->970751)
00002000:00010000:0.0:1651531955.874976:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000003ec7b6d9
00000100:00100000:0.0:1651531955.875279:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531955.875288:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467327040
00000100:00100000:0.0:1651531955.875296:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44386
00000100:00100000:0.0:1651531955.875297:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002d3e5ae4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+66:680972:x1731754467327040:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531955.875301:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531955.875305:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d2430cf1/0x3234de053ca2d45 lrc: 2/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 52 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44529e expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.875312:0:166112:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e2f464ac/0x3234de053ca2cab lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 52 type: EXT [966656->978943] (req 966656->970751) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445186 expref: 67 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.875315:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531955.875316:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531955.875317:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d2430cf1/0x3234de053ca2d45 lrc: 4/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 52 type: EXT [974848->978943] (req 974848->978943) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44529e expref: 67 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.875324:0:166112:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e2f464ac/0x3234de053ca2cab lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 52 type: EXT [966656->978943] (req 966656->970751) gid 0 flags: 0x50000000020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445186 expref: 67 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.875328:0:166112:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e2f464ac/0x3234de053ca2cab lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 52 type: EXT [966656->978943] (req 966656->970751) gid 0 flags: 0x70000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445186 expref: 67 pid: 166113 timeout: 22764 lvb_type: 0
00000100:00100000:0.0:1651531955.875332:0:166112:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b67ad021 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:166112:1731745997350656:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531955.875344:0:166112:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a01e87d3 going to sleep for 6 seconds
00000100:00100000:0.0:1651531955.875560:0:166112:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b67ad021 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:166112:1731745997350656:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651531955.875566:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d2430cf1/0x3234de053ca2d45 lrc: 3/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 52 type: EXT [974848->978943] (req 974848->978943) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44529e expref: 67 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.875582:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d2430cf1, rc 0)
00000100:00100000:0.0:1651531955.875593:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002d3e5ae4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+67:680972:x1731754467327040:12345-10.240.43.64@tcp:101:fio.0 Request processed in 294us (314us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531955.875596:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44386
00000100:00100000:0.0:1651531955.875910:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531955.875918:0:166102:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467327232
00010000:00010000:0.0:1651531955.875923:0:166102:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e2f464ac/0x3234de053ca2cab lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 52 type: EXT [966656->978943] (req 966656->970751) gid 0 flags: 0x60000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445186 expref: 67 pid: 166113 timeout: 22764 lvb_type: 0
00000100:00100000:0.0:1651531955.875931:0:166102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 137
00000100:00100000:0.0:1651531955.875933:0:166102:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b67ad021 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+67:438147:x1731754467327232:12345-10.240.43.64@tcp:103:ldlm_bl_05.0
00010000:00010000:0.0:1651531955.875935:0:166102:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531955.875939:0:166102:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e2f464ac/0x3234de053ca2cab lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 53 type: EXT [966656->978943] (req 966656->970751) gid 0 flags: 0x60000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445186 expref: 67 pid: 166113 timeout: 22764 lvb_type: 0
00010000:00010000:0.0:1651531955.875942:0:166102:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e2f464ac/0x3234de053ca2cab lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 53 type: EXT [966656->978943] (req 966656->970751) gid 0 flags: 0x50000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445186 expref: 67 pid: 166113 timeout: 22764 lvb_type: 0
00010000:00010000:0.0:1651531955.875949:0:166102:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2f464ac/0x3234de053ca2cab lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 53 type: EXT [966656->978943] (req 966656->970751) gid 0 flags: 0x44801400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445186 expref: 67 pid: 166113 timeout: 22764 lvb_type: 0
00010000:00010000:0.0:1651531955.875953:0:166102:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651531955.875961:0:166102:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b67ad021 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+66:438147:x1731754467327232:12345-10.240.43.64@tcp:103:ldlm_bl_05.0 Request processed in 28us (51us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531955.875964:0:166102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 137
00000100:00100000:0.0:1651531955.876146:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531955.876154:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467327296
00000100:00100000:0.0:1651531955.876161:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44387
00000100:00100000:0.0:1651531955.876162:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f3a0807 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+66:680970:x1731754467327296:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531955.876166:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531955.876169:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004df6dea8/0x3234de053ca2d4c lrc: 2/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 52 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4452a5 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.876176:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531955.876176:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531955.876178:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004df6dea8/0x3234de053ca2d4c lrc: 3/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 52 type: EXT [356352->360447] (req 356352->360447) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4452a5 expref: 67 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.876181:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004df6dea8/0x3234de053ca2d4c lrc: 3/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 52 type: EXT [356352->360447] (req 356352->360447) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4452a5 expref: 67 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.876185:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004df6dea8, rc 0)
00000100:00100000:0.0:1651531955.876194:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f3a0807 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+67:680970:x1731754467327296:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (49us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531955.876197:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44387
00000100:00100000:0.0:1651531955.876876:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531955.876883:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467327360
00000100:00100000:0.0:1651531955.876890:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44388
00000100:00100000:0.0:1651531955.876892:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a20162bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+67:680969:x1731754467327360:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531955.876895:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531955.876898:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003e4793c3/0x3234de053ca2d53 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 53 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4452ac expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.876907:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531955.876908:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531955.876911:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003e4793c3/0x3234de053ca2d53 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 53 type: EXT [8192->28671] (req 8192->12287) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4452ac expref: 68 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.876915:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003e4793c3/0x3234de053ca2d53 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 53 type: EXT [8192->28671] (req 8192->12287) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4452ac expref: 68 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.876918:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003e4793c3, rc 0)
00000100:00100000:0.0:1651531955.876927:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a20162bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+68:680969:x1731754467327360:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (52us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531955.876930:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44388
00000100:00100000:0.0:1651531955.877246:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531955.877254:0:216322:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467327488
00002000:00100000:0.0:1651531955.877261:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34545:0x0] (8192->28671)  req@000000002ae2aeac x1731754467327488/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:416/0 lens 488/0 e 0 to 0 dl 1651531961 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:0.0:1651531955.877265:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000002ae2aeac with x1731754467327488 ext(8192->28671)
00002000:00010000:0.0:1651531955.877266:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000002ae2aeac
00000100:00100000:0.0:1651531955.877276:0:216322:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249671
00000100:00100000:0.0:1651531955.877278:0:216322:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002ae2aeac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+68:438149:x1731754467327488:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651531955.877470:0:216322:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002ae2aeac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+68:438149:x1731754467327488:12345-10.240.43.64@tcp:3:fio.0 Request processed in 191us (224us total) trans 0 rc 20480/20480
00000100:00100000:0.0:1651531955.877473:0:216322:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249671
00002000:00100000:0.0:1651531955.877476:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34545:0x0] (8192->28671)  req@000000002ae2aeac x1731754467327488/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:416/0 lens 488/440 e 0 to 0 dl 1651531961 ref 1 fl Complete:/0/0 rc 20480/20480 job:'fio.0'
00002000:00100000:0.0:1651531955.877484:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000002ae2aeac with x1731754467327488 ext(8192->28671)
00002000:00010000:0.0:1651531955.877485:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000002ae2aeac
00000100:00100000:0.0:1651531955.883776:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531955.883784:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467328384
00000100:00100000:0.0:1651531955.883791:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44389
00000100:00100000:0.0:1651531955.883793:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005ad0bdd2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+68:680969:x1731754467328384:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531955.883796:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531955.883800:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000940bc691/0x3234de053ca2d5a lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 54 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4452d6 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.883806:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531955.883807:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531955.883809:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000940bc691/0x3234de053ca2d5a lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 54 type: EXT [0->28671] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4452d6 expref: 69 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.883814:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000940bc691/0x3234de053ca2d5a lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 54 type: EXT [0->28671] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4452d6 expref: 69 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.883818:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000940bc691, rc 0)
00000100:00100000:0.0:1651531955.883827:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005ad0bdd2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+69:680969:x1731754467328384:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (51us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531955.883829:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44389
00000100:00100000:0.0:1651531955.884109:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531955.884117:0:216322:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467328512
00002000:00100000:0.0:1651531955.884124:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34545:0x0] (0->8191)  req@00000000b597647e x1731754467328512/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:416/0 lens 488/0 e 0 to 0 dl 1651531961 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:0.0:1651531955.884132:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000b597647e with x1731754467328512 ext(0->8191)
00002000:00010000:0.0:1651531955.884133:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000b597647e
00000100:00100000:0.0:1651531955.884143:0:216322:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249672
00000100:00100000:0.0:1651531955.884145:0:216322:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b597647e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+69:438149:x1731754467328512:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651531955.884171:0:216322:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b597647e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+69:438149:x1731754467328512:12345-10.240.43.64@tcp:3:fio.0 Request processed in 26us (63us total) trans 0 rc 8192/8192
00000100:00100000:0.0:1651531955.884174:0:216322:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249672
00002000:00100000:0.0:1651531955.884176:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34545:0x0] (0->8191)  req@00000000b597647e x1731754467328512/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:416/0 lens 488/8632 e 0 to 0 dl 1651531961 ref 1 fl Complete:/0/0 rc 8192/8192 job:'fio.0'
00002000:00100000:0.0:1651531955.884179:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000b597647e with x1731754467328512 ext(0->8191)
00002000:00010000:0.0:1651531955.884181:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000b597647e
00000100:00100000:0.0:1651531955.884524:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531955.884533:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467328576
00000100:00100000:0.0:1651531955.884540:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44390
00000100:00100000:0.0:1651531955.884542:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001ae5624b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+69:680969:x1731754467328576:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531955.884545:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531955.884549:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ee6f7a6e/0x3234de053ca2d61 lrc: 2/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4452dd expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.884555:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531955.884556:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531955.884558:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee6f7a6e/0x3234de053ca2d61 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [36864->49151] (req 36864->40959) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4452dd expref: 70 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.884563:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ee6f7a6e/0x3234de053ca2d61 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [36864->49151] (req 36864->40959) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4452dd expref: 70 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531955.884568:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ee6f7a6e, rc 0)
00000100:00100000:0.0:1651531955.884578:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001ae5624b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+70:680969:x1731754467328576:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (54us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531955.884581:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44390
00000100:00100000:0.0:1651531956.448157:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651531956.448168:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951226496
00000100:00100000:0.0:1651531956.448178:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 462
00000100:00100000:0.0:1651531956.448180:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000295be4cd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951226496:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:0.0:1651531956.448189:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 380928 granted 293422528 pending 1626112 free 81277214720 avail 77106503680
00000100:00100000:0.0:1651531956.448217:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000295be4cd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951226496:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 36us (61us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531956.448221:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 462
00000001:00080000:0.0:1651531956.563830:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869071 is committed
00010000:00010000:1.0:1651531956.563868:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd6ff34d/0x3234de053ca2d0d lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [28672->32767] (req 28672->32767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531956.563874:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fd6ff34d/0x3234de053ca2d0d lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [28672->32767] (req 28672->32767) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531956.563900:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004650255e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+63:438147:x1731754467323200:12345-10.240.43.64@tcp:4:fio.0 Request processed in 696568us (696618us total) trans 21474869071 rc 0/0
00000100:00100000:1.0:1651531956.563904:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249661
00010000:00010000:1.0:1651531956.563913:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fd6ff34d/0x3234de053ca2d0d lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [28672->32767] (req 28672->32767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531956.563917:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fd6ff34d already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531956.563918:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd6ff34d/0x3234de053ca2d0d lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [28672->32767] (req 28672->32767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531956.563921:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd6ff34d/0x3234de053ca2d0d lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [28672->32767] (req 28672->32767) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531956.563937:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fd6ff34d/0x3234de053ca2d0d lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [28672->32767] (req 28672->32767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531956.563940:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fd6ff34d/0x3234de053ca2d0d lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [28672->32767] (req 28672->32767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531956.568471:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531956.568489:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467329280
00000100:00100000:1.0:1651531956.568507:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249673
00000100:00100000:1.0:1651531956.568509:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c4db449c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+63:438147:x1731754467329280:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531956.568517:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca2d68 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531956.568522:0:216321:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003ad4b055/0x3234de053ca2b00 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [585728->659455] (req 585728->589823) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444d57 expref: 63 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531956.568526:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531956.568527:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531956.568528:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca2d68 lrc: 4/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [622592->626687] (req 622592->626687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531956.568536:0:216321:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003ad4b055/0x3234de053ca2b00 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [585728->659455] (req 585728->589823) gid 0 flags: 0x50000000020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444d57 expref: 63 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531956.568539:0:216321:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003ad4b055/0x3234de053ca2b00 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [585728->659455] (req 585728->589823) gid 0 flags: 0x70000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444d57 expref: 63 pid: 166113 timeout: 22765 lvb_type: 0
00000100:00100000:1.0:1651531956.568544:0:216321:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005e4b6deb pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997350720:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531956.568562:0:216321:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ec524534 going to sleep for 6 seconds
00000100:00100000:0.0:1651531956.568874:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531956.568880:0:216321:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005e4b6deb pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997350720:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531956.568883:0:169267:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467329344
00010000:00010000:1.0:1651531956.568885:0:216321:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca2d68 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [622592->626687] (req 622592->626687) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.568890:0:169267:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003ad4b055/0x3234de053ca2b00 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 56 type: EXT [585728->659455] (req 585728->589823) gid 0 flags: 0x60000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444d57 expref: 64 pid: 166113 timeout: 22765 lvb_type: 0
00000100:00100000:0.0:1651531956.568900:0:169267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 138
00000100:00100000:0.0:1651531956.568902:0:169267:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000028e5e6f5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+64:438146:x1731754467329344:12345-10.240.43.64@tcp:103:ldlm_bl_04.0
00010000:00010000:0.0:1651531956.568905:0:169267:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531956.568909:0:169267:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003ad4b055/0x3234de053ca2b00 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 56 type: EXT [585728->659455] (req 585728->589823) gid 0 flags: 0x60000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444d57 expref: 64 pid: 166113 timeout: 22765 lvb_type: 0
00010000:00010000:0.0:1651531956.568918:0:169267:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003ad4b055/0x3234de053ca2b00 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 56 type: EXT [585728->659455] (req 585728->589823) gid 0 flags: 0x50000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444d57 expref: 64 pid: 166113 timeout: 22765 lvb_type: 0
00010000:00010000:0.0:1651531956.568925:0:169267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003ad4b055/0x3234de053ca2b00 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 56 type: EXT [585728->659455] (req 585728->589823) gid 0 flags: 0x44801400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444d57 expref: 64 pid: 166113 timeout: 22765 lvb_type: 0
00010000:00010000:0.0:1651531956.568929:0:169267:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651531956.568939:0:169267:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000028e5e6f5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+63:438146:x1731754467329344:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 37us (65us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531956.568942:0:169267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 138
00000001:00080000:0.0:1651531956.586568:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869073 is committed
00010000:00010000:1.0:1651531956.586598:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca2d1b lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 54 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531956.586602:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca2d1b lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 54 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531956.586621:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000063553cfb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+58:438148:x1731754467324032:12345-10.240.43.64@tcp:4:fio.0 Request processed in 716866us (716900us total) trans 21474869072 rc 0/0
00000100:00100000:1.0:1651531956.586624:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249664
00010000:00010000:0.0:1651531956.586626:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca2d1b lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 54 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.586630:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008558d1b3 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531956.586631:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca2d1b lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 54 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.586634:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca2d1b lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 54 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531956.586641:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca2d37 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [679936->684031] (req 679936->684031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531956.586644:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca2d37 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 54 type: EXT [679936->684031] (req 679936->684031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.586655:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca2d1b lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 54 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531956.586657:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c6cd3250 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+57:438149:x1731754467326080:12345-10.240.43.64@tcp:4:fio.0 Request processed in 713551us (713574us total) trans 21474869073 rc 0/0
00010000:00010000:0.0:1651531956.586658:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca2d1b lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 54 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531956.586659:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249668
00010000:00010000:0.0:1651531956.586679:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca2d37 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 53 type: EXT [679936->684031] (req 679936->684031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.586682:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e9b84540 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531956.586683:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca2d37 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 53 type: EXT [679936->684031] (req 679936->684031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.586686:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca2d37 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 53 type: EXT [679936->684031] (req 679936->684031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.586690:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca2d37 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 53 type: EXT [679936->684031] (req 679936->684031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.586693:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca2d37 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 53 type: EXT [679936->684031] (req 679936->684031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531956.587112:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004bb4b5db pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+58:438146:x1731754467326400:12345-10.240.43.64@tcp:4:fio.0 Request processed in 713453us (713490us total) trans 21474869074 rc 0/0
00000100:00100000:1.0:1651531956.587115:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 13
00002000:00100000:1.0:1651531956.587118:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x34545:0x0] (270336->929791)  req@000000004bb4b5db x1731754467326400/t21474869074(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:416/0 lens 536/456 e 0 to 0 dl 1651531961 ref 1 fl Complete:H/0/0 rc 0/0 job:'fio.0'
00002000:00100000:1.0:1651531956.587123:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000004bb4b5db with x1731754467326400 ext(270336->929791)
00010000:00010000:1.0:1651531956.587127:0:166118:0:(ldlm_lockd.c:599:ldlm_refresh_waiting_lock()) ### refreshed to 81s ns: filter-lustre-OST0001_UUID lock: 000000009dff3fc3/0x3234de053ca2a89 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 53 type: EXT [290816->360447] (req 290816->294911) gid 0 flags: 0x60000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c5b expref: 58 pid: 206699 timeout: 22764 lvb_type: 0
00002000:00010000:1.0:1651531956.587134:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req 000000004bb4b5db
00000100:00100000:1.0:1651531956.587345:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531956.587354:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467329600
00000100:00100000:1.0:1651531956.587364:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249674
00000100:00100000:1.0:1651531956.587366:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005e4b6deb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+58:438148:x1731754467329600:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531956.587373:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca2d6f lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 53 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531956.587378:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531956.587378:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:0.0:1651531956.587378:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651531956.587380:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca2d6f lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 53 type: EXT [651264->655359] (req 651264->655359) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531956.587384:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca2d6f lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 53 type: EXT [651264->655359] (req 651264->655359) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531956.587386:0:166102:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467329664
00010000:00010000:0.0:1651531956.587393:0:166102:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009dff3fc3/0x3234de053ca2a89 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 53 type: EXT [290816->360447] (req 290816->294911) gid 0 flags: 0x60000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c5b expref: 59 pid: 206699 timeout: 22764 lvb_type: 0
00000100:00100000:0.0:1651531956.587401:0:166102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 139
00000100:00100000:0.0:1651531956.587402:0:166102:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000042b96101 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+59:438148:x1731754467329664:12345-10.240.43.64@tcp:103:ldlm_bl_01.0
00010000:00010000:0.0:1651531956.587406:0:166102:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00002000:00010000:0.0:1651531956.587408:0:166102:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x34545:0x0] updating lvb mtime from disk: 1651531955 -> 1651531956
00002000:00010000:0.0:1651531956.587410:0:166102:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x34545:0x0] updating lvb ctime from disk: 1651531955 -> 1651531956
00010000:00010000:0.0:1651531956.587423:0:166102:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009dff3fc3/0x3234de053ca2a89 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 54 type: EXT [290816->360447] (req 290816->294911) gid 0 flags: 0x60000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c5b expref: 59 pid: 206699 timeout: 22764 lvb_type: 0
00010000:00010000:0.0:1651531956.587427:0:166102:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009dff3fc3/0x3234de053ca2a89 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 54 type: EXT [290816->360447] (req 290816->294911) gid 0 flags: 0x50000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c5b expref: 59 pid: 206699 timeout: 22764 lvb_type: 0
00010000:00010000:0.0:1651531956.587434:0:166102:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009dff3fc3/0x3234de053ca2a89 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 54 type: EXT [290816->360447] (req 290816->294911) gid 0 flags: 0x44801400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c5b expref: 61 pid: 206699 timeout: 22764 lvb_type: 0
00010000:00010000:0.0:1651531956.587438:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531956.587439:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531956.587440:0:166102:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca2d3e lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 53 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.587443:0:166102:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca2d3e lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 53 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.587447:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531956.587447:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531956.587449:0:166102:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d2430cf1/0x3234de053ca2d45 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 53 type: EXT [974848->978943] (req 974848->978943) gid 0 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44529e expref: 60 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.587452:0:166102:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d2430cf1/0x3234de053ca2d45 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 53 type: EXT [974848->978943] (req 974848->978943) gid 0 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44529e expref: 60 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.587455:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531956.587456:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531956.587458:0:166102:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004df6dea8/0x3234de053ca2d4c lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 53 type: EXT [356352->372735] (req 356352->360447) gid 0 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4452a5 expref: 60 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.587464:0:166102:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004df6dea8/0x3234de053ca2d4c lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 53 type: EXT [356352->372735] (req 356352->360447) gid 0 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4452a5 expref: 60 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.587466:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531956.587467:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531956.587467:0:166102:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca2d68 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 53 type: EXT [622592->626687] (req 622592->626687) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.587470:0:166102:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca2d68 lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 53 type: EXT [622592->626687] (req 622592->626687) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.587484:0:166102:0:(ldlm_lockd.c:1067:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000004df6dea8/0x3234de053ca2d4c lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 53 type: EXT [356352->372735] (req 356352->360447) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4452a5 expref: 60 pid: 166112 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531956.587488:0:166102:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006cc45165 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:166102:1731745997350784:10.240.43.64@tcp:105:
00010000:00010000:1.0:1651531956.587491:0:216321:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca2d68 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 53 type: EXT [622592->626687] (req 622592->626687) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531956.587495:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca2d68 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 53 type: EXT [622592->626687] (req 622592->626687) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.587505:0:166102:0:(ldlm_lockd.c:1067:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d2430cf1/0x3234de053ca2d45 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 53 type: EXT [974848->978943] (req 974848->978943) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44529e expref: 60 pid: 166112 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531956.587509:0:166102:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000416f774b pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:166102:1731745997350848:10.240.43.64@tcp:105:
00000100:00100000:0.0:1651531956.587517:0:166102:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a01e87d3 going to sleep for 6 seconds
00010000:00010000:0.0:1651531956.587527:0:192753:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca2d3e lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 53 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.587530:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca2d3e lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 53 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531956.587815:0:166102:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006cc45165 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:166102:1731745997350784:10.240.43.64@tcp:105:
00000100:00100000:0.0:1651531956.587820:0:166102:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000416f774b pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:166102:1731745997350848:10.240.43.64@tcp:105:
00010000:00010000:0.0:1651531956.587824:0:166102:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651531956.587840:0:166102:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000042b96101 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+64:438148:x1731754467329664:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 437us (462us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531956.587843:0:166102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 139
00000100:00100000:0.0:1651531956.588466:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531956.588489:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467329984
00000100:00100000:1.0:1651531956.588501:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249675
00000100:00100000:1.0:1651531956.588503:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000416f774b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+64:438148:x1731754467329984:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531956.588511:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca2d76 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 53 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531956.588517:0:192755:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000049e48890/0x3234de053ca2d06 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 53 type: EXT [999424->18446744073709551615] (req 999424->1003519) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445251 expref: 64 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531956.588521:0:192755:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000c9190a4/0x3234de053ca2cb2 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 53 type: EXT [1003520->18446744073709551615] (req 1003520->1007615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44518d expref: 64 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531956.588524:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:1.0:1651531956.588525:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:1.0:1651531956.588525:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca2d76 lrc: 5/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 53 type: EXT [1019904->1023999] (req 1019904->1023999) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531956.588532:0:192755:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000c9190a4/0x3234de053ca2cb2 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 53 type: EXT [1003520->18446744073709551615] (req 1003520->1007615) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44518d expref: 64 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531956.588536:0:192755:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000c9190a4/0x3234de053ca2cb2 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 53 type: EXT [1003520->18446744073709551615] (req 1003520->1007615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44518d expref: 64 pid: 166113 timeout: 22765 lvb_type: 0
00000100:00100000:1.0:1651531956.588541:0:192755:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000941ac345 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0001_UUID:192755:1731745997350912:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651531956.588556:0:192755:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000049e48890/0x3234de053ca2d06 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 53 type: EXT [999424->18446744073709551615] (req 999424->1003519) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445251 expref: 64 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531956.588560:0:192755:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000049e48890/0x3234de053ca2d06 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 53 type: EXT [999424->18446744073709551615] (req 999424->1003519) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445251 expref: 64 pid: 166111 timeout: 22765 lvb_type: 0
00000100:00100000:1.0:1651531956.588563:0:192755:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c29abd66 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0001_UUID:192755:1731745997350976:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531956.588570:0:192755:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ec524534 going to sleep for 6 seconds
00000100:00100000:0.0:1651531956.588693:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531956.588702:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531956.588709:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467330048
00000100:00100000:0.0:1651531956.588722:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467330112
00000100:00100000:0.0:1651531956.588728:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44391
00000100:00100000:0.0:1651531956.588730:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006cc45165 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+66:680970:x1731754467330048:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531956.588733:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651531956.588737:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44392
00010000:00010000:0.0:1651531956.588738:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009f4458d9/0x3234de053ca2d7d lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 54 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4452f2 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531956.588740:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004bc6d4f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+66:680972:x1731754467330112:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531956.588744:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531956.588744:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531956.588745:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531956.588748:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca2d84 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 56 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4452f9 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.588748:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009f4458d9/0x3234de053ca2d7d lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [966656->974847] (req 966656->970751) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4452f2 expref: 67 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.588752:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009f4458d9/0x3234de053ca2d7d lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [966656->974847] (req 966656->970751) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4452f2 expref: 68 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531956.588754:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531956.588755:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531956.588757:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca2d84 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [688128->692223] (req 688128->692223) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4452f9 expref: 68 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531956.588762:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca2d84 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [688128->692223] (req 688128->692223) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4452f9 expref: 68 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.588762:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009f4458d9, rc 0)
00010000:00010000:1.0:1651531956.588766:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b4c8742a, rc 0)
00000100:00100000:0.0:1651531956.588775:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006cc45165 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+68:680970:x1731754467330048:12345-10.240.43.64@tcp:101:fio.0 Request processed in 45us (82us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531956.588781:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004bc6d4f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+68:680972:x1731754467330112:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (79us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531956.588781:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44391
00000100:00100000:1.0:1651531956.588784:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44392
00000100:00100000:1.0:1651531956.588906:0:192755:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000941ac345 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0001_UUID:192755:1731745997350912:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531956.588926:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531956.588936:0:192755:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c29abd66 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0001_UUID:192755:1731745997350976:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531956.588936:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651531956.588946:0:192755:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca2d76 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [1019904->1023999] (req 1019904->1023999) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531956.588946:0:166102:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467330176
00010000:00010000:0.0:1651531956.588951:0:166102:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000c9190a4/0x3234de053ca2cb2 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [1003520->18446744073709551615] (req 1003520->1007615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44518d expref: 67 pid: 166113 timeout: 22765 lvb_type: 0
00000100:00100000:1.0:1651531956.588954:0:169267:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467330240
00000100:00100000:0.0:1651531956.588962:0:166102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 140
00000100:00100000:0.0:1651531956.588963:0:166102:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a4f44993 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+68:438146:x1731754467330176:12345-10.240.43.64@tcp:103:ldlm_bl_02.0
00010000:00010000:1.0:1651531956.588964:0:169267:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000049e48890/0x3234de053ca2d06 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [999424->18446744073709551615] (req 999424->1003519) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445251 expref: 68 pid: 166111 timeout: 22765 lvb_type: 0
00010000:00010000:0.0:1651531956.588967:0:166102:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531956.588970:0:166102:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000c9190a4/0x3234de053ca2cb2 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 56 type: EXT [1003520->18446744073709551615] (req 1003520->1007615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44518d expref: 68 pid: 166113 timeout: 22765 lvb_type: 0
00000100:00100000:1.0:1651531956.588973:0:169267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 141
00010000:00010000:0.0:1651531956.588974:0:166102:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000c9190a4/0x3234de053ca2cb2 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 56 type: EXT [1003520->18446744073709551615] (req 1003520->1007615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44518d expref: 68 pid: 166113 timeout: 22765 lvb_type: 0
00000100:00100000:1.0:1651531956.588975:0:169267:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008f80e18b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+68:438148:x1731754467330240:12345-10.240.43.64@tcp:103:ldlm_bl_03.0
00010000:00010000:1.0:1651531956.588979:0:169267:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531956.588980:0:166102:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000c9190a4/0x3234de053ca2cb2 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 57 type: EXT [1003520->18446744073709551615] (req 1003520->1007615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44518d expref: 68 pid: 166113 timeout: 22765 lvb_type: 0
00010000:00010000:1.0:1651531956.588982:0:169267:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000049e48890/0x3234de053ca2d06 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 58 type: EXT [999424->18446744073709551615] (req 999424->1003519) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445251 expref: 68 pid: 166111 timeout: 22765 lvb_type: 0
00010000:00010000:0.0:1651531956.588984:0:166102:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1651531956.588986:0:169267:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000049e48890/0x3234de053ca2d06 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [999424->18446744073709551615] (req 999424->1003519) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445251 expref: 67 pid: 166111 timeout: 22765 lvb_type: 0
00010000:00010000:1.0:1651531956.588992:0:169267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000049e48890/0x3234de053ca2d06 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [999424->18446744073709551615] (req 999424->1003519) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445251 expref: 67 pid: 166111 timeout: 22765 lvb_type: 0
00000100:00100000:0.0:1651531956.588996:0:166102:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a4f44993 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+67:438146:x1731754467330176:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 32us (70us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531956.588999:0:166102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 140
00010000:00010000:1.0:1651531956.589002:0:169267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531956.589003:0:169267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531956.589004:0:169267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca2d76 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 54 type: EXT [1019904->1023999] (req 1019904->1023999) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531956.589007:0:169267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca2d76 lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 54 type: EXT [1019904->1023999] (req 1019904->1023999) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531956.589014:0:169267:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1651531956.589022:0:169267:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008f80e18b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+65:438148:x1731754467330240:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 45us (85us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531956.589024:0:169267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 141
00010000:00010000:1.0:1651531956.589048:0:192755:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca2d76 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 53 type: EXT [1019904->1023999] (req 1019904->1023999) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531956.589056:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca2d76 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 53 type: EXT [1019904->1023999] (req 1019904->1023999) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531956.589126:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531956.589148:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531956.589155:0:216322:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467330368
00002000:00100000:0.0:1651531956.589163:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34545:0x0] (966656->974847)  req@0000000036c8d608 x1731754467330368/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:417/0 lens 488/0 e 0 to 0 dl 1651531962 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:0.0:1651531956.589168:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000036c8d608 with x1731754467330368 ext(966656->974847)
00002000:00010000:0.0:1651531956.589169:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000036c8d608
00000100:00100000:0.0:1651531956.589178:0:216322:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467330432
00002000:00100000:0.0:1651531956.589181:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34545:0x0] (688128->692223)  req@0000000028e5e6f5 x1731754467330432/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:417/0 lens 488/0 e 0 to 0 dl 1651531962 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:0.0:1651531956.589185:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000028e5e6f5 with x1731754467330432 ext(688128->692223)
00002000:00010000:0.0:1651531956.589186:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000028e5e6f5
00000100:00100000:1.0:1651531956.589188:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249676
00000100:00100000:1.0:1651531956.589191:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000036c8d608 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+68:438148:x1731754467330368:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651531956.589196:0:216322:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249677
00000100:00100000:0.0:1651531956.589197:0:216322:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000028e5e6f5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+68:438148:x1731754467330432:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651531956.589249:0:216322:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000028e5e6f5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+68:438148:x1731754467330432:12345-10.240.43.64@tcp:3:fio.0 Request processed in 50us (100us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531956.589250:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000036c8d608 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+68:438148:x1731754467330368:12345-10.240.43.64@tcp:3:fio.0 Request processed in 58us (124us total) trans 0 rc 8192/8192
00000100:00100000:0.0:1651531956.589252:0:216322:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249677
00000100:00100000:1.0:1651531956.589254:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249676
00002000:00100000:0.0:1651531956.589254:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34545:0x0] (688128->692223)  req@0000000028e5e6f5 x1731754467330432/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:417/0 lens 488/4536 e 0 to 0 dl 1651531962 ref 1 fl Complete:/0/0 rc 4096/4096 job:'fio.0'
00002000:00100000:1.0:1651531956.589256:0:216323:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x100010000:0x34545:0x0] (966656->974847)  req@0000000036c8d608 x1731754467330368/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:417/0 lens 488/8632 e 0 to 0 dl 1651531962 ref 1 fl Complete:/0/0 rc 8192/8192 job:'fio.0'
00002000:00100000:0.0:1651531956.589258:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000028e5e6f5 with x1731754467330432 ext(688128->692223)
00002000:00010000:0.0:1651531956.589259:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000028e5e6f5
00002000:00100000:1.0:1651531956.589261:0:216323:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000036c8d608 with x1731754467330368 ext(966656->974847)
00002000:00010000:1.0:1651531956.589262:0:216323:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000036c8d608
00000100:00100000:1.0:1651531956.589675:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531956.589684:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531956.589697:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467330560
00000100:00100000:0.0:1651531956.589702:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467330624
00000100:00100000:1.0:1651531956.589707:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44393
00000100:00100000:1.0:1651531956.589709:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c29abd66 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+68:680970:x1731754467330560:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531956.589712:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531956.589716:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2d8b lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 54 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445300 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531956.589716:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44394
00000100:00100000:0.0:1651531956.589718:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000941ac345 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+68:680972:x1731754467330624:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531956.589721:0:206699:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531956.589723:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531956.589723:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531956.589725:0:206699:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fd7c5262/0x3234de053ca2d92 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 56 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445307 expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531956.589726:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2d8b lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 56 type: EXT [544768->561151] (req 544768->548863) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445300 expref: 69 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531956.589734:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2d8b lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [544768->561151] (req 544768->548863) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445300 expref: 70 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.589736:0:206699:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531956.589737:0:206699:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531956.589739:0:206699:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd7c5262/0x3234de053ca2d92 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [1040384->18446744073709551615] (req 1040384->1044479) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445307 expref: 70 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531956.589744:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a8889a80, rc 0)
00010000:00010000:0.0:1651531956.589744:0:206699:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fd7c5262/0x3234de053ca2d92 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [1040384->18446744073709551615] (req 1040384->1044479) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445307 expref: 70 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.589748:0:206699:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fd7c5262, rc 0)
00000100:00100000:1.0:1651531956.589755:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c29abd66 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+70:680970:x1731754467330560:12345-10.240.43.64@tcp:101:fio.0 Request processed in 46us (81us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531956.589758:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44393
00000100:00100000:0.0:1651531956.589763:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000941ac345 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+69:680972:x1731754467330624:12345-10.240.43.64@tcp:101:fio.0 Request processed in 45us (79us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531956.589766:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44394
00000100:00100000:1.0:1651531956.590087:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531956.590097:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531956.590105:0:192756:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467330816
00002000:00100000:1.0:1651531956.590111:0:192756:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x100010000:0x34545:0x0] (1040384->1048575)  req@0000000028aef41e x1731754467330816/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:417/0 lens 488/0 e 0 to 0 dl 1651531962 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:1.0:1651531956.590116:0:192756:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000028aef41e with x1731754467330816 ext(1040384->1048575)
00002000:00010000:1.0:1651531956.590117:0:192756:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000028aef41e
00000100:00100000:1.0:1651531956.590121:0:192756:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467330752
00002000:00100000:1.0:1651531956.590124:0:192756:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x100010000:0x34545:0x0] (544768->561151)  req@000000000d0b1769 x1731754467330752/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:417/0 lens 488/0 e 0 to 0 dl 1651531962 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:1.0:1651531956.590128:0:192756:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000000d0b1769 with x1731754467330752 ext(544768->561151)
00002000:00010000:1.0:1651531956.590129:0:192756:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000000d0b1769
00000100:00100000:1.0:1651531956.590139:0:192756:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249678
00000100:00100000:1.0:1651531956.590141:0:192756:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000028aef41e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+70:438149:x1731754467330816:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651531956.590149:0:216322:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249679
00000100:00100000:0.0:1651531956.590151:0:216322:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000d0b1769 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+70:438149:x1731754467330752:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651531956.590178:0:192756:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000028aef41e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+70:438149:x1731754467330816:12345-10.240.43.64@tcp:3:fio.0 Request processed in 36us (91us total) trans 0 rc 8192/8192
00000100:00100000:1.0:1651531956.590182:0:192756:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249678
00002000:00100000:1.0:1651531956.590185:0:192756:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x100010000:0x34545:0x0] (1040384->1048575)  req@0000000028aef41e x1731754467330816/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:417/0 lens 488/8632 e 0 to 0 dl 1651531962 ref 1 fl Complete:/0/0 rc 8192/8192 job:'fio.0'
00000100:00100000:0.0:1651531956.590187:0:216322:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000d0b1769 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+70:438149:x1731754467330752:12345-10.240.43.64@tcp:3:fio.0 Request processed in 35us (89us total) trans 0 rc 16384/16384
00002000:00100000:1.0:1651531956.590188:0:192756:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000028aef41e with x1731754467330816 ext(1040384->1048575)
00002000:00010000:1.0:1651531956.590190:0:192756:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000028aef41e
00000100:00100000:0.0:1651531956.590190:0:216322:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249679
00002000:00100000:0.0:1651531956.590192:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34545:0x0] (544768->561151)  req@000000000d0b1769 x1731754467330752/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:417/0 lens 488/16824 e 0 to 0 dl 1651531962 ref 1 fl Complete:/0/0 rc 16384/16384 job:'fio.0'
00002000:00100000:0.0:1651531956.590196:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000000d0b1769 with x1731754467330752 ext(544768->561151)
00002000:00010000:0.0:1651531956.590197:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000000d0b1769
00000100:00100000:1.0:1651531956.591019:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531956.591037:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467330944
00000100:00100000:0.0:1651531956.591046:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44395
00000100:00100000:0.0:1651531956.591047:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000087d14965 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+69:680970:x1731754467330944:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531956.591052:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531956.591056:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000698979ac/0x3234de053ca2d99 lrc: 2/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 56 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44530e expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.591062:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531956.591063:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531956.591065:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000698979ac/0x3234de053ca2d99 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 56 type: EXT [1003520->1019903] (req 1003520->1007615) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44530e expref: 70 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.591070:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000698979ac/0x3234de053ca2d99 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 56 type: EXT [1003520->1019903] (req 1003520->1007615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44530e expref: 70 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.591074:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000698979ac, rc 0)
00000100:00100000:0.0:1651531956.591083:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000087d14965 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+70:680970:x1731754467330944:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (65us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531956.591086:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44395
00000100:00100000:1.0:1651531956.594656:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531956.594677:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467331712
00000100:00100000:0.0:1651531956.594686:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44396
00000100:00100000:0.0:1651531956.594687:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006236111c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+70:680970:x1731754467331712:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531956.594691:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531956.594694:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000049e48890/0x3234de053ca2da0 lrc: 2/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 57 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445338 expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.594701:0:166111:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2d8b lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 57 type: EXT [544768->561151] (req 544768->548863) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445300 expref: 71 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.594704:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531956.594706:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531956.594707:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049e48890/0x3234de053ca2da0 lrc: 4/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 57 type: EXT [557056->561151] (req 557056->561151) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445338 expref: 71 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.594714:0:166111:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2d8b lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 57 type: EXT [544768->561151] (req 544768->548863) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445300 expref: 71 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.594718:0:166111:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2d8b lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 57 type: EXT [544768->561151] (req 544768->548863) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445300 expref: 71 pid: 166113 timeout: 22765 lvb_type: 0
00000100:00100000:0.0:1651531956.594723:0:166111:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000042b96101 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:166111:1731745997351040:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531956.594735:0:166111:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a2b9dcac going to sleep for 6 seconds
00000100:00100000:0.0:1651531956.595007:0:166111:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000042b96101 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:166111:1731745997351040:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531956.595008:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651531956.595012:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000049e48890/0x3234de053ca2da0 lrc: 3/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 57 type: EXT [557056->561151] (req 557056->561151) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445338 expref: 71 pid: 166111 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531956.595016:0:166103:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467331840
00010000:00010000:0.0:1651531956.595018:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000049e48890, rc 0)
00010000:00010000:1.0:1651531956.595022:0:166103:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2d8b lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 57 type: EXT [544768->561151] (req 544768->548863) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445300 expref: 72 pid: 166113 timeout: 22765 lvb_type: 0
00000100:00100000:0.0:1651531956.595029:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006236111c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+72:680970:x1731754467331712:12345-10.240.43.64@tcp:101:fio.0 Request processed in 341us (373us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531956.595030:0:166103:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 142
00000100:00100000:0.0:1651531956.595031:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44396
00000100:00100000:1.0:1651531956.595032:0:166103:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a6b3689b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+72:438146:x1731754467331840:12345-10.240.43.64@tcp:103:ldlm_bl_05.0
00010000:00010000:1.0:1651531956.595035:0:166103:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1651531956.595039:0:166103:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2d8b lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 58 type: EXT [544768->561151] (req 544768->548863) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445300 expref: 71 pid: 166113 timeout: 22765 lvb_type: 0
00010000:00010000:1.0:1651531956.595043:0:166103:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2d8b lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 58 type: EXT [544768->561151] (req 544768->548863) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445300 expref: 71 pid: 166113 timeout: 22765 lvb_type: 0
00010000:00010000:1.0:1651531956.595049:0:166103:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2d8b lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 58 type: EXT [544768->561151] (req 544768->548863) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445300 expref: 71 pid: 166113 timeout: 22765 lvb_type: 0
00010000:00010000:1.0:1651531956.595053:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531956.595054:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531956.595055:0:166103:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000049e48890/0x3234de053ca2da0 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 57 type: EXT [557056->561151] (req 557056->561151) gid 0 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445338 expref: 70 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531956.595072:0:166103:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049e48890/0x3234de053ca2da0 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 57 type: EXT [557056->561151] (req 557056->561151) gid 0 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445338 expref: 70 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531956.595081:0:166103:0:(ldlm_lockd.c:1067:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000049e48890/0x3234de053ca2da0 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 57 type: EXT [557056->561151] (req 557056->561151) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445338 expref: 70 pid: 166111 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531956.595085:0:166103:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005e3ba1d0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:166103:1731745997351104:10.240.43.64@tcp:105:
00000100:00100000:1.0:1651531956.595098:0:166103:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fc7d2635 going to sleep for 6 seconds
00000100:00100000:1.0:1651531956.595442:0:166103:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005e3ba1d0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:166103:1731745997351104:10.240.43.64@tcp:105:
00010000:00010000:1.0:1651531956.595447:0:166103:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1651531956.595456:0:166103:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a6b3689b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+70:438146:x1731754467331840:12345-10.240.43.64@tcp:103:ldlm_bl_05.0 Request processed in 424us (449us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531956.595459:0:166103:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 142
00000100:00100000:0.0:1651531956.596291:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531956.596299:0:216322:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467332160
00002000:00100000:0.0:1651531956.596305:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34545:0x0] (110592->114687)  req@0000000042b96101 x1731754467332160/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:417/0 lens 488/0 e 0 to 0 dl 1651531962 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:0.0:1651531956.596309:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000042b96101 with x1731754467332160 ext(110592->114687)
00002000:00010000:0.0:1651531956.596311:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000042b96101
00000100:00100000:0.0:1651531956.596321:0:216322:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249680
00000100:00100000:0.0:1651531956.596324:0:216322:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000042b96101 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+70:438148:x1731754467332160:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651531956.596351:0:216322:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000042b96101 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+70:438148:x1731754467332160:12345-10.240.43.64@tcp:3:fio.0 Request processed in 26us (60us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531956.596354:0:216322:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249680
00002000:00100000:0.0:1651531956.596356:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34545:0x0] (110592->114687)  req@0000000042b96101 x1731754467332160/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:417/0 lens 488/4536 e 0 to 0 dl 1651531962 ref 1 fl Complete:/0/0 rc 4096/4096 job:'fio.0'
00002000:00100000:0.0:1651531956.596359:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000042b96101 with x1731754467332160 ext(110592->114687)
00002000:00010000:0.0:1651531956.596361:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000042b96101
00000100:00100000:0.0:1651531956.597959:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531956.597967:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467332480
00000100:00100000:0.0:1651531956.597974:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44397
00000100:00100000:0.0:1651531956.597976:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a4f44993 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+70:680970:x1731754467332480:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531956.597979:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531956.597982:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fd6ff34d/0x3234de053ca2da7 lrc: 2/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 57 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445362 expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.597988:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531956.597989:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531956.597992:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd6ff34d/0x3234de053ca2da7 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 57 type: EXT [294912->335871] (req 294912->299007) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445362 expref: 71 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.597996:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fd6ff34d/0x3234de053ca2da7 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 57 type: EXT [294912->335871] (req 294912->299007) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445362 expref: 71 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.598000:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fd6ff34d, rc 0)
00000100:00100000:0.0:1651531956.598014:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a4f44993 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+71:680970:x1731754467332480:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (56us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531956.598018:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44397
00000100:00100000:0.0:1651531956.600628:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531956.600637:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467332992
00000100:00100000:0.0:1651531956.600643:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44398
00000100:00100000:0.0:1651531956.600645:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000221a0e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+71:680970:x1731754467332992:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531956.600648:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531956.600652:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000c9190a4/0x3234de053ca2dae lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 58 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445385 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.600658:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531956.600659:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531956.600661:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000c9190a4/0x3234de053ca2dae lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 58 type: EXT [147456->172031] (req 147456->151551) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445385 expref: 72 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.600665:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000c9190a4/0x3234de053ca2dae lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 58 type: EXT [147456->172031] (req 147456->151551) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445385 expref: 72 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.600669:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000000c9190a4, rc 0)
00000100:00100000:0.0:1651531956.600683:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000221a0e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+72:680970:x1731754467332992:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (55us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531956.600686:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44398
00000100:00100000:0.0:1651531956.600994:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531956.601001:0:216322:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467333248
00002000:00100000:0.0:1651531956.601007:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34545:0x0] (147456->172031)  req@00000000787b0e63 x1731754467333248/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:417/0 lens 488/0 e 0 to 0 dl 1651531962 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:0.0:1651531956.601011:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000787b0e63 with x1731754467333248 ext(147456->172031)
00002000:00010000:0.0:1651531956.601014:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000787b0e63
00000100:00100000:0.0:1651531956.601024:0:216322:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249681
00000100:00100000:0.0:1651531956.601025:0:216322:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000787b0e63 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+72:438148:x1731754467333248:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651531956.601267:0:216322:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000787b0e63 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+72:438148:x1731754467333248:12345-10.240.43.64@tcp:3:fio.0 Request processed in 241us (274us total) trans 0 rc 24576/24576
00000100:00100000:0.0:1651531956.601271:0:216322:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249681
00002000:00100000:0.0:1651531956.601273:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34545:0x0] (147456->172031)  req@00000000787b0e63 x1731754467333248/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:417/0 lens 488/440 e 0 to 0 dl 1651531962 ref 1 fl Complete:/0/0 rc 24576/24576 job:'fio.0'
00002000:00100000:0.0:1651531956.601277:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000787b0e63 with x1731754467333248 ext(147456->172031)
00002000:00010000:0.0:1651531956.601278:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000787b0e63
00000100:00100000:0.0:1651531956.602882:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531956.602889:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467333632
00000100:00100000:0.0:1651531956.602896:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44399
00000100:00100000:0.0:1651531956.602898:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002cc4c977 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+72:680970:x1731754467333632:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531956.602901:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531956.602905:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009dff3fc3/0x3234de053ca2db5 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 59 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445393 expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.602916:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531956.602916:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531956.602919:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009dff3fc3/0x3234de053ca2db5 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 59 type: EXT [200704->225279] (req 200704->204799) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445393 expref: 73 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.602923:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009dff3fc3/0x3234de053ca2db5 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 59 type: EXT [200704->225279] (req 200704->204799) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445393 expref: 73 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.602931:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009dff3fc3, rc 0)
00000100:00100000:0.0:1651531956.602945:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002cc4c977 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+73:680970:x1731754467333632:12345-10.240.43.64@tcp:101:fio.0 Request processed in 47us (64us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531956.602948:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44399
00000100:00100000:0.0:1651531956.603590:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531956.603597:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467333696
00000100:00100000:0.0:1651531956.603603:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44400
00000100:00100000:0.0:1651531956.603605:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d1a3b76f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+73:680972:x1731754467333696:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531956.603608:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531956.603611:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b59a05a3/0x3234de053ca2dbc lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 60 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44539a expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.603617:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531956.603618:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531956.603620:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b59a05a3/0x3234de053ca2dbc lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 60 type: EXT [929792->946175] (req 929792->933887) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44539a expref: 74 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.603624:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b59a05a3/0x3234de053ca2dbc lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 60 type: EXT [929792->946175] (req 929792->933887) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44539a expref: 74 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.603627:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b59a05a3, rc 0)
00000100:00100000:0.0:1651531956.603649:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d1a3b76f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+74:680972:x1731754467333696:12345-10.240.43.64@tcp:101:fio.0 Request processed in 43us (60us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531956.603652:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44400
00000100:00100000:0.0:1651531956.603736:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531956.603744:0:216322:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467333824
00002000:00100000:0.0:1651531956.603751:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34545:0x0] (200704->225279)  req@00000000aa73df31 x1731754467333824/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:417/0 lens 488/0 e 0 to 0 dl 1651531962 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:0.0:1651531956.603755:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000aa73df31 with x1731754467333824 ext(200704->225279)
00002000:00010000:0.0:1651531956.603756:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000aa73df31
00000100:00100000:0.0:1651531956.603766:0:216322:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249682
00000100:00100000:0.0:1651531956.603768:0:216322:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aa73df31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+74:438149:x1731754467333824:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651531956.603981:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531956.604001:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467333952
00000100:00100000:0.0:1651531956.604010:0:216322:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aa73df31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+75:438149:x1731754467333824:12345-10.240.43.64@tcp:3:fio.0 Request processed in 242us (275us total) trans 0 rc 24576/24576
00002000:00100000:1.0:1651531956.604014:0:216323:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x100010000:0x34545:0x0] (929792->946175)  req@00000000f17f2de2 x1731754467333952/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:417/0 lens 488/0 e 0 to 0 dl 1651531962 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00000100:00100000:0.0:1651531956.604014:0:216322:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249682
00002000:00100000:0.0:1651531956.604016:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34545:0x0] (200704->225279)  req@00000000aa73df31 x1731754467333824/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:417/0 lens 488/440 e 0 to 0 dl 1651531962 ref 1 fl Complete:/0/0 rc 24576/24576 job:'fio.0'
00002000:00100000:1.0:1651531956.604019:0:216323:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000f17f2de2 with x1731754467333952 ext(929792->946175)
00002000:00010000:1.0:1651531956.604020:0:216323:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000f17f2de2
00002000:00100000:0.0:1651531956.604020:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000aa73df31 with x1731754467333824 ext(200704->225279)
00002000:00010000:0.0:1651531956.604021:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000aa73df31
00000100:00100000:1.0:1651531956.604026:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249683
00000100:00100000:1.0:1651531956.604027:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f17f2de2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+74:438146:x1731754467333952:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651531956.604061:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f17f2de2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+74:438146:x1731754467333952:12345-10.240.43.64@tcp:3:fio.0 Request processed in 33us (81us total) trans 0 rc 16384/16384
00000100:00100000:1.0:1651531956.604064:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249683
00002000:00100000:1.0:1651531956.604067:0:216323:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x100010000:0x34545:0x0] (929792->946175)  req@00000000f17f2de2 x1731754467333952/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:417/0 lens 488/16824 e 0 to 0 dl 1651531962 ref 1 fl Complete:/0/0 rc 16384/16384 job:'fio.0'
00002000:00100000:1.0:1651531956.604071:0:216323:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000f17f2de2 with x1731754467333952 ext(929792->946175)
00002000:00010000:1.0:1651531956.604072:0:216323:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000f17f2de2
00000100:00100000:0.0:1651531956.604389:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531956.604397:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467334080
00000100:00100000:0.0:1651531956.604404:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44401
00000100:00100000:0.0:1651531956.604406:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000146152db pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+74:680972:x1731754467334080:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531956.604409:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531956.604413:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eba74384/0x3234de053ca2dc3 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 61 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4453a8 expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.604419:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531956.604420:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531956.604422:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eba74384/0x3234de053ca2dc3 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 61 type: EXT [348160->356351] (req 348160->352255) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4453a8 expref: 75 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.604430:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000eba74384/0x3234de053ca2dc3 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 61 type: EXT [348160->356351] (req 348160->352255) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4453a8 expref: 75 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.604434:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000eba74384, rc 0)
00000100:00100000:0.0:1651531956.604449:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000146152db pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+75:680972:x1731754467334080:12345-10.240.43.64@tcp:101:fio.0 Request processed in 42us (60us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531956.604452:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44401
00000100:00100000:0.0:1651531956.604719:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531956.604741:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467334336
00002000:00100000:1.0:1651531956.604748:0:216323:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x100010000:0x34545:0x0] (348160->356351)  req@000000008d4158a2 x1731754467334336/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:417/0 lens 488/0 e 0 to 0 dl 1651531962 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:1.0:1651531956.604752:0:216323:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000008d4158a2 with x1731754467334336 ext(348160->356351)
00002000:00010000:1.0:1651531956.604753:0:216323:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000008d4158a2
00000100:00100000:1.0:1651531956.604763:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249684
00000100:00100000:1.0:1651531956.604764:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008d4158a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+75:438146:x1731754467334336:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651531956.604790:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008d4158a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+75:438146:x1731754467334336:12345-10.240.43.64@tcp:3:fio.0 Request processed in 25us (72us total) trans 0 rc 8192/8192
00000100:00100000:1.0:1651531956.604793:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249684
00002000:00100000:1.0:1651531956.604795:0:216323:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x100010000:0x34545:0x0] (348160->356351)  req@000000008d4158a2 x1731754467334336/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:417/0 lens 488/8632 e 0 to 0 dl 1651531962 ref 1 fl Complete:/0/0 rc 8192/8192 job:'fio.0'
00002000:00100000:1.0:1651531956.604798:0:216323:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000008d4158a2 with x1731754467334336 ext(348160->356351)
00002000:00010000:1.0:1651531956.604800:0:216323:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000008d4158a2
00000100:00100000:0.0:1651531956.605627:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531956.605635:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467334464
00000100:00100000:0.0:1651531956.605642:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44402
00000100:00100000:0.0:1651531956.605643:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008cc636a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+75:680970:x1731754467334464:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531956.605647:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531956.605650:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003cf86247/0x3234de053ca2dca lrc: 2/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 62 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4453b6 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.605656:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531956.605657:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531956.605659:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003cf86247/0x3234de053ca2dca lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 62 type: EXT [716800->729087] (req 716800->720895) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4453b6 expref: 76 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.605663:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003cf86247/0x3234de053ca2dca lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 62 type: EXT [716800->729087] (req 716800->720895) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4453b6 expref: 76 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.605667:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003cf86247, rc 0)
00000100:00100000:0.0:1651531956.605681:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008cc636a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+76:680970:x1731754467334464:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (55us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531956.605685:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44402
00000100:00100000:0.0:1651531956.605994:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531956.606001:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467334528
00000100:00100000:0.0:1651531956.606008:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44403
00000100:00100000:0.0:1651531956.606009:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000009473c76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+76:680972:x1731754467334528:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531956.606012:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531956.606024:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2f464ac/0x3234de053ca2dd1 lrc: 2/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 63 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4453bd expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.606031:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531956.606031:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531956.606034:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2f464ac/0x3234de053ca2dd1 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 63 type: EXT [1028096->1040383] (req 1028096->1032191) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4453bd expref: 77 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.606038:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e2f464ac/0x3234de053ca2dd1 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 63 type: EXT [1028096->1040383] (req 1028096->1032191) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4453bd expref: 77 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.606042:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e2f464ac, rc 0)
00000100:00100000:0.0:1651531956.606056:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000009473c76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+77:680972:x1731754467334528:12345-10.240.43.64@tcp:101:fio.0 Request processed in 46us (62us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531956.606059:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44403
00000100:00100000:0.0:1651531956.606482:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531956.606490:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467334656
00000100:00100000:0.0:1651531956.606496:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44404
00000100:00100000:0.0:1651531956.606498:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000195015e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+77:680970:x1731754467334656:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531956.606501:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531956.606506:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000049c67f6a/0x3234de053ca2dd8 lrc: 2/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 64 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4453cb expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.606512:0:166112:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003e4793c3/0x3234de053ca2d53 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 64 type: EXT [8192->28671] (req 8192->12287) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4452ac expref: 78 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.606516:0:166112:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000940bc691/0x3234de053ca2d5a lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 64 type: EXT [0->28671] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4452d6 expref: 78 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.606519:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:0.0:1651531956.606519:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:0.0:1651531956.606520:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049c67f6a/0x3234de053ca2dd8 lrc: 5/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 64 type: EXT [24576->28671] (req 24576->28671) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4453cb expref: 78 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.606527:0:166112:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000940bc691/0x3234de053ca2d5a lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 64 type: EXT [0->28671] (req 0->4095) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4452d6 expref: 78 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.606531:0:166112:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000940bc691/0x3234de053ca2d5a lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 64 type: EXT [0->28671] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4452d6 expref: 78 pid: 166112 timeout: 22765 lvb_type: 0
00000100:00100000:0.0:1651531956.606535:0:166112:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e206d444 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:166112:1731745997351168:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651531956.606555:0:166112:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003e4793c3/0x3234de053ca2d53 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 64 type: EXT [8192->28671] (req 8192->12287) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4452ac expref: 78 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.606559:0:166112:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003e4793c3/0x3234de053ca2d53 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 64 type: EXT [8192->28671] (req 8192->12287) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4452ac expref: 78 pid: 166111 timeout: 22765 lvb_type: 0
00000100:00100000:0.0:1651531956.606562:0:166112:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001345dda6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:166112:1731745997351232:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531956.606570:0:166112:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a2b9dcac going to sleep for 6 seconds
00000100:00100000:0.0:1651531956.606893:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531956.606908:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531956.606913:0:166103:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467334720
00000100:00100000:0.0:1651531956.606915:0:166104:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467334784
00010000:00010000:1.0:1651531956.606920:0:166103:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003e4793c3/0x3234de053ca2d53 lrc: 5/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 64 type: EXT [8192->28671] (req 8192->12287) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4452ac expref: 80 pid: 166111 timeout: 22765 lvb_type: 0
00010000:00010000:0.0:1651531956.606921:0:166104:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000940bc691/0x3234de053ca2d5a lrc: 5/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 65 type: EXT [0->28671] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4452d6 expref: 80 pid: 166112 timeout: 22765 lvb_type: 0
00000100:00100000:1.0:1651531956.606929:0:166103:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 143
00000100:00100000:1.0:1651531956.606931:0:166103:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007ff31eaa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+80:438146:x1731754467334720:12345-10.240.43.64@tcp:103:ldlm_bl_04.0
00000100:00100000:0.0:1651531956.606931:0:166104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 144
00000100:00100000:0.0:1651531956.606933:0:166104:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006985bc0d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+80:438149:x1731754467334784:12345-10.240.43.64@tcp:103:ldlm_bl_01.0
00010000:00010000:1.0:1651531956.606936:0:166103:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531956.606936:0:166104:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531956.606939:0:166104:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000940bc691/0x3234de053ca2d5a lrc: 5/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 66 type: EXT [0->28671] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4452d6 expref: 80 pid: 166112 timeout: 22765 lvb_type: 0
00010000:00010000:1.0:1651531956.606940:0:166103:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003e4793c3/0x3234de053ca2d53 lrc: 5/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 67 type: EXT [8192->28671] (req 8192->12287) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4452ac expref: 80 pid: 166111 timeout: 22765 lvb_type: 0
00010000:00010000:0.0:1651531956.606943:0:166104:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000940bc691/0x3234de053ca2d5a lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 66 type: EXT [0->28671] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4452d6 expref: 80 pid: 166112 timeout: 22765 lvb_type: 0
00010000:00010000:1.0:1651531956.606948:0:166103:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003e4793c3/0x3234de053ca2d53 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 66 type: EXT [8192->28671] (req 8192->12287) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4452ac expref: 80 pid: 166111 timeout: 22765 lvb_type: 0
00010000:00010000:0.0:1651531956.606961:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531956.606962:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531956.606963:0:166104:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000049c67f6a/0x3234de053ca2dd8 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 66 type: EXT [24576->36863] (req 24576->28671) gid 0 flags: 0x50080000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4453cb expref: 80 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.606967:0:166104:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049c67f6a/0x3234de053ca2dd8 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 66 type: EXT [24576->36863] (req 24576->28671) gid 0 flags: 0x50080000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4453cb expref: 80 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531956.606971:0:166103:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1651531956.606975:0:166104:0:(ldlm_lockd.c:1067:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000049c67f6a/0x3234de053ca2dd8 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 65 type: EXT [24576->36863] (req 24576->28671) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4453cb expref: 80 pid: 166112 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531956.606979:0:166104:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000412cebd2 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:166104:1731745997351296:10.240.43.64@tcp:105:
00000100:00100000:1.0:1651531956.606980:0:166103:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007ff31eaa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+80:438146:x1731754467334720:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 49us (88us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531956.606983:0:166103:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 143
00000100:00100000:0.0:1651531956.606989:0:166104:0:(client.c:2492:ptlrpc_set_wait()) set 000000000073caa3 going to sleep for 6 seconds
00010000:00010000:0.0:1651531956.606999:0:166112:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000940bc691/0x3234de053ca2d5a lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 65 type: EXT [0->28671] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4452d6 expref: 79 pid: 166112 timeout: 22765 lvb_type: 0
00000100:00100000:0.0:1651531956.607003:0:166112:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e206d444 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:166112:1731745997351168:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651531956.607006:0:166112:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003e4793c3/0x3234de053ca2d53 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 64 type: EXT [8192->28671] (req 8192->12287) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4452ac expref: 78 pid: 166111 timeout: 22765 lvb_type: 0
00000100:00100000:0.0:1651531956.607009:0:166112:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001345dda6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:166112:1731745997351232:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651531956.607014:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000049c67f6a/0x3234de053ca2dd8 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 63 type: EXT [24576->36863] (req 24576->28671) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4453cb expref: 77 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.607018:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000049c67f6a, rc 0)
00000100:00100000:0.0:1651531956.607026:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000195015e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+77:680970:x1731754467334656:12345-10.240.43.64@tcp:101:fio.0 Request processed in 527us (544us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531956.607028:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44404
00000100:00100000:0.0:1651531956.607236:0:166104:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000412cebd2 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:166104:1731745997351296:10.240.43.64@tcp:105:
00010000:00010000:0.0:1651531956.607241:0:166104:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651531956.607250:0:166104:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006985bc0d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+76:438149:x1731754467334784:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 317us (342us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531956.607253:0:166104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 144
00000100:00100000:1.0:1651531956.607743:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531956.607752:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467335040
00002000:00100000:1.0:1651531956.607758:0:216323:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x100010000:0x34545:0x0] (1011712->1019903)  req@000000005e3ba1d0 x1731754467335040/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:417/0 lens 488/0 e 0 to 0 dl 1651531962 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:1.0:1651531956.607762:0:216323:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000005e3ba1d0 with x1731754467335040 ext(1011712->1019903)
00002000:00010000:1.0:1651531956.607763:0:216323:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000005e3ba1d0
00000100:00100000:1.0:1651531956.607774:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249685
00000100:00100000:1.0:1651531956.607776:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005e3ba1d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+76:438149:x1731754467335040:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651531956.607804:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005e3ba1d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+76:438149:x1731754467335040:12345-10.240.43.64@tcp:3:fio.0 Request processed in 28us (62us total) trans 0 rc 8192/8192
00000100:00100000:1.0:1651531956.607807:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249685
00002000:00100000:1.0:1651531956.607809:0:216323:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x100010000:0x34545:0x0] (1011712->1019903)  req@000000005e3ba1d0 x1731754467335040/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:417/0 lens 488/8632 e 0 to 0 dl 1651531962 ref 1 fl Complete:/0/0 rc 8192/8192 job:'fio.0'
00002000:00100000:1.0:1651531956.607813:0:216323:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000005e3ba1d0 with x1731754467335040 ext(1011712->1019903)
00002000:00010000:1.0:1651531956.607816:0:216323:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000005e3ba1d0
00000100:00100000:1.0:1651531956.608088:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531956.608102:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467335104
00000100:00100000:0.0:1651531956.608110:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44405
00000100:00100000:0.0:1651531956.608112:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d0182154 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+76:680972:x1731754467335104:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531956.608115:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531956.608120:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000030d4a6f9/0x3234de053ca2ddf lrc: 2/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 63 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4453d2 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.608127:0:166112:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000c9190a4/0x3234de053ca2dae lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 63 type: EXT [147456->172031] (req 147456->151551) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445385 expref: 77 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.608130:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531956.608131:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531956.608132:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000030d4a6f9/0x3234de053ca2ddf lrc: 4/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 63 type: EXT [155648->159743] (req 155648->159743) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4453d2 expref: 77 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.608138:0:166112:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000c9190a4/0x3234de053ca2dae lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 63 type: EXT [147456->172031] (req 147456->151551) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445385 expref: 77 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.608142:0:166112:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000c9190a4/0x3234de053ca2dae lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 63 type: EXT [147456->172031] (req 147456->151551) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445385 expref: 77 pid: 166112 timeout: 22765 lvb_type: 0
00000100:00100000:0.0:1651531956.608146:0:166112:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000412cebd2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:166112:1731745997351360:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531956.608158:0:166112:0:(client.c:2492:ptlrpc_set_wait()) set 000000000073caa3 going to sleep for 6 seconds
00000100:00100000:1.0:1651531956.608434:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531956.608442:0:166112:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000412cebd2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:166112:1731745997351360:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651531956.608447:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000030d4a6f9/0x3234de053ca2ddf lrc: 3/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 63 type: EXT [155648->159743] (req 155648->159743) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4453d2 expref: 77 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.608453:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000030d4a6f9, rc 0)
00000100:00100000:0.0:1651531956.608462:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d0182154 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+77:680972:x1731754467335104:12345-10.240.43.64@tcp:101:fio.0 Request processed in 350us (375us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531956.608465:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44405
00000100:00100000:0.0:1651531956.608473:0:166104:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467335168
00010000:00010000:0.0:1651531956.608478:0:166104:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000c9190a4/0x3234de053ca2dae lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 63 type: EXT [147456->172031] (req 147456->151551) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445385 expref: 77 pid: 166112 timeout: 22765 lvb_type: 0
00000100:00100000:0.0:1651531956.608485:0:166104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 145
00000100:00100000:0.0:1651531956.608487:0:166104:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000096080ff0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+77:438147:x1731754467335168:12345-10.240.43.64@tcp:103:ldlm_bl_05.0
00010000:00010000:0.0:1651531956.608489:0:166104:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531956.608493:0:166104:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000c9190a4/0x3234de053ca2dae lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 64 type: EXT [147456->172031] (req 147456->151551) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445385 expref: 77 pid: 166112 timeout: 22765 lvb_type: 0
00010000:00010000:0.0:1651531956.608496:0:166104:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000c9190a4/0x3234de053ca2dae lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 64 type: EXT [147456->172031] (req 147456->151551) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445385 expref: 77 pid: 166112 timeout: 22765 lvb_type: 0
00010000:00010000:0.0:1651531956.608503:0:166104:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000c9190a4/0x3234de053ca2dae lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 64 type: EXT [147456->172031] (req 147456->151551) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445385 expref: 77 pid: 166112 timeout: 22765 lvb_type: 0
00010000:00010000:0.0:1651531956.608506:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531956.608507:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531956.608509:0:166104:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000030d4a6f9/0x3234de053ca2ddf lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 63 type: EXT [155648->172031] (req 155648->159743) gid 0 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4453d2 expref: 76 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.608512:0:166104:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000030d4a6f9/0x3234de053ca2ddf lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 63 type: EXT [155648->172031] (req 155648->159743) gid 0 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4453d2 expref: 76 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.608519:0:166104:0:(ldlm_lockd.c:1067:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000030d4a6f9/0x3234de053ca2ddf lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 63 type: EXT [155648->172031] (req 155648->159743) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4453d2 expref: 76 pid: 166112 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531956.608523:0:166104:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000412cebd2 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:166104:1731745997351424:10.240.43.64@tcp:105:
00000100:00100000:0.0:1651531956.608531:0:166104:0:(client.c:2492:ptlrpc_set_wait()) set 000000000073caa3 going to sleep for 6 seconds
00000100:00100000:0.0:1651531956.608726:0:166104:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000412cebd2 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:166104:1731745997351424:10.240.43.64@tcp:105:
00010000:00010000:0.0:1651531956.608731:0:166104:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651531956.608740:0:166104:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000096080ff0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+76:438147:x1731754467335168:12345-10.240.43.64@tcp:103:ldlm_bl_05.0 Request processed in 252us (306us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531956.608743:0:166104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 145
00000100:00100000:1.0:1651531956.608987:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531956.608997:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467335360
00000100:00100000:0.0:1651531956.609005:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44406
00000100:00100000:0.0:1651531956.609007:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ed7e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+76:680972:x1731754467335360:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531956.609010:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531956.609013:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000007a8a843/0x3234de053ca2de6 lrc: 2/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 63 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4453d9 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.609020:0:166112:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000eba74384/0x3234de053ca2dc3 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 63 type: EXT [348160->356351] (req 348160->352255) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4453a8 expref: 77 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.609023:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531956.609024:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531956.609024:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000007a8a843/0x3234de053ca2de6 lrc: 4/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 63 type: EXT [352256->356351] (req 352256->356351) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4453d9 expref: 77 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.609031:0:166112:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000eba74384/0x3234de053ca2dc3 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 63 type: EXT [348160->356351] (req 348160->352255) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4453a8 expref: 77 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.609034:0:166112:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000eba74384/0x3234de053ca2dc3 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 63 type: EXT [348160->356351] (req 348160->352255) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4453a8 expref: 77 pid: 166111 timeout: 22765 lvb_type: 0
00000100:00100000:0.0:1651531956.609038:0:166112:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000412cebd2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:166112:1731745997351488:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531956.609051:0:166112:0:(client.c:2492:ptlrpc_set_wait()) set 000000000073caa3 going to sleep for 6 seconds
00000100:00100000:1.0:1651531956.609333:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531956.609341:0:166112:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000412cebd2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:166112:1731745997351488:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651531956.609346:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000007a8a843/0x3234de053ca2de6 lrc: 3/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 63 type: EXT [352256->356351] (req 352256->356351) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4453d9 expref: 77 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.609352:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000007a8a843, rc 0)
00000100:00100000:0.0:1651531956.609361:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ed7e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+77:680972:x1731754467335360:12345-10.240.43.64@tcp:101:fio.0 Request processed in 354us (375us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531956.609364:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44406
00000100:00100000:0.0:1651531956.609371:0:166104:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467335424
00010000:00010000:0.0:1651531956.609375:0:166104:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000eba74384/0x3234de053ca2dc3 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 63 type: EXT [348160->356351] (req 348160->352255) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4453a8 expref: 77 pid: 166111 timeout: 22765 lvb_type: 0
00000100:00100000:0.0:1651531956.609382:0:166104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 146
00000100:00100000:0.0:1651531956.609383:0:166104:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b67ad021 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+77:438146:x1731754467335424:12345-10.240.43.64@tcp:103:ldlm_bl_02.0
00010000:00010000:0.0:1651531956.609386:0:166104:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531956.609389:0:166104:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000eba74384/0x3234de053ca2dc3 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 64 type: EXT [348160->356351] (req 348160->352255) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4453a8 expref: 77 pid: 166111 timeout: 22765 lvb_type: 0
00010000:00010000:0.0:1651531956.609393:0:166104:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000eba74384/0x3234de053ca2dc3 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 64 type: EXT [348160->356351] (req 348160->352255) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4453a8 expref: 77 pid: 166111 timeout: 22765 lvb_type: 0
00010000:00010000:0.0:1651531956.609399:0:166104:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eba74384/0x3234de053ca2dc3 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 64 type: EXT [348160->356351] (req 348160->352255) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4453a8 expref: 77 pid: 166111 timeout: 22765 lvb_type: 0
00010000:00010000:0.0:1651531956.609403:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531956.609404:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531956.609406:0:166104:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000007a8a843/0x3234de053ca2de6 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 63 type: EXT [352256->356351] (req 352256->356351) gid 0 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4453d9 expref: 76 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.609410:0:166104:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000007a8a843/0x3234de053ca2de6 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 63 type: EXT [352256->356351] (req 352256->356351) gid 0 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4453d9 expref: 76 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.609416:0:166104:0:(ldlm_lockd.c:1067:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000007a8a843/0x3234de053ca2de6 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 63 type: EXT [352256->356351] (req 352256->356351) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4453d9 expref: 76 pid: 166112 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531956.609420:0:166104:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000412cebd2 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:166104:1731745997351552:10.240.43.64@tcp:105:
00000100:00100000:0.0:1651531956.609428:0:166104:0:(client.c:2492:ptlrpc_set_wait()) set 000000000073caa3 going to sleep for 6 seconds
00000100:00100000:0.0:1651531956.609640:0:166104:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000412cebd2 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:166104:1731745997351552:10.240.43.64@tcp:105:
00010000:00010000:0.0:1651531956.609644:0:166104:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651531956.609653:0:166104:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b67ad021 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+76:438146:x1731754467335424:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 269us (321us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531956.609656:0:166104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 146
00000100:00100000:1.0:1651531956.609975:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531956.609982:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467335680
00002000:00100000:1.0:1651531956.609989:0:216323:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x100010000:0x34545:0x0] (1032192->1040383)  req@000000005dd15341 x1731754467335680/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:417/0 lens 488/0 e 0 to 0 dl 1651531962 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:1.0:1651531956.609992:0:216323:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000005dd15341 with x1731754467335680 ext(1032192->1040383)
00002000:00010000:1.0:1651531956.609993:0:216323:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000005dd15341
00000100:00100000:1.0:1651531956.610003:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249686
00000100:00100000:1.0:1651531956.610005:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005dd15341 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+76:438147:x1731754467335680:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651531956.610033:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005dd15341 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+76:438147:x1731754467335680:12345-10.240.43.64@tcp:3:fio.0 Request processed in 27us (59us total) trans 0 rc 8192/8192
00000100:00100000:1.0:1651531956.610036:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249686
00002000:00100000:1.0:1651531956.610038:0:216323:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x100010000:0x34545:0x0] (1032192->1040383)  req@000000005dd15341 x1731754467335680/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:417/0 lens 488/8632 e 0 to 0 dl 1651531962 ref 1 fl Complete:/0/0 rc 8192/8192 job:'fio.0'
00002000:00100000:1.0:1651531956.610042:0:216323:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000005dd15341 with x1731754467335680 ext(1032192->1040383)
00002000:00010000:1.0:1651531956.610043:0:216323:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000005dd15341
00000100:00100000:1.0:1651531956.612937:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531956.612954:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467336320
00000100:00100000:0.0:1651531956.612963:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44407
00000100:00100000:0.0:1651531956.612964:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007a05c3e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+76:680972:x1731754467336320:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531956.612968:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531956.612971:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f253fba8/0x3234de053ca2ded lrc: 2/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 63 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4453f5 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.612977:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531956.612978:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531956.612980:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f253fba8/0x3234de053ca2ded lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 63 type: EXT [712704->716799] (req 712704->716799) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4453f5 expref: 77 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.612988:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f253fba8/0x3234de053ca2ded lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 63 type: EXT [712704->716799] (req 712704->716799) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4453f5 expref: 77 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.612992:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f253fba8, rc 0)
00000100:00100000:0.0:1651531956.613002:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007a05c3e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+77:680972:x1731754467336320:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (66us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531956.613005:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44407
00000100:00100000:1.0:1651531956.613955:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531956.613972:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467336768
00000100:00100000:0.0:1651531956.613980:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44408
00000100:00100000:0.0:1651531956.613982:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006e255cae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+77:680972:x1731754467336768:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531956.613985:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531956.613989:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003e4793c3/0x3234de053ca2df4 lrc: 2/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 64 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4453fc expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.613994:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531956.613995:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531956.613997:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003e4793c3/0x3234de053ca2df4 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 64 type: EXT [589824->622591] (req 589824->593919) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4453fc expref: 78 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.614002:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003e4793c3/0x3234de053ca2df4 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 64 type: EXT [589824->622591] (req 589824->593919) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4453fc expref: 78 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.614005:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000003e4793c3, rc 0)
00000100:00100000:0.0:1651531956.614015:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006e255cae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+78:680972:x1731754467336768:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (60us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531956.614018:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44408
00000100:00100000:1.0:1651531956.614679:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531956.614688:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531956.614699:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467336896
00000100:00100000:0.0:1651531956.614704:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467336960
00002000:00100000:1.0:1651531956.614706:0:216323:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x100010000:0x34545:0x0] (724992->729087)  req@00000000d9e74b4c x1731754467336896/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:417/0 lens 488/0 e 0 to 0 dl 1651531962 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:1.0:1651531956.614710:0:216323:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000d9e74b4c with x1731754467336896 ext(724992->729087)
00002000:00010000:1.0:1651531956.614712:0:216323:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000d9e74b4c
00000100:00100000:0.0:1651531956.614712:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44409
00000100:00100000:0.0:1651531956.614714:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000f4bed26 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+79:680972:x1731754467336960:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651531956.614720:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249687
00000100:00100000:1.0:1651531956.614722:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d9e74b4c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+79:438149:x1731754467336896:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531956.614722:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531956.614726:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000940bc691/0x3234de053ca2dfb lrc: 2/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 65 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445403 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.614732:0:166112:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000035e369e2/0x3234de053ca2be7 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 65 type: EXT [569344->573439] (req 569344->573439) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444fc6 expref: 80 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.614736:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531956.614736:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531956.614737:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000940bc691/0x3234de053ca2dfb lrc: 4/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 65 type: EXT [569344->573439] (req 569344->573439) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445403 expref: 80 pid: 166112 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531956.614745:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d9e74b4c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+80:438149:x1731754467336896:12345-10.240.43.64@tcp:3:fio.0 Request processed in 23us (67us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531956.614749:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249687
00010000:00010000:0.0:1651531956.614749:0:166112:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000035e369e2/0x3234de053ca2be7 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 65 type: EXT [569344->573439] (req 569344->573439) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444fc6 expref: 80 pid: 166112 timeout: 0 lvb_type: 0
00002000:00100000:1.0:1651531956.614751:0:216323:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x100010000:0x34545:0x0] (724992->729087)  req@00000000d9e74b4c x1731754467336896/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:417/0 lens 488/4536 e 0 to 0 dl 1651531962 ref 1 fl Complete:/0/0 rc 4096/4096 job:'fio.0'
00010000:00010000:0.0:1651531956.614753:0:166112:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000035e369e2/0x3234de053ca2be7 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 65 type: EXT [569344->573439] (req 569344->573439) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444fc6 expref: 80 pid: 166112 timeout: 22765 lvb_type: 0
00002000:00100000:1.0:1651531956.614754:0:216323:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000d9e74b4c with x1731754467336896 ext(724992->729087)
00002000:00010000:1.0:1651531956.614755:0:216323:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000d9e74b4c
00000100:00100000:0.0:1651531956.614757:0:166112:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000412cebd2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:166112:1731745997351616:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531956.614772:0:166112:0:(client.c:2492:ptlrpc_set_wait()) set 000000000073caa3 going to sleep for 6 seconds
00000100:00100000:0.0:1651531956.614997:0:166112:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000412cebd2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:166112:1731745997351616:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651531956.615002:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000940bc691/0x3234de053ca2dfb lrc: 3/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 65 type: EXT [569344->573439] (req 569344->573439) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445403 expref: 79 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.615011:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000940bc691, rc 0)
00000100:00100000:0.0:1651531956.615026:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000f4bed26 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+79:680972:x1731754467336960:12345-10.240.43.64@tcp:101:fio.0 Request processed in 311us (338us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531956.615028:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44409
00000100:00100000:1.0:1651531956.615693:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531956.615710:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467337024
00000100:00100000:0.0:1651531956.615722:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44410
00000100:00100000:0.0:1651531956.615724:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004237e3f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+79:680970:x1731754467337024:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531956.615727:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531956.615742:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca2e02 lrc: 2/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 66 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44540a expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.615768:0:166112:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009dff3fc3/0x3234de053ca2db5 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 66 type: EXT [200704->225279] (req 200704->204799) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445393 expref: 80 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.615772:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531956.615772:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531956.615773:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca2e02 lrc: 4/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 66 type: EXT [208896->212991] (req 208896->212991) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44540a expref: 80 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.615780:0:166112:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009dff3fc3/0x3234de053ca2db5 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 66 type: EXT [200704->225279] (req 200704->204799) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445393 expref: 80 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.615783:0:166112:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009dff3fc3/0x3234de053ca2db5 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 66 type: EXT [200704->225279] (req 200704->204799) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445393 expref: 80 pid: 166111 timeout: 22765 lvb_type: 0
00000100:00100000:0.0:1651531956.615787:0:166112:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000412cebd2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:166112:1731745997351680:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531956.615802:0:166112:0:(client.c:2492:ptlrpc_set_wait()) set 000000000073caa3 going to sleep for 6 seconds
00000100:00100000:1.0:1651531956.615805:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531956.615821:0:166104:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467337088
00010000:00010000:0.0:1651531956.615827:0:166104:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000035e369e2/0x3234de053ca2be7 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 66 type: EXT [569344->573439] (req 569344->573439) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444fc6 expref: 81 pid: 166112 timeout: 22765 lvb_type: 0
00000100:00100000:0.0:1651531956.615834:0:166104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 147
00000100:00100000:0.0:1651531956.615836:0:166104:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001385780a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+81:438148:x1731754467337088:12345-10.240.43.64@tcp:103:ldlm_bl_01.0
00010000:00010000:0.0:1651531956.615838:0:166104:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531956.615841:0:166104:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000035e369e2/0x3234de053ca2be7 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 67 type: EXT [569344->573439] (req 569344->573439) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444fc6 expref: 81 pid: 166112 timeout: 22765 lvb_type: 0
00010000:00010000:0.0:1651531956.615845:0:166104:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000035e369e2/0x3234de053ca2be7 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 67 type: EXT [569344->573439] (req 569344->573439) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444fc6 expref: 81 pid: 166112 timeout: 22765 lvb_type: 0
00010000:00010000:0.0:1651531956.615851:0:166104:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000035e369e2/0x3234de053ca2be7 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 67 type: EXT [569344->573439] (req 569344->573439) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444fc6 expref: 81 pid: 166112 timeout: 22765 lvb_type: 0
00010000:00010000:0.0:1651531956.615856:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531956.615856:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531956.615858:0:166104:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000940bc691/0x3234de053ca2dfb lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 66 type: EXT [569344->573439] (req 569344->573439) gid 0 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445403 expref: 80 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.615862:0:166104:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000940bc691/0x3234de053ca2dfb lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 66 type: EXT [569344->573439] (req 569344->573439) gid 0 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445403 expref: 80 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.615869:0:166104:0:(ldlm_lockd.c:1067:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000940bc691/0x3234de053ca2dfb lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 66 type: EXT [569344->573439] (req 569344->573439) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445403 expref: 80 pid: 166112 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531956.615876:0:166104:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002304cc7a pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:166104:1731745997351744:10.240.43.64@tcp:105:
00000100:00100000:0.0:1651531956.615892:0:166104:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a2b9dcac going to sleep for 6 seconds
00000100:00100000:1.0:1651531956.616086:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531956.616088:0:166112:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000412cebd2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:166112:1731745997351680:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651531956.616104:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca2e02 lrc: 3/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 66 type: EXT [208896->212991] (req 208896->212991) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44540a expref: 80 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.616109:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fb2f6575, rc 0)
00000100:00100000:0.0:1651531956.616122:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004237e3f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+80:680970:x1731754467337024:12345-10.240.43.64@tcp:101:fio.0 Request processed in 397us (429us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531956.616124:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44410
00000100:00100000:0.0:1651531956.616143:0:166102:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467337152
00010000:00010000:0.0:1651531956.616148:0:166102:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009dff3fc3/0x3234de053ca2db5 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 66 type: EXT [200704->225279] (req 200704->204799) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445393 expref: 80 pid: 166111 timeout: 22765 lvb_type: 0
00000100:00100000:0.0:1651531956.616159:0:166102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 148
00000100:00100000:0.0:1651531956.616161:0:166102:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ca77fad9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+80:438146:x1731754467337152:12345-10.240.43.64@tcp:103:ldlm_bl_05.0
00010000:00010000:0.0:1651531956.616168:0:166102:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531956.616172:0:166102:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009dff3fc3/0x3234de053ca2db5 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 67 type: EXT [200704->225279] (req 200704->204799) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445393 expref: 80 pid: 166111 timeout: 22765 lvb_type: 0
00010000:00010000:0.0:1651531956.616176:0:166102:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009dff3fc3/0x3234de053ca2db5 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 67 type: EXT [200704->225279] (req 200704->204799) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445393 expref: 80 pid: 166111 timeout: 22765 lvb_type: 0
00010000:00010000:0.0:1651531956.616182:0:166102:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009dff3fc3/0x3234de053ca2db5 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 67 type: EXT [200704->225279] (req 200704->204799) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445393 expref: 80 pid: 166111 timeout: 22765 lvb_type: 0
00010000:00010000:0.0:1651531956.616187:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531956.616188:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531956.616190:0:166102:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca2e02 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 66 type: EXT [208896->225279] (req 208896->212991) gid 0 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44540a expref: 79 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.616193:0:166102:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca2e02 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 66 type: EXT [208896->225279] (req 208896->212991) gid 0 flags: 0x40080000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44540a expref: 79 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.616200:0:166102:0:(ldlm_lockd.c:1067:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca2e02 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 66 type: EXT [208896->225279] (req 208896->212991) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44540a expref: 79 pid: 166112 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531956.616216:0:166102:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000412cebd2 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:166102:1731745997351808:10.240.43.64@tcp:105:
00000100:00100000:0.0:1651531956.616244:0:166102:0:(client.c:2492:ptlrpc_set_wait()) set 000000000073caa3 going to sleep for 6 seconds
00000100:00100000:0.0:1651531956.616252:0:166104:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002304cc7a pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:166104:1731745997351744:10.240.43.64@tcp:105:
00010000:00010000:0.0:1651531956.616255:0:166104:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651531956.616261:0:166104:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001385780a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+79:438148:x1731754467337088:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 425us (468us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531956.616264:0:166104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 147
00000100:00100000:0.0:1651531956.618182:0:166102:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000412cebd2 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:166102:1731745997351808:10.240.43.64@tcp:105:
00010000:00010000:0.0:1651531956.618186:0:166102:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651531956.618200:0:166102:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ca77fad9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+78:438146:x1731754467337152:12345-10.240.43.64@tcp:103:ldlm_bl_05.0 Request processed in 2038us (2114us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531956.618211:0:166102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 148
00000100:00100000:1.0:1651531956.619056:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531956.619065:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467337408
00002000:00100000:1.0:1651531956.619080:0:192754:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x100010000:0x34545:0x0] (991232->995327)  req@00000000ee9b8766 x1731754467337408/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:417/0 lens 488/0 e 0 to 0 dl 1651531962 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:1.0:1651531956.619084:0:192754:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000ee9b8766 with x1731754467337408 ext(991232->995327)
00002000:00010000:1.0:1651531956.619085:0:192754:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000ee9b8766
00000100:00100000:1.0:1651531956.619096:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249688
00000100:00100000:1.0:1651531956.619098:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ee9b8766 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+78:438147:x1731754467337408:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651531956.619120:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ee9b8766 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+78:438147:x1731754467337408:12345-10.240.43.64@tcp:3:fio.0 Request processed in 21us (64us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531956.619124:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249688
00002000:00100000:1.0:1651531956.619126:0:192754:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x100010000:0x34545:0x0] (991232->995327)  req@00000000ee9b8766 x1731754467337408/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:417/0 lens 488/4536 e 0 to 0 dl 1651531962 ref 1 fl Complete:/0/0 rc 4096/4096 job:'fio.0'
00002000:00100000:1.0:1651531956.619129:0:192754:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000ee9b8766 with x1731754467337408 ext(991232->995327)
00002000:00010000:1.0:1651531956.619130:0:192754:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000ee9b8766
00000100:00100000:1.0:1651531956.620314:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531956.620334:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467337664
00000100:00100000:0.0:1651531956.620342:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44411
00000100:00100000:0.0:1651531956.620345:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bc543913 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+78:680970:x1731754467337664:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531956.620348:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531956.620352:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca2e09 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 65 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445426 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.620358:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531956.620359:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531956.620361:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca2e09 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 65 type: EXT [286720->294911] (req 286720->290815) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445426 expref: 79 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.620365:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca2e09 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 65 type: EXT [286720->294911] (req 286720->290815) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445426 expref: 79 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.620369:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c1022d42, rc 0)
00000100:00100000:0.0:1651531956.620385:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bc543913 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+79:680970:x1731754467337664:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (71us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531956.620388:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44411
00000100:00100000:1.0:1651531956.620802:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531956.620809:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467337856
00002000:00100000:1.0:1651531956.620816:0:216323:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x100010000:0x34545:0x0] (286720->294911)  req@00000000df8f7846 x1731754467337856/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:417/0 lens 488/0 e 0 to 0 dl 1651531962 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:1.0:1651531956.620820:0:216323:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000df8f7846 with x1731754467337856 ext(286720->294911)
00002000:00010000:1.0:1651531956.620821:0:216323:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000df8f7846
00000100:00100000:1.0:1651531956.620826:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249689
00000100:00100000:1.0:1651531956.620828:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000df8f7846 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+79:438148:x1731754467337856:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651531956.620852:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000df8f7846 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+79:438148:x1731754467337856:12345-10.240.43.64@tcp:3:fio.0 Request processed in 24us (51us total) trans 0 rc 8192/8192
00000100:00100000:1.0:1651531956.620855:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249689
00002000:00100000:1.0:1651531956.620857:0:216323:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x100010000:0x34545:0x0] (286720->294911)  req@00000000df8f7846 x1731754467337856/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:417/0 lens 488/8632 e 0 to 0 dl 1651531962 ref 1 fl Complete:/0/0 rc 8192/8192 job:'fio.0'
00002000:00100000:1.0:1651531956.620860:0:216323:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000df8f7846 with x1731754467337856 ext(286720->294911)
00002000:00010000:1.0:1651531956.620861:0:216323:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000df8f7846
00000100:00100000:1.0:1651531956.624373:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531956.624382:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467338432
00002000:00100000:1.0:1651531956.624389:0:192754:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x100010000:0x34545:0x0] (303104->335871)  req@000000004abf7bb5 x1731754467338432/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:417/0 lens 504/0 e 0 to 0 dl 1651531962 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:1.0:1651531956.624393:0:192754:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000004abf7bb5 with x1731754467338432 ext(303104->335871)
00002000:00010000:1.0:1651531956.624394:0:192754:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000004abf7bb5
00000100:00100000:1.0:1651531956.624405:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249690
00000100:00100000:1.0:1651531956.624407:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004abf7bb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+79:438149:x1731754467338432:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651531956.624435:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531956.624465:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467338560
00002000:00100000:1.0:1651531956.624478:0:216323:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x100010000:0x34545:0x0] (720896->724991)  req@0000000005dce48d x1731754467338560/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:417/0 lens 488/0 e 0 to 0 dl 1651531962 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:1.0:1651531956.624482:0:216323:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000005dce48d with x1731754467338560 ext(720896->724991)
00002000:00010000:1.0:1651531956.624483:0:216323:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000005dce48d
00000100:00100000:1.0:1651531956.624493:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249691
00000100:00100000:1.0:1651531956.624495:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000005dce48d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+81:438147:x1731754467338560:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651531956.624518:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000005dce48d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+81:438147:x1731754467338560:12345-10.240.43.64@tcp:3:fio.0 Request processed in 22us (83us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531956.624521:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249691
00002000:00100000:1.0:1651531956.624523:0:216323:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x100010000:0x34545:0x0] (720896->724991)  req@0000000005dce48d x1731754467338560/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:417/0 lens 488/4536 e 0 to 0 dl 1651531962 ref 1 fl Complete:/0/0 rc 4096/4096 job:'fio.0'
00002000:00100000:1.0:1651531956.624526:0:216323:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000005dce48d with x1731754467338560 ext(720896->724991)
00002000:00010000:1.0:1651531956.624527:0:216323:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000005dce48d
00000100:00100000:1.0:1651531956.624696:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004abf7bb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+79:438149:x1731754467338432:12345-10.240.43.64@tcp:3:fio.0 Request processed in 288us (322us total) trans 0 rc 28672/28672
00000100:00100000:1.0:1651531956.624699:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249690
00002000:00100000:1.0:1651531956.624702:0:192754:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x100010000:0x34545:0x0] (303104->335871)  req@000000004abf7bb5 x1731754467338432/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:417/0 lens 504/440 e 0 to 0 dl 1651531962 ref 1 fl Complete:/0/0 rc 28672/28672 job:'fio.0'
00002000:00100000:1.0:1651531956.624706:0:192754:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000004abf7bb5 with x1731754467338432 ext(303104->335871)
00002000:00010000:1.0:1651531956.624708:0:192754:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000004abf7bb5
00000100:00100000:0.0:1651531956.625611:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531956.625633:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467338816
00002000:00100000:1.0:1651531956.625640:0:192754:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x100010000:0x34545:0x0] (32768->49151)  req@000000006985bc0d x1731754467338816/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:417/0 lens 504/0 e 0 to 0 dl 1651531962 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:1.0:1651531956.625643:0:192754:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000006985bc0d with x1731754467338816 ext(32768->49151)
00002000:00010000:1.0:1651531956.625647:0:192754:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000006985bc0d
00000100:00100000:1.0:1651531956.625653:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249692
00000100:00100000:1.0:1651531956.625654:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006985bc0d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+79:438149:x1731754467338816:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651531956.625898:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006985bc0d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+79:438149:x1731754467338816:12345-10.240.43.64@tcp:3:fio.0 Request processed in 243us (288us total) trans 0 rc 12288/12288
00000100:00100000:1.0:1651531956.625902:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249692
00002000:00100000:1.0:1651531956.625904:0:192754:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x100010000:0x34545:0x0] (32768->49151)  req@000000006985bc0d x1731754467338816/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:417/0 lens 504/440 e 0 to 0 dl 1651531962 ref 1 fl Complete:/0/0 rc 12288/12288 job:'fio.0'
00002000:00100000:1.0:1651531956.625908:0:192754:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000006985bc0d with x1731754467338816 ext(32768->49151)
00002000:00010000:1.0:1651531956.625910:0:192754:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000006985bc0d
00000100:00100000:0.0:1651531956.628104:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531956.628126:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467339136
00002000:00100000:1.0:1651531956.628133:0:192754:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x100010000:0x34545:0x0] (364544->372735)  req@00000000412cebd2 x1731754467339136/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:417/0 lens 488/0 e 0 to 0 dl 1651531962 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:1.0:1651531956.628137:0:192754:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000412cebd2 with x1731754467339136 ext(364544->372735)
00002000:00010000:1.0:1651531956.628138:0:192754:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000412cebd2
00000100:00100000:1.0:1651531956.628143:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249693
00000100:00100000:1.0:1651531956.628145:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000412cebd2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+79:438148:x1731754467339136:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651531956.628170:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000412cebd2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+79:438148:x1731754467339136:12345-10.240.43.64@tcp:3:fio.0 Request processed in 24us (66us total) trans 0 rc 8192/8192
00000100:00100000:1.0:1651531956.628173:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249693
00002000:00100000:1.0:1651531956.628174:0:192754:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x100010000:0x34545:0x0] (364544->372735)  req@00000000412cebd2 x1731754467339136/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:417/0 lens 488/8632 e 0 to 0 dl 1651531962 ref 1 fl Complete:/0/0 rc 8192/8192 job:'fio.0'
00002000:00100000:1.0:1651531956.628178:0:192754:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000412cebd2 with x1731754467339136 ext(364544->372735)
00002000:00010000:1.0:1651531956.628179:0:192754:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000412cebd2
00000100:00100000:0.0:1651531956.628400:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531956.628409:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467339200
00000100:00100000:0.0:1651531956.628416:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44412
00000100:00100000:0.0:1651531956.628418:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002304cc7a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+79:680972:x1731754467339200:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531956.628421:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531956.628425:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca2e10 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 66 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44545e expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.628431:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531956.628433:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531956.628435:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca2e10 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 66 type: EXT [16384->24575] (req 16384->20479) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44545e expref: 80 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.628439:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca2e10 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 66 type: EXT [16384->24575] (req 16384->20479) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44545e expref: 80 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.628443:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002c5e01dd, rc 0)
00000100:00100000:0.0:1651531956.628458:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002304cc7a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+80:680972:x1731754467339200:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (58us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531956.628460:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44412
00000100:00100000:0.0:1651531956.628750:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531956.628771:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467339328
00002000:00100000:1.0:1651531956.628778:0:216323:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x100010000:0x34545:0x0] (16384->24575)  req@0000000084bebe36 x1731754467339328/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:417/0 lens 488/0 e 0 to 0 dl 1651531962 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:1.0:1651531956.628782:0:216323:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000084bebe36 with x1731754467339328 ext(16384->24575)
00002000:00010000:1.0:1651531956.628783:0:216323:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000084bebe36
00000100:00100000:1.0:1651531956.628789:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249694
00000100:00100000:1.0:1651531956.628790:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000084bebe36 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+80:438147:x1731754467339328:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651531956.628814:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000084bebe36 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+80:438147:x1731754467339328:12345-10.240.43.64@tcp:3:fio.0 Request processed in 23us (65us total) trans 0 rc 8192/8192
00000100:00100000:1.0:1651531956.628817:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249694
00002000:00100000:1.0:1651531956.628819:0:216323:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x100010000:0x34545:0x0] (16384->24575)  req@0000000084bebe36 x1731754467339328/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:417/0 lens 488/8632 e 0 to 0 dl 1651531962 ref 1 fl Complete:/0/0 rc 8192/8192 job:'fio.0'
00002000:00100000:1.0:1651531956.628822:0:216323:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000084bebe36 with x1731754467339328 ext(16384->24575)
00002000:00010000:1.0:1651531956.628823:0:216323:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000084bebe36
00000100:00100000:0.0:1651531956.629377:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531956.629385:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467339392
00000100:00100000:0.0:1651531956.629395:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44413
00000100:00100000:0.0:1651531956.629397:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004ecd4d6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+80:680972:x1731754467339392:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531956.629400:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531956.629404:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca2e17 lrc: 2/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 67 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445465 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.629410:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531956.629411:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531956.629413:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca2e17 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 67 type: EXT [884736->892927] (req 884736->888831) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445465 expref: 81 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.629417:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca2e17 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 67 type: EXT [884736->892927] (req 884736->888831) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445465 expref: 81 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.629421:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f765708a, rc 0)
00000100:00100000:0.0:1651531956.629436:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004ecd4d6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+81:680972:x1731754467339392:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (60us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531956.629439:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44413
00000100:00100000:0.0:1651531956.631049:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531956.631071:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467340032
00002000:00100000:1.0:1651531956.631077:0:192754:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x100010000:0x34545:0x0] (888832->892927)  req@00000000a0f47a3d x1731754467340032/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:417/0 lens 488/0 e 0 to 0 dl 1651531962 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:1.0:1651531956.631085:0:192754:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000a0f47a3d with x1731754467340032 ext(888832->892927)
00002000:00010000:1.0:1651531956.631086:0:192754:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000a0f47a3d
00000100:00100000:1.0:1651531956.631092:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249695
00000100:00100000:1.0:1651531956.631093:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a0f47a3d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+81:438147:x1731754467340032:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651531956.631113:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a0f47a3d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+81:438147:x1731754467340032:12345-10.240.43.64@tcp:3:fio.0 Request processed in 19us (65us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531956.631116:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249695
00002000:00100000:1.0:1651531956.631117:0:192754:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x100010000:0x34545:0x0] (888832->892927)  req@00000000a0f47a3d x1731754467340032/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:417/0 lens 488/4536 e 0 to 0 dl 1651531962 ref 1 fl Complete:/0/0 rc 4096/4096 job:'fio.0'
00002000:00100000:1.0:1651531956.631120:0:192754:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000a0f47a3d with x1731754467340032 ext(888832->892927)
00002000:00010000:1.0:1651531956.631121:0:192754:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000a0f47a3d
00000100:00100000:0.0:1651531956.631476:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531956.631499:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467340160
00002000:00100000:1.0:1651531956.631505:0:216323:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x100010000:0x34545:0x0] (610304->618495)  req@000000008324a274 x1731754467340160/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:417/0 lens 488/0 e 0 to 0 dl 1651531962 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:1.0:1651531956.631509:0:216323:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000008324a274 with x1731754467340160 ext(610304->618495)
00002000:00010000:1.0:1651531956.631510:0:216323:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000008324a274
00000100:00100000:1.0:1651531956.631516:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249696
00000100:00100000:1.0:1651531956.631517:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008324a274 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+81:438147:x1731754467340160:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651531956.631541:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008324a274 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+81:438147:x1731754467340160:12345-10.240.43.64@tcp:3:fio.0 Request processed in 23us (65us total) trans 0 rc 8192/8192
00000100:00100000:1.0:1651531956.631543:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249696
00002000:00100000:1.0:1651531956.631545:0:216323:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x100010000:0x34545:0x0] (610304->618495)  req@000000008324a274 x1731754467340160/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:417/0 lens 488/8632 e 0 to 0 dl 1651531962 ref 1 fl Complete:/0/0 rc 8192/8192 job:'fio.0'
00002000:00100000:1.0:1651531956.631552:0:216323:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000008324a274 with x1731754467340160 ext(610304->618495)
00002000:00010000:1.0:1651531956.631553:0:216323:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000008324a274
00000100:00100000:0.0:1651531956.631867:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531956.631874:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467340224
00000100:00100000:0.0:1651531956.631886:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44414
00000100:00100000:0.0:1651531956.631887:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000150fa98b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+81:680972:x1731754467340224:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531956.631891:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531956.631894:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca2e1e lrc: 2/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 68 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44546c expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.631900:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531956.631901:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531956.631903:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca2e1e lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 68 type: EXT [151552->155647] (req 151552->155647) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44546c expref: 82 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.631908:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca2e1e lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 68 type: EXT [151552->155647] (req 151552->155647) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44546c expref: 82 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.631911:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f5657138, rc 0)
00000100:00100000:0.0:1651531956.631933:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000150fa98b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+82:680972:x1731754467340224:12345-10.240.43.64@tcp:101:fio.0 Request processed in 44us (66us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531956.631936:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44414
00000100:00100000:0.0:1651531956.633021:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531956.633028:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467340416
00000100:00100000:0.0:1651531956.633040:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44415
00000100:00100000:0.0:1651531956.633050:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b3565786 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+82:680972:x1731754467340416:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531956.633053:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531956.633057:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca2e25 lrc: 2/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 69 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445473 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.633063:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531956.633063:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531956.633066:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca2e25 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 69 type: EXT [524288->557055] (req 524288->528383) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445473 expref: 83 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.633070:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca2e25 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 69 type: EXT [524288->557055] (req 524288->528383) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445473 expref: 83 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.633074:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e2ec18e1, rc 0)
00000100:00100000:0.0:1651531956.633087:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b3565786 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+83:680972:x1731754467340416:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (67us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531956.633090:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44415
00000100:00100000:0.0:1651531956.634607:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531956.634629:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467340672
00002000:00100000:1.0:1651531956.634636:0:192754:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x100010000:0x34545:0x0] (1007616->1011711)  req@00000000f30a7a36 x1731754467340672/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:417/0 lens 488/0 e 0 to 0 dl 1651531962 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:1.0:1651531956.634639:0:192754:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000f30a7a36 with x1731754467340672 ext(1007616->1011711)
00002000:00010000:1.0:1651531956.634640:0:192754:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000f30a7a36
00000100:00100000:1.0:1651531956.634645:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249697
00000100:00100000:1.0:1651531956.634647:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f30a7a36 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+83:438147:x1731754467340672:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651531956.634667:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f30a7a36 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+83:438147:x1731754467340672:12345-10.240.43.64@tcp:3:fio.0 Request processed in 19us (60us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531956.634669:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249697
00002000:00100000:1.0:1651531956.634671:0:192754:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x100010000:0x34545:0x0] (1007616->1011711)  req@00000000f30a7a36 x1731754467340672/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:417/0 lens 488/4536 e 0 to 0 dl 1651531962 ref 1 fl Complete:/0/0 rc 4096/4096 job:'fio.0'
00002000:00100000:1.0:1651531956.634674:0:192754:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000f30a7a36 with x1731754467340672 ext(1007616->1011711)
00002000:00010000:1.0:1651531956.634675:0:192754:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000f30a7a36
00000001:00080000:0.0:1651531956.636054:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869078 is committed
00010000:00010000:1.0:1651531956.636086:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca2d6f lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 69 type: EXT [651264->655359] (req 651264->655359) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531956.636091:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca2d6f lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 70 type: EXT [651264->655359] (req 651264->655359) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.636097:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca2d3e lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 69 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.636101:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca2d3e lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 69 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531956.636106:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005e4b6deb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+72:438148:x1731754467329600:12345-10.240.43.64@tcp:4:fio.0 Request processed in 48739us (48762us total) trans 21474869075 rc 0/0
00000100:00100000:1.0:1651531956.636111:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249674
00000100:00100000:0.0:1651531956.636116:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f8a13c4e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+71:438147:x1731754467326208:12345-10.240.43.64@tcp:4:fio.0 Request processed in 762939us (763011us total) trans 21474869077 rc 0/0
00000100:00100000:0.0:1651531956.636119:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249669
00010000:00010000:1.0:1651531956.636122:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca2d68 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 69 type: EXT [622592->626687] (req 622592->626687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531956.636125:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca2d68 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 69 type: EXT [622592->626687] (req 622592->626687) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531956.636140:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c4db449c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+70:438147:x1731754467329280:12345-10.240.43.64@tcp:4:fio.0 Request processed in 67630us (67670us total) trans 21474869076 rc 0/0
00000100:00100000:1.0:1651531956.636142:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249673
00010000:00010000:0.0:1651531956.636143:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca2d6f lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 69 type: EXT [651264->655359] (req 651264->655359) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.636146:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006da7a892 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531956.636147:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca2d6f lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 69 type: EXT [651264->655359] (req 651264->655359) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.636151:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca2d6f lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 69 type: EXT [651264->655359] (req 651264->655359) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531956.636153:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca2d76 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 70 type: EXT [1019904->1023999] (req 1019904->1023999) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531956.636156:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca2d76 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 69 type: EXT [1019904->1023999] (req 1019904->1023999) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.636162:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca2d6f lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 69 type: EXT [651264->655359] (req 651264->655359) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531956.636164:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000416f774b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+69:438148:x1731754467329984:12345-10.240.43.64@tcp:4:fio.0 Request processed in 47661us (47699us total) trans 21474869078 rc 0/0
00010000:00010000:0.0:1651531956.636165:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca2d6f lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 69 type: EXT [651264->655359] (req 651264->655359) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531956.636167:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249675
00010000:00010000:0.0:1651531956.636169:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca2d3e lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 68 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531956.636172:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca2d68 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 69 type: EXT [622592->626687] (req 622592->626687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.636172:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c2b76533 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531956.636173:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca2d3e lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 69 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531956.636175:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000968553c1 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531956.636175:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca2d3e lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 68 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531956.636176:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca2d68 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 69 type: EXT [622592->626687] (req 622592->626687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531956.636179:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca2d68 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 69 type: EXT [622592->626687] (req 622592->626687) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.636179:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca2d3e lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 69 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.636182:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca2d3e lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 69 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531956.636186:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca2d68 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 69 type: EXT [622592->626687] (req 622592->626687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531956.636189:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca2d68 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 69 type: EXT [622592->626687] (req 622592->626687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.636191:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca2d76 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 68 type: EXT [1019904->1023999] (req 1019904->1023999) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.636194:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001e36c601 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531956.636195:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca2d76 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 66 type: EXT [1019904->1023999] (req 1019904->1023999) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.636198:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca2d76 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 66 type: EXT [1019904->1023999] (req 1019904->1023999) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.636209:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca2d76 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 66 type: EXT [1019904->1023999] (req 1019904->1023999) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.636211:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca2d76 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 66 type: EXT [1019904->1023999] (req 1019904->1023999) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531956.636272:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531956.636296:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467340864
00000100:00100000:0.0:1651531956.636306:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44416
00000100:00100000:0.0:1651531956.636308:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e8b66db1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+69:680972:x1731754467340864:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531956.636311:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531956.636315:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca2e2c lrc: 2/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 66 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445481 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.636321:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531956.636322:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531956.636324:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca2e2c lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 66 type: EXT [8192->16383] (req 8192->12287) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445481 expref: 70 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.636354:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca2e2c lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 66 type: EXT [8192->16383] (req 8192->12287) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445481 expref: 70 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.636358:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000775318ab, rc 0)
00000100:00100000:0.0:1651531956.636369:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e8b66db1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+70:680972:x1731754467340864:12345-10.240.43.64@tcp:101:fio.0 Request processed in 60us (97us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531956.636372:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44416
00000100:00100000:1.0:1651531956.636694:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531956.636701:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467341056
00000100:00100000:1.0:1651531956.636710:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249698
00000100:00100000:1.0:1651531956.636712:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f7fd28e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+70:438146:x1731754467341056:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531956.636719:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2e33 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 67 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531956.636724:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531956.636725:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531956.636726:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2e33 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 67 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531956.636730:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2e33 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 67 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531956.636740:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2e33 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 67 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531956.636744:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2e33 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 67 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531956.636769:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f7fd28e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+70:438146:x1731754467341056:12345-10.240.43.64@tcp:3:fio.0 Request processed in 56us (76us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531956.636772:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249698
00010000:00010000:1.0:1651531956.636780:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2e33 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 67 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531956.636784:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a8889a80 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531956.636785:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2e33 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 67 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531956.636788:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2e33 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 67 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531956.636792:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2e33 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 67 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531956.636795:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2e33 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 67 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531956.638750:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531956.638759:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467341568
00002000:00100000:1.0:1651531956.638765:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x34545:0x0] (163840->172031)  req@000000003c394037 x1731754467341568/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:417/0 lens 488/0 e 0 to 0 dl 1651531962 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:1.0:1651531956.638769:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000003c394037 with x1731754467341568 ext(163840->172031)
00002000:00010000:1.0:1651531956.638770:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000003c394037
00000100:00100000:1.0:1651531956.638775:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249699
00000100:00100000:1.0:1651531956.638778:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003c394037 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+70:438146:x1731754467341568:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651531956.638809:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003c394037 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+70:438146:x1731754467341568:12345-10.240.43.64@tcp:3:fio.0 Request processed in 30us (59us total) trans 0 rc 8192/8192
00000100:00100000:1.0:1651531956.638812:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249699
00002000:00100000:1.0:1651531956.638814:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x34545:0x0] (163840->172031)  req@000000003c394037 x1731754467341568/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:417/0 lens 488/8632 e 0 to 0 dl 1651531962 ref 1 fl Complete:/0/0 rc 8192/8192 job:'fio.0'
00002000:00100000:1.0:1651531956.638818:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000003c394037 with x1731754467341568 ext(163840->172031)
00002000:00010000:1.0:1651531956.638819:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000003c394037
00000100:00100000:1.0:1651531956.836157:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531956.836166:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467347328
00002000:00100000:1.0:1651531956.836174:0:192755:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x100010000:0x34545:0x0] (8192->1032191)  req@0000000044bf4099 x1731754467347328/t0(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:417/0 lens 1192/0 e 0 to 0 dl 1651531962 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:1.0:1651531956.836177:0:192755:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000044bf4099 with x1731754467347328 ext(8192->1032191)
00002000:00010000:1.0:1651531956.836183:0:192755:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000044bf4099
00000100:00100000:1.0:1651531956.836188:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249700
00000100:00100000:1.0:1651531956.836190:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000044bf4099 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+70:438148:x1731754467347328:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651531956.837666:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000044bf4099 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+72:438148:x1731754467347328:12345-10.240.43.64@tcp:4:fio.0 Request processed in 1474us (1509us total) trans 21474869079 rc 0/0
00000100:00100000:1.0:1651531956.837670:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249700
00002000:00100000:1.0:1651531956.837672:0:192755:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x100010000:0x34545:0x0] (8192->1032191)  req@0000000044bf4099 x1731754467347328/t21474869079(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:417/0 lens 1192/624 e 0 to 0 dl 1651531962 ref 1 fl Complete:/0/0 rc 0/0 job:'fio.0'
00002000:00100000:1.0:1651531956.837676:0:192755:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000044bf4099 with x1731754467347328 ext(8192->1032191)
00002000:00010000:1.0:1651531956.837681:0:192755:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000044bf4099
00000100:00100000:0.0:1651531956.838054:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531956.838062:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467347776
00000100:00100000:0.0:1651531956.838076:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44417
00000100:00100000:0.0:1651531956.838077:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000053c65c94 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+72:680972:x1731754467347776:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531956.838081:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531956.838085:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca2e3a lrc: 2/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 67 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4454a4 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.838091:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531956.838092:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531956.838094:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca2e3a lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 67 type: EXT [184320->208895] (req 184320->188415) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4454a4 expref: 73 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.838099:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca2e3a lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 67 type: EXT [184320->208895] (req 184320->188415) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4454a4 expref: 73 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.838102:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000075a78972, rc 0)
00000100:00100000:0.0:1651531956.838116:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000053c65c94 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+73:680972:x1731754467347776:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (63us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531956.838122:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44417
00000100:00100000:0.0:1651531956.838169:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531956.838190:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467347904
00000100:00100000:1.0:1651531956.838212:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249701
00000100:00100000:1.0:1651531956.838214:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004a3fd269 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+73:438146:x1731754467347904:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531956.838235:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2e41 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 68 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531956.838241:0:192755:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca2b54 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 68 type: EXT [69632->102399] (req 69632->73727) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444e3e expref: 73 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531956.838245:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531956.838246:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531956.838247:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2e41 lrc: 4/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 68 type: EXT [86016->90111] (req 86016->90111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531956.838255:0:192755:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca2b54 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 68 type: EXT [69632->102399] (req 69632->73727) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444e3e expref: 73 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531956.838259:0:192755:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca2b54 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 68 type: EXT [69632->102399] (req 69632->73727) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444e3e expref: 73 pid: 166111 timeout: 22765 lvb_type: 0
00000100:00100000:1.0:1651531956.838263:0:192755:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000df3a50db pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0001_UUID:192755:1731745997351872:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531956.838276:0:192755:0:(client.c:2492:ptlrpc_set_wait()) set 000000002ddea5d6 going to sleep for 6 seconds
00000100:00100000:1.0:1651531956.838475:0:192755:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000df3a50db pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0001_UUID:192755:1731745997351872:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651531956.838480:0:192755:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2e41 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 68 type: EXT [86016->90111] (req 86016->90111) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531956.838593:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531956.838608:0:166102:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467347968
00010000:00010000:0.0:1651531956.838614:0:166102:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca2b54 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 68 type: EXT [69632->102399] (req 69632->73727) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444e3e expref: 74 pid: 166111 timeout: 22765 lvb_type: 0
00000100:00100000:0.0:1651531956.838623:0:166102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 149
00000100:00100000:0.0:1651531956.838624:0:166102:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000df3a50db pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+74:438146:x1731754467347968:12345-10.240.43.64@tcp:103:ldlm_bl_06.0
00010000:00010000:0.0:1651531956.838627:0:166102:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00002000:00010000:0.0:1651531956.838631:0:166102:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x34545:0x0] updating lvb atime from disk: 1651531955 -> 1651531956
00010000:00010000:0.0:1651531956.838633:0:166102:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca2b54 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 69 type: EXT [69632->102399] (req 69632->73727) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444e3e expref: 74 pid: 166111 timeout: 22765 lvb_type: 0
00010000:00010000:0.0:1651531956.838637:0:166102:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca2b54 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 69 type: EXT [69632->102399] (req 69632->73727) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444e3e expref: 74 pid: 166111 timeout: 22765 lvb_type: 0
00010000:00010000:0.0:1651531956.838643:0:166102:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca2b54 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 69 type: EXT [69632->102399] (req 69632->73727) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444e3e expref: 74 pid: 166111 timeout: 22765 lvb_type: 0
00010000:00010000:0.0:1651531956.838647:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531956.838648:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531956.838649:0:166102:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2e41 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 68 type: EXT [86016->90111] (req 86016->90111) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.838652:0:166102:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2e41 lrc: 4/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 68 type: EXT [86016->90111] (req 86016->90111) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.838661:0:166102:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1651531956.838667:0:192755:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2e41 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 67 type: EXT [86016->90111] (req 86016->90111) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531956.838672:0:166102:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000df3a50db pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+73:438146:x1731754467347968:12345-10.240.43.64@tcp:103:ldlm_bl_06.0 Request processed in 47us (80us total) trans 0 rc 0/0
00010000:00010000:1.0:1651531956.838675:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2e41 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 67 type: EXT [86016->90111] (req 86016->90111) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531956.838675:0:166102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 149
00010000:00010000:1.0:1651531956.838689:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2e41 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 67 type: EXT [86016->90111] (req 86016->90111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531956.838692:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2e41 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 67 type: EXT [86016->90111] (req 86016->90111) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.838709:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2e41 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 67 type: EXT [86016->90111] (req 86016->90111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.838713:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a8889a80 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531956.838714:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2e41 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 67 type: EXT [86016->90111] (req 86016->90111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.838717:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2e41 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 67 type: EXT [86016->90111] (req 86016->90111) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531956.838718:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004a3fd269 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+72:438146:x1731754467347904:12345-10.240.43.64@tcp:3:fio.0 Request processed in 503us (549us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531956.838721:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249701
00010000:00010000:0.0:1651531956.838722:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2e41 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 67 type: EXT [86016->90111] (req 86016->90111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.838725:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2e41 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 67 type: EXT [86016->90111] (req 86016->90111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531956.838982:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531956.838996:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531956.839006:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467348096
00000100:00100000:0.0:1651531956.839006:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467348160
00002000:00100000:1.0:1651531956.839013:0:192755:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x100010000:0x34545:0x0] (196608->208895)  req@000000009565b19c x1731754467348096/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:417/0 lens 488/0 e 0 to 0 dl 1651531962 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:1.0:1651531956.839017:0:192755:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000009565b19c with x1731754467348096 ext(196608->208895)
00000100:00100000:0.0:1651531956.839017:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249702
00002000:00010000:1.0:1651531956.839018:0:192755:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000009565b19c
00000100:00100000:0.0:1651531956.839019:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009c9c67cc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+73:438149:x1731754467348160:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651531956.839024:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249703
00000100:00100000:1.0:1651531956.839026:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009565b19c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+73:438149:x1731754467348096:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531956.839026:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca2e48 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 67 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.839030:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531956.839031:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531956.839034:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca2e48 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 67 type: EXT [897024->901119] (req 897024->901119) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.839037:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca2e48 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 67 type: EXT [897024->901119] (req 897024->901119) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.839050:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca2e48 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 67 type: EXT [897024->901119] (req 897024->901119) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531956.839052:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009565b19c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+73:438149:x1731754467348096:12345-10.240.43.64@tcp:3:fio.0 Request processed in 25us (71us total) trans 0 rc 12288/12288
00010000:00010000:0.0:1651531956.839053:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca2e48 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 67 type: EXT [897024->901119] (req 897024->901119) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531956.839055:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249703
00002000:00100000:1.0:1651531956.839057:0:192755:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x100010000:0x34545:0x0] (196608->208895)  req@000000009565b19c x1731754467348096/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:417/0 lens 488/12728 e 0 to 0 dl 1651531962 ref 1 fl Complete:/0/0 rc 12288/12288 job:'fio.0'
00002000:00100000:1.0:1651531956.839064:0:192755:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000009565b19c with x1731754467348096 ext(196608->208895)
00002000:00010000:1.0:1651531956.839065:0:192755:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000009565b19c
00000100:00100000:0.0:1651531956.839066:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009c9c67cc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+73:438149:x1731754467348160:12345-10.240.43.64@tcp:3:fio.0 Request processed in 47us (69us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531956.839069:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249702
00010000:00010000:0.0:1651531956.839076:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca2e48 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 67 type: EXT [897024->901119] (req 897024->901119) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.839079:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f968d777 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531956.839080:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca2e48 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 67 type: EXT [897024->901119] (req 897024->901119) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.839083:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca2e48 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 67 type: EXT [897024->901119] (req 897024->901119) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.839088:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca2e48 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 67 type: EXT [897024->901119] (req 897024->901119) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.839090:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca2e48 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 67 type: EXT [897024->901119] (req 897024->901119) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531956.840724:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531956.840733:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467348672
00002000:00100000:0.0:1651531956.840740:0:192753:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x100010000:0x34545:0x0] (212992->225279)  req@00000000a6b3689b x1731754467348672/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:417/0 lens 488/0 e 0 to 0 dl 1651531962 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:0.0:1651531956.840744:0:192753:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000a6b3689b with x1731754467348672 ext(212992->225279)
00002000:00010000:0.0:1651531956.840746:0:192753:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000a6b3689b
00000100:00100000:0.0:1651531956.840751:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249704
00000100:00100000:0.0:1651531956.840753:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a6b3689b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+72:438149:x1731754467348672:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651531956.840784:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a6b3689b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+72:438149:x1731754467348672:12345-10.240.43.64@tcp:3:fio.0 Request processed in 30us (60us total) trans 0 rc 12288/12288
00000100:00100000:0.0:1651531956.840787:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249704
00002000:00100000:0.0:1651531956.840789:0:192753:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x100010000:0x34545:0x0] (212992->225279)  req@00000000a6b3689b x1731754467348672/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:417/0 lens 488/12728 e 0 to 0 dl 1651531962 ref 1 fl Complete:/0/0 rc 12288/12288 job:'fio.0'
00002000:00100000:0.0:1651531956.840793:0:192753:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000a6b3689b with x1731754467348672 ext(212992->225279)
00002000:00010000:0.0:1651531956.840794:0:192753:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000a6b3689b
00000100:00100000:0.0:1651531956.842635:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531956.842642:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467348992
00002000:00100000:0.0:1651531956.842648:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x34545:0x0] (528384->557055)  req@0000000096080ff0 x1731754467348992/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:417/0 lens 488/0 e 0 to 0 dl 1651531962 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:0.0:1651531956.842652:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000096080ff0 with x1731754467348992 ext(528384->557055)
00002000:00010000:0.0:1651531956.842653:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000096080ff0
00000100:00100000:0.0:1651531956.842658:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249705
00000100:00100000:0.0:1651531956.842659:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000096080ff0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+72:438149:x1731754467348992:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651531956.842879:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000096080ff0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+72:438149:x1731754467348992:12345-10.240.43.64@tcp:3:fio.0 Request processed in 219us (245us total) trans 0 rc 28672/28672
00000100:00100000:0.0:1651531956.842883:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249705
00002000:00100000:0.0:1651531956.842885:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x34545:0x0] (528384->557055)  req@0000000096080ff0 x1731754467348992/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:417/0 lens 488/440 e 0 to 0 dl 1651531962 ref 1 fl Complete:/0/0 rc 28672/28672 job:'fio.0'
00002000:00100000:0.0:1651531956.842889:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000096080ff0 with x1731754467348992 ext(528384->557055)
00002000:00010000:0.0:1651531956.842890:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000096080ff0
00000100:00100000:0.0:1651531956.844113:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531956.844120:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467349184
00000100:00100000:0.0:1651531956.844134:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44418
00000100:00100000:0.0:1651531956.844136:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b67ad021 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+72:680972:x1731754467349184:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531956.844139:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531956.844143:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca2e4f lrc: 2/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 67 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4454b9 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.844149:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531956.844150:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531956.844152:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca2e4f lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 67 type: EXT [585728->589823] (req 585728->589823) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4454b9 expref: 73 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.844157:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca2e4f lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 67 type: EXT [585728->589823] (req 585728->589823) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4454b9 expref: 73 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.844160:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000014685f38, rc 0)
00000100:00100000:0.0:1651531956.844174:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b67ad021 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+73:680972:x1731754467349184:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (62us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531956.844179:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44418
00000100:00100000:0.0:1651531956.844592:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531956.844600:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467349312
00002000:00100000:0.0:1651531956.844606:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x34545:0x0] (593920->610303)  req@000000007ff31eaa x1731754467349312/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:417/0 lens 488/0 e 0 to 0 dl 1651531962 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:0.0:1651531956.844610:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000007ff31eaa with x1731754467349312 ext(593920->610303)
00002000:00010000:0.0:1651531956.844611:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000007ff31eaa
00000100:00100000:0.0:1651531956.844616:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249706
00000100:00100000:0.0:1651531956.844618:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007ff31eaa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+73:438149:x1731754467349312:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651531956.844650:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007ff31eaa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+73:438149:x1731754467349312:12345-10.240.43.64@tcp:3:fio.0 Request processed in 31us (58us total) trans 0 rc 16384/16384
00000100:00100000:0.0:1651531956.844653:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249706
00002000:00100000:0.0:1651531956.844654:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x34545:0x0] (593920->610303)  req@000000007ff31eaa x1731754467349312/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:417/0 lens 488/16824 e 0 to 0 dl 1651531962 ref 1 fl Complete:/0/0 rc 16384/16384 job:'fio.0'
00002000:00100000:0.0:1651531956.844658:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000007ff31eaa with x1731754467349312 ext(593920->610303)
00002000:00010000:0.0:1651531956.844659:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000007ff31eaa
00000100:00100000:0.0:1651531956.846711:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531956.846719:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467349696
00002000:00100000:0.0:1651531956.846725:0:192753:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x100010000:0x34545:0x0] (954368->962559)  req@000000001345dda6 x1731754467349696/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:417/0 lens 488/0 e 0 to 0 dl 1651531962 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:0.0:1651531956.846728:0:192753:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000001345dda6 with x1731754467349696 ext(954368->962559)
00002000:00010000:0.0:1651531956.846730:0:192753:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000001345dda6
00000100:00100000:0.0:1651531956.846735:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249707
00000100:00100000:0.0:1651531956.846736:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001345dda6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+73:438148:x1731754467349696:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651531956.846766:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001345dda6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+73:438148:x1731754467349696:12345-10.240.43.64@tcp:3:fio.0 Request processed in 29us (56us total) trans 0 rc 8192/8192
00000100:00100000:0.0:1651531956.846769:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249707
00002000:00100000:0.0:1651531956.846771:0:192753:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x100010000:0x34545:0x0] (954368->962559)  req@000000001345dda6 x1731754467349696/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:417/0 lens 488/8632 e 0 to 0 dl 1651531962 ref 1 fl Complete:/0/0 rc 8192/8192 job:'fio.0'
00002000:00100000:0.0:1651531956.846775:0:192753:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000001345dda6 with x1731754467349696 ext(954368->962559)
00002000:00010000:0.0:1651531956.846776:0:192753:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000001345dda6
00000100:00100000:0.0:1651531956.847722:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531956.847729:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467349888
00000100:00100000:0.0:1651531956.847741:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44419
00000100:00100000:0.0:1651531956.847743:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e206d444 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+73:680972:x1731754467349888:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531956.847746:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531956.847750:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca2e56 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 68 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4454c0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.847756:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531956.847757:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531956.847759:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca2e56 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 68 type: EXT [999424->1003519] (req 999424->1003519) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4454c0 expref: 74 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.847763:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca2e56 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 68 type: EXT [999424->1003519] (req 999424->1003519) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4454c0 expref: 74 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.847767:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f968d777, rc 0)
00000100:00100000:0.0:1651531956.847780:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e206d444 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+74:680972:x1731754467349888:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (59us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531956.847786:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44419
00000100:00100000:0.0:1651531956.848083:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531956.848091:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467350016
00002000:00100000:0.0:1651531956.848098:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x34545:0x0] (999424->1003519)  req@0000000098bec39b x1731754467350016/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:417/0 lens 488/0 e 0 to 0 dl 1651531962 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:0.0:1651531956.848101:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000098bec39b with x1731754467350016 ext(999424->1003519)
00002000:00010000:0.0:1651531956.848102:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000098bec39b
00000100:00100000:0.0:1651531956.848107:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249708
00000100:00100000:0.0:1651531956.848109:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000098bec39b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+74:438148:x1731754467350016:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651531956.848136:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000098bec39b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+74:438148:x1731754467350016:12345-10.240.43.64@tcp:3:fio.0 Request processed in 26us (53us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531956.848139:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249708
00002000:00100000:0.0:1651531956.848141:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x34545:0x0] (999424->1003519)  req@0000000098bec39b x1731754467350016/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:417/0 lens 488/4536 e 0 to 0 dl 1651531962 ref 1 fl Complete:/0/0 rc 4096/4096 job:'fio.0'
00002000:00100000:0.0:1651531956.848144:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000098bec39b with x1731754467350016 ext(999424->1003519)
00002000:00010000:0.0:1651531956.848145:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000098bec39b
00000100:00100000:0.0:1651531956.850255:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531956.850263:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467350400
00000100:00100000:0.0:1651531956.850275:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44420
00000100:00100000:0.0:1651531956.850277:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000b25168e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+74:680972:x1731754467350400:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531956.850280:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531956.850284:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca2e5d lrc: 2/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 69 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4454d5 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.850294:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531956.850295:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531956.850297:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca2e5d lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 69 type: EXT [1019904->1028095] (req 1019904->1023999) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4454d5 expref: 75 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.850301:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca2e5d lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 69 type: EXT [1019904->1028095] (req 1019904->1023999) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4454d5 expref: 75 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.850305:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000080362f27, rc 0)
00000100:00100000:0.0:1651531956.850319:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000b25168e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+75:680972:x1731754467350400:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (64us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531956.850321:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44420
00000100:00100000:0.0:1651531956.883939:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531956.883948:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467351488
00000100:00100000:0.0:1651531956.883958:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249709
00000100:00100000:0.0:1651531956.883960:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000017a53f9a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+75:438149:x1731754467351488:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531956.883967:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2e64 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 70 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.883972:0:192753:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca2e09 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 70 type: EXT [286720->294911] (req 286720->290815) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445426 expref: 75 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.883975:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531956.883976:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531956.883977:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2e64 lrc: 4/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 70 type: EXT [286720->290815] (req 286720->290815) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.883987:0:192753:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca2e09 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 70 type: EXT [286720->294911] (req 286720->290815) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445426 expref: 75 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.883991:0:192753:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca2e09 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 70 type: EXT [286720->294911] (req 286720->290815) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445426 expref: 75 pid: 166112 timeout: 22765 lvb_type: 0
00000100:00100000:0.0:1651531956.883996:0:192753:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000036404f05 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:192753:1731745997351936:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531956.884012:0:192753:0:(client.c:2492:ptlrpc_set_wait()) set 000000000073caa3 going to sleep for 6 seconds
00000100:00100000:0.0:1651531956.884285:0:192753:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000036404f05 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:192753:1731745997351936:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651531956.884290:0:192753:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2e64 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 70 type: EXT [286720->290815] (req 286720->290815) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531956.884427:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531956.884451:0:166104:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467351552
00010000:00010000:0.0:1651531956.884457:0:166104:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca2e09 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 70 type: EXT [286720->294911] (req 286720->290815) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445426 expref: 76 pid: 166112 timeout: 22765 lvb_type: 0
00000100:00100000:0.0:1651531956.884466:0:166104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 150
00000100:00100000:0.0:1651531956.884467:0:166104:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fdf9c097 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+76:438147:x1731754467351552:12345-10.240.43.64@tcp:103:ldlm_bl_03.0
00010000:00010000:0.0:1651531956.884470:0:166104:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531956.884474:0:166104:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca2e09 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 71 type: EXT [286720->294911] (req 286720->290815) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445426 expref: 76 pid: 166112 timeout: 22765 lvb_type: 0
00010000:00010000:0.0:1651531956.884478:0:166104:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca2e09 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 71 type: EXT [286720->294911] (req 286720->290815) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445426 expref: 76 pid: 166112 timeout: 22765 lvb_type: 0
00010000:00010000:0.0:1651531956.884488:0:166104:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca2e09 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 71 type: EXT [286720->294911] (req 286720->290815) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445426 expref: 76 pid: 166112 timeout: 22765 lvb_type: 0
00010000:00010000:0.0:1651531956.884493:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531956.884493:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531956.884494:0:166104:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2e64 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 70 type: EXT [286720->290815] (req 286720->290815) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.884497:0:166104:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2e64 lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 70 type: EXT [286720->290815] (req 286720->290815) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.884504:0:166104:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651531956.884513:0:166104:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fdf9c097 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+75:438147:x1731754467351552:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 45us (87us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531956.884515:0:166104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 150
00010000:00010000:0.0:1651531956.884522:0:192753:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2e64 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 69 type: EXT [286720->290815] (req 286720->290815) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.884525:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2e64 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 69 type: EXT [286720->290815] (req 286720->290815) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531956.886863:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531956.886883:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467352192
00000100:00100000:0.0:1651531956.886899:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249710
00000100:00100000:0.0:1651531956.886901:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b9e0d216 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+77:438149:x1731754467352192:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531956.886909:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca2e6b lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 70 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.886917:0:216321:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003f7e6a6f/0x3234de053ca2bd9 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 70 type: EXT [692224->704511] (req 692224->696319) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444f95 expref: 77 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.886921:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531956.886921:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531956.886922:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca2e6b lrc: 4/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 70 type: EXT [696320->700415] (req 696320->700415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.886929:0:216321:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003f7e6a6f/0x3234de053ca2bd9 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 70 type: EXT [692224->704511] (req 692224->696319) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444f95 expref: 77 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.886933:0:216321:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003f7e6a6f/0x3234de053ca2bd9 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 70 type: EXT [692224->704511] (req 692224->696319) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444f95 expref: 77 pid: 166111 timeout: 22765 lvb_type: 0
00000100:00100000:0.0:1651531956.886937:0:216321:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000036404f05 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997352000:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531956.886950:0:216321:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f14111ff going to sleep for 6 seconds
00000100:00100000:1.0:1651531956.887237:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531956.887250:0:166102:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467352256
00010000:00010000:0.0:1651531956.887257:0:166102:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003f7e6a6f/0x3234de053ca2bd9 lrc: 5/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 70 type: EXT [692224->704511] (req 692224->696319) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444f95 expref: 78 pid: 166111 timeout: 22765 lvb_type: 0
00000100:00100000:0.0:1651531956.887265:0:166102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 151
00000100:00100000:0.0:1651531956.887267:0:166102:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d1dc0e21 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+78:438147:x1731754467352256:12345-10.240.43.64@tcp:103:ldlm_bl_02.0
00010000:00010000:0.0:1651531956.887270:0:166102:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531956.887273:0:166102:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003f7e6a6f/0x3234de053ca2bd9 lrc: 5/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 71 type: EXT [692224->704511] (req 692224->696319) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444f95 expref: 78 pid: 166111 timeout: 22765 lvb_type: 0
00010000:00010000:0.0:1651531956.887281:0:166102:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003f7e6a6f/0x3234de053ca2bd9 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 71 type: EXT [692224->704511] (req 692224->696319) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444f95 expref: 78 pid: 166111 timeout: 22765 lvb_type: 0
00010000:00010000:0.0:1651531956.887287:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531956.887288:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531956.887289:0:166102:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca2e6b lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 71 type: EXT [696320->700415] (req 696320->700415) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.887292:0:166102:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca2e6b lrc: 4/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 71 type: EXT [696320->700415] (req 696320->700415) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.887297:0:166102:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651531956.887306:0:166102:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d1dc0e21 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+78:438147:x1731754467352256:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 39us (71us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531956.887309:0:166102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 151
00010000:00010000:0.0:1651531956.887320:0:216321:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003f7e6a6f/0x3234de053ca2bd9 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 70 type: EXT [692224->704511] (req 692224->696319) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444f95 expref: 77 pid: 166111 timeout: 22765 lvb_type: 0
00000100:00100000:0.0:1651531956.887324:0:216321:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000036404f05 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997352000:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651531956.887327:0:216321:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca2e6b lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 69 type: EXT [696320->700415] (req 696320->700415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.887331:0:216321:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca2e6b lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 69 type: EXT [696320->700415] (req 696320->700415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.887334:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca2e6b lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 69 type: EXT [696320->700415] (req 696320->700415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.887350:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca2e6b lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 69 type: EXT [696320->700415] (req 696320->700415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.887353:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca2e6b lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 69 type: EXT [696320->700415] (req 696320->700415) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531956.887374:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b9e0d216 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+76:438149:x1731754467352192:12345-10.240.43.64@tcp:3:fio.0 Request processed in 472us (512us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531956.887377:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249710
00010000:00010000:1.0:1651531956.887379:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca2e6b lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 69 type: EXT [696320->700415] (req 696320->700415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531956.887385:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000820577fb already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531956.887386:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca2e6b lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 69 type: EXT [696320->700415] (req 696320->700415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531956.887389:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca2e6b lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 69 type: EXT [696320->700415] (req 696320->700415) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531956.887395:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca2e6b lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 69 type: EXT [696320->700415] (req 696320->700415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531956.887398:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca2e6b lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 69 type: EXT [696320->700415] (req 696320->700415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531956.974810:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869080 is committed
00010000:00010000:0.0:1651531956.974824:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2e64 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 68 type: EXT [286720->290815] (req 286720->290815) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.974828:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2e64 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 68 type: EXT [286720->290815] (req 286720->290815) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531956.974849:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000017a53f9a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+71:438149:x1731754467351488:12345-10.240.43.64@tcp:4:fio.0 Request processed in 90888us (90910us total) trans 21474869080 rc 0/0
00000100:00100000:0.0:1651531956.974852:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249709
00010000:00010000:0.0:1651531956.974859:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2e64 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 68 type: EXT [286720->290815] (req 286720->290815) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.974863:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fab23815 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531956.974864:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2e64 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 68 type: EXT [286720->290815] (req 286720->290815) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.974867:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2e64 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 68 type: EXT [286720->290815] (req 286720->290815) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.974875:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2e64 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 68 type: EXT [286720->290815] (req 286720->290815) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531956.974877:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2e64 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 68 type: EXT [286720->290815] (req 286720->290815) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531957.062646:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531957.062662:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467352832
00000100:00100000:0.0:1651531957.062673:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249711
00000100:00100000:0.0:1651531957.062674:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000036404f05 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+71:438148:x1731754467352832:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531957.062681:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2e72 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 68 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.062686:0:192753:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fd6ff34d/0x3234de053ca2da7 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 68 type: EXT [294912->335871] (req 294912->299007) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445362 expref: 71 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.062690:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531957.062691:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531957.062691:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2e72 lrc: 4/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 68 type: EXT [319488->323583] (req 319488->323583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.062698:0:192753:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fd6ff34d/0x3234de053ca2da7 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 68 type: EXT [294912->335871] (req 294912->299007) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445362 expref: 71 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.062702:0:192753:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fd6ff34d/0x3234de053ca2da7 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 68 type: EXT [294912->335871] (req 294912->299007) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445362 expref: 71 pid: 166111 timeout: 22765 lvb_type: 0
00000100:00100000:0.0:1651531957.062710:0:192753:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000042972edd pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:192753:1731745997352064:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531957.062728:0:192753:0:(client.c:2492:ptlrpc_set_wait()) set 000000000073caa3 going to sleep for 6 seconds
00000100:00100000:0.0:1651531957.063032:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531957.063039:0:166104:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467353024
00010000:00010000:0.0:1651531957.063044:0:166104:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fd6ff34d/0x3234de053ca2da7 lrc: 5/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 68 type: EXT [294912->335871] (req 294912->299007) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445362 expref: 72 pid: 166111 timeout: 22765 lvb_type: 0
00000100:00100000:0.0:1651531957.063052:0:166104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 152
00000100:00100000:0.0:1651531957.063054:0:166104:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000087355620 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+72:438146:x1731754467353024:12345-10.240.43.64@tcp:103:ldlm_bl_03.0
00010000:00010000:0.0:1651531957.063057:0:166104:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531957.063060:0:166104:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fd6ff34d/0x3234de053ca2da7 lrc: 5/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 69 type: EXT [294912->335871] (req 294912->299007) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445362 expref: 72 pid: 166111 timeout: 22765 lvb_type: 0
00010000:00010000:0.0:1651531957.063064:0:166104:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fd6ff34d/0x3234de053ca2da7 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 69 type: EXT [294912->335871] (req 294912->299007) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445362 expref: 72 pid: 166111 timeout: 22765 lvb_type: 0
00010000:00010000:0.0:1651531957.063071:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531957.063071:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531957.063072:0:166104:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2e72 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 69 type: EXT [319488->323583] (req 319488->323583) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.063075:0:166104:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2e72 lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 69 type: EXT [319488->323583] (req 319488->323583) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.063081:0:166104:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651531957.063096:0:166104:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000087355620 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+72:438146:x1731754467353024:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 42us (65us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531957.063101:0:166104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 152
00010000:00010000:0.0:1651531957.063112:0:192753:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fd6ff34d/0x3234de053ca2da7 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 68 type: EXT [294912->335871] (req 294912->299007) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445362 expref: 71 pid: 166111 timeout: 22765 lvb_type: 0
00000100:00100000:0.0:1651531957.063116:0:192753:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000042972edd pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:192753:1731745997352064:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651531957.063120:0:192753:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2e72 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 67 type: EXT [319488->323583] (req 319488->323583) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.063123:0:192753:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2e72 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 67 type: EXT [319488->323583] (req 319488->323583) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.063126:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2e72 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 67 type: EXT [319488->323583] (req 319488->323583) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531957.118709:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869081 is committed
00002000:00010000:0.0:1651531957.118723:0:192753:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x34545:0x0] updating lvb mtime from disk: 1651531956 -> 1651531957
00002000:00010000:0.0:1651531957.118724:0:192753:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x34545:0x0] updating lvb ctime from disk: 1651531956 -> 1651531957
00010000:00010000:0.0:1651531957.118727:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2e72 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 67 type: EXT [319488->323583] (req 319488->323583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.118730:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2e72 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 67 type: EXT [319488->323583] (req 319488->323583) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531957.118747:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000036404f05 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+70:438148:x1731754467352832:12345-10.240.43.64@tcp:4:fio.0 Request processed in 56071us (56101us total) trans 21474869081 rc 0/0
00000100:00100000:0.0:1651531957.118750:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249711
00010000:00010000:0.0:1651531957.118758:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2e72 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 67 type: EXT [319488->323583] (req 319488->323583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.118762:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fab23815 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531957.118763:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2e72 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 67 type: EXT [319488->323583] (req 319488->323583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.118766:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2e72 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 67 type: EXT [319488->323583] (req 319488->323583) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.118770:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2e72 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 67 type: EXT [319488->323583] (req 319488->323583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.118773:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2e72 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 67 type: EXT [319488->323583] (req 319488->323583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531957.205221:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531957.205253:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467353984
00000100:00100000:0.0:1651531957.205266:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249712
00000100:00100000:0.0:1651531957.205268:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bc543913 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+70:438146:x1731754467353984:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531957.205275:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2e79 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 67 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.205280:0:192753:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bfa41eae/0x3234de053ca2ae4 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 67 type: EXT [659456->667647] (req 659456->663551) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444d11 expref: 70 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.205284:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531957.205284:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531957.205285:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2e79 lrc: 4/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 67 type: EXT [663552->667647] (req 663552->667647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.205296:0:192753:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bfa41eae/0x3234de053ca2ae4 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 67 type: EXT [659456->667647] (req 659456->663551) gid 0 flags: 0x50000000020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444d11 expref: 70 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.205301:0:192753:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bfa41eae/0x3234de053ca2ae4 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 67 type: EXT [659456->667647] (req 659456->663551) gid 0 flags: 0x70000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444d11 expref: 70 pid: 166113 timeout: 22765 lvb_type: 0
00000100:00100000:0.0:1651531957.205305:0:192753:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000042972edd pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:192753:1731745997352128:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531957.205317:0:192753:0:(client.c:2492:ptlrpc_set_wait()) set 000000000073caa3 going to sleep for 6 seconds
00000100:00100000:1.0:1651531957.221908:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531957.221932:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467354112
00000100:00100000:0.0:1651531957.221948:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249713
00000100:00100000:0.0:1651531957.221950:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e8b66db1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+71:438149:x1731754467354112:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531957.221957:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca2e80 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 68 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.221961:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531957.221962:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531957.221963:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca2e80 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 68 type: EXT [634880->638975] (req 634880->638975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.221967:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca2e80 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 68 type: EXT [634880->638975] (req 634880->638975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531957.222069:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531957.222076:0:166102:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467354304
00010000:00010000:0.0:1651531957.222082:0:166102:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bfa41eae/0x3234de053ca2ae4 lrc: 5/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 68 type: EXT [659456->667647] (req 659456->663551) gid 0 flags: 0x60000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444d11 expref: 74 pid: 166113 timeout: 22765 lvb_type: 0
00000100:00100000:0.0:1651531957.222106:0:166102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 153
00000100:00100000:0.0:1651531957.222108:0:166102:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c2670ecb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+74:438147:x1731754467354304:12345-10.240.43.64@tcp:103:ldlm_bl_04.0
00010000:00010000:0.0:1651531957.222111:0:166102:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531957.222115:0:166102:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bfa41eae/0x3234de053ca2ae4 lrc: 5/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 69 type: EXT [659456->667647] (req 659456->663551) gid 0 flags: 0x60000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444d11 expref: 74 pid: 166113 timeout: 22765 lvb_type: 0
00010000:00010000:0.0:1651531957.222119:0:166102:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bfa41eae/0x3234de053ca2ae4 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 69 type: EXT [659456->667647] (req 659456->663551) gid 0 flags: 0x50000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444d11 expref: 74 pid: 166113 timeout: 22765 lvb_type: 0
00010000:00010000:0.0:1651531957.222125:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531957.222126:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531957.222127:0:166102:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2e79 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 69 type: EXT [663552->667647] (req 663552->667647) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.222130:0:166102:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2e79 lrc: 4/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 69 type: EXT [663552->667647] (req 663552->667647) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.222135:0:166102:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651531957.222151:0:166102:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c2670ecb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+74:438147:x1731754467354304:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 43us (83us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531957.222154:0:166102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 153
00010000:00010000:0.0:1651531957.222166:0:192753:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bfa41eae/0x3234de053ca2ae4 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 68 type: EXT [659456->667647] (req 659456->663551) gid 0 flags: 0x44801400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444d11 expref: 73 pid: 166113 timeout: 22765 lvb_type: 0
00000100:00100000:0.0:1651531957.222170:0:192753:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000042972edd pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:192753:1731745997352128:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651531957.222174:0:192753:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2e79 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 67 type: EXT [663552->667647] (req 663552->667647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.222179:0:192753:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2e79 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 67 type: EXT [663552->667647] (req 663552->667647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.222182:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2e79 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 67 type: EXT [663552->667647] (req 663552->667647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.222193:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2e79 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 67 type: EXT [663552->667647] (req 663552->667647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.222196:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2e79 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 67 type: EXT [663552->667647] (req 663552->667647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531957.222216:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2e79 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 67 type: EXT [663552->667647] (req 663552->667647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531957.222234:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fab23815 already unused, calling callback (0000000049fddea7)
00000100:00100000:0.0:1651531957.222235:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bc543913 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+72:438146:x1731754467353984:12345-10.240.43.64@tcp:3:fio.0 Request processed in 16966us (17015us total) trans 0 rc 4096/4096
00010000:00010000:1.0:1651531957.222238:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2e79 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 67 type: EXT [663552->667647] (req 663552->667647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531957.222238:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249712
00010000:00010000:1.0:1651531957.222242:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2e79 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 67 type: EXT [663552->667647] (req 663552->667647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531957.222249:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2e79 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 67 type: EXT [663552->667647] (req 663552->667647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531957.222252:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2e79 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 67 type: EXT [663552->667647] (req 663552->667647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531957.229113:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531957.229135:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467354432
00000100:00100000:0.0:1651531957.229150:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249714
00000100:00100000:0.0:1651531957.229152:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001385780a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+72:438147:x1731754467354432:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531957.229159:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca2e87 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 67 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.229164:0:192753:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003e4793c3/0x3234de053ca2df4 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 67 type: EXT [589824->622591] (req 589824->593919) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4453fc expref: 72 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.229167:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531957.229168:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531957.229170:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca2e87 lrc: 4/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 67 type: EXT [610304->614399] (req 610304->614399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.229177:0:192753:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003e4793c3/0x3234de053ca2df4 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 67 type: EXT [589824->622591] (req 589824->593919) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4453fc expref: 72 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.229182:0:192753:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003e4793c3/0x3234de053ca2df4 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 67 type: EXT [589824->622591] (req 589824->593919) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4453fc expref: 72 pid: 166111 timeout: 22765 lvb_type: 0
00000100:00100000:0.0:1651531957.229186:0:192753:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000042972edd pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:192753:1731745997352192:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531957.229198:0:192753:0:(client.c:2492:ptlrpc_set_wait()) set 000000000073caa3 going to sleep for 6 seconds
00000100:00100000:0.0:1651531957.235956:0:192753:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000042972edd pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:192753:1731745997352192:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651531957.235961:0:192753:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca2e87 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 67 type: EXT [610304->614399] (req 610304->614399) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531957.242830:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531957.242862:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467354496
00002000:00100000:1.0:1651531957.242872:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x34545:0x0] (106496->1023999)  req@0000000042972edd x1731754467354496/t0(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:418/0 lens 712/0 e 0 to 0 dl 1651531963 ref 1 fl New:/0/ffffffff rc 0/-1 job:'fio.0'
00002000:00100000:1.0:1651531957.242878:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000042972edd with x1731754467354496 ext(106496->1023999)
00010000:00010000:1.0:1651531957.242884:0:166118:0:(ldlm_lockd.c:599:ldlm_refresh_waiting_lock()) ### refreshed to 81s ns: filter-lustre-OST0001_UUID lock: 000000003e4793c3/0x3234de053ca2df4 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 68 type: EXT [589824->622591] (req 589824->593919) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4453fc expref: 73 pid: 166111 timeout: 22765 lvb_type: 0
00002000:00010000:1.0:1651531957.242889:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req 0000000042972edd
00000100:00100000:1.0:1651531957.242897:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 14
00000100:00100000:1.0:1651531957.242899:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000042972edd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+73:438148:x1731754467354496:12345-10.240.43.64@tcp:4:fio.0
00000001:00080000:0.0:1651531957.264850:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869082 is committed
00010000:00010000:0.0:1651531957.264870:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca2e80 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 67 type: EXT [634880->638975] (req 634880->638975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.264874:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca2e80 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 67 type: EXT [634880->638975] (req 634880->638975) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531957.264893:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e8b66db1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+72:438149:x1731754467354112:12345-10.240.43.64@tcp:4:fio.0 Request processed in 42943us (42986us total) trans 21474869082 rc 0/0
00000100:00100000:0.0:1651531957.264896:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249713
00010000:00010000:0.0:1651531957.264904:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca2e80 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 67 type: EXT [634880->638975] (req 634880->638975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.264911:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c1022d42 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531957.264912:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca2e80 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 67 type: EXT [634880->638975] (req 634880->638975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.264915:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca2e80 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 67 type: EXT [634880->638975] (req 634880->638975) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.264921:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca2e80 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 67 type: EXT [634880->638975] (req 634880->638975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.264924:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca2e80 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 67 type: EXT [634880->638975] (req 634880->638975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531957.266273:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000042972edd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+72:438148:x1731754467354496:12345-10.240.43.64@tcp:4:fio.0 Request processed in 23372us (23442us total) trans 21474869083 rc 0/0
00000100:00100000:1.0:1651531957.266278:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 14
00002000:00100000:1.0:1651531957.266281:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x34545:0x0] (106496->1023999)  req@0000000042972edd x1731754467354496/t21474869083(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:418/0 lens 712/504 e 0 to 0 dl 1651531963 ref 1 fl Complete:H/0/0 rc 0/0 job:'fio.0'
00002000:00100000:1.0:1651531957.266287:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000042972edd with x1731754467354496 ext(106496->1023999)
00010000:00010000:1.0:1651531957.266293:0:166118:0:(ldlm_lockd.c:599:ldlm_refresh_waiting_lock()) ### refreshed to 81s ns: filter-lustre-OST0001_UUID lock: 000000003e4793c3/0x3234de053ca2df4 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 67 type: EXT [589824->622591] (req 589824->593919) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4453fc expref: 72 pid: 166111 timeout: 22765 lvb_type: 0
00002000:00010000:1.0:1651531957.266298:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req 0000000042972edd
00000100:00100000:0.0:1651531957.287830:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531957.287838:0:166104:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467355392
00010000:00010000:0.0:1651531957.287844:0:166104:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003e4793c3/0x3234de053ca2df4 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 66 type: EXT [589824->622591] (req 589824->593919) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4453fc expref: 72 pid: 166111 timeout: 22765 lvb_type: 0
00000100:00100000:0.0:1651531957.287852:0:166104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 154
00000100:00100000:0.0:1651531957.287854:0:166104:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000043aab0c9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+72:438149:x1731754467355392:12345-10.240.43.64@tcp:103:ldlm_bl_01.0
00010000:00010000:0.0:1651531957.287857:0:166104:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531957.287861:0:166104:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003e4793c3/0x3234de053ca2df4 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 67 type: EXT [589824->622591] (req 589824->593919) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4453fc expref: 72 pid: 166111 timeout: 22765 lvb_type: 0
00010000:00010000:0.0:1651531957.287865:0:166104:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003e4793c3/0x3234de053ca2df4 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 67 type: EXT [589824->622591] (req 589824->593919) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4453fc expref: 72 pid: 166111 timeout: 22765 lvb_type: 0
00010000:00010000:0.0:1651531957.287874:0:166104:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003e4793c3/0x3234de053ca2df4 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 67 type: EXT [589824->622591] (req 589824->593919) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4453fc expref: 72 pid: 166111 timeout: 22765 lvb_type: 0
00010000:00010000:0.0:1651531957.287879:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531957.287879:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531957.287880:0:166104:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca2e87 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 66 type: EXT [610304->614399] (req 610304->614399) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.287883:0:166104:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca2e87 lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 66 type: EXT [610304->614399] (req 610304->614399) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.287890:0:166104:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651531957.287905:0:166104:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000043aab0c9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+71:438149:x1731754467355392:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 50us (76us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531957.287908:0:166104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 154
00010000:00010000:0.0:1651531957.287916:0:192753:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca2e87 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 65 type: EXT [610304->614399] (req 610304->614399) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.287919:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca2e87 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 65 type: EXT [610304->614399] (req 610304->614399) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531957.341919:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869084 is committed
00010000:00010000:0.0:1651531957.341935:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca2e87 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 65 type: EXT [610304->614399] (req 610304->614399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.341939:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca2e87 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 65 type: EXT [610304->614399] (req 610304->614399) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531957.341958:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001385780a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+68:438147:x1731754467354432:12345-10.240.43.64@tcp:4:fio.0 Request processed in 112805us (112846us total) trans 21474869084 rc 0/0
00000100:00100000:0.0:1651531957.341962:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249714
00010000:00010000:0.0:1651531957.341969:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca2e87 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 65 type: EXT [610304->614399] (req 610304->614399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.341972:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000032ee36ee already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531957.341973:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca2e87 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 65 type: EXT [610304->614399] (req 610304->614399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.341976:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca2e87 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 65 type: EXT [610304->614399] (req 610304->614399) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.341981:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca2e87 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 65 type: EXT [610304->614399] (req 610304->614399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.341984:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca2e87 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 65 type: EXT [610304->614399] (req 610304->614399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531957.416257:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531957.416281:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467356480
00000100:00100000:0.0:1651531957.416300:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249715
00000100:00100000:0.0:1651531957.416302:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ed7e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+68:438149:x1731754467356480:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531957.416311:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca2e8e lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 65 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.416318:0:192753:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000768f2bc3/0x3234de053ca2c03 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 65 type: EXT [372736->393215] (req 372736->376831) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444ff0 expref: 68 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.416323:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531957.416324:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531957.416325:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca2e8e lrc: 4/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 65 type: EXT [376832->380927] (req 376832->380927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.416333:0:192753:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000768f2bc3/0x3234de053ca2c03 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 65 type: EXT [372736->393215] (req 372736->376831) gid 0 flags: 0x50000000020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444ff0 expref: 68 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.416337:0:192753:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000768f2bc3/0x3234de053ca2c03 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 65 type: EXT [372736->393215] (req 372736->376831) gid 0 flags: 0x70000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444ff0 expref: 68 pid: 166112 timeout: 22766 lvb_type: 0
00000100:00100000:0.0:1651531957.416341:0:192753:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000844a4f50 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:192753:1731745997352256:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531957.416356:0:192753:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f14111ff going to sleep for 6 seconds
00000100:00100000:0.0:1651531957.416598:0:192753:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000844a4f50 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:192753:1731745997352256:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651531957.416603:0:192753:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca2e8e lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 65 type: EXT [376832->380927] (req 376832->380927) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531957.416879:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531957.416889:0:166102:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467356736
00010000:00010000:0.0:1651531957.416895:0:166102:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000768f2bc3/0x3234de053ca2c03 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 65 type: EXT [372736->393215] (req 372736->376831) gid 0 flags: 0x60000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444ff0 expref: 69 pid: 166112 timeout: 22766 lvb_type: 0
00000100:00100000:0.0:1651531957.416903:0:166102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 155
00000100:00100000:0.0:1651531957.416905:0:166102:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e7c71b99 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+69:438148:x1731754467356736:12345-10.240.43.64@tcp:103:ldlm_bl_02.0
00010000:00010000:0.0:1651531957.416908:0:166102:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531957.416914:0:166102:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000768f2bc3/0x3234de053ca2c03 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 66 type: EXT [372736->393215] (req 372736->376831) gid 0 flags: 0x60000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444ff0 expref: 69 pid: 166112 timeout: 22766 lvb_type: 0
00010000:00010000:0.0:1651531957.416918:0:166102:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000768f2bc3/0x3234de053ca2c03 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 66 type: EXT [372736->393215] (req 372736->376831) gid 0 flags: 0x50000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444ff0 expref: 69 pid: 166112 timeout: 22766 lvb_type: 0
00010000:00010000:0.0:1651531957.416924:0:166102:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000768f2bc3/0x3234de053ca2c03 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 66 type: EXT [372736->393215] (req 372736->376831) gid 0 flags: 0x44801400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444ff0 expref: 69 pid: 166112 timeout: 22766 lvb_type: 0
00010000:00010000:0.0:1651531957.416928:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531957.416929:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531957.416930:0:166102:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca2e8e lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 65 type: EXT [376832->380927] (req 376832->380927) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.416933:0:166102:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca2e8e lrc: 4/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 65 type: EXT [376832->380927] (req 376832->380927) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.416940:0:166102:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651531957.416955:0:166102:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e7c71b99 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+68:438148:x1731754467356736:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 49us (76us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531957.416958:0:166102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 155
00010000:00010000:0.0:1651531957.416979:0:192753:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca2e8e lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 64 type: EXT [376832->380927] (req 376832->380927) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.416983:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca2e8e lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 64 type: EXT [376832->380927] (req 376832->380927) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.416997:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca2e8e lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 64 type: EXT [376832->380927] (req 376832->380927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.417004:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca2e8e lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 64 type: EXT [376832->380927] (req 376832->380927) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531957.417041:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ed7e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+67:438149:x1731754467356480:12345-10.240.43.64@tcp:3:fio.0 Request processed in 738us (784us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531957.417044:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249715
00010000:00010000:1.0:1651531957.417045:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca2e8e lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 64 type: EXT [376832->380927] (req 376832->380927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531957.417051:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000032ee36ee already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531957.417052:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca2e8e lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 64 type: EXT [376832->380927] (req 376832->380927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531957.417056:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca2e8e lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 64 type: EXT [376832->380927] (req 376832->380927) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531957.417060:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651531957.417061:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca2e8e lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 64 type: EXT [376832->380927] (req 376832->380927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531957.417064:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca2e8e lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 64 type: EXT [376832->380927] (req 376832->380927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531957.417086:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467356928
00000100:00100000:0.0:1651531957.417099:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249716
00000100:00100000:0.0:1651531957.417101:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000087355620 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+67:438148:x1731754467356928:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531957.417111:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca2e95 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 64 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.417116:0:192753:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003e3ad07b/0x3234de053ca2af2 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 64 type: EXT [823296->872447] (req 823296->827391) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444d3b expref: 67 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.417119:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531957.417120:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531957.417120:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca2e95 lrc: 4/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 64 type: EXT [835584->839679] (req 835584->839679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.417128:0:192753:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003e3ad07b/0x3234de053ca2af2 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 64 type: EXT [823296->872447] (req 823296->827391) gid 0 flags: 0x50000000020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444d3b expref: 67 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.417147:0:192753:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003e3ad07b/0x3234de053ca2af2 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 64 type: EXT [823296->872447] (req 823296->827391) gid 0 flags: 0x70000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444d3b expref: 67 pid: 166113 timeout: 22766 lvb_type: 0
00000100:00100000:0.0:1651531957.417156:0:192753:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c2670ecb pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:192753:1731745997352320:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531957.417173:0:192753:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f14111ff going to sleep for 6 seconds
00000100:00100000:0.0:1651531957.417476:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531957.417485:0:166104:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467357120
00010000:00010000:0.0:1651531957.417490:0:166104:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003e3ad07b/0x3234de053ca2af2 lrc: 5/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 64 type: EXT [823296->872447] (req 823296->827391) gid 0 flags: 0x60000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444d3b expref: 68 pid: 166113 timeout: 22766 lvb_type: 0
00000100:00100000:0.0:1651531957.417498:0:166104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 156
00000100:00100000:0.0:1651531957.417499:0:166104:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000043aab0c9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+68:438146:x1731754467357120:12345-10.240.43.64@tcp:103:ldlm_bl_05.0
00010000:00010000:0.0:1651531957.417503:0:166104:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531957.417506:0:166104:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003e3ad07b/0x3234de053ca2af2 lrc: 5/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 65 type: EXT [823296->872447] (req 823296->827391) gid 0 flags: 0x60000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444d3b expref: 68 pid: 166113 timeout: 22766 lvb_type: 0
00010000:00010000:0.0:1651531957.417510:0:166104:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003e3ad07b/0x3234de053ca2af2 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 65 type: EXT [823296->872447] (req 823296->827391) gid 0 flags: 0x50000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444d3b expref: 68 pid: 166113 timeout: 22766 lvb_type: 0
00010000:00010000:0.0:1651531957.417517:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531957.417517:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531957.417518:0:166104:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca2e95 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 65 type: EXT [835584->839679] (req 835584->839679) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.417521:0:166104:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca2e95 lrc: 4/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 65 type: EXT [835584->839679] (req 835584->839679) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.417527:0:166104:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651531957.417541:0:166104:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000043aab0c9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+68:438146:x1731754467357120:12345-10.240.43.64@tcp:103:ldlm_bl_05.0 Request processed in 41us (65us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531957.417553:0:166104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 156
00010000:00010000:0.0:1651531957.417566:0:192753:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003e3ad07b/0x3234de053ca2af2 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 64 type: EXT [823296->872447] (req 823296->827391) gid 0 flags: 0x44801400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444d3b expref: 67 pid: 166113 timeout: 22766 lvb_type: 0
00000100:00100000:0.0:1651531957.417570:0:192753:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c2670ecb pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:192753:1731745997352320:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651531957.417574:0:192753:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca2e95 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 63 type: EXT [835584->839679] (req 835584->839679) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.417577:0:192753:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca2e95 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 63 type: EXT [835584->839679] (req 835584->839679) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.417580:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca2e95 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 63 type: EXT [835584->839679] (req 835584->839679) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.417592:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca2e95 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 63 type: EXT [835584->839679] (req 835584->839679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.417595:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca2e95 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 63 type: EXT [835584->839679] (req 835584->839679) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531957.417609:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000087355620 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+66:438148:x1731754467356928:12345-10.240.43.64@tcp:3:fio.0 Request processed in 508us (549us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531957.417612:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249716
00010000:00010000:0.0:1651531957.417619:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca2e95 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 63 type: EXT [835584->839679] (req 835584->839679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.417622:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c1022d42 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531957.417631:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca2e95 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 63 type: EXT [835584->839679] (req 835584->839679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.417635:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca2e95 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 63 type: EXT [835584->839679] (req 835584->839679) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.417640:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca2e95 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 63 type: EXT [835584->839679] (req 835584->839679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.417643:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca2e95 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 63 type: EXT [835584->839679] (req 835584->839679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531957.417876:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531957.417887:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467357248
00000100:00100000:0.0:1651531957.417901:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249717
00000100:00100000:0.0:1651531957.417903:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000f4bed26 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+66:438148:x1731754467357248:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531957.417910:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2e9c lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 63 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.417915:0:192753:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca2b4d lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 63 type: EXT [729088->753663] (req 729088->733183) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444e1b expref: 66 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.417919:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531957.417919:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531957.417920:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2e9c lrc: 4/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 63 type: EXT [745472->749567] (req 745472->749567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.417927:0:192753:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca2b4d lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 63 type: EXT [729088->753663] (req 729088->733183) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444e1b expref: 66 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.417934:0:192753:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca2b4d lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 63 type: EXT [729088->753663] (req 729088->733183) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444e1b expref: 66 pid: 166111 timeout: 22766 lvb_type: 0
00000100:00100000:0.0:1651531957.417938:0:192753:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c2670ecb pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:192753:1731745997352384:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531957.417951:0:192753:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f14111ff going to sleep for 6 seconds
00000100:00100000:1.0:1651531957.418216:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531957.418219:0:192753:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c2670ecb pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:192753:1731745997352384:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651531957.418242:0:192753:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2e9c lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 63 type: EXT [745472->749567] (req 745472->749567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531957.418251:0:166102:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467357440
00010000:00010000:0.0:1651531957.418256:0:166102:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca2b4d lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 63 type: EXT [729088->753663] (req 729088->733183) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444e1b expref: 67 pid: 166111 timeout: 22766 lvb_type: 0
00000100:00100000:0.0:1651531957.418263:0:166102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 157
00000100:00100000:0.0:1651531957.418265:0:166102:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004237e3f1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+67:438147:x1731754467357440:12345-10.240.43.64@tcp:103:ldlm_bl_03.0
00010000:00010000:0.0:1651531957.418268:0:166102:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531957.418271:0:166102:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca2b4d lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 64 type: EXT [729088->753663] (req 729088->733183) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444e1b expref: 67 pid: 166111 timeout: 22766 lvb_type: 0
00010000:00010000:0.0:1651531957.418275:0:166102:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca2b4d lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 64 type: EXT [729088->753663] (req 729088->733183) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444e1b expref: 67 pid: 166111 timeout: 22766 lvb_type: 0
00010000:00010000:0.0:1651531957.418281:0:166102:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca2b4d lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 64 type: EXT [729088->753663] (req 729088->733183) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444e1b expref: 67 pid: 166111 timeout: 22766 lvb_type: 0
00010000:00010000:0.0:1651531957.418289:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531957.418290:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531957.418290:0:166102:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2e9c lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 63 type: EXT [745472->749567] (req 745472->749567) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.418294:0:166102:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2e9c lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 63 type: EXT [745472->749567] (req 745472->749567) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.418300:0:166102:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651531957.418309:0:166102:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004237e3f1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+66:438147:x1731754467357440:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 43us (93us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531957.418311:0:166102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 157
00010000:00010000:0.0:1651531957.418318:0:192753:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2e9c lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 62 type: EXT [745472->749567] (req 745472->749567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.418321:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2e9c lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 62 type: EXT [745472->749567] (req 745472->749567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531957.451706:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869085 is committed
00010000:00010000:0.0:1651531957.451721:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2e9c lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 62 type: EXT [745472->749567] (req 745472->749567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.451725:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2e9c lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 62 type: EXT [745472->749567] (req 745472->749567) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531957.451746:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000f4bed26 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+65:438148:x1731754467357248:12345-10.240.43.64@tcp:4:fio.0 Request processed in 33842us (33870us total) trans 21474869085 rc 0/0
00000100:00100000:0.0:1651531957.451752:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249717
00010000:00010000:0.0:1651531957.451759:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2e9c lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 62 type: EXT [745472->749567] (req 745472->749567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.451763:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fab23815 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531957.451764:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2e9c lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 62 type: EXT [745472->749567] (req 745472->749567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.451767:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2e9c lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 62 type: EXT [745472->749567] (req 745472->749567) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.451772:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2e9c lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 62 type: EXT [745472->749567] (req 745472->749567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.451775:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2e9c lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 62 type: EXT [745472->749567] (req 745472->749567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531957.452071:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531957.452078:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467357632
00000100:00100000:0.0:1651531957.452094:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249718
00000100:00100000:0.0:1651531957.452096:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c2670ecb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+65:438148:x1731754467357632:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531957.452104:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca2ea3 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 62 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.452109:0:192753:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004b7d0a41/0x3234de053ca2b1c lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 62 type: EXT [794624->823295] (req 794624->798719) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444d88 expref: 65 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.452116:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531957.452117:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531957.452117:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca2ea3 lrc: 4/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 62 type: EXT [819200->823295] (req 819200->823295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.452124:0:192753:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004b7d0a41/0x3234de053ca2b1c lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 62 type: EXT [794624->823295] (req 794624->798719) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444d88 expref: 65 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.452128:0:192753:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004b7d0a41/0x3234de053ca2b1c lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 62 type: EXT [794624->823295] (req 794624->798719) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444d88 expref: 65 pid: 166113 timeout: 22766 lvb_type: 0
00000100:00100000:0.0:1651531957.452132:0:192753:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000844a4f50 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:192753:1731745997352448:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531957.452149:0:192753:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f14111ff going to sleep for 6 seconds
00000100:00100000:0.0:1651531957.452445:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531957.452452:0:166104:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467357696
00010000:00010000:0.0:1651531957.452457:0:166104:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004b7d0a41/0x3234de053ca2b1c lrc: 5/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 62 type: EXT [794624->823295] (req 794624->798719) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444d88 expref: 66 pid: 166113 timeout: 22766 lvb_type: 0
00000100:00100000:0.0:1651531957.452465:0:166104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 158
00000100:00100000:0.0:1651531957.452466:0:166104:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000045181741 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+66:438146:x1731754467357696:12345-10.240.43.64@tcp:103:ldlm_bl_04.0
00010000:00010000:0.0:1651531957.452469:0:166104:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531957.452473:0:166104:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004b7d0a41/0x3234de053ca2b1c lrc: 5/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 63 type: EXT [794624->823295] (req 794624->798719) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444d88 expref: 66 pid: 166113 timeout: 22766 lvb_type: 0
00010000:00010000:0.0:1651531957.452477:0:166104:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004b7d0a41/0x3234de053ca2b1c lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 63 type: EXT [794624->823295] (req 794624->798719) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444d88 expref: 66 pid: 166113 timeout: 22766 lvb_type: 0
00010000:00010000:0.0:1651531957.452487:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531957.452488:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531957.452489:0:166104:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca2ea3 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 63 type: EXT [819200->823295] (req 819200->823295) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.452492:0:166104:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca2ea3 lrc: 4/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 63 type: EXT [819200->823295] (req 819200->823295) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.452497:0:166104:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651531957.452513:0:166104:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000045181741 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+66:438146:x1731754467357696:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 46us (69us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531957.452516:0:166104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 158
00010000:00010000:0.0:1651531957.452528:0:192753:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004b7d0a41/0x3234de053ca2b1c lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 62 type: EXT [794624->823295] (req 794624->798719) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444d88 expref: 65 pid: 166113 timeout: 22766 lvb_type: 0
00000100:00100000:0.0:1651531957.452532:0:192753:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000844a4f50 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:192753:1731745997352448:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651531957.452536:0:192753:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca2ea3 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 61 type: EXT [819200->823295] (req 819200->823295) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.452539:0:192753:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca2ea3 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 61 type: EXT [819200->823295] (req 819200->823295) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.452542:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca2ea3 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 61 type: EXT [819200->823295] (req 819200->823295) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.452554:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca2ea3 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 61 type: EXT [819200->823295] (req 819200->823295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.452561:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca2ea3 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 61 type: EXT [819200->823295] (req 819200->823295) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531957.452581:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c2670ecb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+64:438148:x1731754467357632:12345-10.240.43.64@tcp:3:fio.0 Request processed in 484us (511us total) trans 0 rc 4096/4096
00010000:00010000:1.0:1651531957.452584:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca2ea3 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 61 type: EXT [819200->823295] (req 819200->823295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531957.452584:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249718
00010000:00010000:1.0:1651531957.452589:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c1022d42 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531957.452592:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca2ea3 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 61 type: EXT [819200->823295] (req 819200->823295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531957.452595:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca2ea3 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 61 type: EXT [819200->823295] (req 819200->823295) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531957.452601:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca2ea3 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 61 type: EXT [819200->823295] (req 819200->823295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531957.452603:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca2ea3 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 61 type: EXT [819200->823295] (req 819200->823295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531957.452944:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531957.452956:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467357824
00000100:00100000:0.0:1651531957.452972:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249719
00000100:00100000:0.0:1651531957.452974:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006e255cae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+64:438149:x1731754467357824:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531957.452981:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca2eaa lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 61 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.452986:0:192753:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca2e02 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 61 type: EXT [208896->225279] (req 208896->212991) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44540a expref: 64 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.452990:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531957.452990:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531957.452991:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca2eaa lrc: 4/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 61 type: EXT [221184->225279] (req 221184->225279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.452998:0:192753:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca2e02 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 61 type: EXT [208896->225279] (req 208896->212991) gid 0 flags: 0x50000000020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44540a expref: 64 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.453002:0:192753:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca2e02 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 61 type: EXT [208896->225279] (req 208896->212991) gid 0 flags: 0x70000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44540a expref: 64 pid: 166112 timeout: 22766 lvb_type: 0
00000100:00100000:0.0:1651531957.453006:0:192753:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000844a4f50 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:192753:1731745997352512:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531957.453019:0:192753:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f14111ff going to sleep for 6 seconds
00000100:00100000:0.0:1651531957.453215:0:192753:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000844a4f50 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:192753:1731745997352512:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651531957.453219:0:192753:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca2eaa lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 61 type: EXT [221184->225279] (req 221184->225279) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531957.453278:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531957.453286:0:166102:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467357888
00010000:00010000:0.0:1651531957.453292:0:166102:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca2e02 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 61 type: EXT [208896->225279] (req 208896->212991) gid 0 flags: 0x60000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44540a expref: 65 pid: 166112 timeout: 22766 lvb_type: 0
00000100:00100000:0.0:1651531957.453299:0:166102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 159
00000100:00100000:0.0:1651531957.453301:0:166102:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000844a4f50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+65:438148:x1731754467357888:12345-10.240.43.64@tcp:103:ldlm_bl_06.0
00010000:00010000:0.0:1651531957.453304:0:166102:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531957.453308:0:166102:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca2e02 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 62 type: EXT [208896->225279] (req 208896->212991) gid 0 flags: 0x60000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44540a expref: 65 pid: 166112 timeout: 22766 lvb_type: 0
00010000:00010000:0.0:1651531957.453311:0:166102:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca2e02 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 62 type: EXT [208896->225279] (req 208896->212991) gid 0 flags: 0x50000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44540a expref: 65 pid: 166112 timeout: 22766 lvb_type: 0
00010000:00010000:0.0:1651531957.453317:0:166102:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca2e02 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 62 type: EXT [208896->225279] (req 208896->212991) gid 0 flags: 0x44801400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44540a expref: 65 pid: 166112 timeout: 22766 lvb_type: 0
00010000:00010000:0.0:1651531957.453322:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531957.453322:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531957.453323:0:166102:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca2eaa lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 61 type: EXT [221184->225279] (req 221184->225279) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.453326:0:166102:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca2eaa lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 61 type: EXT [221184->225279] (req 221184->225279) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.453334:0:166102:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651531957.453346:0:166102:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000844a4f50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+64:438148:x1731754467357888:12345-10.240.43.64@tcp:103:ldlm_bl_06.0 Request processed in 44us (69us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531957.453349:0:166102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 159
00010000:00010000:0.0:1651531957.453357:0:192753:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca2eaa lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 60 type: EXT [221184->225279] (req 221184->225279) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.453360:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca2eaa lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 60 type: EXT [221184->225279] (req 221184->225279) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531957.477538:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531957.477560:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467358528
00000100:00100000:1.0:1651531957.477578:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249720
00000100:00100000:1.0:1651531957.477580:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000af5f6682 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+66:438146:x1731754467358528:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531957.477588:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca2eb1 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 61 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531957.477593:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531957.477593:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531957.477595:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca2eb1 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 61 type: EXT [98304->102399] (req 98304->102399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531957.477599:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca2eb1 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 61 type: EXT [98304->102399] (req 98304->102399) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531957.499412:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869086 is committed
00010000:00010000:1.0:1651531957.499446:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca2eaa lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 61 type: EXT [221184->225279] (req 221184->225279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531957.499454:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca2eaa lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 61 type: EXT [221184->225279] (req 221184->225279) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.499466:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca2eaa lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 61 type: EXT [221184->225279] (req 221184->225279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.499471:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000820577fb already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531957.499472:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca2eaa lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 61 type: EXT [221184->225279] (req 221184->225279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531957.499474:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006e255cae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+66:438149:x1731754467357824:12345-10.240.43.64@tcp:4:fio.0 Request processed in 46499us (46530us total) trans 21474869086 rc 0/0
00010000:00010000:0.0:1651531957.499476:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca2eaa lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 61 type: EXT [221184->225279] (req 221184->225279) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531957.499477:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249719
00010000:00010000:0.0:1651531957.499482:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca2eaa lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 61 type: EXT [221184->225279] (req 221184->225279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.499484:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca2eaa lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 61 type: EXT [221184->225279] (req 221184->225279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531957.500241:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531957.500264:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467358784
00000100:00100000:1.0:1651531957.500280:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249721
00000100:00100000:1.0:1651531957.500282:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009acdfe57 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+66:438149:x1731754467358784:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531957.500290:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2eb8 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 61 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531957.500295:0:192753:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca2b46 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 61 type: EXT [753664->794623] (req 753664->757759) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444e0d expref: 66 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531957.500299:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531957.500299:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531957.500300:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2eb8 lrc: 4/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 61 type: EXT [765952->770047] (req 765952->770047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531957.500308:0:192753:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca2b46 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 61 type: EXT [753664->794623] (req 753664->757759) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444e0d expref: 66 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531957.500312:0:192753:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca2b46 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 61 type: EXT [753664->794623] (req 753664->757759) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444e0d expref: 66 pid: 166111 timeout: 22766 lvb_type: 0
00000100:00100000:1.0:1651531957.500316:0:192753:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007a05c3e3 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:192753:1731745997352576:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531957.500331:0:192753:0:(client.c:2492:ptlrpc_set_wait()) set 00000000996f1fed going to sleep for 6 seconds
00000100:00100000:1.0:1651531957.500555:0:192753:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007a05c3e3 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:192753:1731745997352576:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651531957.500560:0:192753:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2eb8 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 61 type: EXT [765952->770047] (req 765952->770047) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531957.500640:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531957.500654:0:166104:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467358848
00010000:00010000:0.0:1651531957.500662:0:166104:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca2b46 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 61 type: EXT [753664->794623] (req 753664->757759) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444e0d expref: 67 pid: 166111 timeout: 22766 lvb_type: 0
00000100:00100000:0.0:1651531957.500670:0:166104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 160
00000100:00100000:0.0:1651531957.500672:0:166104:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007a05c3e3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+67:438148:x1731754467358848:12345-10.240.43.64@tcp:103:ldlm_bl_02.0
00010000:00010000:0.0:1651531957.500675:0:166104:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531957.500679:0:166104:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca2b46 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 62 type: EXT [753664->794623] (req 753664->757759) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444e0d expref: 67 pid: 166111 timeout: 22766 lvb_type: 0
00010000:00010000:0.0:1651531957.500683:0:166104:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca2b46 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 62 type: EXT [753664->794623] (req 753664->757759) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444e0d expref: 67 pid: 166111 timeout: 22766 lvb_type: 0
00010000:00010000:0.0:1651531957.500689:0:166104:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca2b46 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 62 type: EXT [753664->794623] (req 753664->757759) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444e0d expref: 67 pid: 166111 timeout: 22766 lvb_type: 0
00010000:00010000:0.0:1651531957.500693:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531957.500694:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531957.500695:0:166104:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2eb8 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 61 type: EXT [765952->770047] (req 765952->770047) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.500698:0:166104:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2eb8 lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 61 type: EXT [765952->770047] (req 765952->770047) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.500711:0:166104:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1651531957.500718:0:192753:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2eb8 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 60 type: EXT [765952->770047] (req 765952->770047) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531957.500721:0:166104:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007a05c3e3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+66:438148:x1731754467358848:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 49us (81us total) trans 0 rc 0/0
00010000:00010000:1.0:1651531957.500723:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2eb8 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 60 type: EXT [765952->770047] (req 765952->770047) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531957.500726:0:166104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 160
00000001:00080000:0.0:1651531957.547979:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869087 is committed
00010000:00010000:1.0:1651531957.548012:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca2eb1 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 60 type: EXT [98304->102399] (req 98304->102399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531957.548018:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca2eb1 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 60 type: EXT [98304->102399] (req 98304->102399) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.548030:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca2eb1 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 60 type: EXT [98304->102399] (req 98304->102399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.548036:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000968553c1 already unused, calling callback (0000000049fddea7)
00000100:00100000:1.0:1651531957.548037:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000af5f6682 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+65:438146:x1731754467358528:12345-10.240.43.64@tcp:4:fio.0 Request processed in 70456us (70499us total) trans 21474869087 rc 0/0
00010000:00010000:0.0:1651531957.548037:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca2eb1 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 60 type: EXT [98304->102399] (req 98304->102399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531957.548040:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249720
00010000:00010000:0.0:1651531957.548041:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca2eb1 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 60 type: EXT [98304->102399] (req 98304->102399) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.548047:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca2eb1 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 60 type: EXT [98304->102399] (req 98304->102399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.548050:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca2eb1 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 60 type: EXT [98304->102399] (req 98304->102399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531957.595716:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869088 is committed
00010000:00010000:0.0:1651531957.595732:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2eb8 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 59 type: EXT [765952->770047] (req 765952->770047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.595737:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2eb8 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 59 type: EXT [765952->770047] (req 765952->770047) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531957.595754:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009acdfe57 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+62:438149:x1731754467358784:12345-10.240.43.64@tcp:4:fio.0 Request processed in 95471us (95513us total) trans 21474869088 rc 0/0
00000100:00100000:0.0:1651531957.595758:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249721
00010000:00010000:0.0:1651531957.595767:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2eb8 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 59 type: EXT [765952->770047] (req 765952->770047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.595770:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a8889a80 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531957.595772:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2eb8 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 59 type: EXT [765952->770047] (req 765952->770047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.595775:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2eb8 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 59 type: EXT [765952->770047] (req 765952->770047) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.595779:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2eb8 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 59 type: EXT [765952->770047] (req 765952->770047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.595782:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2eb8 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 59 type: EXT [765952->770047] (req 765952->770047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531957.618048:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531957.618072:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467359872
00000100:00100000:0.0:1651531957.618088:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249722
00000100:00100000:0.0:1651531957.618091:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002d66cb1c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+62:438147:x1731754467359872:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531957.618098:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca2ebf lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 59 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.618104:0:192753:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003cf86247/0x3234de053ca2dca lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 59 type: EXT [716800->729087] (req 716800->720895) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4453b6 expref: 62 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.618107:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531957.618108:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531957.618108:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca2ebf lrc: 4/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 59 type: EXT [724992->729087] (req 724992->729087) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.618120:0:192753:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003cf86247/0x3234de053ca2dca lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 59 type: EXT [716800->729087] (req 716800->720895) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4453b6 expref: 62 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.618124:0:192753:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003cf86247/0x3234de053ca2dca lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 59 type: EXT [716800->729087] (req 716800->720895) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4453b6 expref: 62 pid: 166112 timeout: 22766 lvb_type: 0
00000100:00100000:0.0:1651531957.618129:0:192753:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002e4767d3 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:192753:1731745997352640:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531957.618142:0:192753:0:(client.c:2492:ptlrpc_set_wait()) set 000000000073caa3 going to sleep for 6 seconds
00000100:00100000:0.0:1651531957.618369:0:192753:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002e4767d3 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:192753:1731745997352640:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651531957.618374:0:192753:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca2ebf lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 59 type: EXT [724992->729087] (req 724992->729087) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531957.618455:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531957.618465:0:166102:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467360000
00010000:00010000:0.0:1651531957.618471:0:166102:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003cf86247/0x3234de053ca2dca lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 59 type: EXT [716800->729087] (req 716800->720895) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4453b6 expref: 63 pid: 166112 timeout: 22766 lvb_type: 0
00000100:00100000:0.0:1651531957.618479:0:166102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 161
00000100:00100000:0.0:1651531957.618481:0:166102:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002e4767d3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+63:438148:x1731754467360000:12345-10.240.43.64@tcp:103:ldlm_bl_01.0
00010000:00010000:0.0:1651531957.618484:0:166102:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531957.618488:0:166102:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003cf86247/0x3234de053ca2dca lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 60 type: EXT [716800->729087] (req 716800->720895) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4453b6 expref: 63 pid: 166112 timeout: 22766 lvb_type: 0
00010000:00010000:0.0:1651531957.618492:0:166102:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003cf86247/0x3234de053ca2dca lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 60 type: EXT [716800->729087] (req 716800->720895) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4453b6 expref: 63 pid: 166112 timeout: 22766 lvb_type: 0
00010000:00010000:0.0:1651531957.618502:0:166102:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003cf86247/0x3234de053ca2dca lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 60 type: EXT [716800->729087] (req 716800->720895) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4453b6 expref: 63 pid: 166112 timeout: 22766 lvb_type: 0
00010000:00010000:0.0:1651531957.618507:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531957.618508:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531957.618509:0:166102:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca2ebf lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 59 type: EXT [724992->729087] (req 724992->729087) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.618512:0:166102:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca2ebf lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 59 type: EXT [724992->729087] (req 724992->729087) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.618518:0:166102:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651531957.618531:0:166102:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002e4767d3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+62:438148:x1731754467360000:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 50us (76us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531957.618534:0:166102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 161
00010000:00010000:0.0:1651531957.618542:0:192753:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca2ebf lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 58 type: EXT [724992->729087] (req 724992->729087) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.618546:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca2ebf lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 58 type: EXT [724992->729087] (req 724992->729087) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531957.665747:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869089 is committed
00010000:00010000:0.0:1651531957.665762:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca2ebf lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 58 type: EXT [724992->729087] (req 724992->729087) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.665766:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca2ebf lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 58 type: EXT [724992->729087] (req 724992->729087) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531957.665787:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002d66cb1c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+61:438147:x1731754467359872:12345-10.240.43.64@tcp:4:fio.0 Request processed in 47696us (47740us total) trans 21474869089 rc 0/0
00000100:00100000:0.0:1651531957.665791:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249722
00010000:00010000:0.0:1651531957.666081:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca2ebf lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 58 type: EXT [724992->729087] (req 724992->729087) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.666085:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000820577fb already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531957.666086:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca2ebf lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 58 type: EXT [724992->729087] (req 724992->729087) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.666090:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca2ebf lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 58 type: EXT [724992->729087] (req 724992->729087) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.666095:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca2ebf lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 58 type: EXT [724992->729087] (req 724992->729087) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.666098:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca2ebf lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 58 type: EXT [724992->729087] (req 724992->729087) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531957.666416:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531957.666433:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467360448
00000100:00100000:0.0:1651531957.666449:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249723
00000100:00100000:0.0:1651531957.666451:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005dd15341 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+61:438146:x1731754467360448:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531957.666458:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca2ec6 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 58 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.666464:0:192753:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ce7f2d16/0x3234de053ca2b70 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 58 type: EXT [442368->454655] (req 442368->446463) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444ea0 expref: 61 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.666468:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531957.666469:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531957.666470:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca2ec6 lrc: 4/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 58 type: EXT [446464->450559] (req 446464->450559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.666477:0:192753:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ce7f2d16/0x3234de053ca2b70 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 58 type: EXT [442368->454655] (req 442368->446463) gid 0 flags: 0x50000000020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444ea0 expref: 61 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.666481:0:192753:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ce7f2d16/0x3234de053ca2b70 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 58 type: EXT [442368->454655] (req 442368->446463) gid 0 flags: 0x70000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444ea0 expref: 61 pid: 166113 timeout: 22766 lvb_type: 0
00000100:00100000:0.0:1651531957.666485:0:192753:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000098bec39b pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:192753:1731745997352704:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531957.666499:0:192753:0:(client.c:2492:ptlrpc_set_wait()) set 000000000073caa3 going to sleep for 6 seconds
00000100:00100000:1.0:1651531957.666765:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531957.666767:0:192753:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000098bec39b pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:192753:1731745997352704:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651531957.666779:0:192753:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca2ec6 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 58 type: EXT [446464->450559] (req 446464->450559) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531957.666787:0:166104:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467360512
00010000:00010000:0.0:1651531957.666792:0:166104:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ce7f2d16/0x3234de053ca2b70 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 58 type: EXT [442368->454655] (req 442368->446463) gid 0 flags: 0x60000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444ea0 expref: 62 pid: 166113 timeout: 22766 lvb_type: 0
00000100:00100000:0.0:1651531957.666799:0:166104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 162
00000100:00100000:0.0:1651531957.666801:0:166104:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cf58d30f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+62:438146:x1731754467360512:12345-10.240.43.64@tcp:103:ldlm_bl_05.0
00010000:00010000:0.0:1651531957.666804:0:166104:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531957.666808:0:166104:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ce7f2d16/0x3234de053ca2b70 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 59 type: EXT [442368->454655] (req 442368->446463) gid 0 flags: 0x60000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444ea0 expref: 62 pid: 166113 timeout: 22766 lvb_type: 0
00010000:00010000:0.0:1651531957.666813:0:166104:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ce7f2d16/0x3234de053ca2b70 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 59 type: EXT [442368->454655] (req 442368->446463) gid 0 flags: 0x50000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444ea0 expref: 62 pid: 166113 timeout: 22766 lvb_type: 0
00010000:00010000:0.0:1651531957.666820:0:166104:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ce7f2d16/0x3234de053ca2b70 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 59 type: EXT [442368->454655] (req 442368->446463) gid 0 flags: 0x44801400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444ea0 expref: 62 pid: 166113 timeout: 22766 lvb_type: 0
00010000:00010000:0.0:1651531957.666824:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531957.666824:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531957.666825:0:166104:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca2ec6 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 58 type: EXT [446464->450559] (req 446464->450559) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.666828:0:166104:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca2ec6 lrc: 4/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 58 type: EXT [446464->450559] (req 446464->450559) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.666835:0:166104:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651531957.666844:0:166104:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cf58d30f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+61:438146:x1731754467360512:12345-10.240.43.64@tcp:103:ldlm_bl_05.0 Request processed in 42us (79us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531957.666847:0:166104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 162
00010000:00010000:0.0:1651531957.666868:0:192753:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca2ec6 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 57 type: EXT [446464->450559] (req 446464->450559) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.666872:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca2ec6 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 57 type: EXT [446464->450559] (req 446464->450559) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.666885:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca2ec6 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 57 type: EXT [446464->450559] (req 446464->450559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.666888:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca2ec6 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 57 type: EXT [446464->450559] (req 446464->450559) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531957.666909:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005dd15341 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+60:438146:x1731754467360448:12345-10.240.43.64@tcp:3:fio.0 Request processed in 457us (493us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531957.666912:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249723
00010000:00010000:0.0:1651531957.666919:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca2ec6 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 57 type: EXT [446464->450559] (req 446464->450559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.666923:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fb2f6575 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531957.666924:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca2ec6 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 57 type: EXT [446464->450559] (req 446464->450559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.666927:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca2ec6 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 57 type: EXT [446464->450559] (req 446464->450559) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.666931:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca2ec6 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 57 type: EXT [446464->450559] (req 446464->450559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.666934:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca2ec6 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 57 type: EXT [446464->450559] (req 446464->450559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531957.667585:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531957.667593:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467360768
00000100:00100000:0.0:1651531957.667610:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249724
00000100:00100000:0.0:1651531957.667612:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000043aab0c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+60:438146:x1731754467360768:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531957.667619:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2ecd lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 57 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.667624:0:192753:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002dfc67f7/0x3234de053ca2b7e lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 57 type: EXT [491520->524287] (req 491520->495615) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444edf expref: 60 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.667628:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531957.667629:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531957.667630:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2ecd lrc: 4/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 57 type: EXT [507904->511999] (req 507904->511999) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.667637:0:192753:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002dfc67f7/0x3234de053ca2b7e lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 57 type: EXT [491520->524287] (req 491520->495615) gid 0 flags: 0x50000000020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444edf expref: 60 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.667640:0:192753:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002dfc67f7/0x3234de053ca2b7e lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 57 type: EXT [491520->524287] (req 491520->495615) gid 0 flags: 0x70000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444edf expref: 60 pid: 166113 timeout: 22766 lvb_type: 0
00000100:00100000:0.0:1651531957.667645:0:192753:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000045181741 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:192753:1731745997352768:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531957.667661:0:192753:0:(client.c:2492:ptlrpc_set_wait()) set 000000000073caa3 going to sleep for 6 seconds
00000100:00100000:0.0:1651531957.667938:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531957.667945:0:166102:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467360832
00010000:00010000:0.0:1651531957.667951:0:166102:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002dfc67f7/0x3234de053ca2b7e lrc: 5/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 57 type: EXT [491520->524287] (req 491520->495615) gid 0 flags: 0x60000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444edf expref: 61 pid: 166113 timeout: 22766 lvb_type: 0
00000100:00100000:0.0:1651531957.667958:0:166102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 163
00000100:00100000:0.0:1651531957.667960:0:166102:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000844a4f50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+61:438146:x1731754467360832:12345-10.240.43.64@tcp:103:ldlm_bl_03.0
00010000:00010000:0.0:1651531957.667963:0:166102:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531957.667967:0:166102:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002dfc67f7/0x3234de053ca2b7e lrc: 5/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 58 type: EXT [491520->524287] (req 491520->495615) gid 0 flags: 0x60000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444edf expref: 61 pid: 166113 timeout: 22766 lvb_type: 0
00010000:00010000:0.0:1651531957.667971:0:166102:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002dfc67f7/0x3234de053ca2b7e lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 58 type: EXT [491520->524287] (req 491520->495615) gid 0 flags: 0x50000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444edf expref: 61 pid: 166113 timeout: 22766 lvb_type: 0
00010000:00010000:0.0:1651531957.667981:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531957.667982:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531957.667983:0:166102:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2ecd lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 58 type: EXT [507904->511999] (req 507904->511999) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.667986:0:166102:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2ecd lrc: 4/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 58 type: EXT [507904->511999] (req 507904->511999) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.667991:0:166102:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651531957.668005:0:166102:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000844a4f50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+61:438146:x1731754467360832:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 44us (68us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531957.668008:0:166102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 163
00010000:00010000:0.0:1651531957.668020:0:192753:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002dfc67f7/0x3234de053ca2b7e lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 57 type: EXT [491520->524287] (req 491520->495615) gid 0 flags: 0x44801400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444edf expref: 60 pid: 166113 timeout: 22766 lvb_type: 0
00000100:00100000:0.0:1651531957.668024:0:192753:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000045181741 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:192753:1731745997352768:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651531957.668027:0:192753:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2ecd lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 56 type: EXT [507904->511999] (req 507904->511999) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.668031:0:192753:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2ecd lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 56 type: EXT [507904->511999] (req 507904->511999) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.668034:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2ecd lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 56 type: EXT [507904->511999] (req 507904->511999) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.668046:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2ecd lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 56 type: EXT [507904->511999] (req 507904->511999) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.668052:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2ecd lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 56 type: EXT [507904->511999] (req 507904->511999) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531957.668066:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000043aab0c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+59:438146:x1731754467360768:12345-10.240.43.64@tcp:3:fio.0 Request processed in 454us (482us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531957.668069:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249724
00010000:00010000:0.0:1651531957.668075:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2ecd lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 56 type: EXT [507904->511999] (req 507904->511999) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.668078:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fab23815 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531957.668079:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2ecd lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 56 type: EXT [507904->511999] (req 507904->511999) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.668082:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2ecd lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 56 type: EXT [507904->511999] (req 507904->511999) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.668087:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2ecd lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 56 type: EXT [507904->511999] (req 507904->511999) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.668090:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2ecd lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 56 type: EXT [507904->511999] (req 507904->511999) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531957.669138:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531957.669156:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467361216
00000100:00100000:0.0:1651531957.669172:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249725
00000100:00100000:0.0:1651531957.669174:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007a05c3e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+59:438147:x1731754467361216:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531957.669181:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca2ed4 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 56 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.669187:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531957.669187:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531957.669188:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca2ed4 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 56 type: EXT [753664->757759] (req 753664->757759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.669192:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca2ed4 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 56 type: EXT [753664->757759] (req 753664->757759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531957.714812:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869090 is committed
00010000:00010000:0.0:1651531957.714826:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca2ed4 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 56 type: EXT [753664->757759] (req 753664->757759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.714830:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca2ed4 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 56 type: EXT [753664->757759] (req 753664->757759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531957.714846:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007a05c3e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+59:438147:x1731754467361216:12345-10.240.43.64@tcp:4:fio.0 Request processed in 45671us (45708us total) trans 21474869090 rc 0/0
00000100:00100000:0.0:1651531957.714849:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249725
00010000:00010000:0.0:1651531957.714856:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca2ed4 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 56 type: EXT [753664->757759] (req 753664->757759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.714859:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c1022d42 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531957.714860:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca2ed4 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 56 type: EXT [753664->757759] (req 753664->757759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.714863:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca2ed4 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 56 type: EXT [753664->757759] (req 753664->757759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.714871:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca2ed4 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 56 type: EXT [753664->757759] (req 753664->757759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.714874:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca2ed4 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 56 type: EXT [753664->757759] (req 753664->757759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531957.739257:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531957.739281:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467361664
00000100:00100000:0.0:1651531957.739297:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249726
00000100:00100000:0.0:1651531957.739298:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000071f9ee43 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+59:438148:x1731754467361664:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531957.739306:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca2edb lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 56 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.739311:0:192753:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003c4c045e/0x3234de053ca2cea lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 56 type: EXT [946176->966655] (req 946176->950271) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4451f6 expref: 59 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.739314:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531957.739315:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531957.739316:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca2edb lrc: 4/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 56 type: EXT [962560->966655] (req 962560->966655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.739323:0:192753:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003c4c045e/0x3234de053ca2cea lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 56 type: EXT [946176->966655] (req 946176->950271) gid 0 flags: 0x50000000020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4451f6 expref: 59 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.739326:0:192753:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003c4c045e/0x3234de053ca2cea lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 56 type: EXT [946176->966655] (req 946176->950271) gid 0 flags: 0x70000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4451f6 expref: 59 pid: 166112 timeout: 22766 lvb_type: 0
00000100:00100000:0.0:1651531957.739331:0:192753:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000045181741 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:192753:1731745997352832:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531957.739345:0:192753:0:(client.c:2492:ptlrpc_set_wait()) set 000000000073caa3 going to sleep for 6 seconds
00000100:00100000:0.0:1651531957.739553:0:192753:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000045181741 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:192753:1731745997352832:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651531957.739557:0:192753:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca2edb lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 56 type: EXT [962560->966655] (req 962560->966655) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531957.739609:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531957.739619:0:166104:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467361856
00010000:00010000:0.0:1651531957.739624:0:166104:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003c4c045e/0x3234de053ca2cea lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 56 type: EXT [946176->966655] (req 946176->950271) gid 0 flags: 0x60000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4451f6 expref: 60 pid: 166112 timeout: 22766 lvb_type: 0
00000100:00100000:0.0:1651531957.739632:0:166104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 164
00000100:00100000:0.0:1651531957.739634:0:166104:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000045181741 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+60:438148:x1731754467361856:12345-10.240.43.64@tcp:103:ldlm_bl_06.0
00010000:00010000:0.0:1651531957.739637:0:166104:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531957.739641:0:166104:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003c4c045e/0x3234de053ca2cea lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 57 type: EXT [946176->966655] (req 946176->950271) gid 0 flags: 0x60000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4451f6 expref: 60 pid: 166112 timeout: 22766 lvb_type: 0
00010000:00010000:0.0:1651531957.739645:0:166104:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003c4c045e/0x3234de053ca2cea lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 57 type: EXT [946176->966655] (req 946176->950271) gid 0 flags: 0x50000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4451f6 expref: 60 pid: 166112 timeout: 22766 lvb_type: 0
00010000:00010000:0.0:1651531957.739651:0:166104:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c4c045e/0x3234de053ca2cea lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 57 type: EXT [946176->966655] (req 946176->950271) gid 0 flags: 0x44801400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4451f6 expref: 60 pid: 166112 timeout: 22766 lvb_type: 0
00010000:00010000:0.0:1651531957.739655:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531957.739656:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531957.739656:0:166104:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca2edb lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 56 type: EXT [962560->966655] (req 962560->966655) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.739660:0:166104:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca2edb lrc: 4/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 56 type: EXT [962560->966655] (req 962560->966655) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.739668:0:166104:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651531957.739680:0:166104:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000045181741 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+59:438148:x1731754467361856:12345-10.240.43.64@tcp:103:ldlm_bl_06.0 Request processed in 45us (71us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531957.739683:0:166104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 164
00010000:00010000:0.0:1651531957.739690:0:192753:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca2edb lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [962560->966655] (req 962560->966655) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.739693:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca2edb lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [962560->966655] (req 962560->966655) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.739706:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca2edb lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [962560->966655] (req 962560->966655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.739709:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca2edb lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [962560->966655] (req 962560->966655) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531957.739722:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000071f9ee43 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+58:438148:x1731754467361664:12345-10.240.43.64@tcp:3:fio.0 Request processed in 423us (467us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531957.739725:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249726
00010000:00010000:0.0:1651531957.739731:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca2edb lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [962560->966655] (req 962560->966655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.739734:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c1022d42 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531957.739735:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca2edb lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [962560->966655] (req 962560->966655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.739738:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca2edb lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [962560->966655] (req 962560->966655) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.739744:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca2edb lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [962560->966655] (req 962560->966655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.739747:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca2edb lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [962560->966655] (req 962560->966655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531957.740752:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531957.740770:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467362240
00000100:00100000:0.0:1651531957.740787:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249727
00000100:00100000:0.0:1651531957.740788:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fb90eb28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+58:438149:x1731754467362240:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531957.740795:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2ee2 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.740800:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531957.740800:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531957.740801:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2ee2 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [630784->634879] (req 630784->634879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.740805:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2ee2 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [630784->634879] (req 630784->634879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531957.787081:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531957.787104:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467362496
00000100:00100000:1.0:1651531957.787131:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249728
00000100:00100000:1.0:1651531957.787133:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002e4767d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+61:438147:x1731754467362496:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531957.787142:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca2ee9 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 56 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531957.787148:0:166118:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f253fba8/0x3234de053ca2ded lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 56 type: EXT [712704->716799] (req 712704->716799) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4453f5 expref: 61 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531957.787152:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531957.787153:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531957.787153:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca2ee9 lrc: 4/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 56 type: EXT [712704->716799] (req 712704->716799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531957.787161:0:166118:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f253fba8/0x3234de053ca2ded lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 56 type: EXT [712704->716799] (req 712704->716799) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4453f5 expref: 61 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531957.787165:0:166118:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f253fba8/0x3234de053ca2ded lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 56 type: EXT [712704->716799] (req 712704->716799) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4453f5 expref: 61 pid: 166112 timeout: 22766 lvb_type: 0
00000100:00100000:1.0:1651531957.787170:0:166118:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e4e3ecb5 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:166118:1731745997352896:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531957.787184:0:166118:0:(client.c:2492:ptlrpc_set_wait()) set 00000000996f1fed going to sleep for 6 seconds
00000100:00100000:1.0:1651531957.787404:0:166118:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e4e3ecb5 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:166118:1731745997352896:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651531957.787409:0:166118:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca2ee9 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 56 type: EXT [712704->716799] (req 712704->716799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531957.787526:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531957.787539:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531957.787548:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467362624
00000100:00100000:0.0:1651531957.787563:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249729
00000100:00100000:0.0:1651531957.787565:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e4e3ecb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+62:438149:x1731754467362624:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651531957.787573:0:166102:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467362688
00010000:00010000:0.0:1651531957.787573:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca2ef0 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 57 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.787582:0:216321:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000d9e7472/0x3234de053ca2c26 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 57 type: EXT [53248->61439] (req 53248->57343) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445021 expref: 62 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.787586:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531957.787586:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531957.787587:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca2ef0 lrc: 4/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 57 type: EXT [57344->61439] (req 57344->61439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531957.787588:0:166102:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f253fba8/0x3234de053ca2ded lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 58 type: EXT [712704->716799] (req 712704->716799) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4453f5 expref: 63 pid: 166112 timeout: 22766 lvb_type: 0
00010000:00010000:0.0:1651531957.787594:0:216321:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000d9e7472/0x3234de053ca2c26 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 57 type: EXT [53248->61439] (req 53248->57343) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445021 expref: 63 pid: 166112 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531957.787600:0:166102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 165
00000100:00100000:1.0:1651531957.787602:0:166102:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009078ca7d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+63:438146:x1731754467362688:12345-10.240.43.64@tcp:103:ldlm_bl_02.0
00010000:00010000:1.0:1651531957.787605:0:166102:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531957.787605:0:216321:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000d9e7472/0x3234de053ca2c26 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 57 type: EXT [53248->61439] (req 53248->57343) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445021 expref: 63 pid: 166112 timeout: 22766 lvb_type: 0
00010000:00010000:1.0:1651531957.787609:0:166102:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f253fba8/0x3234de053ca2ded lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 58 type: EXT [712704->716799] (req 712704->716799) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4453f5 expref: 63 pid: 166112 timeout: 22766 lvb_type: 0
00000100:00100000:0.0:1651531957.787609:0:216321:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000098bec39b pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997352960:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651531957.787613:0:166102:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f253fba8/0x3234de053ca2ded lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 58 type: EXT [712704->716799] (req 712704->716799) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4453f5 expref: 63 pid: 166112 timeout: 22766 lvb_type: 0
00010000:00010000:1.0:1651531957.787620:0:166102:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f253fba8/0x3234de053ca2ded lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 58 type: EXT [712704->716799] (req 712704->716799) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4453f5 expref: 63 pid: 166112 timeout: 22766 lvb_type: 0
00000100:00100000:0.0:1651531957.787622:0:216321:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a2b9dcac going to sleep for 6 seconds
00010000:00010000:1.0:1651531957.787624:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531957.787625:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531957.787626:0:166102:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca2ee9 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 57 type: EXT [712704->716799] (req 712704->716799) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531957.787629:0:166102:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca2ee9 lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 57 type: EXT [712704->716799] (req 712704->716799) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531957.787637:0:166102:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1651531957.787645:0:166102:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009078ca7d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+62:438146:x1731754467362688:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 43us (106us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531957.787648:0:166102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 165
00010000:00010000:1.0:1651531957.787683:0:166118:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca2ee9 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 56 type: EXT [712704->716799] (req 712704->716799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531957.787696:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca2ee9 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 56 type: EXT [712704->716799] (req 712704->716799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531957.787853:0:216321:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000098bec39b pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997352960:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651531957.787857:0:216321:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca2ef0 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 56 type: EXT [57344->61439] (req 57344->61439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531957.787911:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531957.787935:0:166102:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467362752
00010000:00010000:1.0:1651531957.787942:0:166102:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000d9e7472/0x3234de053ca2c26 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 56 type: EXT [53248->61439] (req 53248->57343) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445021 expref: 64 pid: 166112 timeout: 22766 lvb_type: 0
00000100:00100000:1.0:1651531957.787953:0:166102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 166
00000100:00100000:1.0:1651531957.787955:0:166102:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000098bec39b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+64:438148:x1731754467362752:12345-10.240.43.64@tcp:103:ldlm_bl_01.0
00010000:00010000:1.0:1651531957.787958:0:166102:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1651531957.787961:0:166102:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000d9e7472/0x3234de053ca2c26 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 57 type: EXT [53248->61439] (req 53248->57343) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445021 expref: 64 pid: 166112 timeout: 22766 lvb_type: 0
00010000:00010000:1.0:1651531957.787966:0:166102:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000d9e7472/0x3234de053ca2c26 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 57 type: EXT [53248->61439] (req 53248->57343) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445021 expref: 64 pid: 166112 timeout: 22766 lvb_type: 0
00010000:00010000:1.0:1651531957.787972:0:166102:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000d9e7472/0x3234de053ca2c26 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 57 type: EXT [53248->61439] (req 53248->57343) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445021 expref: 64 pid: 166112 timeout: 22766 lvb_type: 0
00010000:00010000:1.0:1651531957.787976:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531957.787976:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531957.787977:0:166102:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca2ef0 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 56 type: EXT [57344->61439] (req 57344->61439) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531957.787981:0:166102:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca2ef0 lrc: 4/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 56 type: EXT [57344->61439] (req 57344->61439) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531957.788001:0:166102:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1651531957.788006:0:216321:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca2ef0 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [57344->61439] (req 57344->61439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.788010:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca2ef0 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [57344->61439] (req 57344->61439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531957.788012:0:166102:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000098bec39b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+63:438148:x1731754467362752:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 56us (101us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531957.788015:0:166102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 166
00010000:00010000:0.0:1651531957.788028:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca2ef0 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [57344->61439] (req 57344->61439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.788031:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca2ef0 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [57344->61439] (req 57344->61439) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531957.788047:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e4e3ecb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+62:438149:x1731754467362624:12345-10.240.43.64@tcp:3:fio.0 Request processed in 481us (521us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531957.788050:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249729
00010000:00010000:1.0:1651531957.788056:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca2ef0 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [57344->61439] (req 57344->61439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531957.788060:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c1022d42 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531957.788061:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca2ef0 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [57344->61439] (req 57344->61439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531957.788064:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca2ef0 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [57344->61439] (req 57344->61439) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531957.788069:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca2ef0 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [57344->61439] (req 57344->61439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531957.788072:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca2ef0 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [57344->61439] (req 57344->61439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531957.799046:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869091 is committed
00010000:00010000:0.0:1651531957.799060:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2ee2 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 54 type: EXT [630784->634879] (req 630784->634879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.799064:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2ee2 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 54 type: EXT [630784->634879] (req 630784->634879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531957.799084:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fb90eb28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+59:438149:x1731754467362240:12345-10.240.43.64@tcp:4:fio.0 Request processed in 58295us (58332us total) trans 21474869091 rc 0/0
00000100:00100000:0.0:1651531957.799088:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249727
00010000:00010000:0.0:1651531957.799095:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2ee2 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 54 type: EXT [630784->634879] (req 630784->634879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.799098:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fab23815 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531957.799099:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2ee2 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 54 type: EXT [630784->634879] (req 630784->634879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.799102:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2ee2 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 54 type: EXT [630784->634879] (req 630784->634879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.799109:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2ee2 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 54 type: EXT [630784->634879] (req 630784->634879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.799112:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2ee2 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 54 type: EXT [630784->634879] (req 630784->634879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531957.799471:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531957.799479:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467362944
00000100:00100000:0.0:1651531957.799490:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249730
00000100:00100000:0.0:1651531957.799491:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000017a53f9a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+59:438148:x1731754467362944:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531957.799498:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca2ef7 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 54 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.799503:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531957.799503:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531957.799505:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca2ef7 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 54 type: EXT [630784->634879] (req 630784->634879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.799509:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca2ef7 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 54 type: EXT [630784->634879] (req 630784->634879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531957.811510:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531957.811531:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467363392
00000100:00100000:0.0:1651531957.811546:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249731
00000100:00100000:0.0:1651531957.811548:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000add44b2e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+62:438148:x1731754467363392:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531957.811556:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2efe lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.811565:0:216321:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca2e5d lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [1019904->1028095] (req 1019904->1023999) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4454d5 expref: 62 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.811568:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531957.811569:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531957.811569:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2efe lrc: 4/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [1024000->1028095] (req 1024000->1028095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.811576:0:216321:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca2e5d lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [1019904->1028095] (req 1019904->1023999) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4454d5 expref: 62 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.811580:0:216321:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca2e5d lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [1019904->1028095] (req 1019904->1023999) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4454d5 expref: 62 pid: 166112 timeout: 22766 lvb_type: 0
00000100:00100000:0.0:1651531957.811584:0:216321:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000036404f05 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997353024:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531957.811598:0:216321:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a2b9dcac going to sleep for 6 seconds
00000100:00100000:1.0:1651531957.811898:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531957.811906:0:166102:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467363456
00000100:00100000:0.0:1651531957.811909:0:216321:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000036404f05 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997353024:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651531957.811912:0:166102:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca2e5d lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [1019904->1028095] (req 1019904->1023999) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4454d5 expref: 63 pid: 166112 timeout: 22766 lvb_type: 0
00010000:00010000:0.0:1651531957.811914:0:216321:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2efe lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 56 type: EXT [1024000->1028095] (req 1024000->1028095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531957.811922:0:166102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 167
00000100:00100000:1.0:1651531957.811926:0:166102:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dce6a2c5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+63:438146:x1731754467363456:12345-10.240.43.64@tcp:103:ldlm_bl_05.0
00010000:00010000:1.0:1651531957.811929:0:166102:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1651531957.811932:0:166102:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca2e5d lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 56 type: EXT [1019904->1028095] (req 1019904->1023999) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4454d5 expref: 63 pid: 166112 timeout: 22766 lvb_type: 0
00010000:00010000:1.0:1651531957.811936:0:166102:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca2e5d lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 56 type: EXT [1019904->1028095] (req 1019904->1023999) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4454d5 expref: 63 pid: 166112 timeout: 22766 lvb_type: 0
00010000:00010000:1.0:1651531957.811942:0:166102:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca2e5d lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 56 type: EXT [1019904->1028095] (req 1019904->1023999) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4454d5 expref: 63 pid: 166112 timeout: 22766 lvb_type: 0
00010000:00010000:1.0:1651531957.811946:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531957.811947:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531957.811948:0:166102:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2efe lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [1024000->1028095] (req 1024000->1028095) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531957.811951:0:166102:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2efe lrc: 4/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [1024000->1028095] (req 1024000->1028095) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531957.811962:0:166102:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1651531957.811971:0:166102:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dce6a2c5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+62:438146:x1731754467363456:12345-10.240.43.64@tcp:103:ldlm_bl_05.0 Request processed in 44us (73us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531957.811973:0:166102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 167
00010000:00010000:0.0:1651531957.811973:0:216321:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2efe lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 54 type: EXT [1024000->1028095] (req 1024000->1028095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.811977:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2efe lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 54 type: EXT [1024000->1028095] (req 1024000->1028095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.811993:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2efe lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 54 type: EXT [1024000->1028095] (req 1024000->1028095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.811996:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2efe lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 54 type: EXT [1024000->1028095] (req 1024000->1028095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531957.812016:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000add44b2e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+61:438148:x1731754467363392:12345-10.240.43.64@tcp:3:fio.0 Request processed in 467us (506us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531957.812020:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249731
00010000:00010000:0.0:1651531957.812027:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2efe lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 54 type: EXT [1024000->1028095] (req 1024000->1028095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.812030:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fab23815 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531957.812031:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2efe lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 54 type: EXT [1024000->1028095] (req 1024000->1028095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.812034:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2efe lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 54 type: EXT [1024000->1028095] (req 1024000->1028095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.812039:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2efe lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 54 type: EXT [1024000->1028095] (req 1024000->1028095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.812041:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2efe lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 54 type: EXT [1024000->1028095] (req 1024000->1028095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531957.812714:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531957.812723:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467363712
00000100:00100000:0.0:1651531957.812738:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249732
00000100:00100000:0.0:1651531957.812740:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000036404f05 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+61:438148:x1731754467363712:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531957.812754:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca2f05 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 54 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.812759:0:216321:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca2e3a lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 54 type: EXT [184320->208895] (req 184320->188415) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4454a4 expref: 61 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.812763:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531957.812764:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531957.812764:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca2f05 lrc: 4/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 54 type: EXT [188416->192511] (req 188416->192511) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.812771:0:216321:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca2e3a lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 54 type: EXT [184320->208895] (req 184320->188415) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4454a4 expref: 61 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.812775:0:216321:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca2e3a lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 54 type: EXT [184320->208895] (req 184320->188415) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4454a4 expref: 61 pid: 166112 timeout: 22766 lvb_type: 0
00000100:00100000:0.0:1651531957.812780:0:216321:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000042972edd pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997353088:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531957.812796:0:216321:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a2b9dcac going to sleep for 6 seconds
00000100:00100000:0.0:1651531957.813047:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531957.813063:0:216321:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000042972edd pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997353088:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531957.813065:0:166102:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467363776
00010000:00010000:0.0:1651531957.813067:0:216321:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca2f05 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 54 type: EXT [188416->192511] (req 188416->192511) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531957.813071:0:166102:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca2e3a lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 54 type: EXT [184320->208895] (req 184320->188415) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4454a4 expref: 62 pid: 166112 timeout: 22766 lvb_type: 0
00000100:00100000:1.0:1651531957.813082:0:166102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 168
00000100:00100000:1.0:1651531957.813085:0:166102:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000087355620 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+62:438147:x1731754467363776:12345-10.240.43.64@tcp:103:ldlm_bl_03.0
00010000:00010000:1.0:1651531957.813088:0:166102:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1651531957.813091:0:166102:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca2e3a lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [184320->208895] (req 184320->188415) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4454a4 expref: 62 pid: 166112 timeout: 22766 lvb_type: 0
00010000:00010000:1.0:1651531957.813095:0:166102:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca2e3a lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [184320->208895] (req 184320->188415) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4454a4 expref: 62 pid: 166112 timeout: 22766 lvb_type: 0
00010000:00010000:1.0:1651531957.813101:0:166102:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca2e3a lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 55 type: EXT [184320->208895] (req 184320->188415) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4454a4 expref: 62 pid: 166112 timeout: 22766 lvb_type: 0
00010000:00010000:1.0:1651531957.813105:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531957.813106:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531957.813107:0:166102:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca2f05 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 54 type: EXT [188416->192511] (req 188416->192511) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531957.813110:0:166102:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca2f05 lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 54 type: EXT [188416->192511] (req 188416->192511) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531957.813120:0:166102:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1651531957.813129:0:216321:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca2f05 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 53 type: EXT [188416->192511] (req 188416->192511) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531957.813130:0:166102:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000087355620 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+61:438147:x1731754467363776:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 45us (84us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531957.813133:0:166102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 168
00010000:00010000:0.0:1651531957.813145:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca2f05 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 53 type: EXT [188416->192511] (req 188416->192511) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531957.844535:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869093 is committed
00010000:00010000:1.0:1651531957.844566:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca2ee9 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 53 type: EXT [712704->716799] (req 712704->716799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531957.844571:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca2ee9 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 53 type: EXT [712704->716799] (req 712704->716799) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.844583:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca2ef7 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 53 type: EXT [630784->634879] (req 630784->634879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.844589:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca2ef7 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 53 type: EXT [630784->634879] (req 630784->634879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531957.844593:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002e4767d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+58:438147:x1731754467362496:12345-10.240.43.64@tcp:4:fio.0 Request processed in 57459us (57513us total) trans 21474869092 rc 0/0
00000100:00100000:1.0:1651531957.844597:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249728
00010000:00010000:1.0:1651531957.844608:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca2ee9 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 53 type: EXT [712704->716799] (req 712704->716799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531957.844612:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001e36c601 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531957.844613:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca2ee9 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 53 type: EXT [712704->716799] (req 712704->716799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531957.844616:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca2ee9 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 53 type: EXT [712704->716799] (req 712704->716799) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531957.844620:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000017a53f9a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+57:438148:x1731754467362944:12345-10.240.43.64@tcp:4:fio.0 Request processed in 45127us (45148us total) trans 21474869093 rc 0/0
00010000:00010000:1.0:1651531957.844621:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca2ee9 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 53 type: EXT [712704->716799] (req 712704->716799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531957.844623:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca2ee9 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 53 type: EXT [712704->716799] (req 712704->716799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531957.844626:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249730
00010000:00010000:1.0:1651531957.844627:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca2ef7 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 52 type: EXT [630784->634879] (req 630784->634879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531957.844639:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fb2f6575 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531957.844640:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca2ef7 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 52 type: EXT [630784->634879] (req 630784->634879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531957.844643:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca2ef7 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 52 type: EXT [630784->634879] (req 630784->634879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531957.844649:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca2ef7 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 52 type: EXT [630784->634879] (req 630784->634879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531957.844651:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca2ef7 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 52 type: EXT [630784->634879] (req 630784->634879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531957.844993:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531957.845017:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467363968
00000100:00100000:0.0:1651531957.845032:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249733
00000100:00100000:0.0:1651531957.845034:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000028779db6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+57:438146:x1731754467363968:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531957.845041:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2f0c lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 52 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.845046:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531957.845046:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531957.845047:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2f0c lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 52 type: EXT [770048->774143] (req 770048->774143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.845051:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2f0c lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 52 type: EXT [770048->774143] (req 770048->774143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531957.880180:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869094 is committed
00010000:00010000:0.0:1651531957.880249:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca2f05 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 52 type: EXT [188416->192511] (req 188416->192511) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.880254:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca2f05 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 52 type: EXT [188416->192511] (req 188416->192511) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531957.880280:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000036404f05 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+57:438148:x1731754467363712:12345-10.240.43.64@tcp:4:fio.0 Request processed in 67539us (67566us total) trans 21474869094 rc 0/0
00000100:00100000:0.0:1651531957.880283:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249732
00010000:00010000:0.0:1651531957.880303:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca2f05 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 52 type: EXT [188416->192511] (req 188416->192511) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.880306:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000820577fb already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531957.880307:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca2f05 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 52 type: EXT [188416->192511] (req 188416->192511) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.880310:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca2f05 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 52 type: EXT [188416->192511] (req 188416->192511) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.880316:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca2f05 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 52 type: EXT [188416->192511] (req 188416->192511) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.880318:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca2f05 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 52 type: EXT [188416->192511] (req 188416->192511) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531957.916940:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531957.916967:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467365120
00000100:00100000:0.0:1651531957.916985:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249734
00000100:00100000:0.0:1651531957.916987:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000670433b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+57:438149:x1731754467365120:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531957.916995:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca2f13 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 52 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.917001:0:216321:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca2e10 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 52 type: EXT [16384->24575] (req 16384->20479) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44545e expref: 57 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.917004:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531957.917005:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531957.917005:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca2f13 lrc: 4/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 52 type: EXT [20480->24575] (req 20480->24575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.917013:0:216321:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca2e10 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 52 type: EXT [16384->24575] (req 16384->20479) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44545e expref: 57 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.917017:0:216321:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca2e10 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 52 type: EXT [16384->24575] (req 16384->20479) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44545e expref: 57 pid: 166112 timeout: 22766 lvb_type: 0
00000100:00100000:0.0:1651531957.917021:0:216321:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000042972edd pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997353152:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531957.917034:0:216321:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a2b9dcac going to sleep for 6 seconds
00000100:00100000:1.0:1651531957.917328:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531957.917334:0:216321:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000042972edd pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997353152:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531957.917336:0:166102:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467365184
00010000:00010000:0.0:1651531957.917339:0:216321:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca2f13 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 52 type: EXT [20480->24575] (req 20480->24575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531957.917343:0:166102:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca2e10 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 53 type: EXT [16384->24575] (req 16384->20479) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44545e expref: 58 pid: 166112 timeout: 22766 lvb_type: 0
00000100:00100000:1.0:1651531957.917351:0:166102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 169
00000100:00100000:1.0:1651531957.917353:0:166102:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001e1e0cd6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+58:438146:x1731754467365184:12345-10.240.43.64@tcp:103:ldlm_bl_02.0
00010000:00010000:1.0:1651531957.917356:0:166102:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1651531957.917359:0:166102:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca2e10 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 53 type: EXT [16384->24575] (req 16384->20479) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44545e expref: 58 pid: 166112 timeout: 22766 lvb_type: 0
00010000:00010000:1.0:1651531957.917364:0:166102:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca2e10 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 53 type: EXT [16384->24575] (req 16384->20479) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44545e expref: 58 pid: 166112 timeout: 22766 lvb_type: 0
00010000:00010000:1.0:1651531957.917370:0:166102:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca2e10 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 53 type: EXT [16384->24575] (req 16384->20479) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44545e expref: 58 pid: 166112 timeout: 22766 lvb_type: 0
00010000:00010000:1.0:1651531957.917375:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531957.917385:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531957.917386:0:166102:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca2f13 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 52 type: EXT [20480->24575] (req 20480->24575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531957.917390:0:166102:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca2f13 lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 52 type: EXT [20480->24575] (req 20480->24575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531957.917399:0:166102:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1651531957.917405:0:216321:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca2f13 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 51 type: EXT [20480->24575] (req 20480->24575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531957.917411:0:166102:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001e1e0cd6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+57:438146:x1731754467365184:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 58us (84us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531957.917414:0:166102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 169
00010000:00010000:0.0:1651531957.917418:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca2f13 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 51 type: EXT [20480->24575] (req 20480->24575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531957.930856:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869095 is committed
00010000:00010000:1.0:1651531957.930886:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2f0c lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 51 type: EXT [770048->774143] (req 770048->774143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531957.930890:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2f0c lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 51 type: EXT [770048->774143] (req 770048->774143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531957.930911:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000028779db6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+56:438146:x1731754467363968:12345-10.240.43.64@tcp:4:fio.0 Request processed in 85876us (85918us total) trans 21474869095 rc 0/0
00010000:00010000:0.0:1651531957.930912:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2f0c lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 51 type: EXT [770048->774143] (req 770048->774143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531957.930914:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249733
00010000:00010000:0.0:1651531957.930916:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fab23815 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531957.930917:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2f0c lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 51 type: EXT [770048->774143] (req 770048->774143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.930920:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2f0c lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 51 type: EXT [770048->774143] (req 770048->774143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.930926:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2f0c lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 51 type: EXT [770048->774143] (req 770048->774143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.930929:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2f0c lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 51 type: EXT [770048->774143] (req 770048->774143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531957.957120:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531957.957152:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467365568
00000100:00100000:1.0:1651531957.957166:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249735
00000100:00100000:1.0:1651531957.957168:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000042972edd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+56:438148:x1731754467365568:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531957.957176:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca2f1a lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 51 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531957.957181:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531957.957182:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531957.957183:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca2f1a lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 51 type: EXT [614400->618495] (req 614400->618495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531957.957197:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca2f1a lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 51 type: EXT [614400->618495] (req 614400->618495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531957.957219:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca2f1a lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 51 type: EXT [614400->618495] (req 614400->618495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531957.957241:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca2f1a lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 51 type: EXT [614400->618495] (req 614400->618495) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531957.957258:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000042972edd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+56:438148:x1731754467365568:12345-10.240.43.64@tcp:3:fio.0 Request processed in 89us (138us total) trans 0 rc 4096/4096
00010000:00010000:0.0:1651531957.957260:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca2f1a lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 51 type: EXT [614400->618495] (req 614400->618495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531957.957261:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249735
00010000:00010000:0.0:1651531957.957264:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001e36c601 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531957.957265:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca2f1a lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 51 type: EXT [614400->618495] (req 614400->618495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.957272:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca2f1a lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 51 type: EXT [614400->618495] (req 614400->618495) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.957277:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca2f1a lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 51 type: EXT [614400->618495] (req 614400->618495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.957280:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca2f1a lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 51 type: EXT [614400->618495] (req 614400->618495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531957.993567:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869096 is committed
00010000:00010000:0.0:1651531957.993584:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca2f13 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 50 type: EXT [20480->24575] (req 20480->24575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.993589:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca2f13 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 50 type: EXT [20480->24575] (req 20480->24575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531957.993607:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000670433b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+53:438149:x1731754467365120:12345-10.240.43.64@tcp:4:fio.0 Request processed in 76619us (76667us total) trans 21474869096 rc 0/0
00000100:00100000:0.0:1651531957.993611:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249734
00010000:00010000:0.0:1651531957.993618:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca2f13 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 50 type: EXT [20480->24575] (req 20480->24575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.993622:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000820577fb already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531957.993623:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca2f13 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 50 type: EXT [20480->24575] (req 20480->24575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.993626:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca2f13 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 50 type: EXT [20480->24575] (req 20480->24575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.993632:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca2f13 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 50 type: EXT [20480->24575] (req 20480->24575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.993635:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca2f13 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 50 type: EXT [20480->24575] (req 20480->24575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531957.994709:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531957.994727:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467366336
00000100:00100000:0.0:1651531957.994745:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249736
00000100:00100000:0.0:1651531957.994747:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009078ca7d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+53:438147:x1731754467366336:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531957.994755:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2f21 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 50 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.994759:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531957.994760:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531957.994761:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2f21 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 50 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.994765:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2f21 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 50 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.994777:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2f21 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 50 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.994780:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2f21 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 50 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531957.994796:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009078ca7d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+53:438147:x1731754467366336:12345-10.240.43.64@tcp:3:fio.0 Request processed in 49us (88us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531957.994802:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249736
00010000:00010000:0.0:1651531957.994808:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2f21 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 50 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.994811:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fab23815 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531957.994812:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2f21 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 50 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.994815:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2f21 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 50 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.994820:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2f21 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 50 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531957.994823:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2f21 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 50 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531958.020020:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531958.020042:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467366976
00000100:00100000:0.0:1651531958.020058:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249737
00000100:00100000:0.0:1651531958.020059:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dce6a2c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+53:438149:x1731754467366976:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531958.020066:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2f28 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 50 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.020071:0:216321:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004df6dea8/0x3234de053ca2d4c lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 50 type: EXT [356352->372735] (req 356352->360447) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4452a5 expref: 53 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.020075:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531958.020076:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531958.020077:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2f28 lrc: 4/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 50 type: EXT [368640->372735] (req 368640->372735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.020085:0:216321:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004df6dea8/0x3234de053ca2d4c lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 50 type: EXT [356352->372735] (req 356352->360447) gid 0 flags: 0x50000000020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4452a5 expref: 53 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.020089:0:216321:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004df6dea8/0x3234de053ca2d4c lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 50 type: EXT [356352->372735] (req 356352->360447) gid 0 flags: 0x70000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4452a5 expref: 53 pid: 166112 timeout: 22766 lvb_type: 0
00000100:00100000:0.0:1651531958.020093:0:216321:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c2670ecb pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997353216:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531958.020106:0:216321:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a2b9dcac going to sleep for 6 seconds
00000100:00100000:0.0:1651531958.020323:0:216321:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c2670ecb pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997353216:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651531958.020328:0:216321:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2f28 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 50 type: EXT [368640->372735] (req 368640->372735) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531958.020421:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531958.020442:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467367104
00000100:00100000:0.0:1651531958.020442:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531958.020457:0:166102:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467367168
00000100:00100000:1.0:1651531958.020462:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249738
00000100:00100000:1.0:1651531958.020464:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c2670ecb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+55:438149:x1731754467367104:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531958.020469:0:166102:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004df6dea8/0x3234de053ca2d4c lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 50 type: EXT [356352->372735] (req 356352->360447) gid 0 flags: 0x60000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4452a5 expref: 55 pid: 166112 timeout: 22766 lvb_type: 0
00010000:00010000:1.0:1651531958.020473:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca2f2f lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 51 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531958.020477:0:166102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 170
00010000:00010000:1.0:1651531958.020478:0:192753:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f78aa55f/0x3234de053ca2a66 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 51 type: EXT [872448->884735] (req 872448->876543) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c1c expref: 55 pid: 206699 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531958.020479:0:166102:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000af5f6682 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+55:438147:x1731754467367168:12345-10.240.43.64@tcp:103:ldlm_bl_01.0
00010000:00010000:1.0:1651531958.020482:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531958.020482:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531958.020482:0:166102:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1651531958.020483:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca2f2f lrc: 4/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 52 type: EXT [876544->880639] (req 876544->880639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.020492:0:166102:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004df6dea8/0x3234de053ca2d4c lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 52 type: EXT [356352->372735] (req 356352->360447) gid 0 flags: 0x60000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4452a5 expref: 55 pid: 166112 timeout: 22766 lvb_type: 0
00010000:00010000:1.0:1651531958.020495:0:192753:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f78aa55f/0x3234de053ca2a66 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 53 type: EXT [872448->884735] (req 872448->876543) gid 0 flags: 0x50000000020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c1c expref: 55 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.020499:0:192753:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f78aa55f/0x3234de053ca2a66 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 52 type: EXT [872448->884735] (req 872448->876543) gid 0 flags: 0x70000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c1c expref: 55 pid: 206699 timeout: 22766 lvb_type: 0
00000100:00100000:1.0:1651531958.020503:0:192753:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dccc50c6 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:192753:1731745997353280:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651531958.020503:0:166102:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004df6dea8/0x3234de053ca2d4c lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 52 type: EXT [356352->372735] (req 356352->360447) gid 0 flags: 0x50000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4452a5 expref: 55 pid: 166112 timeout: 22766 lvb_type: 0
00010000:00010000:0.0:1651531958.020509:0:166102:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004df6dea8/0x3234de053ca2d4c lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 52 type: EXT [356352->372735] (req 356352->360447) gid 0 flags: 0x44801400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4452a5 expref: 55 pid: 166112 timeout: 22766 lvb_type: 0
00010000:00010000:0.0:1651531958.020513:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531958.020514:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531958.020515:0:166102:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2f28 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 51 type: EXT [368640->372735] (req 368640->372735) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531958.020516:0:192753:0:(client.c:2492:ptlrpc_set_wait()) set 00000000996f1fed going to sleep for 6 seconds
00010000:00010000:0.0:1651531958.020518:0:166102:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2f28 lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 51 type: EXT [368640->372735] (req 368640->372735) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.020525:0:166102:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651531958.020533:0:166102:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000af5f6682 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+54:438147:x1731754467367168:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 54us (91us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531958.020536:0:166102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 170
00010000:00010000:0.0:1651531958.020545:0:216321:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2f28 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 50 type: EXT [368640->372735] (req 368640->372735) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.020548:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2f28 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 50 type: EXT [368640->372735] (req 368640->372735) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531958.020849:0:192753:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dccc50c6 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:192753:1731745997353280:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531958.020850:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651531958.020854:0:192753:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca2f2f lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 50 type: EXT [876544->880639] (req 876544->880639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531958.020859:0:166104:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467367232
00010000:00010000:0.0:1651531958.020865:0:166104:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f78aa55f/0x3234de053ca2a66 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 50 type: EXT [872448->884735] (req 872448->876543) gid 0 flags: 0x60000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c1c expref: 56 pid: 206699 timeout: 22766 lvb_type: 0
00000100:00100000:0.0:1651531958.020877:0:166104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 171
00000100:00100000:0.0:1651531958.020879:0:166104:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009acdfe57 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+56:438147:x1731754467367232:12345-10.240.43.64@tcp:103:ldlm_bl_05.0
00010000:00010000:0.0:1651531958.020882:0:166104:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00002000:00010000:0.0:1651531958.020885:0:166104:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x34545:0x0] updating lvb mtime from disk: 1651531957 -> 1651531958
00002000:00010000:0.0:1651531958.020886:0:166104:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x34545:0x0] updating lvb ctime from disk: 1651531957 -> 1651531958
00010000:00010000:0.0:1651531958.020887:0:166104:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f78aa55f/0x3234de053ca2a66 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 51 type: EXT [872448->884735] (req 872448->876543) gid 0 flags: 0x60000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c1c expref: 56 pid: 206699 timeout: 22766 lvb_type: 0
00010000:00010000:0.0:1651531958.020891:0:166104:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f78aa55f/0x3234de053ca2a66 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 51 type: EXT [872448->884735] (req 872448->876543) gid 0 flags: 0x50000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c1c expref: 56 pid: 206699 timeout: 22766 lvb_type: 0
00010000:00010000:0.0:1651531958.020897:0:166104:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f78aa55f/0x3234de053ca2a66 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 51 type: EXT [872448->884735] (req 872448->876543) gid 0 flags: 0x44801400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c1c expref: 56 pid: 206699 timeout: 22766 lvb_type: 0
00010000:00010000:0.0:1651531958.020901:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531958.020902:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531958.020903:0:166104:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca2f2f lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 50 type: EXT [876544->880639] (req 876544->880639) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.020906:0:166104:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca2f2f lrc: 4/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 50 type: EXT [876544->880639] (req 876544->880639) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.020916:0:166104:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1651531958.020921:0:192753:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca2f2f lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 49 type: EXT [876544->880639] (req 876544->880639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.020924:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca2f2f lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 49 type: EXT [876544->880639] (req 876544->880639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531958.020928:0:166104:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009acdfe57 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+55:438147:x1731754467367232:12345-10.240.43.64@tcp:103:ldlm_bl_05.0 Request processed in 49us (79us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531958.020931:0:166104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 171
00010000:00010000:1.0:1651531958.020942:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca2f2f lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 49 type: EXT [876544->880639] (req 876544->880639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.020945:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca2f2f lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 49 type: EXT [876544->880639] (req 876544->880639) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.020958:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca2f2f lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 49 type: EXT [876544->880639] (req 876544->880639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.020962:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c2b76533 already unused, calling callback (0000000049fddea7)
00000100:00100000:1.0:1651531958.020965:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c2670ecb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+54:438149:x1731754467367104:12345-10.240.43.64@tcp:3:fio.0 Request processed in 500us (545us total) trans 0 rc 4096/4096
00010000:00010000:0.0:1651531958.020968:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca2f2f lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 49 type: EXT [876544->880639] (req 876544->880639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531958.020971:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249738
00010000:00010000:0.0:1651531958.020971:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca2f2f lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 49 type: EXT [876544->880639] (req 876544->880639) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.020976:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca2f2f lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 49 type: EXT [876544->880639] (req 876544->880639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.020978:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca2f2f lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 49 type: EXT [876544->880639] (req 876544->880639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531958.070482:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531958.070504:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467367552
00000100:00100000:1.0:1651531958.070520:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249739
00000100:00100000:1.0:1651531958.070521:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001e3c8bc4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+54:438148:x1731754467367552:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531958.070528:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca2f36 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 49 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.070533:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531958.070534:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531958.070535:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca2f36 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 49 type: EXT [450560->454655] (req 450560->454655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.070539:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca2f36 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 49 type: EXT [450560->454655] (req 450560->454655) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531958.081515:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869097 is committed
00010000:00010000:0.0:1651531958.081530:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2f28 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 49 type: EXT [368640->372735] (req 368640->372735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.081534:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2f28 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 49 type: EXT [368640->372735] (req 368640->372735) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531958.081556:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dce6a2c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+54:438149:x1731754467366976:12345-10.240.43.64@tcp:4:fio.0 Request processed in 61495us (61536us total) trans 21474869097 rc 0/0
00000100:00100000:0.0:1651531958.081559:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249737
00010000:00010000:0.0:1651531958.081567:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2f28 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 49 type: EXT [368640->372735] (req 368640->372735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.081574:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fab23815 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531958.081575:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2f28 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 49 type: EXT [368640->372735] (req 368640->372735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.081577:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2f28 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 49 type: EXT [368640->372735] (req 368640->372735) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.081583:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2f28 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 49 type: EXT [368640->372735] (req 368640->372735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.081585:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2f28 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 49 type: EXT [368640->372735] (req 368640->372735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531958.144218:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869098 is committed
00010000:00010000:1.0:1651531958.144252:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca2f36 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 48 type: EXT [450560->454655] (req 450560->454655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.144256:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca2f36 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 48 type: EXT [450560->454655] (req 450560->454655) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531958.144278:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001e3c8bc4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+51:438148:x1731754467367552:12345-10.240.43.64@tcp:4:fio.0 Request processed in 73756us (73796us total) trans 21474869098 rc 0/0
00010000:00010000:0.0:1651531958.144280:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca2f36 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 48 type: EXT [450560->454655] (req 450560->454655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531958.144281:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249739
00010000:00010000:0.0:1651531958.144285:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006da7a892 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531958.144286:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca2f36 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 48 type: EXT [450560->454655] (req 450560->454655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.144289:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca2f36 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 48 type: EXT [450560->454655] (req 450560->454655) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.144295:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca2f36 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 48 type: EXT [450560->454655] (req 450560->454655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.144298:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca2f36 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 48 type: EXT [450560->454655] (req 450560->454655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531958.144616:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531958.144624:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467368256
00000100:00100000:1.0:1651531958.144639:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249740
00000100:00100000:1.0:1651531958.144641:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dccc50c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+51:438149:x1731754467368256:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531958.144649:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca2f3d lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 48 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.144654:0:192753:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000049c67f6a/0x3234de053ca2dd8 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 48 type: EXT [24576->36863] (req 24576->28671) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4453cb expref: 51 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.144658:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531958.144658:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531958.144659:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca2f3d lrc: 4/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 48 type: EXT [24576->28671] (req 24576->28671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.144666:0:192753:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000049c67f6a/0x3234de053ca2dd8 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 48 type: EXT [24576->36863] (req 24576->28671) gid 0 flags: 0x50000000020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4453cb expref: 51 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.144670:0:192753:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000049c67f6a/0x3234de053ca2dd8 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 48 type: EXT [24576->36863] (req 24576->28671) gid 0 flags: 0x70000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4453cb expref: 51 pid: 166112 timeout: 22766 lvb_type: 0
00000100:00100000:1.0:1651531958.144674:0:192753:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002d3e5ae4 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:192753:1731745997353344:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531958.144685:0:192753:0:(client.c:2492:ptlrpc_set_wait()) set 00000000996f1fed going to sleep for 6 seconds
00000100:00100000:1.0:1651531958.144989:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531958.145003:0:192753:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002d3e5ae4 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:192753:1731745997353344:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651531958.145007:0:192753:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca2f3d lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 48 type: EXT [24576->28671] (req 24576->28671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531958.145007:0:166102:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467368320
00010000:00010000:0.0:1651531958.145015:0:166102:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000049c67f6a/0x3234de053ca2dd8 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 48 type: EXT [24576->36863] (req 24576->28671) gid 0 flags: 0x60000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4453cb expref: 52 pid: 166112 timeout: 22766 lvb_type: 0
00000100:00100000:0.0:1651531958.145024:0:166102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 172
00000100:00100000:0.0:1651531958.145025:0:166102:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b67ad021 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+52:438146:x1731754467368320:12345-10.240.43.64@tcp:103:ldlm_bl_03.0
00010000:00010000:0.0:1651531958.145029:0:166102:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531958.145033:0:166102:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000049c67f6a/0x3234de053ca2dd8 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 49 type: EXT [24576->36863] (req 24576->28671) gid 0 flags: 0x60000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4453cb expref: 52 pid: 166112 timeout: 22766 lvb_type: 0
00010000:00010000:0.0:1651531958.145037:0:166102:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000049c67f6a/0x3234de053ca2dd8 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 49 type: EXT [24576->36863] (req 24576->28671) gid 0 flags: 0x50000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4453cb expref: 52 pid: 166112 timeout: 22766 lvb_type: 0
00010000:00010000:0.0:1651531958.145044:0:166102:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000049c67f6a/0x3234de053ca2dd8 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 49 type: EXT [24576->36863] (req 24576->28671) gid 0 flags: 0x44801400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4453cb expref: 52 pid: 166112 timeout: 22766 lvb_type: 0
00010000:00010000:0.0:1651531958.145048:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531958.145048:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531958.145049:0:166102:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca2f3d lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 48 type: EXT [24576->28671] (req 24576->28671) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.145053:0:166102:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca2f3d lrc: 4/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 48 type: EXT [24576->28671] (req 24576->28671) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.145066:0:166102:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651531958.145076:0:166102:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b67ad021 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+51:438146:x1731754467368320:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 50us (88us total) trans 0 rc 0/0
00010000:00010000:1.0:1651531958.145078:0:192753:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca2f3d lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 47 type: EXT [24576->28671] (req 24576->28671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.145082:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca2f3d lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 47 type: EXT [24576->28671] (req 24576->28671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531958.145082:0:166102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 172
00010000:00010000:1.0:1651531958.145097:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca2f3d lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 47 type: EXT [24576->28671] (req 24576->28671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.145100:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca2f3d lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 47 type: EXT [24576->28671] (req 24576->28671) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.145121:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca2f3d lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 47 type: EXT [24576->28671] (req 24576->28671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531958.145123:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dccc50c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+50:438149:x1731754467368256:12345-10.240.43.64@tcp:3:fio.0 Request processed in 481us (507us total) trans 0 rc 4096/4096
00010000:00010000:0.0:1651531958.145125:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e9b84540 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531958.145126:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca2f3d lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 47 type: EXT [24576->28671] (req 24576->28671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531958.145127:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249740
00010000:00010000:0.0:1651531958.145129:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca2f3d lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 47 type: EXT [24576->28671] (req 24576->28671) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.145134:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca2f3d lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 47 type: EXT [24576->28671] (req 24576->28671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.145137:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca2f3d lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 47 type: EXT [24576->28671] (req 24576->28671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531958.170454:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531958.170463:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467369024
00000100:00100000:1.0:1651531958.170477:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249741
00000100:00100000:1.0:1651531958.170479:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002d3e5ae4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+50:438149:x1731754467369024:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531958.170486:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca2f44 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 47 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.170491:0:192753:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca2b85 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 47 type: EXT [479232->491519] (req 479232->483327) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444ee6 expref: 50 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.170495:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531958.170495:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531958.170496:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca2f44 lrc: 4/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 47 type: EXT [483328->487423] (req 483328->487423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.170503:0:192753:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca2b85 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 47 type: EXT [479232->491519] (req 479232->483327) gid 0 flags: 0x50000000020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444ee6 expref: 50 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.170511:0:192753:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca2b85 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 47 type: EXT [479232->491519] (req 479232->483327) gid 0 flags: 0x70000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444ee6 expref: 50 pid: 166112 timeout: 22766 lvb_type: 0
00000100:00100000:1.0:1651531958.170515:0:192753:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000089660739 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:192753:1731745997353408:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531958.170526:0:192753:0:(client.c:2492:ptlrpc_set_wait()) set 00000000996f1fed going to sleep for 6 seconds
00000100:00100000:1.0:1651531958.170736:0:192753:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000089660739 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:192753:1731745997353408:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651531958.170741:0:192753:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca2f44 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 47 type: EXT [483328->487423] (req 483328->487423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531958.170838:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531958.170856:0:166104:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467369088
00010000:00010000:0.0:1651531958.170863:0:166104:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca2b85 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 47 type: EXT [479232->491519] (req 479232->483327) gid 0 flags: 0x60000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444ee6 expref: 51 pid: 166112 timeout: 22766 lvb_type: 0
00000100:00100000:0.0:1651531958.170871:0:166104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 173
00000100:00100000:0.0:1651531958.170872:0:166104:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000089660739 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+51:438148:x1731754467369088:12345-10.240.43.64@tcp:103:ldlm_bl_06.0
00010000:00010000:0.0:1651531958.170876:0:166104:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531958.170879:0:166104:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca2b85 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 48 type: EXT [479232->491519] (req 479232->483327) gid 0 flags: 0x60000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444ee6 expref: 51 pid: 166112 timeout: 22766 lvb_type: 0
00010000:00010000:0.0:1651531958.170886:0:166104:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca2b85 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 48 type: EXT [479232->491519] (req 479232->483327) gid 0 flags: 0x50000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444ee6 expref: 51 pid: 166112 timeout: 22766 lvb_type: 0
00010000:00010000:0.0:1651531958.170892:0:166104:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca2b85 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 48 type: EXT [479232->491519] (req 479232->483327) gid 0 flags: 0x44801400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444ee6 expref: 51 pid: 166112 timeout: 22766 lvb_type: 0
00010000:00010000:0.0:1651531958.170896:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531958.170897:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531958.170897:0:166104:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca2f44 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 47 type: EXT [483328->487423] (req 483328->487423) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.170900:0:166104:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca2f44 lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 47 type: EXT [483328->487423] (req 483328->487423) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.170912:0:166104:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651531958.170921:0:166104:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000089660739 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+50:438148:x1731754467369088:12345-10.240.43.64@tcp:103:ldlm_bl_06.0 Request processed in 48us (84us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531958.170924:0:166104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 173
00010000:00010000:1.0:1651531958.170925:0:192753:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca2f44 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 46 type: EXT [483328->487423] (req 483328->487423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.170929:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca2f44 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 46 type: EXT [483328->487423] (req 483328->487423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531958.221184:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869099 is committed
00010000:00010000:1.0:1651531958.221233:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca2f44 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 46 type: EXT [483328->487423] (req 483328->487423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.221237:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca2f44 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 46 type: EXT [483328->487423] (req 483328->487423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531958.221257:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002d3e5ae4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+49:438149:x1731754467369024:12345-10.240.43.64@tcp:4:fio.0 Request processed in 50777us (50803us total) trans 21474869099 rc 0/0
00000100:00100000:1.0:1651531958.221260:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249741
00010000:00010000:0.0:1651531958.221260:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca2f44 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 46 type: EXT [483328->487423] (req 483328->487423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.221265:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008558d1b3 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531958.221266:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca2f44 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 46 type: EXT [483328->487423] (req 483328->487423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.221269:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca2f44 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 46 type: EXT [483328->487423] (req 483328->487423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.221276:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca2f44 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 46 type: EXT [483328->487423] (req 483328->487423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.221279:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca2f44 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 46 type: EXT [483328->487423] (req 483328->487423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531958.221623:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531958.221631:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467369600
00000100:00100000:1.0:1651531958.221645:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249742
00000100:00100000:1.0:1651531958.221647:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aa58c961 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+49:438147:x1731754467369600:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531958.221654:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca2f4b lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 46 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.221658:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531958.221659:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531958.221660:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca2f4b lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 46 type: EXT [20480->24575] (req 20480->24575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.221664:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca2f4b lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 46 type: EXT [20480->24575] (req 20480->24575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531958.258043:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869100 is committed
00010000:00010000:1.0:1651531958.258071:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca2f4b lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 46 type: EXT [20480->24575] (req 20480->24575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.258075:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca2f4b lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 46 type: EXT [20480->24575] (req 20480->24575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531958.258095:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aa58c961 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+49:438147:x1731754467369600:12345-10.240.43.64@tcp:4:fio.0 Request processed in 36447us (36472us total) trans 21474869100 rc 0/0
00010000:00010000:0.0:1651531958.258097:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca2f4b lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 46 type: EXT [20480->24575] (req 20480->24575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531958.258098:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249742
00010000:00010000:0.0:1651531958.258101:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e9b84540 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531958.258102:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca2f4b lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 46 type: EXT [20480->24575] (req 20480->24575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.258105:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca2f4b lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 46 type: EXT [20480->24575] (req 20480->24575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.258110:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca2f4b lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 46 type: EXT [20480->24575] (req 20480->24575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.258113:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca2f4b lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 46 type: EXT [20480->24575] (req 20480->24575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531958.313674:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531958.313682:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467370240
00000100:00100000:1.0:1651531958.313697:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249743
00000100:00100000:1.0:1651531958.313699:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000021f31110 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+49:438148:x1731754467370240:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531958.313708:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca2f52 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 46 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.313713:0:192753:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca2cc0 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 46 type: EXT [172032->180223] (req 172032->176127) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4451a2 expref: 49 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.313716:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531958.313717:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531958.313718:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca2f52 lrc: 4/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 46 type: EXT [176128->180223] (req 176128->180223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.313725:0:192753:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca2cc0 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 46 type: EXT [172032->180223] (req 172032->176127) gid 0 flags: 0x50000000020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4451a2 expref: 49 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.313728:0:192753:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca2cc0 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 46 type: EXT [172032->180223] (req 172032->176127) gid 0 flags: 0x70000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4451a2 expref: 49 pid: 166111 timeout: 22766 lvb_type: 0
00000100:00100000:1.0:1651531958.313732:0:192753:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000000615301 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:192753:1731745997353472:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531958.313744:0:192753:0:(client.c:2492:ptlrpc_set_wait()) set 00000000996f1fed going to sleep for 6 seconds
00000100:00100000:1.0:1651531958.313890:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531958.313911:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467370368
00000100:00100000:0.0:1651531958.313925:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249744
00000100:00100000:0.0:1651531958.313927:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003158b8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+50:438147:x1731754467370368:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531958.313934:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2f59 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 47 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.313940:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531958.313941:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531958.313942:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2f59 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 47 type: EXT [360448->364543] (req 360448->364543) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.313945:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2f59 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 47 type: EXT [360448->364543] (req 360448->364543) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531958.314090:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531958.314101:0:192753:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000000615301 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:192753:1731745997353472:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651531958.314105:0:192753:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca2f52 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 47 type: EXT [176128->180223] (req 176128->180223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531958.314112:0:166102:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467370432
00010000:00010000:0.0:1651531958.314120:0:166102:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca2cc0 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 47 type: EXT [172032->180223] (req 172032->176127) gid 0 flags: 0x60000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4451a2 expref: 53 pid: 166111 timeout: 22766 lvb_type: 0
00000100:00100000:0.0:1651531958.314130:0:166102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 174
00000100:00100000:0.0:1651531958.314131:0:166102:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000e33e11e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+53:438147:x1731754467370432:12345-10.240.43.64@tcp:103:ldlm_bl_02.0
00010000:00010000:0.0:1651531958.314135:0:166102:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531958.314138:0:166102:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca2cc0 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 48 type: EXT [172032->180223] (req 172032->176127) gid 0 flags: 0x60000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4451a2 expref: 53 pid: 166111 timeout: 22766 lvb_type: 0
00010000:00010000:0.0:1651531958.314142:0:166102:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca2cc0 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 48 type: EXT [172032->180223] (req 172032->176127) gid 0 flags: 0x50000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4451a2 expref: 53 pid: 166111 timeout: 22766 lvb_type: 0
00010000:00010000:0.0:1651531958.314149:0:166102:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca2cc0 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 48 type: EXT [172032->180223] (req 172032->176127) gid 0 flags: 0x44801400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4451a2 expref: 53 pid: 166111 timeout: 22766 lvb_type: 0
00010000:00010000:0.0:1651531958.314153:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531958.314154:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531958.314154:0:166102:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca2f52 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 47 type: EXT [176128->180223] (req 176128->180223) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.314159:0:166102:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca2f52 lrc: 4/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 47 type: EXT [176128->180223] (req 176128->180223) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.314172:0:166102:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651531958.314182:0:166102:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000e33e11e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+52:438147:x1731754467370432:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 50us (93us total) trans 0 rc 0/0
00010000:00010000:1.0:1651531958.314184:0:192753:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca2f52 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 46 type: EXT [176128->180223] (req 176128->180223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531958.314185:0:166102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 174
00010000:00010000:1.0:1651531958.314192:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca2f52 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 46 type: EXT [176128->180223] (req 176128->180223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.314214:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca2f52 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 46 type: EXT [176128->180223] (req 176128->180223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.314217:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca2f52 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 46 type: EXT [176128->180223] (req 176128->180223) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.314241:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca2f52 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 46 type: EXT [176128->180223] (req 176128->180223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.314245:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006da7a892 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531958.314247:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca2f52 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 46 type: EXT [176128->180223] (req 176128->180223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531958.314248:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000021f31110 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+51:438148:x1731754467370240:12345-10.240.43.64@tcp:3:fio.0 Request processed in 548us (574us total) trans 0 rc 4096/4096
00010000:00010000:0.0:1651531958.314250:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca2f52 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 46 type: EXT [176128->180223] (req 176128->180223) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531958.314251:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249743
00010000:00010000:0.0:1651531958.314255:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca2f52 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 46 type: EXT [176128->180223] (req 176128->180223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.314258:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca2f52 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 46 type: EXT [176128->180223] (req 176128->180223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531958.379301:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869101 is committed
00010000:00010000:0.0:1651531958.379318:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2f59 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 45 type: EXT [360448->364543] (req 360448->364543) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.379322:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2f59 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 45 type: EXT [360448->364543] (req 360448->364543) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531958.379345:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003158b8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+48:438147:x1731754467370368:12345-10.240.43.64@tcp:4:fio.0 Request processed in 65417us (65455us total) trans 21474869101 rc 0/0
00000100:00100000:0.0:1651531958.379349:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249744
00010000:00010000:0.0:1651531958.379357:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2f59 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 45 type: EXT [360448->364543] (req 360448->364543) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.379360:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fab23815 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531958.379361:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2f59 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 45 type: EXT [360448->364543] (req 360448->364543) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.379364:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2f59 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 45 type: EXT [360448->364543] (req 360448->364543) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.379369:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2f59 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 45 type: EXT [360448->364543] (req 360448->364543) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.379372:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2f59 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 45 type: EXT [360448->364543] (req 360448->364543) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531958.380292:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531958.380310:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467371328
00000100:00100000:0.0:1651531958.380327:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249745
00000100:00100000:0.0:1651531958.380329:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000000615301 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+48:438149:x1731754467371328:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531958.380336:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca2f60 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 45 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.380340:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531958.380342:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531958.380344:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca2f60 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 45 type: EXT [28672->32767] (req 28672->32767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.380348:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca2f60 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 45 type: EXT [28672->32767] (req 28672->32767) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.380360:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca2f60 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 45 type: EXT [28672->32767] (req 28672->32767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.380362:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca2f60 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 45 type: EXT [28672->32767] (req 28672->32767) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531958.380383:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000000615301 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+48:438149:x1731754467371328:12345-10.240.43.64@tcp:3:fio.0 Request processed in 53us (92us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531958.380386:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249745
00010000:00010000:0.0:1651531958.380393:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca2f60 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 45 type: EXT [28672->32767] (req 28672->32767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.380396:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000820577fb already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531958.380397:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca2f60 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 45 type: EXT [28672->32767] (req 28672->32767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.380400:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca2f60 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 45 type: EXT [28672->32767] (req 28672->32767) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.380404:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca2f60 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 45 type: EXT [28672->32767] (req 28672->32767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.380407:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca2f60 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 45 type: EXT [28672->32767] (req 28672->32767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531958.380808:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531958.380826:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467371712
00000100:00100000:0.0:1651531958.380842:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249746
00000100:00100000:0.0:1651531958.380843:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000053de45f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+48:438148:x1731754467371712:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531958.380850:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca2f67 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 45 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.380854:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531958.380855:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531958.380856:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca2f67 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 45 type: EXT [516096->520191] (req 516096->520191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.380859:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca2f67 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 45 type: EXT [516096->520191] (req 516096->520191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531958.418014:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869102 is committed
00010000:00010000:0.0:1651531958.418029:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca2f67 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 45 type: EXT [516096->520191] (req 516096->520191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.418034:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca2f67 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 45 type: EXT [516096->520191] (req 516096->520191) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531958.418057:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000053de45f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+48:438148:x1731754467371712:12345-10.240.43.64@tcp:4:fio.0 Request processed in 37212us (37248us total) trans 21474869102 rc 0/0
00000100:00100000:0.0:1651531958.418060:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249746
00010000:00010000:0.0:1651531958.418068:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca2f67 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 45 type: EXT [516096->520191] (req 516096->520191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.418075:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000032ee36ee already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531958.418076:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca2f67 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 45 type: EXT [516096->520191] (req 516096->520191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.418079:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca2f67 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 45 type: EXT [516096->520191] (req 516096->520191) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.418084:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca2f67 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 45 type: EXT [516096->520191] (req 516096->520191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.418087:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca2f67 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 45 type: EXT [516096->520191] (req 516096->520191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531958.418431:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531958.418449:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467372032
00000100:00100000:0.0:1651531958.418466:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249747
00000100:00100000:0.0:1651531958.418468:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006c46ca95 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+48:438149:x1731754467372032:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531958.418475:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca2f6e lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 45 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.418480:0:216321:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a0fea916/0x3234de053ca2b23 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 45 type: EXT [909312->929791] (req 909312->913407) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444d96 expref: 48 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.418484:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531958.418485:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531958.418485:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca2f6e lrc: 4/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 45 type: EXT [925696->929791] (req 925696->929791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.418496:0:216321:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a0fea916/0x3234de053ca2b23 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 45 type: EXT [909312->929791] (req 909312->913407) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444d96 expref: 48 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.418500:0:216321:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a0fea916/0x3234de053ca2b23 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 45 type: EXT [909312->929791] (req 909312->913407) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444d96 expref: 48 pid: 166113 timeout: 22767 lvb_type: 0
00000100:00100000:0.0:1651531958.418504:0:216321:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000006e3b98d pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997353536:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531958.418522:0:216321:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a2b9dcac going to sleep for 6 seconds
00000100:00100000:1.0:1651531958.418833:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531958.418835:0:216321:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000006e3b98d pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997353536:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651531958.418846:0:216321:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca2f6e lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 45 type: EXT [925696->929791] (req 925696->929791) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531958.418853:0:166104:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467372096
00010000:00010000:0.0:1651531958.418858:0:166104:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a0fea916/0x3234de053ca2b23 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 45 type: EXT [909312->929791] (req 909312->913407) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444d96 expref: 49 pid: 166113 timeout: 22767 lvb_type: 0
00000100:00100000:0.0:1651531958.418866:0:166104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 175
00000100:00100000:0.0:1651531958.418867:0:166104:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cc11a3b9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+49:438146:x1731754467372096:12345-10.240.43.64@tcp:103:ldlm_bl_05.0
00010000:00010000:0.0:1651531958.418870:0:166104:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531958.418874:0:166104:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a0fea916/0x3234de053ca2b23 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 46 type: EXT [909312->929791] (req 909312->913407) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444d96 expref: 49 pid: 166113 timeout: 22767 lvb_type: 0
00010000:00010000:0.0:1651531958.418878:0:166104:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a0fea916/0x3234de053ca2b23 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 46 type: EXT [909312->929791] (req 909312->913407) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444d96 expref: 49 pid: 166113 timeout: 22767 lvb_type: 0
00010000:00010000:0.0:1651531958.418887:0:166104:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a0fea916/0x3234de053ca2b23 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 46 type: EXT [909312->929791] (req 909312->913407) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444d96 expref: 49 pid: 166113 timeout: 22767 lvb_type: 0
00010000:00010000:0.0:1651531958.418892:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531958.418892:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531958.418893:0:166104:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca2f6e lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 45 type: EXT [925696->929791] (req 925696->929791) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.418896:0:166104:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca2f6e lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 45 type: EXT [925696->929791] (req 925696->929791) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.418902:0:166104:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651531958.418919:0:166104:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cc11a3b9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+48:438146:x1731754467372096:12345-10.240.43.64@tcp:103:ldlm_bl_05.0 Request processed in 50us (86us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531958.418922:0:166104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 175
00010000:00010000:0.0:1651531958.418930:0:216321:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca2f6e lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 44 type: EXT [925696->929791] (req 925696->929791) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.418933:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca2f6e lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 44 type: EXT [925696->929791] (req 925696->929791) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531958.443816:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531958.443825:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531958.443835:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467372416
00000100:00100000:0.0:1651531958.443844:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467372352
00000100:00100000:1.0:1651531958.443847:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249748
00000100:00100000:1.0:1651531958.443849:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a899ddab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+51:438149:x1731754467372416:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531958.443856:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca2f75 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 45 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.443867:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531958.443868:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:0.0:1651531958.443868:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249749
00010000:00010000:1.0:1651531958.443869:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca2f75 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 45 type: EXT [708608->712703] (req 708608->712703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531958.443871:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000033696ffa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+51:438149:x1731754467372352:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531958.443874:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca2f75 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 45 type: EXT [708608->712703] (req 708608->712703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.443883:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca2f7c lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 46 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.443898:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531958.443899:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531958.443900:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca2f7c lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 46 type: EXT [348160->352255] (req 348160->352255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.443907:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca2f7c lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 46 type: EXT [348160->352255] (req 348160->352255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.443943:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca2f7c lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 46 type: EXT [348160->352255] (req 348160->352255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.443947:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca2f7c lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 46 type: EXT [348160->352255] (req 348160->352255) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531958.443982:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000033696ffa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+53:438149:x1731754467372352:12345-10.240.43.64@tcp:3:fio.0 Request processed in 109us (155us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531958.443989:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249749
00010000:00010000:0.0:1651531958.444014:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca2f7c lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 46 type: EXT [348160->352255] (req 348160->352255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.444021:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000032ee36ee already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531958.444022:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca2f7c lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 46 type: EXT [348160->352255] (req 348160->352255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.444027:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca2f7c lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 46 type: EXT [348160->352255] (req 348160->352255) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.444034:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca2f7c lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 46 type: EXT [348160->352255] (req 348160->352255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.444038:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca2f7c lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 46 type: EXT [348160->352255] (req 348160->352255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531958.455338:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869103 is committed
00010000:00010000:0.0:1651531958.455351:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca2f6e lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 45 type: EXT [925696->929791] (req 925696->929791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.455355:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca2f6e lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 45 type: EXT [925696->929791] (req 925696->929791) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531958.455376:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006c46ca95 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+50:438149:x1731754467372032:12345-10.240.43.64@tcp:4:fio.0 Request processed in 36907us (36945us total) trans 21474869103 rc 0/0
00000100:00100000:0.0:1651531958.455379:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249747
00010000:00010000:0.0:1651531958.455387:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca2f6e lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 45 type: EXT [925696->929791] (req 925696->929791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.455390:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000820577fb already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531958.455391:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca2f6e lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 45 type: EXT [925696->929791] (req 925696->929791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.455394:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca2f6e lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 45 type: EXT [925696->929791] (req 925696->929791) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.455399:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca2f6e lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 45 type: EXT [925696->929791] (req 925696->929791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.455401:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca2f6e lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 45 type: EXT [925696->929791] (req 925696->929791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531958.455719:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531958.455737:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467372864
00000100:00100000:0.0:1651531958.455749:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249750
00000100:00100000:0.0:1651531958.455750:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000427633c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+50:438148:x1731754467372864:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531958.455757:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca2f83 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 45 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.455761:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531958.455762:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531958.455763:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca2f83 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 45 type: EXT [720896->724991] (req 720896->724991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.455766:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca2f83 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 45 type: EXT [720896->724991] (req 720896->724991) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531958.514771:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869105 is committed
00010000:00010000:0.0:1651531958.514793:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca2f83 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 45 type: EXT [720896->724991] (req 720896->724991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.514797:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca2f83 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 45 type: EXT [720896->724991] (req 720896->724991) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.514805:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca2f75 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 45 type: EXT [708608->712703] (req 708608->712703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.514809:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca2f75 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 45 type: EXT [708608->712703] (req 708608->712703) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531958.514823:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000427633c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+48:438148:x1731754467372864:12345-10.240.43.64@tcp:4:fio.0 Request processed in 59072us (59105us total) trans 21474869105 rc 0/0
00000100:00100000:0.0:1651531958.514827:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249750
00000100:00100000:1.0:1651531958.514831:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a899ddab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+47:438149:x1731754467372416:12345-10.240.43.64@tcp:4:fio.0 Request processed in 70982us (71015us total) trans 21474869104 rc 0/0
00000100:00100000:1.0:1651531958.514835:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249748
00010000:00010000:0.0:1651531958.514835:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca2f83 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 45 type: EXT [720896->724991] (req 720896->724991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.514842:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000032ee36ee already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531958.514843:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca2f83 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 45 type: EXT [720896->724991] (req 720896->724991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.514846:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca2f83 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 45 type: EXT [720896->724991] (req 720896->724991) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.514851:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca2f83 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 45 type: EXT [720896->724991] (req 720896->724991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.514854:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca2f83 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 45 type: EXT [720896->724991] (req 720896->724991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.514857:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca2f75 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 44 type: EXT [708608->712703] (req 708608->712703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.514860:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c2b76533 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531958.514861:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca2f75 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 44 type: EXT [708608->712703] (req 708608->712703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.514863:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca2f75 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 44 type: EXT [708608->712703] (req 708608->712703) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.514866:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca2f75 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 44 type: EXT [708608->712703] (req 708608->712703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.514869:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca2f75 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 44 type: EXT [708608->712703] (req 708608->712703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531958.515748:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531958.515755:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467373696
00000100:00100000:1.0:1651531958.515770:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249751
00000100:00100000:1.0:1651531958.515772:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b10bc064 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+47:438148:x1731754467373696:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531958.515780:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca2f8a lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 44 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.515785:0:192753:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000141899af/0x3234de053ca2b38 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 44 type: EXT [401408->434175] (req 401408->405503) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444de3 expref: 47 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.515789:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531958.515789:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531958.515790:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca2f8a lrc: 4/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 44 type: EXT [413696->417791] (req 413696->417791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.515801:0:192753:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000141899af/0x3234de053ca2b38 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 44 type: EXT [401408->434175] (req 401408->405503) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444de3 expref: 47 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.515805:0:192753:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000141899af/0x3234de053ca2b38 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 44 type: EXT [401408->434175] (req 401408->405503) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444de3 expref: 47 pid: 166111 timeout: 22767 lvb_type: 0
00000100:00100000:1.0:1651531958.515809:0:192753:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000099b6616a pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:192753:1731745997353600:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531958.515821:0:192753:0:(client.c:2492:ptlrpc_set_wait()) set 00000000996f1fed going to sleep for 6 seconds
00000100:00100000:1.0:1651531958.516003:0:192753:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000099b6616a pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:192753:1731745997353600:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651531958.516007:0:192753:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca2f8a lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 44 type: EXT [413696->417791] (req 413696->417791) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531958.516094:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531958.516106:0:166102:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467373824
00010000:00010000:0.0:1651531958.516114:0:166102:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000141899af/0x3234de053ca2b38 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 44 type: EXT [401408->434175] (req 401408->405503) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444de3 expref: 48 pid: 166111 timeout: 22767 lvb_type: 0
00000100:00100000:0.0:1651531958.516122:0:166102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 176
00000100:00100000:0.0:1651531958.516124:0:166102:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000eae2589f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+48:438148:x1731754467373824:12345-10.240.43.64@tcp:103:ldlm_bl_06.0
00010000:00010000:0.0:1651531958.516127:0:166102:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531958.516131:0:166102:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000141899af/0x3234de053ca2b38 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 45 type: EXT [401408->434175] (req 401408->405503) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444de3 expref: 48 pid: 166111 timeout: 22767 lvb_type: 0
00010000:00010000:0.0:1651531958.516136:0:166102:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000141899af/0x3234de053ca2b38 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 45 type: EXT [401408->434175] (req 401408->405503) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444de3 expref: 48 pid: 166111 timeout: 22767 lvb_type: 0
00010000:00010000:0.0:1651531958.516142:0:166102:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000141899af/0x3234de053ca2b38 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 45 type: EXT [401408->434175] (req 401408->405503) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444de3 expref: 48 pid: 166111 timeout: 22767 lvb_type: 0
00010000:00010000:0.0:1651531958.516146:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531958.516146:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531958.516147:0:166102:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca2f8a lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 44 type: EXT [413696->417791] (req 413696->417791) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.516151:0:166102:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca2f8a lrc: 4/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 44 type: EXT [413696->417791] (req 413696->417791) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.516163:0:166102:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651531958.516174:0:166102:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000eae2589f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+47:438148:x1731754467373824:12345-10.240.43.64@tcp:103:ldlm_bl_06.0 Request processed in 49us (80us total) trans 0 rc 0/0
00010000:00010000:1.0:1651531958.516176:0:192753:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca2f8a lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 43 type: EXT [413696->417791] (req 413696->417791) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531958.516179:0:166102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 176
00010000:00010000:1.0:1651531958.516180:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca2f8a lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 43 type: EXT [413696->417791] (req 413696->417791) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.516194:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca2f8a lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 43 type: EXT [413696->417791] (req 413696->417791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.516197:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca2f8a lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 43 type: EXT [413696->417791] (req 413696->417791) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.516220:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca2f8a lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 43 type: EXT [413696->417791] (req 413696->417791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531958.516233:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b10bc064 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+46:438148:x1731754467373696:12345-10.240.43.64@tcp:3:fio.0 Request processed in 448us (474us total) trans 0 rc 4096/4096
00010000:00010000:0.0:1651531958.516234:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001e36c601 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531958.516235:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca2f8a lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 43 type: EXT [413696->417791] (req 413696->417791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531958.516238:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249751
00010000:00010000:0.0:1651531958.516238:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca2f8a lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 43 type: EXT [413696->417791] (req 413696->417791) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.516243:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca2f8a lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 43 type: EXT [413696->417791] (req 413696->417791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.516246:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca2f8a lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 43 type: EXT [413696->417791] (req 413696->417791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531958.516884:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531958.516891:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467374080
00000100:00100000:1.0:1651531958.516905:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249752
00000100:00100000:1.0:1651531958.516907:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000099b6616a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+46:438148:x1731754467374080:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531958.516914:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2f91 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 43 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.516918:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531958.516919:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531958.516920:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2f91 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 43 type: EXT [626688->630783] (req 626688->630783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.516923:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2f91 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 43 type: EXT [626688->630783] (req 626688->630783) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.516934:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2f91 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 43 type: EXT [626688->630783] (req 626688->630783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.516937:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2f91 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 43 type: EXT [626688->630783] (req 626688->630783) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.516954:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2f91 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 43 type: EXT [626688->630783] (req 626688->630783) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531958.516956:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000099b6616a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+46:438148:x1731754467374080:12345-10.240.43.64@tcp:3:fio.0 Request processed in 48us (72us total) trans 0 rc 4096/4096
00010000:00010000:0.0:1651531958.516958:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a8889a80 already unused, calling callback (0000000049fddea7)
00000100:00100000:1.0:1651531958.516959:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249752
00010000:00010000:0.0:1651531958.516959:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2f91 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 43 type: EXT [626688->630783] (req 626688->630783) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.516962:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2f91 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 43 type: EXT [626688->630783] (req 626688->630783) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.516967:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2f91 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 43 type: EXT [626688->630783] (req 626688->630783) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.516971:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2f91 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 43 type: EXT [626688->630783] (req 626688->630783) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531958.517255:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531958.517263:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467374208
00000100:00100000:1.0:1651531958.517276:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249753
00000100:00100000:1.0:1651531958.517278:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d76314b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+46:438149:x1731754467374208:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531958.517285:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca2f98 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 43 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.517290:0:192753:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000064aa83ac/0x3234de053ca2ce3 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 43 type: EXT [131072->147455] (req 131072->135167) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4451ef expref: 46 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.517293:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531958.517294:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531958.517294:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca2f98 lrc: 4/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 43 type: EXT [139264->143359] (req 139264->143359) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.517301:0:192753:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000064aa83ac/0x3234de053ca2ce3 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 43 type: EXT [131072->147455] (req 131072->135167) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4451ef expref: 46 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.517305:0:192753:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000064aa83ac/0x3234de053ca2ce3 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 43 type: EXT [131072->147455] (req 131072->135167) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4451ef expref: 46 pid: 166111 timeout: 22767 lvb_type: 0
00000100:00100000:1.0:1651531958.517309:0:192753:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008b42dfe9 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:192753:1731745997353664:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531958.517321:0:192753:0:(client.c:2492:ptlrpc_set_wait()) set 00000000996f1fed going to sleep for 6 seconds
00000100:00100000:1.0:1651531958.517564:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531958.517578:0:192753:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008b42dfe9 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:192753:1731745997353664:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531958.517581:0:166104:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467374272
00010000:00010000:1.0:1651531958.517582:0:192753:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca2f98 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 43 type: EXT [139264->143359] (req 139264->143359) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.517588:0:166104:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000064aa83ac/0x3234de053ca2ce3 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 43 type: EXT [131072->147455] (req 131072->135167) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4451ef expref: 47 pid: 166111 timeout: 22767 lvb_type: 0
00000100:00100000:0.0:1651531958.517596:0:166104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 177
00000100:00100000:0.0:1651531958.517597:0:166104:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000329eeeee pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+47:438147:x1731754467374272:12345-10.240.43.64@tcp:103:ldlm_bl_02.0
00010000:00010000:0.0:1651531958.517600:0:166104:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531958.517604:0:166104:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000064aa83ac/0x3234de053ca2ce3 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 44 type: EXT [131072->147455] (req 131072->135167) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4451ef expref: 47 pid: 166111 timeout: 22767 lvb_type: 0
00010000:00010000:0.0:1651531958.517608:0:166104:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000064aa83ac/0x3234de053ca2ce3 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 44 type: EXT [131072->147455] (req 131072->135167) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4451ef expref: 47 pid: 166111 timeout: 22767 lvb_type: 0
00010000:00010000:0.0:1651531958.517613:0:166104:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000064aa83ac/0x3234de053ca2ce3 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 44 type: EXT [131072->147455] (req 131072->135167) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4451ef expref: 47 pid: 166111 timeout: 22767 lvb_type: 0
00010000:00010000:0.0:1651531958.517617:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531958.517618:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531958.517619:0:166104:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca2f98 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 43 type: EXT [139264->143359] (req 139264->143359) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.517622:0:166104:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca2f98 lrc: 4/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 43 type: EXT [139264->143359] (req 139264->143359) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.517638:0:166104:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651531958.517648:0:166104:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000329eeeee pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+46:438147:x1731754467374272:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 50us (85us total) trans 0 rc 0/0
00010000:00010000:1.0:1651531958.517651:0:192753:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca2f98 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 42 type: EXT [139264->143359] (req 139264->143359) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531958.517651:0:166104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 177
00010000:00010000:1.0:1651531958.517658:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca2f98 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 42 type: EXT [139264->143359] (req 139264->143359) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.517671:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca2f98 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 42 type: EXT [139264->143359] (req 139264->143359) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.517674:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca2f98 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 42 type: EXT [139264->143359] (req 139264->143359) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531958.517689:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d76314b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+45:438149:x1731754467374208:12345-10.240.43.64@tcp:3:fio.0 Request processed in 410us (435us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531958.517692:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249753
00010000:00010000:1.0:1651531958.517699:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca2f98 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 42 type: EXT [139264->143359] (req 139264->143359) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.517702:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000968553c1 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531958.517703:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca2f98 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 42 type: EXT [139264->143359] (req 139264->143359) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.517706:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca2f98 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 42 type: EXT [139264->143359] (req 139264->143359) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.517711:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca2f98 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 42 type: EXT [139264->143359] (req 139264->143359) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.517714:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca2f98 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 42 type: EXT [139264->143359] (req 139264->143359) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531958.628125:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531958.628133:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467375744
00000100:00100000:1.0:1651531958.628149:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249754
00000100:00100000:1.0:1651531958.628150:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008b42dfe9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+45:438148:x1731754467375744:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531958.628157:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca2f9f lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 42 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.628161:0:192753:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001ee3405a/0x3234de053ca2aba lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 42 type: EXT [225280->249855] (req 225280->229375) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444ca1 expref: 45 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.628165:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531958.628165:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531958.628166:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca2f9f lrc: 4/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 42 type: EXT [225280->229375] (req 225280->229375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.628173:0:192753:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001ee3405a/0x3234de053ca2aba lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 42 type: EXT [225280->249855] (req 225280->229375) gid 0 flags: 0x50000000020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444ca1 expref: 45 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.628176:0:192753:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001ee3405a/0x3234de053ca2aba lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 42 type: EXT [225280->249855] (req 225280->229375) gid 0 flags: 0x70000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444ca1 expref: 45 pid: 166113 timeout: 22767 lvb_type: 0
00000100:00100000:1.0:1651531958.628180:0:192753:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b97e3b28 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:192753:1731745997353728:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531958.628192:0:192753:0:(client.c:2492:ptlrpc_set_wait()) set 00000000996f1fed going to sleep for 6 seconds
00000100:00100000:1.0:1651531958.628485:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531958.628496:0:192753:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b97e3b28 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:192753:1731745997353728:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531958.628499:0:166102:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467375872
00010000:00010000:1.0:1651531958.628501:0:192753:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca2f9f lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 42 type: EXT [225280->229375] (req 225280->229375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.628507:0:166102:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001ee3405a/0x3234de053ca2aba lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 42 type: EXT [225280->249855] (req 225280->229375) gid 0 flags: 0x60000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444ca1 expref: 46 pid: 166113 timeout: 22767 lvb_type: 0
00000100:00100000:0.0:1651531958.628515:0:166102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 178
00000100:00100000:0.0:1651531958.628517:0:166102:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002ae2aeac pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+46:438146:x1731754467375872:12345-10.240.43.64@tcp:103:ldlm_bl_05.0
00010000:00010000:0.0:1651531958.628520:0:166102:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531958.628523:0:166102:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001ee3405a/0x3234de053ca2aba lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 43 type: EXT [225280->249855] (req 225280->229375) gid 0 flags: 0x60000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444ca1 expref: 46 pid: 166113 timeout: 22767 lvb_type: 0
00010000:00010000:0.0:1651531958.628527:0:166102:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001ee3405a/0x3234de053ca2aba lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 43 type: EXT [225280->249855] (req 225280->229375) gid 0 flags: 0x50000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444ca1 expref: 46 pid: 166113 timeout: 22767 lvb_type: 0
00010000:00010000:0.0:1651531958.628533:0:166102:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ee3405a/0x3234de053ca2aba lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 43 type: EXT [225280->249855] (req 225280->229375) gid 0 flags: 0x44801400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444ca1 expref: 46 pid: 166113 timeout: 22767 lvb_type: 0
00010000:00010000:0.0:1651531958.628537:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531958.628538:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531958.628539:0:166102:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca2f9f lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 42 type: EXT [225280->229375] (req 225280->229375) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.628542:0:166102:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca2f9f lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 42 type: EXT [225280->229375] (req 225280->229375) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.628555:0:166102:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651531958.628564:0:166102:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002ae2aeac pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+45:438146:x1731754467375872:12345-10.240.43.64@tcp:103:ldlm_bl_05.0 Request processed in 47us (80us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531958.628567:0:166102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 178
00010000:00010000:1.0:1651531958.628568:0:192753:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca2f9f lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 41 type: EXT [225280->229375] (req 225280->229375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.628572:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca2f9f lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 41 type: EXT [225280->229375] (req 225280->229375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531958.703049:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869106 is committed
00010000:00010000:1.0:1651531958.703078:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca2f9f lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 41 type: EXT [225280->229375] (req 225280->229375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.703082:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca2f9f lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 41 type: EXT [225280->229375] (req 225280->229375) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531958.703102:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008b42dfe9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+44:438148:x1731754467375744:12345-10.240.43.64@tcp:4:fio.0 Request processed in 74950us (74977us total) trans 21474869106 rc 0/0
00000100:00100000:1.0:1651531958.703105:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249754
00010000:00010000:0.0:1651531958.703105:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca2f9f lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 41 type: EXT [225280->229375] (req 225280->229375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.703109:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000968553c1 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531958.703110:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca2f9f lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 41 type: EXT [225280->229375] (req 225280->229375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.703113:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca2f9f lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 41 type: EXT [225280->229375] (req 225280->229375) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.703119:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca2f9f lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 41 type: EXT [225280->229375] (req 225280->229375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.703122:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca2f9f lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 41 type: EXT [225280->229375] (req 225280->229375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531958.703465:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531958.703472:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467376320
00000100:00100000:1.0:1651531958.703484:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249755
00000100:00100000:1.0:1651531958.703486:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b97e3b28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+44:438146:x1731754467376320:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531958.703493:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2fa6 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 41 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.703497:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531958.703498:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531958.703499:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2fa6 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 41 type: EXT [225280->229375] (req 225280->229375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.703507:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2fa6 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 41 type: EXT [225280->229375] (req 225280->229375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.703518:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2fa6 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 41 type: EXT [225280->229375] (req 225280->229375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.703521:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2fa6 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 41 type: EXT [225280->229375] (req 225280->229375) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531958.703535:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b97e3b28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+44:438146:x1731754467376320:12345-10.240.43.64@tcp:3:fio.0 Request processed in 48us (71us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531958.703537:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249755
00010000:00010000:1.0:1651531958.703544:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2fa6 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 41 type: EXT [225280->229375] (req 225280->229375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.703547:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a8889a80 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531958.703548:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2fa6 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 41 type: EXT [225280->229375] (req 225280->229375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.703551:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2fa6 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 41 type: EXT [225280->229375] (req 225280->229375) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.703555:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2fa6 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 41 type: EXT [225280->229375] (req 225280->229375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.703558:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2fa6 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 41 type: EXT [225280->229375] (req 225280->229375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531958.703926:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531958.703933:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467376448
00000100:00100000:1.0:1651531958.703948:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249756
00000100:00100000:1.0:1651531958.703950:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f3a0807 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+44:438147:x1731754467376448:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531958.703957:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca2fad lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 41 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.703961:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531958.703961:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531958.703962:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca2fad lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 41 type: EXT [606208->610303] (req 606208->610303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.703966:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca2fad lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 41 type: EXT [606208->610303] (req 606208->610303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531958.704219:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531958.704256:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467376640
00000100:00100000:0.0:1651531958.704274:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249757
00000100:00100000:0.0:1651531958.704277:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a20162bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+47:438146:x1731754467376640:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531958.704285:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca2fb4 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 42 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.704295:0:216321:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b59a05a3/0x3234de053ca2dbc lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 42 type: EXT [929792->946175] (req 929792->933887) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44539a expref: 47 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.704298:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531958.704298:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531958.704299:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca2fb4 lrc: 4/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 42 type: EXT [937984->942079] (req 937984->942079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.704307:0:216321:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b59a05a3/0x3234de053ca2dbc lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 42 type: EXT [929792->946175] (req 929792->933887) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44539a expref: 47 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.704311:0:216321:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b59a05a3/0x3234de053ca2dbc lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 42 type: EXT [929792->946175] (req 929792->933887) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44539a expref: 47 pid: 166112 timeout: 22767 lvb_type: 0
00000100:00100000:0.0:1651531958.704315:0:216321:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000af5f6682 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997353792:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531958.704335:0:216321:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a2b9dcac going to sleep for 6 seconds
00000100:00100000:1.0:1651531958.704698:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531958.704710:0:216321:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000af5f6682 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997353792:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531958.704715:0:166104:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467376832
00010000:00010000:0.0:1651531958.704715:0:216321:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca2fb4 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 42 type: EXT [937984->942079] (req 937984->942079) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.704721:0:166104:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b59a05a3/0x3234de053ca2dbc lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 42 type: EXT [929792->946175] (req 929792->933887) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44539a expref: 48 pid: 166112 timeout: 22767 lvb_type: 0
00000100:00100000:1.0:1651531958.704731:0:166104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 179
00000100:00100000:1.0:1651531958.704733:0:166104:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000054ed0749 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+48:438147:x1731754467376832:12345-10.240.43.64@tcp:103:ldlm_bl_04.0
00010000:00010000:1.0:1651531958.704736:0:166104:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1651531958.704739:0:166104:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b59a05a3/0x3234de053ca2dbc lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 43 type: EXT [929792->946175] (req 929792->933887) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44539a expref: 48 pid: 166112 timeout: 22767 lvb_type: 0
00010000:00010000:1.0:1651531958.704747:0:166104:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b59a05a3/0x3234de053ca2dbc lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 43 type: EXT [929792->946175] (req 929792->933887) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44539a expref: 48 pid: 166112 timeout: 22767 lvb_type: 0
00010000:00010000:1.0:1651531958.704753:0:166104:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b59a05a3/0x3234de053ca2dbc lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 43 type: EXT [929792->946175] (req 929792->933887) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44539a expref: 48 pid: 166112 timeout: 22767 lvb_type: 0
00010000:00010000:1.0:1651531958.704757:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531958.704758:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531958.704759:0:166104:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca2fb4 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 42 type: EXT [937984->942079] (req 937984->942079) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.704762:0:166104:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca2fb4 lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 42 type: EXT [937984->942079] (req 937984->942079) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.704773:0:166104:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1651531958.704781:0:216321:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca2fb4 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 41 type: EXT [937984->942079] (req 937984->942079) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531958.704783:0:166104:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000054ed0749 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+47:438147:x1731754467376832:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 49us (85us total) trans 0 rc 0/0
00010000:00010000:0.0:1651531958.704785:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca2fb4 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 41 type: EXT [937984->942079] (req 937984->942079) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531958.704786:0:166104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 179
00000001:00080000:0.0:1651531958.740937:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869107 is committed
00010000:00010000:1.0:1651531958.740972:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca2fad lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 41 type: EXT [606208->610303] (req 606208->610303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.740977:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca2fad lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 41 type: EXT [606208->610303] (req 606208->610303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531958.740994:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f3a0807 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+46:438147:x1731754467376448:12345-10.240.43.64@tcp:4:fio.0 Request processed in 37043us (37068us total) trans 21474869107 rc 0/0
00000100:00100000:1.0:1651531958.740997:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249756
00010000:00010000:1.0:1651531958.741005:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca2fad lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 41 type: EXT [606208->610303] (req 606208->610303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.741008:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001e36c601 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531958.741009:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca2fad lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 41 type: EXT [606208->610303] (req 606208->610303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.741012:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca2fad lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 41 type: EXT [606208->610303] (req 606208->610303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.741017:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca2fad lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 41 type: EXT [606208->610303] (req 606208->610303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.741020:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca2fad lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 41 type: EXT [606208->610303] (req 606208->610303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531958.743035:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531958.743044:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467377408
00000100:00100000:1.0:1651531958.743060:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249758
00000100:00100000:1.0:1651531958.743062:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+46:438147:x1731754467377408:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531958.743068:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2fbb lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 41 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.743073:0:192753:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca2e25 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 41 type: EXT [524288->557055] (req 524288->528383) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445473 expref: 46 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.743077:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531958.743077:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531958.743078:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2fbb lrc: 4/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 41 type: EXT [532480->536575] (req 532480->536575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.743086:0:192753:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca2e25 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 41 type: EXT [524288->557055] (req 524288->528383) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445473 expref: 46 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.743090:0:192753:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca2e25 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 41 type: EXT [524288->557055] (req 524288->528383) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445473 expref: 46 pid: 166112 timeout: 22767 lvb_type: 0
00000100:00100000:1.0:1651531958.743094:0:192753:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000567318ba pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:192753:1731745997353856:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531958.743106:0:192753:0:(client.c:2492:ptlrpc_set_wait()) set 00000000996f1fed going to sleep for 6 seconds
00000100:00100000:1.0:1651531958.743373:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531958.743380:0:166104:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467377472
00010000:00010000:1.0:1651531958.743385:0:166104:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca2e25 lrc: 5/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 41 type: EXT [524288->557055] (req 524288->528383) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445473 expref: 47 pid: 166112 timeout: 22767 lvb_type: 0
00000100:00100000:1.0:1651531958.743399:0:166104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 180
00000100:00100000:1.0:1651531958.743401:0:166104:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c43262d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+47:438146:x1731754467377472:12345-10.240.43.64@tcp:103:ldlm_bl_02.0
00010000:00010000:1.0:1651531958.743404:0:166104:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1651531958.743407:0:166104:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca2e25 lrc: 5/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 42 type: EXT [524288->557055] (req 524288->528383) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445473 expref: 47 pid: 166112 timeout: 22767 lvb_type: 0
00010000:00010000:1.0:1651531958.743411:0:166104:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca2e25 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 42 type: EXT [524288->557055] (req 524288->528383) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445473 expref: 47 pid: 166112 timeout: 22767 lvb_type: 0
00010000:00010000:1.0:1651531958.743417:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531958.743418:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531958.743418:0:166104:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2fbb lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 42 type: EXT [532480->536575] (req 532480->536575) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.743425:0:166104:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2fbb lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 42 type: EXT [532480->536575] (req 532480->536575) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.743430:0:166104:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1651531958.743439:0:166104:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c43262d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+47:438146:x1731754467377472:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 38us (67us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531958.743442:0:166104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 180
00010000:00010000:1.0:1651531958.743452:0:192753:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca2e25 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 41 type: EXT [524288->557055] (req 524288->528383) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445473 expref: 46 pid: 166112 timeout: 22767 lvb_type: 0
00000100:00100000:1.0:1651531958.743455:0:192753:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000567318ba pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:192753:1731745997353856:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651531958.743459:0:192753:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2fbb lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 40 type: EXT [532480->536575] (req 532480->536575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.743462:0:192753:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2fbb lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 40 type: EXT [532480->536575] (req 532480->536575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.743464:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2fbb lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 40 type: EXT [532480->536575] (req 532480->536575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531958.754101:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531958.754124:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467377600
00000100:00100000:0.0:1651531958.754142:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249759
00000100:00100000:0.0:1651531958.754144:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000567318ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+48:438148:x1731754467377600:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531958.754152:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca2fc2 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 41 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.754157:0:166118:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a6553f30/0x3234de053ca2a74 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 41 type: EXT [249856->286719] (req 249856->253951) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c3f expref: 48 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.754160:0:166118:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000007a8a843/0x3234de053ca2de6 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 41 type: EXT [352256->356351] (req 352256->356351) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4453d9 expref: 48 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.754163:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:0.0:1651531958.754164:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:0.0:1651531958.754165:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca2fc2 lrc: 5/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 41 type: EXT [192512->385023] (req 192512->385023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.754172:0:166118:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000007a8a843/0x3234de053ca2de6 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 41 type: EXT [352256->356351] (req 352256->356351) gid 0 flags: 0x50000000020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4453d9 expref: 48 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.754176:0:166118:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000007a8a843/0x3234de053ca2de6 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 41 type: EXT [352256->356351] (req 352256->356351) gid 0 flags: 0x70000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4453d9 expref: 48 pid: 166112 timeout: 22767 lvb_type: 0
00000100:00100000:0.0:1651531958.754180:0:166118:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000af5f6682 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:166118:1731745997353920:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651531958.754201:0:166118:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a6553f30/0x3234de053ca2a74 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 41 type: EXT [249856->286719] (req 249856->253951) gid 0 flags: 0x50000000020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c3f expref: 48 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.754213:0:166118:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a6553f30/0x3234de053ca2a74 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 41 type: EXT [249856->286719] (req 249856->253951) gid 0 flags: 0x70000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c3f expref: 48 pid: 206699 timeout: 22767 lvb_type: 0
00000100:00100000:0.0:1651531958.754218:0:166118:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009acdfe57 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:166118:1731745997353984:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531958.754238:0:166118:0:(client.c:2492:ptlrpc_set_wait()) set 000000008ce9bece going to sleep for 6 seconds
00000100:00100000:0.0:1651531958.754474:0:166118:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000af5f6682 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:166118:1731745997353920:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531958.754478:0:166118:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009acdfe57 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:166118:1731745997353984:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651531958.754482:0:166118:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca2fc2 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 41 type: EXT [192512->385023] (req 192512->385023) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531958.754598:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531958.754607:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531958.754617:0:166104:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467377728
00000100:00100000:0.0:1651531958.754621:0:166102:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467377792
00010000:00010000:1.0:1651531958.754623:0:166104:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000007a8a843/0x3234de053ca2de6 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 41 type: EXT [352256->356351] (req 352256->356351) gid 0 flags: 0x60000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4453d9 expref: 49 pid: 166112 timeout: 22767 lvb_type: 0
00010000:00010000:0.0:1651531958.754628:0:166102:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a6553f30/0x3234de053ca2a74 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 42 type: EXT [249856->286719] (req 249856->253951) gid 0 flags: 0x60000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c3f expref: 50 pid: 206699 timeout: 22767 lvb_type: 0
00000100:00100000:1.0:1651531958.754640:0:166104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 181
00000100:00100000:1.0:1651531958.754642:0:166104:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ffcc974c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+50:438148:x1731754467377728:12345-10.240.43.64@tcp:103:ldlm_bl_01.0
00000100:00100000:0.0:1651531958.754642:0:166102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 182
00000100:00100000:0.0:1651531958.754644:0:166102:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003ffbc5dc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+50:438147:x1731754467377792:12345-10.240.43.64@tcp:103:ldlm_bl_05.0
00010000:00010000:1.0:1651531958.754645:0:166104:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531958.754647:0:166102:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1651531958.754648:0:166104:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000007a8a843/0x3234de053ca2de6 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 43 type: EXT [352256->356351] (req 352256->356351) gid 0 flags: 0x60000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4453d9 expref: 50 pid: 166112 timeout: 22767 lvb_type: 0
00010000:00010000:0.0:1651531958.754651:0:166102:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a6553f30/0x3234de053ca2a74 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 44 type: EXT [249856->286719] (req 249856->253951) gid 0 flags: 0x60000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c3f expref: 50 pid: 206699 timeout: 22767 lvb_type: 0
00010000:00010000:1.0:1651531958.754653:0:166104:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000007a8a843/0x3234de053ca2de6 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 44 type: EXT [352256->356351] (req 352256->356351) gid 0 flags: 0x50000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4453d9 expref: 50 pid: 166112 timeout: 22767 lvb_type: 0
00010000:00010000:0.0:1651531958.754656:0:166102:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a6553f30/0x3234de053ca2a74 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 43 type: EXT [249856->286719] (req 249856->253951) gid 0 flags: 0x50000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c3f expref: 50 pid: 206699 timeout: 22767 lvb_type: 0
00010000:00010000:1.0:1651531958.754664:0:166104:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000007a8a843/0x3234de053ca2de6 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 43 type: EXT [352256->356351] (req 352256->356351) gid 0 flags: 0x44801400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4453d9 expref: 50 pid: 166112 timeout: 22767 lvb_type: 0
00010000:00010000:0.0:1651531958.754667:0:166102:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a6553f30/0x3234de053ca2a74 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 43 type: EXT [249856->286719] (req 249856->253951) gid 0 flags: 0x44801400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444c3f expref: 50 pid: 206699 timeout: 22767 lvb_type: 0
00010000:00010000:1.0:1651531958.754668:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531958.754669:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531958.754670:0:166104:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca2fc2 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 42 type: EXT [192512->385023] (req 192512->385023) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.754673:0:166104:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca2fc2 lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 41 type: EXT [192512->385023] (req 192512->385023) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.754676:0:166102:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1651531958.754682:0:166104:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1651531958.754691:0:166104:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ffcc974c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+48:438148:x1731754467377728:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 49us (101us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531958.754693:0:166102:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003ffbc5dc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+48:438147:x1731754467377792:12345-10.240.43.64@tcp:103:ldlm_bl_05.0 Request processed in 48us (86us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531958.754694:0:166104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 181
00000100:00100000:0.0:1651531958.754696:0:166102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 182
00010000:00010000:0.0:1651531958.754704:0:166118:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca2fc2 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 39 type: EXT [192512->385023] (req 192512->385023) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.754707:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca2fc2 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 39 type: EXT [192512->385023] (req 192512->385023) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531958.766269:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869108 is committed
00010000:00010000:0.0:1651531958.766291:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca2fb4 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 39 type: EXT [937984->942079] (req 937984->942079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.766294:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca2fb4 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 39 type: EXT [937984->942079] (req 937984->942079) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531958.766316:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a20162bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+47:438146:x1731754467376640:12345-10.240.43.64@tcp:4:fio.0 Request processed in 62038us (62097us total) trans 21474869108 rc 0/0
00000100:00100000:0.0:1651531958.766319:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249757
00010000:00010000:0.0:1651531958.766327:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca2fb4 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 39 type: EXT [937984->942079] (req 937984->942079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.766330:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000032ee36ee already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531958.766331:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca2fb4 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 39 type: EXT [937984->942079] (req 937984->942079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.766334:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca2fb4 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 39 type: EXT [937984->942079] (req 937984->942079) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.766343:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca2fb4 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 39 type: EXT [937984->942079] (req 937984->942079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.766346:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca2fb4 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 39 type: EXT [937984->942079] (req 937984->942079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531958.766620:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531958.766639:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467377920
00000100:00100000:0.0:1651531958.766655:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249760
00000100:00100000:0.0:1651531958.766657:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009acffcb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+47:438147:x1731754467377920:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531958.766665:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2fc9 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 39 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.766669:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531958.766670:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531958.766671:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2fc9 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 39 type: EXT [696320->700415] (req 696320->700415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.766674:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2fc9 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 39 type: EXT [696320->700415] (req 696320->700415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531958.799889:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869110 is committed
00010000:00010000:1.0:1651531958.799921:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2fbb lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 39 type: EXT [532480->536575] (req 532480->536575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.799927:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2fbb lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 39 type: EXT [532480->536575] (req 532480->536575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531958.799941:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+45:438147:x1731754467377408:12345-10.240.43.64@tcp:4:fio.0 Request processed in 56879us (56906us total) trans 21474869109 rc 0/0
00010000:00010000:0.0:1651531958.799943:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca2fc2 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 39 type: EXT [192512->385023] (req 192512->385023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531958.799944:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249758
00010000:00010000:0.0:1651531958.799949:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca2fc2 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 39 type: EXT [192512->385023] (req 192512->385023) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.799951:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2fbb lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 40 type: EXT [532480->536575] (req 532480->536575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.799954:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a8889a80 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531958.799955:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2fbb lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 39 type: EXT [532480->536575] (req 532480->536575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.799958:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2fbb lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 39 type: EXT [532480->536575] (req 532480->536575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.799970:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2fbb lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 39 type: EXT [532480->536575] (req 532480->536575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.799973:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2fbb lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 39 type: EXT [532480->536575] (req 532480->536575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.799976:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca2fc2 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 38 type: EXT [192512->385023] (req 192512->385023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.799979:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000820577fb already unused, calling callback (0000000049fddea7)
00000100:00100000:0.0:1651531958.799979:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000567318ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+43:438148:x1731754467377600:12345-10.240.43.64@tcp:4:fio.0 Request processed in 45833us (45878us total) trans 21474869110 rc 0/0
00010000:00010000:1.0:1651531958.799980:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca2fc2 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 38 type: EXT [192512->385023] (req 192512->385023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.799984:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca2fc2 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 38 type: EXT [192512->385023] (req 192512->385023) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531958.799986:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249759
00010000:00010000:1.0:1651531958.799987:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca2fc2 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 38 type: EXT [192512->385023] (req 192512->385023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.799990:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca2fc2 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 38 type: EXT [192512->385023] (req 192512->385023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531958.800328:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531958.800345:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531958.800351:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467378112
00000100:00100000:1.0:1651531958.800353:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467378048
00000100:00100000:1.0:1651531958.800373:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249761
00000100:00100000:1.0:1651531958.800374:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d9e74b4c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+44:438146:x1731754467378112:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531958.800382:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca2fd0 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 38 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531958.800389:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249762
00000100:00100000:0.0:1651531958.800391:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e15376c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+44:438146:x1731754467378048:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531958.800399:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca2fd7 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 40 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.800401:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531958.800402:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531958.800403:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca2fd0 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 39 type: EXT [671744->675839] (req 671744->675839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.800407:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca2fd0 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 39 type: EXT [671744->675839] (req 671744->675839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.800408:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531958.800409:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531958.800410:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca2fd7 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 39 type: EXT [540672->544767] (req 540672->544767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.800414:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca2fd7 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 39 type: EXT [540672->544767] (req 540672->544767) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.800419:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca2fd0 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 39 type: EXT [671744->675839] (req 671744->675839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.800425:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca2fd0 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 39 type: EXT [671744->675839] (req 671744->675839) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531958.800442:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d9e74b4c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+44:438146:x1731754467378112:12345-10.240.43.64@tcp:3:fio.0 Request processed in 67us (114us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531958.800445:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249761
00000100:00100000:1.0:1651531958.800462:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651531958.800484:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca2fd0 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 39 type: EXT [671744->675839] (req 671744->675839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.800490:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001e36c601 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531958.800492:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca2fd0 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 39 type: EXT [671744->675839] (req 671744->675839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531958.800495:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467378304
00010000:00010000:0.0:1651531958.800497:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca2fd0 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 39 type: EXT [671744->675839] (req 671744->675839) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.800502:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca2fd0 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 39 type: EXT [671744->675839] (req 671744->675839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531958.800505:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249763
00000100:00100000:1.0:1651531958.800507:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b5b5b4c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+46:438149:x1731754467378304:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531958.800509:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca2fd0 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 39 type: EXT [671744->675839] (req 671744->675839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.800513:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca2fde lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 39 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.800517:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531958.800518:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531958.800519:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca2fde lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 39 type: EXT [757760->761855] (req 757760->761855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.800523:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca2fde lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 39 type: EXT [757760->761855] (req 757760->761855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531958.845556:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869111 is committed
00010000:00010000:1.0:1651531958.845594:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2fc9 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 39 type: EXT [696320->700415] (req 696320->700415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.845598:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2fc9 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 39 type: EXT [696320->700415] (req 696320->700415) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531958.845617:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009acffcb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+46:438147:x1731754467377920:12345-10.240.43.64@tcp:4:fio.0 Request processed in 78959us (78997us total) trans 21474869111 rc 0/0
00000100:00100000:1.0:1651531958.845620:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249760
00010000:00010000:1.0:1651531958.845626:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2fc9 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 39 type: EXT [696320->700415] (req 696320->700415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.845630:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fab23815 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531958.845631:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2fc9 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 39 type: EXT [696320->700415] (req 696320->700415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.845634:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2fc9 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 39 type: EXT [696320->700415] (req 696320->700415) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.845638:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2fc9 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 39 type: EXT [696320->700415] (req 696320->700415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.845641:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2fc9 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 39 type: EXT [696320->700415] (req 696320->700415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531958.845977:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531958.845985:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467378816
00000100:00100000:1.0:1651531958.845994:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249764
00000100:00100000:1.0:1651531958.845996:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002bdf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+46:438146:x1731754467378816:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531958.846003:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2fe5 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 39 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.846007:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531958.846009:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531958.846010:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2fe5 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 39 type: EXT [380928->385023] (req 380928->385023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.846014:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2fe5 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 39 type: EXT [380928->385023] (req 380928->385023) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531958.883126:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531958.883135:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467379072
00000001:00080000:0.0:1651531958.883143:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869113 is committed
00000100:00100000:1.0:1651531958.883145:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249765
00000100:00100000:1.0:1651531958.883147:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000137fd3d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+45:438147:x1731754467379072:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531958.883160:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca2fec lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 40 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.883165:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531958.883165:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531958.883167:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca2fec lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 40 type: EXT [28672->32767] (req 28672->32767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.883171:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca2fec lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 40 type: EXT [28672->32767] (req 28672->32767) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.883216:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca2fde lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 40 type: EXT [757760->761855] (req 757760->761855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.883241:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca2fde lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 40 type: EXT [757760->761855] (req 757760->761855) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.883256:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca2fd7 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 40 type: EXT [540672->544767] (req 540672->544767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.883261:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca2fd7 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 40 type: EXT [540672->544767] (req 540672->544767) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531958.883282:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e15376c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+45:438146:x1731754467378048:12345-10.240.43.64@tcp:4:fio.0 Request processed in 82890us (82936us total) trans 21474869112 rc 0/0
00000100:00100000:1.0:1651531958.883288:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249762
00000100:00100000:0.0:1651531958.883291:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b5b5b4c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+44:438149:x1731754467378304:12345-10.240.43.64@tcp:4:fio.0 Request processed in 82782us (82828us total) trans 21474869113 rc 0/0
00010000:00010000:1.0:1651531958.883295:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca2fde lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 40 type: EXT [757760->761855] (req 757760->761855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531958.883295:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249763
00010000:00010000:1.0:1651531958.883298:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c2b76533 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531958.883299:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca2fde lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 40 type: EXT [757760->761855] (req 757760->761855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.883302:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca2fde lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 40 type: EXT [757760->761855] (req 757760->761855) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.883304:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca2fd7 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 41 type: EXT [540672->544767] (req 540672->544767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.883307:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca2fde lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 41 type: EXT [757760->761855] (req 757760->761855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.883307:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000032ee36ee already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531958.883308:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca2fd7 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 41 type: EXT [540672->544767] (req 540672->544767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.883310:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca2fde lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 41 type: EXT [757760->761855] (req 757760->761855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.883312:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca2fd7 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 41 type: EXT [540672->544767] (req 540672->544767) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.883317:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca2fd7 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 39 type: EXT [540672->544767] (req 540672->544767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.883323:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca2fd7 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 39 type: EXT [540672->544767] (req 540672->544767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531958.883684:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531958.883699:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531958.883711:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467379200
00000100:00100000:0.0:1651531958.883728:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467379264
00000100:00100000:0.0:1651531958.883737:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249766
00000100:00100000:0.0:1651531958.883738:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000da31c48f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+47:438147:x1731754467379200:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651531958.883742:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249767
00000100:00100000:1.0:1651531958.883744:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006c903446 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+47:438147:x1731754467379264:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531958.883746:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2ff3 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 39 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.883751:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531958.883751:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531958.883752:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca2ffa lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 40 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.883752:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2ff3 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 41 type: EXT [69632->73727] (req 69632->73727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.883757:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531958.883757:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2ff3 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 40 type: EXT [69632->73727] (req 69632->73727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.883758:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531958.883759:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca2ffa lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 41 type: EXT [618496->622591] (req 618496->622591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.883767:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca2ffa lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 40 type: EXT [618496->622591] (req 618496->622591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.883778:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca2ffa lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 40 type: EXT [618496->622591] (req 618496->622591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.883781:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca2ffa lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 40 type: EXT [618496->622591] (req 618496->622591) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531958.883795:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006c903446 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+47:438147:x1731754467379264:12345-10.240.43.64@tcp:3:fio.0 Request processed in 50us (96us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531958.883798:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249767
00010000:00010000:1.0:1651531958.883804:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca2ffa lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 40 type: EXT [618496->622591] (req 618496->622591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.883807:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d44eb74d already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531958.883808:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca2ffa lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 40 type: EXT [618496->622591] (req 618496->622591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.883811:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca2ffa lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 40 type: EXT [618496->622591] (req 618496->622591) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.883815:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca2ffa lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 40 type: EXT [618496->622591] (req 618496->622591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.883818:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca2ffa lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 40 type: EXT [618496->622591] (req 618496->622591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531958.933518:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869114 is committed
00010000:00010000:1.0:1651531958.933552:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2fe5 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 39 type: EXT [380928->385023] (req 380928->385023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.933556:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2fe5 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 39 type: EXT [380928->385023] (req 380928->385023) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.933569:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2fe5 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 39 type: EXT [380928->385023] (req 380928->385023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531958.933571:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002bdf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+46:438146:x1731754467378816:12345-10.240.43.64@tcp:4:fio.0 Request processed in 87574us (87595us total) trans 21474869114 rc 0/0
00000100:00100000:1.0:1651531958.933574:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249764
00010000:00010000:0.0:1651531958.933575:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a8889a80 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531958.933576:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2fe5 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 39 type: EXT [380928->385023] (req 380928->385023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.933581:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2fe5 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 39 type: EXT [380928->385023] (req 380928->385023) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.933592:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2fe5 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 39 type: EXT [380928->385023] (req 380928->385023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.933597:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca2fe5 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 39 type: EXT [380928->385023] (req 380928->385023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531958.934714:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531958.934722:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467379840
00000100:00100000:1.0:1651531958.934736:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249768
00000100:00100000:1.0:1651531958.934738:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000880cd1d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+46:438146:x1731754467379840:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531958.934753:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3001 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 39 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.934757:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531958.934758:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531958.934759:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3001 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 39 type: EXT [483328->487423] (req 483328->487423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.934763:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3001 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 39 type: EXT [483328->487423] (req 483328->487423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531958.959394:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869116 is committed
00010000:00010000:1.0:1651531958.959425:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca2fec lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 39 type: EXT [28672->32767] (req 28672->32767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.959434:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca2fec lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 39 type: EXT [28672->32767] (req 28672->32767) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531958.959452:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000137fd3d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+44:438147:x1731754467379072:12345-10.240.43.64@tcp:4:fio.0 Request processed in 76305us (76326us total) trans 21474869115 rc 0/0
00000100:00100000:1.0:1651531958.959455:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249765
00010000:00010000:0.0:1651531958.959457:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2ff3 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 39 type: EXT [69632->73727] (req 69632->73727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.959463:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2ff3 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 39 type: EXT [69632->73727] (req 69632->73727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531958.959497:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000da31c48f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+43:438147:x1731754467379200:12345-10.240.43.64@tcp:4:fio.0 Request processed in 75756us (75811us total) trans 21474869116 rc 0/0
00010000:00010000:1.0:1651531958.959502:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca2fec lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 39 type: EXT [28672->32767] (req 28672->32767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531958.959503:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249766
00010000:00010000:1.0:1651531958.959506:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006da7a892 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531958.959507:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca2fec lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 39 type: EXT [28672->32767] (req 28672->32767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.959510:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca2fec lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 39 type: EXT [28672->32767] (req 28672->32767) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.959516:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2ff3 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 40 type: EXT [69632->73727] (req 69632->73727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.959524:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca2fec lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 40 type: EXT [28672->32767] (req 28672->32767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.959527:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca2fec lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 40 type: EXT [28672->32767] (req 28672->32767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.959556:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fab23815 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531958.959558:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2ff3 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 38 type: EXT [69632->73727] (req 69632->73727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.959561:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2ff3 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 38 type: EXT [69632->73727] (req 69632->73727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.959566:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2ff3 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 38 type: EXT [69632->73727] (req 69632->73727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.959571:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca2ff3 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 38 type: EXT [69632->73727] (req 69632->73727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531958.960464:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531958.960483:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467380480
00000100:00100000:0.0:1651531958.960501:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249769
00000100:00100000:0.0:1651531958.960503:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f05c0b82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+43:438146:x1731754467380480:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531958.960511:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3008 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 38 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.960515:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531958.960516:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531958.960517:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3008 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 38 type: EXT [364544->368639] (req 364544->368639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.960521:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3008 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 38 type: EXT [364544->368639] (req 364544->368639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.960535:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3008 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 38 type: EXT [364544->368639] (req 364544->368639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.960538:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3008 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 38 type: EXT [364544->368639] (req 364544->368639) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531958.960559:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f05c0b82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+43:438146:x1731754467380480:12345-10.240.43.64@tcp:3:fio.0 Request processed in 55us (95us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531958.960562:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249769
00010000:00010000:0.0:1651531958.960570:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3008 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 38 type: EXT [364544->368639] (req 364544->368639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.960574:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000032ee36ee already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531958.960575:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3008 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 38 type: EXT [364544->368639] (req 364544->368639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.960578:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3008 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 38 type: EXT [364544->368639] (req 364544->368639) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.960583:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3008 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 38 type: EXT [364544->368639] (req 364544->368639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.960586:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3008 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 38 type: EXT [364544->368639] (req 364544->368639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531958.961423:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531958.961442:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467381056
00000100:00100000:0.0:1651531958.961457:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249770
00000100:00100000:0.0:1651531958.961459:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003a5ac9b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+43:438148:x1731754467381056:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531958.961466:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca300f lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 38 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.961470:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531958.961471:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531958.961472:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca300f lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 38 type: EXT [544768->548863] (req 544768->548863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.961475:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca300f lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 38 type: EXT [544768->548863] (req 544768->548863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531958.972733:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531958.972741:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467381376
00000100:00100000:1.0:1651531958.972756:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249771
00000100:00100000:1.0:1651531958.972758:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001eda4376 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+46:438147:x1731754467381376:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531958.972766:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3016 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 39 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.972770:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531958.972770:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531958.972771:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3016 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 39 type: EXT [430080->434175] (req 430080->434175) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.972775:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3016 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 39 type: EXT [430080->434175] (req 430080->434175) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.972786:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3016 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 39 type: EXT [430080->434175] (req 430080->434175) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.972789:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3016 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 39 type: EXT [430080->434175] (req 430080->434175) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531958.972803:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001eda4376 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+46:438147:x1731754467381376:12345-10.240.43.64@tcp:3:fio.0 Request processed in 44us (71us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531958.972806:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249771
00010000:00010000:1.0:1651531958.972812:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3016 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 39 type: EXT [430080->434175] (req 430080->434175) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.972815:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006da7a892 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531958.972816:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3016 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 39 type: EXT [430080->434175] (req 430080->434175) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.972819:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3016 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 39 type: EXT [430080->434175] (req 430080->434175) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.972824:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3016 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 39 type: EXT [430080->434175] (req 430080->434175) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.972827:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3016 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 39 type: EXT [430080->434175] (req 430080->434175) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531958.973093:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531958.973101:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467381504
00000100:00100000:1.0:1651531958.973114:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249772
00000100:00100000:1.0:1651531958.973115:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000530f55ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+46:438146:x1731754467381504:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531958.973122:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca301d lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 39 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.973126:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531958.973126:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531958.973128:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca301d lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 39 type: EXT [98304->102399] (req 98304->102399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.973131:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca301d lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 39 type: EXT [98304->102399] (req 98304->102399) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.973141:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca301d lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 39 type: EXT [98304->102399] (req 98304->102399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.973144:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca301d lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 39 type: EXT [98304->102399] (req 98304->102399) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.973156:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca301d lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 39 type: EXT [98304->102399] (req 98304->102399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531958.973161:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000530f55ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+46:438146:x1731754467381504:12345-10.240.43.64@tcp:3:fio.0 Request processed in 44us (68us total) trans 0 rc 4096/4096
00010000:00010000:0.0:1651531958.973162:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c2b76533 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531958.973163:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca301d lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 39 type: EXT [98304->102399] (req 98304->102399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531958.973165:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249772
00010000:00010000:0.0:1651531958.973167:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca301d lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 39 type: EXT [98304->102399] (req 98304->102399) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.973172:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca301d lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 39 type: EXT [98304->102399] (req 98304->102399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.973175:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca301d lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 39 type: EXT [98304->102399] (req 98304->102399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531958.984234:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869117 is committed
00010000:00010000:1.0:1651531958.984265:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3001 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 38 type: EXT [483328->487423] (req 483328->487423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531958.984269:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3001 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 38 type: EXT [483328->487423] (req 483328->487423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531958.984286:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000880cd1d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+43:438146:x1731754467379840:12345-10.240.43.64@tcp:4:fio.0 Request processed in 49547us (49572us total) trans 21474869117 rc 0/0
00010000:00010000:0.0:1651531958.984288:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3001 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 38 type: EXT [483328->487423] (req 483328->487423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531958.984289:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249768
00010000:00010000:0.0:1651531958.984293:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d44eb74d already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531958.984295:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3001 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 38 type: EXT [483328->487423] (req 483328->487423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.984300:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3001 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 38 type: EXT [483328->487423] (req 483328->487423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.984308:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3001 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 38 type: EXT [483328->487423] (req 483328->487423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531958.984313:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3001 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 38 type: EXT [483328->487423] (req 483328->487423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531959.034830:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869118 is committed
00010000:00010000:0.0:1651531959.034846:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca300f lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 37 type: EXT [544768->548863] (req 544768->548863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531959.034849:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca300f lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 37 type: EXT [544768->548863] (req 544768->548863) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531959.034871:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003a5ac9b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+40:438148:x1731754467381056:12345-10.240.43.64@tcp:4:fio.0 Request processed in 73411us (73448us total) trans 21474869118 rc 0/0
00010000:00010000:1.0:1651531959.034874:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca300f lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 37 type: EXT [544768->548863] (req 544768->548863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531959.034875:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249770
00010000:00010000:1.0:1651531959.034879:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000820577fb already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531959.034880:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca300f lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 37 type: EXT [544768->548863] (req 544768->548863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.034883:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca300f lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 37 type: EXT [544768->548863] (req 544768->548863) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.034889:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca300f lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 37 type: EXT [544768->548863] (req 544768->548863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.034892:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca300f lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 37 type: EXT [544768->548863] (req 544768->548863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531959.037101:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531959.037124:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467382976
00000100:00100000:0.0:1651531959.037140:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249773
00000100:00100000:0.0:1651531959.037142:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b338475a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+40:438148:x1731754467382976:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531959.037150:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3024 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 37 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531959.037154:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531959.037155:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531959.037156:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3024 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 37 type: EXT [806912->811007] (req 806912->811007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531959.037160:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3024 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 37 type: EXT [806912->811007] (req 806912->811007) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531959.037172:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3024 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 37 type: EXT [806912->811007] (req 806912->811007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531959.037179:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3024 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 37 type: EXT [806912->811007] (req 806912->811007) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531959.037194:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b338475a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+40:438148:x1731754467382976:12345-10.240.43.64@tcp:3:fio.0 Request processed in 52us (94us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531959.037197:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249773
00010000:00010000:0.0:1651531959.037213:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3024 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 37 type: EXT [806912->811007] (req 806912->811007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531959.037217:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000032ee36ee already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531959.037218:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3024 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 37 type: EXT [806912->811007] (req 806912->811007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531959.037221:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3024 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 37 type: EXT [806912->811007] (req 806912->811007) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531959.037241:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3024 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 37 type: EXT [806912->811007] (req 806912->811007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531959.037248:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3024 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 37 type: EXT [806912->811007] (req 806912->811007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531959.037592:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531959.037604:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467383104
00000100:00100000:0.0:1651531959.037619:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249774
00000100:00100000:0.0:1651531959.037621:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c4db449c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+40:438149:x1731754467383104:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531959.037628:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca302b lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 37 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531959.037634:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531959.037634:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531959.037635:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca302b lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 37 type: EXT [630784->634879] (req 630784->634879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531959.037639:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca302b lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 37 type: EXT [630784->634879] (req 630784->634879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531959.084583:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531959.084599:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467383232
00000100:00100000:1.0:1651531959.084611:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249775
00000100:00100000:1.0:1651531959.084612:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009acdfe57 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+43:438146:x1731754467383232:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531959.084619:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3032 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 38 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.084623:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531959.084624:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531959.084625:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3032 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 38 type: EXT [409600->413695] (req 409600->413695) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.084629:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3032 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 38 type: EXT [409600->413695] (req 409600->413695) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531959.097010:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869119 is committed
00002000:00010000:0.0:1651531959.097024:0:192753:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x34545:0x0] updating lvb mtime from disk: 1651531958 -> 1651531959
00002000:00010000:0.0:1651531959.097025:0:192753:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x34545:0x0] updating lvb ctime from disk: 1651531958 -> 1651531959
00010000:00010000:0.0:1651531959.097028:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca302b lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 38 type: EXT [630784->634879] (req 630784->634879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531959.097031:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca302b lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 38 type: EXT [630784->634879] (req 630784->634879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531959.097054:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c4db449c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+43:438149:x1731754467383104:12345-10.240.43.64@tcp:4:fio.0 Request processed in 59431us (59462us total) trans 21474869119 rc 0/0
00000100:00100000:0.0:1651531959.097057:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249774
00010000:00010000:0.0:1651531959.097065:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca302b lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 38 type: EXT [630784->634879] (req 630784->634879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531959.097069:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fab23815 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531959.097070:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca302b lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 38 type: EXT [630784->634879] (req 630784->634879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531959.097076:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca302b lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 38 type: EXT [630784->634879] (req 630784->634879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531959.097082:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca302b lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 38 type: EXT [630784->634879] (req 630784->634879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531959.097084:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca302b lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 38 type: EXT [630784->634879] (req 630784->634879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531959.098585:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531959.098593:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467383680
00000100:00100000:0.0:1651531959.098612:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249776
00000100:00100000:0.0:1651531959.098614:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000af5f6682 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+43:438148:x1731754467383680:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531959.098621:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3039 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 38 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531959.098625:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531959.098626:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531959.098627:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3039 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 38 type: EXT [57344->61439] (req 57344->61439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531959.098631:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3039 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 38 type: EXT [57344->61439] (req 57344->61439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531959.098643:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3039 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 38 type: EXT [57344->61439] (req 57344->61439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531959.098645:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3039 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 38 type: EXT [57344->61439] (req 57344->61439) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531959.098665:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000af5f6682 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+43:438148:x1731754467383680:12345-10.240.43.64@tcp:3:fio.0 Request processed in 51us (81us total) trans 0 rc 4096/4096
00010000:00010000:1.0:1651531959.098668:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3039 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 38 type: EXT [57344->61439] (req 57344->61439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531959.098668:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249776
00010000:00010000:1.0:1651531959.098673:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000032ee36ee already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531959.098674:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3039 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 38 type: EXT [57344->61439] (req 57344->61439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.098677:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3039 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 38 type: EXT [57344->61439] (req 57344->61439) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.098683:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3039 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 38 type: EXT [57344->61439] (req 57344->61439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.098685:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3039 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 38 type: EXT [57344->61439] (req 57344->61439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531959.098981:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531959.098989:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467383808
00000100:00100000:0.0:1651531959.099002:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249777
00000100:00100000:0.0:1651531959.099004:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000006e3b98d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+43:438149:x1731754467383808:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531959.099011:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca3040 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 38 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531959.099016:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531959.099016:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531959.099017:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca3040 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 38 type: EXT [741376->745471] (req 741376->745471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531959.099021:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca3040 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 38 type: EXT [741376->745471] (req 741376->745471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531959.168485:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869121 is committed
00010000:00010000:0.0:1651531959.168507:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca3040 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 38 type: EXT [741376->745471] (req 741376->745471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531959.168510:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca3040 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 38 type: EXT [741376->745471] (req 741376->745471) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.168516:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3032 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 38 type: EXT [409600->413695] (req 409600->413695) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.168521:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3032 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 38 type: EXT [409600->413695] (req 409600->413695) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531959.168534:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000006e3b98d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+41:438149:x1731754467383808:12345-10.240.43.64@tcp:4:fio.0 Request processed in 69522us (69547us total) trans 21474869121 rc 0/0
00000100:00100000:1.0:1651531959.168538:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009acdfe57 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+41:438146:x1731754467383232:12345-10.240.43.64@tcp:4:fio.0 Request processed in 83924us (83956us total) trans 21474869120 rc 0/0
00000100:00100000:0.0:1651531959.168540:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249777
00000100:00100000:1.0:1651531959.168542:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249775
00010000:00010000:0.0:1651531959.168548:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca3040 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 38 type: EXT [741376->745471] (req 741376->745471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531959.168552:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e2ec18e1 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531959.168553:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca3040 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 38 type: EXT [741376->745471] (req 741376->745471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.168554:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3032 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 39 type: EXT [409600->413695] (req 409600->413695) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531959.168556:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca3040 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 39 type: EXT [741376->745471] (req 741376->745471) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.168557:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006da7a892 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531959.168558:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3032 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 39 type: EXT [409600->413695] (req 409600->413695) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.168561:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3032 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 39 type: EXT [409600->413695] (req 409600->413695) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531959.168561:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca3040 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 38 type: EXT [741376->745471] (req 741376->745471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531959.168564:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca3040 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 39 type: EXT [741376->745471] (req 741376->745471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.168566:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3032 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 39 type: EXT [409600->413695] (req 409600->413695) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.168569:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3032 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 37 type: EXT [409600->413695] (req 409600->413695) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531959.169541:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531959.169559:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467384704
00000100:00100000:1.0:1651531959.169574:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249778
00000100:00100000:1.0:1651531959.169577:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000844a4f50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+40:438147:x1731754467384704:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531959.169584:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3047 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 37 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.169587:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531959.169588:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531959.169589:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3047 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 37 type: EXT [487424->491519] (req 487424->491519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.169592:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3047 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 37 type: EXT [487424->491519] (req 487424->491519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531959.206202:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531959.206221:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467385344
00000100:00100000:0.0:1651531959.206248:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249779
00000100:00100000:0.0:1651531959.206250:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000045181741 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+43:438149:x1731754467385344:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531959.206258:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca304e lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 38 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531959.206263:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531959.206264:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531959.206266:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca304e lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 38 type: EXT [921600->925695] (req 921600->925695) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531959.206270:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca304e lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 38 type: EXT [921600->925695] (req 921600->925695) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531959.243952:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869122 is committed
00010000:00010000:1.0:1651531959.243981:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3047 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 38 type: EXT [487424->491519] (req 487424->491519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.243986:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3047 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 38 type: EXT [487424->491519] (req 487424->491519) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531959.244004:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000844a4f50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+43:438147:x1731754467384704:12345-10.240.43.64@tcp:4:fio.0 Request processed in 74426us (74463us total) trans 21474869122 rc 0/0
00000100:00100000:1.0:1651531959.244008:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249778
00010000:00010000:0.0:1651531959.244009:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3047 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 38 type: EXT [487424->491519] (req 487424->491519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531959.244016:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e9b84540 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531959.244018:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3047 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 38 type: EXT [487424->491519] (req 487424->491519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531959.244023:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3047 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 38 type: EXT [487424->491519] (req 487424->491519) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531959.244031:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3047 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 38 type: EXT [487424->491519] (req 487424->491519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531959.244035:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3047 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 38 type: EXT [487424->491519] (req 487424->491519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531959.244365:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531959.244389:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467385472
00000100:00100000:1.0:1651531959.244400:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249780
00000100:00100000:1.0:1651531959.244402:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000098bec39b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+43:438146:x1731754467385472:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531959.244410:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3055 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 38 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.244414:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531959.244416:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531959.244416:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3055 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 38 type: EXT [606208->610303] (req 606208->610303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.244420:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3055 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 38 type: EXT [606208->610303] (req 606208->610303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.244431:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3055 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 38 type: EXT [606208->610303] (req 606208->610303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.244434:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3055 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 38 type: EXT [606208->610303] (req 606208->610303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531959.244454:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000098bec39b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+43:438146:x1731754467385472:12345-10.240.43.64@tcp:3:fio.0 Request processed in 51us (90us total) trans 0 rc 4096/4096
00010000:00010000:0.0:1651531959.244454:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3055 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 38 type: EXT [606208->610303] (req 606208->610303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531959.244457:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249780
00010000:00010000:0.0:1651531959.244458:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006da7a892 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531959.244459:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3055 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 38 type: EXT [606208->610303] (req 606208->610303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531959.244463:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3055 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 38 type: EXT [606208->610303] (req 606208->610303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531959.244469:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3055 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 38 type: EXT [606208->610303] (req 606208->610303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531959.244471:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3055 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 38 type: EXT [606208->610303] (req 606208->610303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531959.244760:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531959.244776:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467385600
00000100:00100000:1.0:1651531959.244786:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249781
00000100:00100000:1.0:1651531959.244788:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000087355620 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+43:438147:x1731754467385600:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531959.244794:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca305c lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 38 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.244799:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531959.244799:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531959.244800:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca305c lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 38 type: EXT [221184->225279] (req 221184->225279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.244804:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca305c lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 38 type: EXT [221184->225279] (req 221184->225279) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531959.269876:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869123 is committed
00010000:00010000:1.0:1651531959.269911:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca304e lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 38 type: EXT [921600->925695] (req 921600->925695) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.269915:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca304e lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 38 type: EXT [921600->925695] (req 921600->925695) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531959.269931:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000045181741 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+43:438149:x1731754467385344:12345-10.240.43.64@tcp:4:fio.0 Request processed in 63679us (63730us total) trans 21474869123 rc 0/0
00000100:00100000:1.0:1651531959.269934:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249779
00010000:00010000:1.0:1651531959.269940:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca304e lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 38 type: EXT [921600->925695] (req 921600->925695) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.269944:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e2ec18e1 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531959.269945:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca304e lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 38 type: EXT [921600->925695] (req 921600->925695) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.269948:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca304e lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 38 type: EXT [921600->925695] (req 921600->925695) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.269952:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca304e lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 38 type: EXT [921600->925695] (req 921600->925695) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.269955:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca304e lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 38 type: EXT [921600->925695] (req 921600->925695) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531959.270686:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531959.270705:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467386112
00000100:00100000:1.0:1651531959.270716:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249782
00000100:00100000:1.0:1651531959.270719:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b67ad021 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+43:438149:x1731754467386112:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531959.270726:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3063 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 38 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.270729:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531959.270730:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531959.270731:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3063 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 38 type: EXT [368640->372735] (req 368640->372735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.270735:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3063 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 38 type: EXT [368640->372735] (req 368640->372735) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.270745:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3063 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 38 type: EXT [368640->372735] (req 368640->372735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.270749:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3063 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 38 type: EXT [368640->372735] (req 368640->372735) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531959.270769:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3063 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 38 type: EXT [368640->372735] (req 368640->372735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531959.270770:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b67ad021 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+43:438149:x1731754467386112:12345-10.240.43.64@tcp:3:fio.0 Request processed in 51us (85us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531959.270773:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249782
00010000:00010000:0.0:1651531959.270773:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006da7a892 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531959.270774:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3063 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 38 type: EXT [368640->372735] (req 368640->372735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531959.270777:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3063 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 38 type: EXT [368640->372735] (req 368640->372735) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531959.270783:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3063 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 38 type: EXT [368640->372735] (req 368640->372735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531959.270786:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3063 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 38 type: EXT [368640->372735] (req 368640->372735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531959.319154:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869124 is committed
00010000:00010000:1.0:1651531959.319182:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca305c lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 37 type: EXT [221184->225279] (req 221184->225279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.319186:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca305c lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 37 type: EXT [221184->225279] (req 221184->225279) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531959.319215:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000087355620 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+40:438147:x1731754467385600:12345-10.240.43.64@tcp:4:fio.0 Request processed in 74426us (74455us total) trans 21474869124 rc 0/0
00010000:00010000:0.0:1651531959.319218:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca305c lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 37 type: EXT [221184->225279] (req 221184->225279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531959.319221:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249781
00010000:00010000:0.0:1651531959.319232:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008558d1b3 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531959.319233:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca305c lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 37 type: EXT [221184->225279] (req 221184->225279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531959.319236:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca305c lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 37 type: EXT [221184->225279] (req 221184->225279) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531959.319242:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca305c lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 37 type: EXT [221184->225279] (req 221184->225279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531959.319244:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca305c lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 37 type: EXT [221184->225279] (req 221184->225279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531959.372094:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531959.372103:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467387584
00000100:00100000:1.0:1651531959.372114:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249783
00000100:00100000:1.0:1651531959.372116:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004237e3f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+40:438148:x1731754467387584:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531959.372123:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca306a lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 37 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.372128:0:192755:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ee6f7a6e/0x3234de053ca2d61 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 37 type: EXT [36864->49151] (req 36864->40959) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4452dd expref: 40 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.372132:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531959.372132:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531959.372133:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca306a lrc: 4/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 37 type: EXT [45056->49151] (req 45056->49151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.372140:0:192755:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ee6f7a6e/0x3234de053ca2d61 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 37 type: EXT [36864->49151] (req 36864->40959) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4452dd expref: 40 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.372144:0:192755:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ee6f7a6e/0x3234de053ca2d61 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 37 type: EXT [36864->49151] (req 36864->40959) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4452dd expref: 40 pid: 166111 timeout: 22768 lvb_type: 0
00000100:00100000:1.0:1651531959.372148:0:192755:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f7096c29 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0001_UUID:192755:1731745997354048:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531959.372160:0:192755:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fc7d2635 going to sleep for 6 seconds
00000100:00100000:1.0:1651531959.372455:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531959.372462:0:166103:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467387840
00010000:00010000:1.0:1651531959.372468:0:166103:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ee6f7a6e/0x3234de053ca2d61 lrc: 5/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 37 type: EXT [36864->49151] (req 36864->40959) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4452dd expref: 41 pid: 166111 timeout: 22768 lvb_type: 0
00000100:00100000:1.0:1651531959.372482:0:166103:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 183
00000100:00100000:1.0:1651531959.372484:0:166103:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000042921202 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+41:438147:x1731754467387840:12345-10.240.43.64@tcp:103:ldlm_bl_03.0
00010000:00010000:1.0:1651531959.372487:0:166103:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1651531959.372491:0:166103:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ee6f7a6e/0x3234de053ca2d61 lrc: 5/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 38 type: EXT [36864->49151] (req 36864->40959) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4452dd expref: 41 pid: 166111 timeout: 22768 lvb_type: 0
00010000:00010000:1.0:1651531959.372495:0:166103:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ee6f7a6e/0x3234de053ca2d61 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 38 type: EXT [36864->49151] (req 36864->40959) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4452dd expref: 41 pid: 166111 timeout: 22768 lvb_type: 0
00010000:00010000:1.0:1651531959.372501:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531959.372502:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531959.372502:0:166103:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca306a lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 38 type: EXT [45056->49151] (req 45056->49151) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.372505:0:166103:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca306a lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 38 type: EXT [45056->49151] (req 45056->49151) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.372510:0:166103:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1651531959.372520:0:166103:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000042921202 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+41:438147:x1731754467387840:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 35us (65us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531959.372522:0:166103:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 183
00010000:00010000:1.0:1651531959.372547:0:192755:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ee6f7a6e/0x3234de053ca2d61 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 37 type: EXT [36864->49151] (req 36864->40959) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4452dd expref: 40 pid: 166111 timeout: 22768 lvb_type: 0
00000100:00100000:1.0:1651531959.372551:0:192755:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f7096c29 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0001_UUID:192755:1731745997354048:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651531959.372555:0:192755:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca306a lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 36 type: EXT [45056->49151] (req 45056->49151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.372559:0:192755:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca306a lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 36 type: EXT [45056->49151] (req 45056->49151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.372562:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca306a lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 36 type: EXT [45056->49151] (req 45056->49151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531959.422699:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869125 is committed
00010000:00010000:1.0:1651531959.422729:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca306a lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 36 type: EXT [45056->49151] (req 45056->49151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.422733:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca306a lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 36 type: EXT [45056->49151] (req 45056->49151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531959.422749:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004237e3f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+39:438148:x1731754467387584:12345-10.240.43.64@tcp:4:fio.0 Request processed in 50632us (50656us total) trans 21474869125 rc 0/0
00000100:00100000:1.0:1651531959.422752:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249783
00010000:00010000:1.0:1651531959.422759:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca306a lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 36 type: EXT [45056->49151] (req 45056->49151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.422762:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e9b84540 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531959.422763:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca306a lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 36 type: EXT [45056->49151] (req 45056->49151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.422766:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca306a lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 36 type: EXT [45056->49151] (req 45056->49151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.422771:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca306a lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 36 type: EXT [45056->49151] (req 45056->49151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.422777:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca306a lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 36 type: EXT [45056->49151] (req 45056->49151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531959.423110:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531959.423118:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467388096
00000100:00100000:1.0:1651531959.423128:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249784
00000100:00100000:1.0:1651531959.423130:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f7096c29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+39:438148:x1731754467388096:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531959.423137:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3071 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 36 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.423140:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531959.423141:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531959.423142:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3071 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 36 type: EXT [278528->282623] (req 278528->282623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.423146:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3071 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 36 type: EXT [278528->282623] (req 278528->282623) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.423156:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3071 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 36 type: EXT [278528->282623] (req 278528->282623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.423159:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3071 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 36 type: EXT [278528->282623] (req 278528->282623) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531959.423180:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f7096c29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+39:438148:x1731754467388096:12345-10.240.43.64@tcp:3:fio.0 Request processed in 50us (70us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531959.423183:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249784
00010000:00010000:0.0:1651531959.423184:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3071 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 36 type: EXT [278528->282623] (req 278528->282623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531959.423189:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d44eb74d already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531959.423190:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3071 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 36 type: EXT [278528->282623] (req 278528->282623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531959.423193:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3071 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 36 type: EXT [278528->282623] (req 278528->282623) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531959.423202:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3071 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 36 type: EXT [278528->282623] (req 278528->282623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531959.423214:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3071 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 36 type: EXT [278528->282623] (req 278528->282623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531959.447978:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531959.447986:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467388416
00000100:00100000:1.0:1651531959.447995:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249785
00000100:00100000:1.0:1651531959.447997:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cebf7380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+39:438146:x1731754467388416:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531959.448004:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3078 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 36 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.448008:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531959.448008:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531959.448009:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3078 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 36 type: EXT [290816->294911] (req 290816->294911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.448013:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3078 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 36 type: EXT [290816->294911] (req 290816->294911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531959.486744:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531959.486752:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467389120
00000100:00100000:1.0:1651531959.486762:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249786
00000100:00100000:1.0:1651531959.486764:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bf4022bf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+42:438149:x1731754467389120:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531959.486770:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca307f lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 37 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.486774:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531959.486775:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531959.486776:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca307f lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 37 type: EXT [299008->303103] (req 299008->303103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.486780:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca307f lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 37 type: EXT [299008->303103] (req 299008->303103) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531959.521651:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869126 is committed
00010000:00010000:1.0:1651531959.521680:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3078 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 37 type: EXT [290816->294911] (req 290816->294911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.521684:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3078 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 37 type: EXT [290816->294911] (req 290816->294911) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531959.521702:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cebf7380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+42:438146:x1731754467388416:12345-10.240.43.64@tcp:4:fio.0 Request processed in 73704us (73725us total) trans 21474869126 rc 0/0
00000100:00100000:1.0:1651531959.521705:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249785
00010000:00010000:0.0:1651531959.521706:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3078 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 37 type: EXT [290816->294911] (req 290816->294911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531959.521713:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e9b84540 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531959.521714:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3078 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 37 type: EXT [290816->294911] (req 290816->294911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531959.521720:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3078 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 37 type: EXT [290816->294911] (req 290816->294911) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531959.521729:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3078 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 37 type: EXT [290816->294911] (req 290816->294911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531959.521734:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3078 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 37 type: EXT [290816->294911] (req 290816->294911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531959.572335:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869127 is committed
00010000:00010000:1.0:1651531959.572364:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca307f lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 36 type: EXT [299008->303103] (req 299008->303103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.572368:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca307f lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 36 type: EXT [299008->303103] (req 299008->303103) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531959.572386:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bf4022bf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+39:438149:x1731754467389120:12345-10.240.43.64@tcp:4:fio.0 Request processed in 85621us (85643us total) trans 21474869127 rc 0/0
00000100:00100000:1.0:1651531959.572389:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249786
00010000:00010000:0.0:1651531959.572390:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca307f lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 36 type: EXT [299008->303103] (req 299008->303103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531959.572395:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c2b76533 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531959.572397:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca307f lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 36 type: EXT [299008->303103] (req 299008->303103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531959.572400:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca307f lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 36 type: EXT [299008->303103] (req 299008->303103) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531959.572406:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca307f lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 36 type: EXT [299008->303103] (req 299008->303103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531959.572409:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca307f lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 36 type: EXT [299008->303103] (req 299008->303103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531959.573136:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531959.573144:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467389760
00000100:00100000:1.0:1651531959.573153:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249787
00000100:00100000:1.0:1651531959.573155:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000043b0f16d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+39:438148:x1731754467389760:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531959.573162:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3086 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 36 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.573166:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531959.573167:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531959.573168:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3086 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 36 type: EXT [368640->372735] (req 368640->372735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.573172:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3086 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 36 type: EXT [368640->372735] (req 368640->372735) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.573183:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3086 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 36 type: EXT [368640->372735] (req 368640->372735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.573186:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3086 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 36 type: EXT [368640->372735] (req 368640->372735) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531959.573214:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3086 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 36 type: EXT [368640->372735] (req 368640->372735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531959.573216:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000043b0f16d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+39:438148:x1731754467389760:12345-10.240.43.64@tcp:3:fio.0 Request processed in 60us (81us total) trans 0 rc 4096/4096
00010000:00010000:0.0:1651531959.573218:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a8889a80 already unused, calling callback (0000000049fddea7)
00000100:00100000:1.0:1651531959.573219:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249787
00010000:00010000:0.0:1651531959.573219:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3086 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 36 type: EXT [368640->372735] (req 368640->372735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531959.573236:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3086 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 36 type: EXT [368640->372735] (req 368640->372735) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531959.573242:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3086 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 36 type: EXT [368640->372735] (req 368640->372735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531959.573244:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3086 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 36 type: EXT [368640->372735] (req 368640->372735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531959.588442:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531959.588450:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467390784
00000100:00100000:1.0:1651531959.588460:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249788
00000100:00100000:1.0:1651531959.588461:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007b76f7f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+39:438146:x1731754467390784:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531959.588468:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca308d lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 36 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.588472:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531959.588473:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531959.588474:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca308d lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 36 type: EXT [921600->925695] (req 921600->925695) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.588478:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca308d lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 36 type: EXT [921600->925695] (req 921600->925695) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531959.660357:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869128 is committed
00010000:00010000:1.0:1651531959.660391:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca308d lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 36 type: EXT [921600->925695] (req 921600->925695) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.660396:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca308d lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 36 type: EXT [921600->925695] (req 921600->925695) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531959.660412:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007b76f7f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+39:438146:x1731754467390784:12345-10.240.43.64@tcp:4:fio.0 Request processed in 71950us (71971us total) trans 21474869128 rc 0/0
00000100:00100000:1.0:1651531959.660415:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249788
00010000:00010000:1.0:1651531959.660422:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca308d lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 36 type: EXT [921600->925695] (req 921600->925695) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.660426:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001e36c601 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531959.660427:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca308d lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 36 type: EXT [921600->925695] (req 921600->925695) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.660430:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca308d lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 36 type: EXT [921600->925695] (req 921600->925695) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.660435:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca308d lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 36 type: EXT [921600->925695] (req 921600->925695) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.660438:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca308d lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 36 type: EXT [921600->925695] (req 921600->925695) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531959.661179:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531959.661187:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467391296
00000100:00100000:1.0:1651531959.661198:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249789
00000100:00100000:1.0:1651531959.661200:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000008e0501d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+39:438147:x1731754467391296:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531959.661219:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3094 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 36 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.661241:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531959.661242:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531959.661243:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3094 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 36 type: EXT [229376->233471] (req 229376->233471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.661247:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3094 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 36 type: EXT [229376->233471] (req 229376->233471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.661259:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3094 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 36 type: EXT [229376->233471] (req 229376->233471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.661262:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3094 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 36 type: EXT [229376->233471] (req 229376->233471) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531959.661276:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3094 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 36 type: EXT [229376->233471] (req 229376->233471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531959.661279:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000008e0501d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+39:438147:x1731754467391296:12345-10.240.43.64@tcp:3:fio.0 Request processed in 78us (100us total) trans 0 rc 4096/4096
00010000:00010000:0.0:1651531959.661280:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000968553c1 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531959.661281:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3094 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 36 type: EXT [229376->233471] (req 229376->233471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531959.661282:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249789
00010000:00010000:0.0:1651531959.661284:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3094 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 36 type: EXT [229376->233471] (req 229376->233471) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531959.661290:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3094 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 36 type: EXT [229376->233471] (req 229376->233471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531959.661293:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3094 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 36 type: EXT [229376->233471] (req 229376->233471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531959.662052:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531959.662060:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467391680
00000100:00100000:1.0:1651531959.662075:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249790
00000100:00100000:1.0:1651531959.662077:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f99d9ea1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+39:438147:x1731754467391680:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531959.662083:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca309b lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 36 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.662091:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531959.662091:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531959.662092:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca309b lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 36 type: EXT [638976->643071] (req 638976->643071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.662095:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca309b lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 36 type: EXT [638976->643071] (req 638976->643071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531959.724283:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869129 is committed
00010000:00010000:1.0:1651531959.724313:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca309b lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 36 type: EXT [638976->643071] (req 638976->643071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.724317:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca309b lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 36 type: EXT [638976->643071] (req 638976->643071) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531959.724337:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f99d9ea1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+39:438147:x1731754467391680:12345-10.240.43.64@tcp:4:fio.0 Request processed in 62259us (62285us total) trans 21474869129 rc 0/0
00000100:00100000:1.0:1651531959.724339:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249790
00010000:00010000:0.0:1651531959.724339:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca309b lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 36 type: EXT [638976->643071] (req 638976->643071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531959.724344:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a8889a80 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531959.724345:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca309b lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 36 type: EXT [638976->643071] (req 638976->643071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531959.724348:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca309b lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 36 type: EXT [638976->643071] (req 638976->643071) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531959.724353:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca309b lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 36 type: EXT [638976->643071] (req 638976->643071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531959.724361:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca309b lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 36 type: EXT [638976->643071] (req 638976->643071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531959.724627:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531959.724635:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467392192
00000100:00100000:1.0:1651531959.724649:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249791
00000100:00100000:1.0:1651531959.724651:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000052cf3c08 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+39:438146:x1731754467392192:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531959.724658:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca30a2 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 36 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.724663:0:216321:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca2bbd lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 36 type: EXT [462848->466943] (req 462848->466943) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444f56 expref: 39 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.724669:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531959.724670:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531959.724670:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca30a2 lrc: 4/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 36 type: EXT [462848->466943] (req 462848->466943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.724678:0:216321:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca2bbd lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 36 type: EXT [462848->466943] (req 462848->466943) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444f56 expref: 39 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.724681:0:216321:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca2bbd lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 36 type: EXT [462848->466943] (req 462848->466943) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444f56 expref: 39 pid: 166113 timeout: 22768 lvb_type: 0
00000100:00100000:1.0:1651531959.724686:0:216321:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000b1a9136 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997354112:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531959.724697:0:216321:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ec524534 going to sleep for 6 seconds
00000100:00100000:1.0:1651531959.724964:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531959.724972:0:166103:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467392256
00010000:00010000:1.0:1651531959.724977:0:166103:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca2bbd lrc: 5/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 36 type: EXT [462848->466943] (req 462848->466943) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444f56 expref: 40 pid: 166113 timeout: 22768 lvb_type: 0
00000100:00100000:1.0:1651531959.724990:0:166103:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 184
00000100:00100000:1.0:1651531959.724992:0:166103:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001e61ed2d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+40:438146:x1731754467392256:12345-10.240.43.64@tcp:103:ldlm_bl_04.0
00010000:00010000:1.0:1651531959.724995:0:166103:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1651531959.724998:0:166103:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca2bbd lrc: 5/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 37 type: EXT [462848->466943] (req 462848->466943) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444f56 expref: 40 pid: 166113 timeout: 22768 lvb_type: 0
00010000:00010000:1.0:1651531959.725002:0:166103:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca2bbd lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 37 type: EXT [462848->466943] (req 462848->466943) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444f56 expref: 40 pid: 166113 timeout: 22768 lvb_type: 0
00010000:00010000:1.0:1651531959.725012:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531959.725013:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531959.725013:0:166103:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca30a2 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 37 type: EXT [462848->466943] (req 462848->466943) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.725016:0:166103:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca30a2 lrc: 4/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 37 type: EXT [462848->466943] (req 462848->466943) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.725021:0:166103:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1651531959.725030:0:166103:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001e61ed2d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+40:438146:x1731754467392256:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 38us (67us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531959.725033:0:166103:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 184
00010000:00010000:1.0:1651531959.725043:0:216321:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca2bbd lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 36 type: EXT [462848->466943] (req 462848->466943) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444f56 expref: 39 pid: 166113 timeout: 22768 lvb_type: 0
00000100:00100000:1.0:1651531959.725047:0:216321:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000b1a9136 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997354112:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651531959.725050:0:216321:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca30a2 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 35 type: EXT [462848->466943] (req 462848->466943) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.725054:0:216321:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca30a2 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 35 type: EXT [462848->466943] (req 462848->466943) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.725056:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca30a2 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 35 type: EXT [462848->466943] (req 462848->466943) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.725068:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca30a2 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 35 type: EXT [462848->466943] (req 462848->466943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.725074:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca30a2 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 35 type: EXT [462848->466943] (req 462848->466943) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531959.725088:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000052cf3c08 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+38:438146:x1731754467392192:12345-10.240.43.64@tcp:3:fio.0 Request processed in 436us (461us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531959.725091:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249791
00010000:00010000:1.0:1651531959.725097:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca30a2 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 35 type: EXT [462848->466943] (req 462848->466943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.725100:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001e36c601 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531959.725101:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca30a2 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 35 type: EXT [462848->466943] (req 462848->466943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.725104:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca30a2 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 35 type: EXT [462848->466943] (req 462848->466943) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.725108:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca30a2 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 35 type: EXT [462848->466943] (req 462848->466943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.725111:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca30a2 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 35 type: EXT [462848->466943] (req 462848->466943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531959.771506:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531959.771514:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467393024
00000100:00100000:1.0:1651531959.771529:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249792
00000100:00100000:1.0:1651531959.771531:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000b1a9136 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+38:438147:x1731754467393024:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531959.771540:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca30a9 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 35 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.771545:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531959.771545:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531959.771546:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca30a9 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 35 type: EXT [143360->147455] (req 143360->147455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.771550:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca30a9 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 35 type: EXT [143360->147455] (req 143360->147455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.771561:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca30a9 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 35 type: EXT [143360->147455] (req 143360->147455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.771564:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca30a9 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 35 type: EXT [143360->147455] (req 143360->147455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531959.771583:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000b1a9136 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+38:438147:x1731754467393024:12345-10.240.43.64@tcp:3:fio.0 Request processed in 52us (78us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531959.771586:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249792
00010000:00010000:0.0:1651531959.771586:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca30a9 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 35 type: EXT [143360->147455] (req 143360->147455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531959.771590:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001e36c601 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531959.771591:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca30a9 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 35 type: EXT [143360->147455] (req 143360->147455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531959.771594:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca30a9 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 35 type: EXT [143360->147455] (req 143360->147455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531959.771600:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca30a9 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 35 type: EXT [143360->147455] (req 143360->147455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531959.771602:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca30a9 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 35 type: EXT [143360->147455] (req 143360->147455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531959.796180:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531959.796188:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467393280
00000100:00100000:1.0:1651531959.796202:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249793
00000100:00100000:1.0:1651531959.796215:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000f4bed26 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+38:438148:x1731754467393280:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531959.796233:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca30b0 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 35 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.796238:0:216321:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca2b8c lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 35 type: EXT [65536->69631] (req 65536->69631) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444f02 expref: 38 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.796243:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531959.796243:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531959.796244:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca30b0 lrc: 4/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 35 type: EXT [65536->69631] (req 65536->69631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.796252:0:216321:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca2b8c lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 35 type: EXT [65536->69631] (req 65536->69631) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444f02 expref: 38 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.796256:0:216321:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca2b8c lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 35 type: EXT [65536->69631] (req 65536->69631) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444f02 expref: 38 pid: 166113 timeout: 22768 lvb_type: 0
00000100:00100000:1.0:1651531959.796260:0:216321:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000329eeeee pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997354176:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531959.796271:0:216321:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ec524534 going to sleep for 6 seconds
00000100:00100000:1.0:1651531959.796476:0:216321:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000329eeeee pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997354176:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651531959.796481:0:216321:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca30b0 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 35 type: EXT [65536->69631] (req 65536->69631) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531959.796569:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531959.796576:0:166103:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467393344
00010000:00010000:1.0:1651531959.796581:0:166103:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca2b8c lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 35 type: EXT [65536->69631] (req 65536->69631) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444f02 expref: 39 pid: 166113 timeout: 22768 lvb_type: 0
00000100:00100000:1.0:1651531959.796593:0:166103:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 185
00000100:00100000:1.0:1651531959.796594:0:166103:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000329eeeee pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+39:438149:x1731754467393344:12345-10.240.43.64@tcp:103:ldlm_bl_06.0
00010000:00010000:1.0:1651531959.796597:0:166103:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1651531959.796602:0:166103:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca2b8c lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 36 type: EXT [65536->69631] (req 65536->69631) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444f02 expref: 39 pid: 166113 timeout: 22768 lvb_type: 0
00010000:00010000:1.0:1651531959.796606:0:166103:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca2b8c lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 36 type: EXT [65536->69631] (req 65536->69631) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444f02 expref: 39 pid: 166113 timeout: 22768 lvb_type: 0
00010000:00010000:1.0:1651531959.796612:0:166103:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca2b8c lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 36 type: EXT [65536->69631] (req 65536->69631) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444f02 expref: 39 pid: 166113 timeout: 22768 lvb_type: 0
00010000:00010000:1.0:1651531959.796616:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531959.796616:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531959.796617:0:166103:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca30b0 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 35 type: EXT [65536->69631] (req 65536->69631) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.796620:0:166103:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca30b0 lrc: 4/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 35 type: EXT [65536->69631] (req 65536->69631) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.796627:0:166103:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1651531959.796636:0:166103:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000329eeeee pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+38:438149:x1731754467393344:12345-10.240.43.64@tcp:103:ldlm_bl_06.0 Request processed in 41us (67us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531959.796638:0:166103:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 185
00010000:00010000:1.0:1651531959.796644:0:216321:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca30b0 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 34 type: EXT [65536->69631] (req 65536->69631) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.796647:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca30b0 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 34 type: EXT [65536->69631] (req 65536->69631) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.796658:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca30b0 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 34 type: EXT [65536->69631] (req 65536->69631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.796665:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca30b0 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 34 type: EXT [65536->69631] (req 65536->69631) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531959.796678:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca30b0 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 34 type: EXT [65536->69631] (req 65536->69631) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531959.796681:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000f4bed26 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+37:438148:x1731754467393280:12345-10.240.43.64@tcp:3:fio.0 Request processed in 477us (501us total) trans 0 rc 4096/4096
00010000:00010000:0.0:1651531959.796682:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c2b76533 already unused, calling callback (0000000049fddea7)
00000100:00100000:1.0:1651531959.796683:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249793
00010000:00010000:0.0:1651531959.796683:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca30b0 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 34 type: EXT [65536->69631] (req 65536->69631) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531959.796686:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca30b0 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 34 type: EXT [65536->69631] (req 65536->69631) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531959.796693:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca30b0 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 34 type: EXT [65536->69631] (req 65536->69631) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531959.796695:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca30b0 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 34 type: EXT [65536->69631] (req 65536->69631) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531959.797391:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531959.797398:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467393600
00000100:00100000:1.0:1651531959.797413:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249794
00000100:00100000:1.0:1651531959.797415:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002ae2aeac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+37:438148:x1731754467393600:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531959.797423:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca30b7 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 34 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.797428:0:216321:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004e1f4768/0x3234de053ca2c18 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 34 type: EXT [458752->462847] (req 458752->462847) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445005 expref: 37 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.797430:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531959.797431:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531959.797432:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca30b7 lrc: 4/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 34 type: EXT [458752->462847] (req 458752->462847) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.797439:0:216321:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004e1f4768/0x3234de053ca2c18 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 34 type: EXT [458752->462847] (req 458752->462847) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445005 expref: 37 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.797442:0:216321:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004e1f4768/0x3234de053ca2c18 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 34 type: EXT [458752->462847] (req 458752->462847) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445005 expref: 37 pid: 166112 timeout: 22768 lvb_type: 0
00000100:00100000:1.0:1651531959.797450:0:216321:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000054ed0749 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997354240:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531959.797461:0:216321:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ec524534 going to sleep for 6 seconds
00000100:00100000:1.0:1651531959.797705:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531959.797712:0:166103:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467393664
00010000:00010000:1.0:1651531959.797717:0:166103:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004e1f4768/0x3234de053ca2c18 lrc: 5/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 34 type: EXT [458752->462847] (req 458752->462847) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445005 expref: 38 pid: 166112 timeout: 22768 lvb_type: 0
00000100:00100000:1.0:1651531959.797731:0:166103:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 186
00000100:00100000:1.0:1651531959.797733:0:166103:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c43262d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+38:438146:x1731754467393664:12345-10.240.43.64@tcp:103:ldlm_bl_02.0
00010000:00010000:1.0:1651531959.797735:0:166103:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1651531959.797739:0:166103:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004e1f4768/0x3234de053ca2c18 lrc: 5/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 35 type: EXT [458752->462847] (req 458752->462847) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445005 expref: 38 pid: 166112 timeout: 22768 lvb_type: 0
00010000:00010000:1.0:1651531959.797743:0:166103:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004e1f4768/0x3234de053ca2c18 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 35 type: EXT [458752->462847] (req 458752->462847) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445005 expref: 38 pid: 166112 timeout: 22768 lvb_type: 0
00010000:00010000:1.0:1651531959.797749:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531959.797749:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531959.797750:0:166103:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca30b7 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 35 type: EXT [458752->462847] (req 458752->462847) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.797753:0:166103:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca30b7 lrc: 4/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 35 type: EXT [458752->462847] (req 458752->462847) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.797758:0:166103:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1651531959.797767:0:166103:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c43262d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+38:438146:x1731754467393664:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 34us (62us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531959.797771:0:166103:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 186
00010000:00010000:1.0:1651531959.797781:0:216321:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004e1f4768/0x3234de053ca2c18 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 34 type: EXT [458752->462847] (req 458752->462847) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445005 expref: 37 pid: 166112 timeout: 22768 lvb_type: 0
00000100:00100000:1.0:1651531959.797784:0:216321:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000054ed0749 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997354240:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651531959.797788:0:216321:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca30b7 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 33 type: EXT [458752->462847] (req 458752->462847) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.797791:0:216321:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca30b7 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 33 type: EXT [458752->462847] (req 458752->462847) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.797793:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca30b7 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 33 type: EXT [458752->462847] (req 458752->462847) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.797804:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca30b7 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 33 type: EXT [458752->462847] (req 458752->462847) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.797807:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca30b7 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 33 type: EXT [458752->462847] (req 458752->462847) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531959.797820:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002ae2aeac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+36:438148:x1731754467393600:12345-10.240.43.64@tcp:3:fio.0 Request processed in 405us (430us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531959.797823:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249794
00010000:00010000:1.0:1651531959.797829:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca30b7 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 33 type: EXT [458752->462847] (req 458752->462847) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.797832:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e9b84540 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531959.797834:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca30b7 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 33 type: EXT [458752->462847] (req 458752->462847) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.797837:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca30b7 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 33 type: EXT [458752->462847] (req 458752->462847) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.797841:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca30b7 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 33 type: EXT [458752->462847] (req 458752->462847) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.797844:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca30b7 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 33 type: EXT [458752->462847] (req 458752->462847) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531959.879115:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531959.879124:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467394880
00000100:00100000:1.0:1651531959.879139:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249795
00000100:00100000:1.0:1651531959.879140:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000054ed0749 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+36:438147:x1731754467394880:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531959.879147:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca30be lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 33 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.879152:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531959.879152:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531959.879153:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca30be lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 33 type: EXT [741376->745471] (req 741376->745471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.879157:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca30be lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 33 type: EXT [741376->745471] (req 741376->745471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.879168:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca30be lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 33 type: EXT [741376->745471] (req 741376->745471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.879175:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca30be lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 33 type: EXT [741376->745471] (req 741376->745471) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531959.879194:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000054ed0749 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+36:438147:x1731754467394880:12345-10.240.43.64@tcp:3:fio.0 Request processed in 52us (79us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531959.879196:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249795
00010000:00010000:0.0:1651531959.879196:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca30be lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 33 type: EXT [741376->745471] (req 741376->745471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531959.879201:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e9b84540 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531959.879202:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca30be lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 33 type: EXT [741376->745471] (req 741376->745471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531959.879213:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca30be lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 33 type: EXT [741376->745471] (req 741376->745471) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531959.879218:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca30be lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 33 type: EXT [741376->745471] (req 741376->745471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531959.879221:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca30be lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 33 type: EXT [741376->745471] (req 741376->745471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531959.879532:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531959.879540:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467395136
00000100:00100000:1.0:1651531959.879552:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249796
00000100:00100000:1.0:1651531959.879553:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ffcc974c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+36:438146:x1731754467395136:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531959.879561:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca30c5 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 33 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.879565:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531959.879565:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531959.879566:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca30c5 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 33 type: EXT [90112->94207] (req 90112->94207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.879570:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca30c5 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 33 type: EXT [90112->94207] (req 90112->94207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.879580:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca30c5 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 33 type: EXT [90112->94207] (req 90112->94207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.879583:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca30c5 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 33 type: EXT [90112->94207] (req 90112->94207) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531959.879596:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca30c5 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 33 type: EXT [90112->94207] (req 90112->94207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531959.879600:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d44eb74d already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531959.879601:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca30c5 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 33 type: EXT [90112->94207] (req 90112->94207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531959.879603:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ffcc974c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+36:438146:x1731754467395136:12345-10.240.43.64@tcp:3:fio.0 Request processed in 49us (71us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531959.879606:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249796
00010000:00010000:0.0:1651531959.879608:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca30c5 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 33 type: EXT [90112->94207] (req 90112->94207) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531959.879613:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca30c5 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 33 type: EXT [90112->94207] (req 90112->94207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531959.879615:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca30c5 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 33 type: EXT [90112->94207] (req 90112->94207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531959.880280:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531959.880288:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467395776
00000100:00100000:1.0:1651531959.880301:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249797
00000100:00100000:1.0:1651531959.880303:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003ffbc5dc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+36:438148:x1731754467395776:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531959.880310:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca30cc lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 33 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.880313:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531959.880314:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531959.880315:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca30cc lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 33 type: EXT [32768->36863] (req 32768->36863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.880319:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca30cc lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 33 type: EXT [32768->36863] (req 32768->36863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.880329:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca30cc lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 33 type: EXT [32768->36863] (req 32768->36863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.880332:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca30cc lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 33 type: EXT [32768->36863] (req 32768->36863) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531959.880345:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003ffbc5dc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+36:438148:x1731754467395776:12345-10.240.43.64@tcp:3:fio.0 Request processed in 41us (65us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531959.880348:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249797
00010000:00010000:1.0:1651531959.880355:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca30cc lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 33 type: EXT [32768->36863] (req 32768->36863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.880358:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008558d1b3 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531959.880358:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca30cc lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 33 type: EXT [32768->36863] (req 32768->36863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.880361:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca30cc lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 33 type: EXT [32768->36863] (req 32768->36863) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.880366:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca30cc lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 33 type: EXT [32768->36863] (req 32768->36863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.880368:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca30cc lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 33 type: EXT [32768->36863] (req 32768->36863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531959.880472:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531959.880479:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467395904
00000100:00100000:1.0:1651531959.880494:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249798
00000100:00100000:1.0:1651531959.880496:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c683c211 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+36:438149:x1731754467395904:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531959.880502:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca30d3 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 33 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.880507:0:216321:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000698979ac/0x3234de053ca2d99 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 33 type: EXT [1003520->1019903] (req 1003520->1007615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44530e expref: 36 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.880511:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531959.880511:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531959.880512:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca30d3 lrc: 4/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 33 type: EXT [1007616->1011711] (req 1007616->1011711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.880520:0:216321:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000698979ac/0x3234de053ca2d99 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 33 type: EXT [1003520->1019903] (req 1003520->1007615) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44530e expref: 36 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.880524:0:216321:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000698979ac/0x3234de053ca2d99 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 33 type: EXT [1003520->1019903] (req 1003520->1007615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44530e expref: 36 pid: 166112 timeout: 22768 lvb_type: 0
00000100:00100000:1.0:1651531959.880528:0:216321:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f7006631 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997354304:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531959.880539:0:216321:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ec524534 going to sleep for 6 seconds
00000100:00100000:1.0:1651531959.880689:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531959.880701:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467396032
00000100:00100000:0.0:1651531959.880734:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249799
00000100:00100000:0.0:1651531959.880736:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000059e5b3a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+37:438148:x1731754467396032:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531959.880744:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca30da lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 34 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531959.880749:0:192755:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007d2b2323/0x3234de053ca2cff lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 34 type: EXT [102400->114687] (req 102400->106495) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44523c expref: 37 pid: 166112 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531959.880751:0:216321:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f7006631 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997354304:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651531959.880752:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531959.880753:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531959.880754:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca30da lrc: 4/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 34 type: EXT [102400->106495] (req 102400->106495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.880757:0:216321:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca30d3 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 34 type: EXT [1007616->1011711] (req 1007616->1011711) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531959.880762:0:192755:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007d2b2323/0x3234de053ca2cff lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 34 type: EXT [102400->114687] (req 102400->106495) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44523c expref: 37 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531959.880766:0:192755:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007d2b2323/0x3234de053ca2cff lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 34 type: EXT [102400->114687] (req 102400->106495) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44523c expref: 37 pid: 166112 timeout: 22768 lvb_type: 0
00000100:00100000:0.0:1651531959.880771:0:192755:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000089660739 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0001_UUID:192755:1731745997354368:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531959.880788:0:192755:0:(client.c:2492:ptlrpc_set_wait()) set 00000000d9e1a9f8 going to sleep for 6 seconds
00000100:00100000:1.0:1651531959.880838:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531959.880845:0:166103:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467396096
00010000:00010000:1.0:1651531959.880850:0:166103:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000698979ac/0x3234de053ca2d99 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 34 type: EXT [1003520->1019903] (req 1003520->1007615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44530e expref: 38 pid: 166112 timeout: 22768 lvb_type: 0
00000100:00100000:1.0:1651531959.880862:0:166103:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 187
00000100:00100000:1.0:1651531959.880863:0:166103:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f7006631 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+38:438149:x1731754467396096:12345-10.240.43.64@tcp:103:ldlm_bl_06.0
00010000:00010000:1.0:1651531959.880866:0:166103:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1651531959.880870:0:166103:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000698979ac/0x3234de053ca2d99 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 35 type: EXT [1003520->1019903] (req 1003520->1007615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44530e expref: 38 pid: 166112 timeout: 22768 lvb_type: 0
00010000:00010000:1.0:1651531959.880874:0:166103:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000698979ac/0x3234de053ca2d99 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 35 type: EXT [1003520->1019903] (req 1003520->1007615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44530e expref: 38 pid: 166112 timeout: 22768 lvb_type: 0
00010000:00010000:1.0:1651531959.880881:0:166103:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000698979ac/0x3234de053ca2d99 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 35 type: EXT [1003520->1019903] (req 1003520->1007615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44530e expref: 38 pid: 166112 timeout: 22768 lvb_type: 0
00010000:00010000:1.0:1651531959.880885:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531959.880886:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531959.880887:0:166103:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca30d3 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 34 type: EXT [1007616->1011711] (req 1007616->1011711) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.880890:0:166103:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca30d3 lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 34 type: EXT [1007616->1011711] (req 1007616->1011711) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.880897:0:166103:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1651531959.880905:0:166103:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f7006631 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+37:438149:x1731754467396096:12345-10.240.43.64@tcp:103:ldlm_bl_06.0 Request processed in 41us (67us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531959.880907:0:166103:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 187
00010000:00010000:1.0:1651531959.880913:0:216321:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca30d3 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 33 type: EXT [1007616->1011711] (req 1007616->1011711) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.880916:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca30d3 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 33 type: EXT [1007616->1011711] (req 1007616->1011711) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531959.881044:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531959.881053:0:166103:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467396160
00000100:00100000:0.0:1651531959.881061:0:192755:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000089660739 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0001_UUID:192755:1731745997354368:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651531959.881068:0:192755:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca30da lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 34 type: EXT [102400->106495] (req 102400->106495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.881069:0:166103:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007d2b2323/0x3234de053ca2cff lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 34 type: EXT [102400->114687] (req 102400->106495) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44523c expref: 39 pid: 166112 timeout: 22768 lvb_type: 0
00000100:00100000:1.0:1651531959.881080:0:166103:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 188
00000100:00100000:1.0:1651531959.881082:0:166103:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c4ea889e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+39:438149:x1731754467396160:12345-10.240.43.64@tcp:103:ldlm_bl_01.0
00010000:00010000:1.0:1651531959.881086:0:166103:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1651531959.881089:0:166103:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007d2b2323/0x3234de053ca2cff lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 34 type: EXT [102400->114687] (req 102400->106495) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44523c expref: 39 pid: 166112 timeout: 22768 lvb_type: 0
00010000:00010000:1.0:1651531959.881093:0:166103:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007d2b2323/0x3234de053ca2cff lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 34 type: EXT [102400->114687] (req 102400->106495) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44523c expref: 39 pid: 166112 timeout: 22768 lvb_type: 0
00010000:00010000:1.0:1651531959.881099:0:166103:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007d2b2323/0x3234de053ca2cff lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 34 type: EXT [102400->114687] (req 102400->106495) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44523c expref: 39 pid: 166112 timeout: 22768 lvb_type: 0
00010000:00010000:1.0:1651531959.881103:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531959.881104:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531959.881105:0:166103:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca30da lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 33 type: EXT [102400->106495] (req 102400->106495) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.881108:0:166103:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca30da lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 33 type: EXT [102400->106495] (req 102400->106495) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.881116:0:166103:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1651531959.881125:0:192755:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca30da lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 32 type: EXT [102400->106495] (req 102400->106495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531959.881126:0:166103:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c4ea889e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+38:438149:x1731754467396160:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 43us (82us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531959.881128:0:166103:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 188
00010000:00010000:0.0:1651531959.881131:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca30da lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 32 type: EXT [102400->106495] (req 102400->106495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531959.917454:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869130 is committed
00010000:00010000:1.0:1651531959.917487:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca30d3 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 32 type: EXT [1007616->1011711] (req 1007616->1011711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.917491:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca30d3 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 32 type: EXT [1007616->1011711] (req 1007616->1011711) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531959.917510:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c683c211 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+37:438149:x1731754467395904:12345-10.240.43.64@tcp:4:fio.0 Request processed in 37013us (37038us total) trans 21474869130 rc 0/0
00010000:00010000:0.0:1651531959.917513:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca30d3 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 32 type: EXT [1007616->1011711] (req 1007616->1011711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531959.917514:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249798
00010000:00010000:0.0:1651531959.917520:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006da7a892 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531959.917522:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca30d3 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 32 type: EXT [1007616->1011711] (req 1007616->1011711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531959.917527:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca30d3 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 32 type: EXT [1007616->1011711] (req 1007616->1011711) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531959.917535:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca30d3 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 32 type: EXT [1007616->1011711] (req 1007616->1011711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531959.917542:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca30d3 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 32 type: EXT [1007616->1011711] (req 1007616->1011711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531959.918264:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531959.918272:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467396416
00000100:00100000:1.0:1651531959.918281:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249800
00000100:00100000:1.0:1651531959.918283:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a925fbf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+37:438149:x1731754467396416:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531959.918290:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca30e1 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 32 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.918294:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531959.918294:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531959.918295:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca30e1 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 32 type: EXT [765952->770047] (req 765952->770047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.918299:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca30e1 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 32 type: EXT [765952->770047] (req 765952->770047) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.918309:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca30e1 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 32 type: EXT [765952->770047] (req 765952->770047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.918312:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca30e1 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 32 type: EXT [765952->770047] (req 765952->770047) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531959.918332:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a925fbf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+37:438149:x1731754467396416:12345-10.240.43.64@tcp:3:fio.0 Request processed in 48us (69us total) trans 0 rc 4096/4096
00010000:00010000:0.0:1651531959.918332:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca30e1 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 32 type: EXT [765952->770047] (req 765952->770047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531959.918335:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249800
00010000:00010000:0.0:1651531959.918336:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008558d1b3 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531959.918337:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca30e1 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 32 type: EXT [765952->770047] (req 765952->770047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531959.918340:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca30e1 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 32 type: EXT [765952->770047] (req 765952->770047) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531959.918346:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca30e1 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 32 type: EXT [765952->770047] (req 765952->770047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531959.918348:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca30e1 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 32 type: EXT [765952->770047] (req 765952->770047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531959.918682:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531959.918690:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467396544
00000100:00100000:1.0:1651531959.918700:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249801
00000100:00100000:1.0:1651531959.918701:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003562cf4d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+37:438148:x1731754467396544:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531959.918708:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca30e8 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 32 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.918712:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531959.918713:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531959.918714:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca30e8 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 32 type: EXT [188416->192511] (req 188416->192511) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.918717:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca30e8 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 32 type: EXT [188416->192511] (req 188416->192511) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531959.942825:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869131 is committed
00010000:00010000:1.0:1651531959.942857:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca30da lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 32 type: EXT [102400->106495] (req 102400->106495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.942861:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca30da lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 32 type: EXT [102400->106495] (req 102400->106495) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531959.942876:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000059e5b3a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+37:438148:x1731754467396032:12345-10.240.43.64@tcp:4:fio.0 Request processed in 62140us (62187us total) trans 21474869131 rc 0/0
00000100:00100000:1.0:1651531959.942879:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249799
00010000:00010000:1.0:1651531959.942886:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca30da lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 32 type: EXT [102400->106495] (req 102400->106495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.942889:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fab23815 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531959.942890:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca30da lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 32 type: EXT [102400->106495] (req 102400->106495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.942896:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca30da lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 32 type: EXT [102400->106495] (req 102400->106495) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.942901:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca30da lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 32 type: EXT [102400->106495] (req 102400->106495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.942904:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca30da lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 32 type: EXT [102400->106495] (req 102400->106495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531959.992057:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869132 is committed
00010000:00010000:1.0:1651531959.992086:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca30e8 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 31 type: EXT [188416->192511] (req 188416->192511) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.992090:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca30e8 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 31 type: EXT [188416->192511] (req 188416->192511) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531959.992110:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003562cf4d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+34:438148:x1731754467396544:12345-10.240.43.64@tcp:4:fio.0 Request processed in 73408us (73428us total) trans 21474869132 rc 0/0
00010000:00010000:0.0:1651531959.992112:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca30e8 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 31 type: EXT [188416->192511] (req 188416->192511) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531959.992113:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249801
00010000:00010000:0.0:1651531959.992117:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d44eb74d already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531959.992118:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca30e8 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 31 type: EXT [188416->192511] (req 188416->192511) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531959.992125:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca30e8 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 31 type: EXT [188416->192511] (req 188416->192511) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531959.992131:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca30e8 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 31 type: EXT [188416->192511] (req 188416->192511) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531959.992134:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca30e8 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 31 type: EXT [188416->192511] (req 188416->192511) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531959.993165:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531959.993172:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467397504
00000100:00100000:1.0:1651531959.993182:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249802
00000100:00100000:1.0:1651531959.993184:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000009c4c564 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+34:438148:x1731754467397504:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531959.993191:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca30ef lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 31 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.993194:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531959.993195:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531959.993198:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca30ef lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 31 type: EXT [253952->258047] (req 253952->258047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.993201:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca30ef lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 31 type: EXT [253952->258047] (req 253952->258047) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.993241:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca30ef lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 31 type: EXT [253952->258047] (req 253952->258047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.993244:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca30ef lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 31 type: EXT [253952->258047] (req 253952->258047) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531959.993255:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca30ef lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 31 type: EXT [253952->258047] (req 253952->258047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531959.993259:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e9b84540 already unused, calling callback (0000000049fddea7)
00000100:00100000:1.0:1651531959.993260:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000009c4c564 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+34:438148:x1731754467397504:12345-10.240.43.64@tcp:3:fio.0 Request processed in 76us (96us total) trans 0 rc 4096/4096
00010000:00010000:0.0:1651531959.993260:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca30ef lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 31 type: EXT [253952->258047] (req 253952->258047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531959.993263:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249802
00010000:00010000:0.0:1651531959.993263:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca30ef lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 31 type: EXT [253952->258047] (req 253952->258047) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531959.993268:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca30ef lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 31 type: EXT [253952->258047] (req 253952->258047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531959.993270:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca30ef lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 31 type: EXT [253952->258047] (req 253952->258047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531959.993495:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531959.993503:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467397632
00000100:00100000:1.0:1651531959.993512:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249803
00000100:00100000:1.0:1651531959.993513:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c0b460ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+34:438149:x1731754467397632:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531959.993520:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca30f6 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 31 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.993523:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531959.993524:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531959.993525:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca30f6 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 31 type: EXT [282624->286719] (req 282624->286719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.993529:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca30f6 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 31 type: EXT [282624->286719] (req 282624->286719) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531959.993660:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531959.993669:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467397760
00000100:00100000:1.0:1651531959.993678:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249804
00000100:00100000:1.0:1651531959.993679:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003d9ef3c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+37:438149:x1731754467397760:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531959.993686:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca30fd lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 32 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.993690:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531959.993691:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531959.993692:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca30fd lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 32 type: EXT [643072->647167] (req 643072->647167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.993695:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca30fd lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 32 type: EXT [643072->647167] (req 643072->647167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.993706:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca30fd lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 32 type: EXT [643072->647167] (req 643072->647167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.993709:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca30fd lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 32 type: EXT [643072->647167] (req 643072->647167) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531959.993722:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003d9ef3c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+37:438149:x1731754467397760:12345-10.240.43.64@tcp:3:fio.0 Request processed in 42us (62us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531959.993725:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249804
00010000:00010000:1.0:1651531959.993731:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca30fd lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 32 type: EXT [643072->647167] (req 643072->647167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.993737:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001e36c601 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531959.993738:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca30fd lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 32 type: EXT [643072->647167] (req 643072->647167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.993741:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca30fd lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 32 type: EXT [643072->647167] (req 643072->647167) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.993746:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca30fd lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 32 type: EXT [643072->647167] (req 643072->647167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531959.993748:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca30fd lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 32 type: EXT [643072->647167] (req 643072->647167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531960.034571:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869133 is committed
00010000:00010000:1.0:1651531960.034600:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca30f6 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 31 type: EXT [282624->286719] (req 282624->286719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.034604:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca30f6 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 31 type: EXT [282624->286719] (req 282624->286719) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531960.034623:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c0b460ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+34:438149:x1731754467397632:12345-10.240.43.64@tcp:4:fio.0 Request processed in 41108us (41128us total) trans 21474869133 rc 0/0
00010000:00010000:0.0:1651531960.034625:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca30f6 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 31 type: EXT [282624->286719] (req 282624->286719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531960.034626:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249803
00010000:00010000:0.0:1651531960.034633:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c2b76533 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531960.034634:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca30f6 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 31 type: EXT [282624->286719] (req 282624->286719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.034637:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca30f6 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 31 type: EXT [282624->286719] (req 282624->286719) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.034643:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca30f6 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 31 type: EXT [282624->286719] (req 282624->286719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.034646:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca30f6 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 31 type: EXT [282624->286719] (req 282624->286719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531960.034965:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531960.034973:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467398016
00000100:00100000:1.0:1651531960.034982:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249805
00000100:00100000:1.0:1651531960.034984:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006e255cae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+34:438148:x1731754467398016:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531960.035001:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3104 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 31 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.035006:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531960.035006:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531960.035007:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3104 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 31 type: EXT [610304->614399] (req 610304->614399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.035011:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3104 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 31 type: EXT [610304->614399] (req 610304->614399) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.035022:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3104 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 31 type: EXT [610304->614399] (req 610304->614399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.035025:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3104 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 31 type: EXT [610304->614399] (req 610304->614399) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.035044:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3104 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 31 type: EXT [610304->614399] (req 610304->614399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531960.035045:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006e255cae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+34:438148:x1731754467398016:12345-10.240.43.64@tcp:3:fio.0 Request processed in 60us (80us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531960.035048:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249805
00010000:00010000:0.0:1651531960.035048:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001e36c601 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531960.035049:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3104 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 31 type: EXT [610304->614399] (req 610304->614399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.035052:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3104 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 31 type: EXT [610304->614399] (req 610304->614399) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.035057:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3104 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 31 type: EXT [610304->614399] (req 610304->614399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.035059:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3104 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 31 type: EXT [610304->614399] (req 610304->614399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531960.035372:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531960.035380:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467398208
00000100:00100000:1.0:1651531960.035389:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249806
00000100:00100000:1.0:1651531960.035391:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000df1eb0d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+34:438149:x1731754467398208:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531960.035397:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca310b lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 31 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.035401:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531960.035403:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531960.035403:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca310b lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 31 type: EXT [643072->647167] (req 643072->647167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.035407:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca310b lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 31 type: EXT [643072->647167] (req 643072->647167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531960.035544:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531960.035552:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467398464
00000100:00100000:1.0:1651531960.035561:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249807
00000100:00100000:1.0:1651531960.035563:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000053497d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+37:438148:x1731754467398464:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531960.035569:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3112 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 32 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.035573:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531960.035573:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531960.035574:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3112 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 32 type: EXT [749568->753663] (req 749568->753663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.035578:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3112 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 32 type: EXT [749568->753663] (req 749568->753663) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531960.073178:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531960.073187:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531960.073199:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467398656
00000100:00100000:1.0:1651531960.073238:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467398592
00000100:00100000:1.0:1651531960.073245:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249808
00000100:00100000:1.0:1651531960.073247:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ffcdece2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+41:438147:x1731754467398656:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651531960.073252:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249809
00000100:00100000:0.0:1651531960.073254:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009c93d7f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+41:438147:x1731754467398592:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531960.073255:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3119 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 33 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.073260:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531960.073261:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531960.073262:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3119 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 33 type: EXT [319488->323583] (req 319488->323583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.073264:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3120 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 35 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.073265:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3119 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 35 type: EXT [319488->323583] (req 319488->323583) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.073269:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531960.073269:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531960.073271:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3120 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 34 type: EXT [864256->868351] (req 864256->868351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.073275:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3120 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 34 type: EXT [864256->868351] (req 864256->868351) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.073276:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3119 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 35 type: EXT [319488->323583] (req 319488->323583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.073279:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3119 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 34 type: EXT [319488->323583] (req 319488->323583) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531960.073303:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ffcdece2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+41:438147:x1731754467398656:12345-10.240.43.64@tcp:3:fio.0 Request processed in 55us (125us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531960.073305:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249808
00010000:00010000:1.0:1651531960.073316:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3119 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 34 type: EXT [319488->323583] (req 319488->323583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.073319:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001e36c601 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531960.073320:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3119 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 34 type: EXT [319488->323583] (req 319488->323583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.073323:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3119 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 34 type: EXT [319488->323583] (req 319488->323583) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.073328:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3119 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 34 type: EXT [319488->323583] (req 319488->323583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.073332:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3119 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 34 type: EXT [319488->323583] (req 319488->323583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531960.073642:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531960.073649:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467398848
00000100:00100000:1.0:1651531960.073659:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249810
00000100:00100000:1.0:1651531960.073660:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007f998d3c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+43:438148:x1731754467398848:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531960.073667:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3127 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 34 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.073671:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531960.073672:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531960.073673:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3127 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 34 type: EXT [98304->102399] (req 98304->102399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.073676:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3127 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 34 type: EXT [98304->102399] (req 98304->102399) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.073686:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3127 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 34 type: EXT [98304->102399] (req 98304->102399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.073689:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3127 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 34 type: EXT [98304->102399] (req 98304->102399) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531960.073710:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007f998d3c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+43:438148:x1731754467398848:12345-10.240.43.64@tcp:3:fio.0 Request processed in 48us (68us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531960.073712:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249810
00010000:00010000:0.0:1651531960.073712:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3127 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 34 type: EXT [98304->102399] (req 98304->102399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.073717:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c2b76533 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531960.073718:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3127 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 34 type: EXT [98304->102399] (req 98304->102399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.073721:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3127 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 34 type: EXT [98304->102399] (req 98304->102399) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.073727:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3127 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 34 type: EXT [98304->102399] (req 98304->102399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.073730:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3127 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 34 type: EXT [98304->102399] (req 98304->102399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531960.074054:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531960.074062:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467398976
00000100:00100000:1.0:1651531960.074070:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249811
00000100:00100000:1.0:1651531960.074072:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000942b56fd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+43:438149:x1731754467398976:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531960.074078:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca312e lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 34 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.074082:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531960.074082:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531960.074083:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca312e lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 34 type: EXT [733184->737279] (req 733184->737279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.074087:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca312e lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 34 type: EXT [733184->737279] (req 733184->737279) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531960.084755:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869135 is committed
00002000:00010000:1.0:1651531960.084783:0:192755:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x34545:0x0] updating lvb mtime from disk: 1651531959 -> 1651531960
00002000:00010000:1.0:1651531960.084785:0:192755:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x34545:0x0] updating lvb ctime from disk: 1651531959 -> 1651531960
00010000:00010000:1.0:1651531960.084787:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3112 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 34 type: EXT [749568->753663] (req 749568->753663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.084790:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3112 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 34 type: EXT [749568->753663] (req 749568->753663) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531960.084809:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000053497d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+41:438148:x1731754467398464:12345-10.240.43.64@tcp:4:fio.0 Request processed in 49246us (49266us total) trans 21474869135 rc 0/0
00010000:00010000:0.0:1651531960.084811:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3112 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 34 type: EXT [749568->753663] (req 749568->753663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531960.084812:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249807
00010000:00010000:0.0:1651531960.084815:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000968553c1 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531960.084816:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3112 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 34 type: EXT [749568->753663] (req 749568->753663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.084819:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3112 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 34 type: EXT [749568->753663] (req 749568->753663) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.084828:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca310b lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 34 type: EXT [643072->647167] (req 643072->647167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.084835:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca310b lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 34 type: EXT [643072->647167] (req 643072->647167) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.084838:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3112 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 34 type: EXT [749568->753663] (req 749568->753663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.084841:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3112 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 34 type: EXT [749568->753663] (req 749568->753663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.084844:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca310b lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 33 type: EXT [643072->647167] (req 643072->647167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531960.084845:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000df1eb0d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+40:438149:x1731754467398208:12345-10.240.43.64@tcp:4:fio.0 Request processed in 49454us (49473us total) trans 21474869134 rc 0/0
00000100:00100000:1.0:1651531960.084847:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249806
00010000:00010000:0.0:1651531960.084847:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a8889a80 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531960.084848:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca310b lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 33 type: EXT [643072->647167] (req 643072->647167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.084850:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca310b lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 33 type: EXT [643072->647167] (req 643072->647167) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.084854:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca310b lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 33 type: EXT [643072->647167] (req 643072->647167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.084858:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca310b lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 33 type: EXT [643072->647167] (req 643072->647167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531960.085186:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531960.085194:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467399104
00000100:00100000:1.0:1651531960.085203:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249812
00000100:00100000:1.0:1651531960.085215:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004d249e37 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+40:438149:x1731754467399104:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531960.085236:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3135 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 33 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.085242:0:216321:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000378a069e/0x3234de053ca2c6c lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 33 type: EXT [978944->995327] (req 978944->983039) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4450c9 expref: 40 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.085245:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531960.085246:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531960.085246:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3135 lrc: 4/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 33 type: EXT [987136->991231] (req 987136->991231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.085254:0:216321:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000378a069e/0x3234de053ca2c6c lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 33 type: EXT [978944->995327] (req 978944->983039) gid 0 flags: 0x50000000020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4450c9 expref: 40 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.085258:0:216321:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000378a069e/0x3234de053ca2c6c lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 33 type: EXT [978944->995327] (req 978944->983039) gid 0 flags: 0x70000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4450c9 expref: 40 pid: 166112 timeout: 22768 lvb_type: 0
00000100:00100000:1.0:1651531960.085266:0:216321:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007d76765b pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997354432:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531960.085291:0:216321:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ec524534 going to sleep for 6 seconds
00000100:00100000:1.0:1651531960.085575:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531960.085581:0:166103:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467399296
00010000:00010000:1.0:1651531960.085587:0:166103:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000378a069e/0x3234de053ca2c6c lrc: 5/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 33 type: EXT [978944->995327] (req 978944->983039) gid 0 flags: 0x60000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4450c9 expref: 41 pid: 166112 timeout: 22768 lvb_type: 0
00000100:00100000:1.0:1651531960.085600:0:166103:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 189
00000100:00100000:1.0:1651531960.085601:0:166103:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d710c5fd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+41:438147:x1731754467399296:12345-10.240.43.64@tcp:103:ldlm_bl_03.0
00010000:00010000:1.0:1651531960.085604:0:166103:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1651531960.085608:0:166103:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000378a069e/0x3234de053ca2c6c lrc: 5/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 34 type: EXT [978944->995327] (req 978944->983039) gid 0 flags: 0x60000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4450c9 expref: 41 pid: 166112 timeout: 22768 lvb_type: 0
00010000:00010000:1.0:1651531960.085611:0:166103:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000378a069e/0x3234de053ca2c6c lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 34 type: EXT [978944->995327] (req 978944->983039) gid 0 flags: 0x50000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4450c9 expref: 41 pid: 166112 timeout: 22768 lvb_type: 0
00010000:00010000:1.0:1651531960.085618:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531960.085618:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531960.085619:0:166103:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3135 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 34 type: EXT [987136->991231] (req 987136->991231) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.085622:0:166103:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3135 lrc: 4/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 34 type: EXT [987136->991231] (req 987136->991231) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.085627:0:166103:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1651531960.085636:0:166103:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d710c5fd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+41:438147:x1731754467399296:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 34us (62us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531960.085640:0:166103:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 189
00010000:00010000:1.0:1651531960.085650:0:216321:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000378a069e/0x3234de053ca2c6c lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 33 type: EXT [978944->995327] (req 978944->983039) gid 0 flags: 0x44801400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4450c9 expref: 40 pid: 166112 timeout: 22768 lvb_type: 0
00000100:00100000:1.0:1651531960.085654:0:216321:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007d76765b pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997354432:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651531960.085658:0:216321:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3135 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 32 type: EXT [987136->991231] (req 987136->991231) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.085661:0:216321:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3135 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 32 type: EXT [987136->991231] (req 987136->991231) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.085664:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3135 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 32 type: EXT [987136->991231] (req 987136->991231) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.085675:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3135 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 32 type: EXT [987136->991231] (req 987136->991231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.085678:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3135 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 32 type: EXT [987136->991231] (req 987136->991231) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.085695:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3135 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 32 type: EXT [987136->991231] (req 987136->991231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531960.085697:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004d249e37 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+39:438149:x1731754467399104:12345-10.240.43.64@tcp:3:fio.0 Request processed in 482us (511us total) trans 0 rc 4096/4096
00010000:00010000:0.0:1651531960.085699:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001e36c601 already unused, calling callback (0000000049fddea7)
00000100:00100000:1.0:1651531960.085700:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249812
00010000:00010000:0.0:1651531960.085700:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3135 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 32 type: EXT [987136->991231] (req 987136->991231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.085703:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3135 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 32 type: EXT [987136->991231] (req 987136->991231) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.085708:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3135 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 32 type: EXT [987136->991231] (req 987136->991231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.085711:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3135 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 32 type: EXT [987136->991231] (req 987136->991231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531960.146883:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869137 is committed
00010000:00010000:0.0:1651531960.146907:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3120 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 31 type: EXT [864256->868351] (req 864256->868351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.146911:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3120 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 31 type: EXT [864256->868351] (req 864256->868351) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.146916:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca312e lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 31 type: EXT [733184->737279] (req 733184->737279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.146925:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca312e lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 31 type: EXT [733184->737279] (req 733184->737279) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531960.146933:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009c93d7f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+34:438147:x1731754467398592:12345-10.240.43.64@tcp:4:fio.0 Request processed in 73678us (73745us total) trans 21474869136 rc 0/0
00000100:00100000:0.0:1651531960.146946:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249809
00000100:00100000:1.0:1651531960.146948:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000942b56fd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+34:438149:x1731754467398976:12345-10.240.43.64@tcp:4:fio.0 Request processed in 72875us (72894us total) trans 21474869137 rc 0/0
00000100:00100000:1.0:1651531960.146951:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249811
00010000:00010000:0.0:1651531960.146954:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3120 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 31 type: EXT [864256->868351] (req 864256->868351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.146957:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002c5e01dd already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531960.146958:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3120 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 31 type: EXT [864256->868351] (req 864256->868351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.146959:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca312e lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 32 type: EXT [733184->737279] (req 733184->737279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.146961:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3120 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 32 type: EXT [864256->868351] (req 864256->868351) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.146962:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e9b84540 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531960.146963:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca312e lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 32 type: EXT [733184->737279] (req 733184->737279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.146967:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca312e lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 31 type: EXT [733184->737279] (req 733184->737279) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.146967:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3120 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 32 type: EXT [864256->868351] (req 864256->868351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.146970:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3120 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 31 type: EXT [864256->868351] (req 864256->868351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.146972:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca312e lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 32 type: EXT [733184->737279] (req 733184->737279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.146975:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca312e lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 30 type: EXT [733184->737279] (req 733184->737279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531960.147309:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531960.147317:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467400512
00000100:00100000:1.0:1651531960.147332:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249813
00000100:00100000:1.0:1651531960.147334:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001304ce4c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+33:438146:x1731754467400512:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531960.147341:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca313c lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 30 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.147345:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531960.147347:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531960.147348:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca313c lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 30 type: EXT [241664->245759] (req 241664->245759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.147352:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca313c lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 30 type: EXT [241664->245759] (req 241664->245759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.147363:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca313c lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 30 type: EXT [241664->245759] (req 241664->245759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.147366:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca313c lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 30 type: EXT [241664->245759] (req 241664->245759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531960.147386:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001304ce4c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+33:438146:x1731754467400512:12345-10.240.43.64@tcp:3:fio.0 Request processed in 51us (77us total) trans 0 rc 4096/4096
00010000:00010000:0.0:1651531960.147387:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca313c lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 30 type: EXT [241664->245759] (req 241664->245759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531960.147388:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249813
00010000:00010000:0.0:1651531960.147392:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d44eb74d already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531960.147393:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca313c lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 30 type: EXT [241664->245759] (req 241664->245759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.147396:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca313c lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 30 type: EXT [241664->245759] (req 241664->245759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.147401:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca313c lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 30 type: EXT [241664->245759] (req 241664->245759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.147405:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca313c lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 30 type: EXT [241664->245759] (req 241664->245759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531960.147722:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531960.147729:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467400704
00000100:00100000:1.0:1651531960.147741:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249814
00000100:00100000:1.0:1651531960.147743:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000063869776 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+33:438147:x1731754467400704:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531960.147751:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3143 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 30 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.147755:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531960.147756:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531960.147756:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3143 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 30 type: EXT [929792->933887] (req 929792->933887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.147760:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3143 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 30 type: EXT [929792->933887] (req 929792->933887) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.147772:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3143 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 30 type: EXT [929792->933887] (req 929792->933887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.147775:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3143 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 30 type: EXT [929792->933887] (req 929792->933887) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.147785:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3143 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 30 type: EXT [929792->933887] (req 929792->933887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.147789:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008558d1b3 already unused, calling callback (0000000049fddea7)
00000100:00100000:1.0:1651531960.147793:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000063869776 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+33:438147:x1731754467400704:12345-10.240.43.64@tcp:3:fio.0 Request processed in 49us (71us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531960.147795:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249814
00010000:00010000:0.0:1651531960.147795:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3143 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 30 type: EXT [929792->933887] (req 929792->933887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.147798:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3143 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 30 type: EXT [929792->933887] (req 929792->933887) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.147803:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3143 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 30 type: EXT [929792->933887] (req 929792->933887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.147805:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3143 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 30 type: EXT [929792->933887] (req 929792->933887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531960.186536:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531960.186544:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467401280
00000100:00100000:1.0:1651531960.186558:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249815
00000100:00100000:1.0:1651531960.186560:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000be87d738 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+33:438148:x1731754467401280:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531960.186567:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca314a lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 30 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.186571:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531960.186572:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531960.186573:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca314a lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 30 type: EXT [843776->847871] (req 843776->847871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.186577:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca314a lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 30 type: EXT [843776->847871] (req 843776->847871) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.186587:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca314a lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 30 type: EXT [843776->847871] (req 843776->847871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.186594:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca314a lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 30 type: EXT [843776->847871] (req 843776->847871) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531960.186613:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000be87d738 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+33:438148:x1731754467401280:12345-10.240.43.64@tcp:3:fio.0 Request processed in 52us (78us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531960.186616:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249815
00010000:00010000:1.0:1651531960.186622:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca314a lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 30 type: EXT [843776->847871] (req 843776->847871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.186625:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e9b84540 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531960.186626:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca314a lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 30 type: EXT [843776->847871] (req 843776->847871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.186629:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca314a lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 30 type: EXT [843776->847871] (req 843776->847871) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.186634:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca314a lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 30 type: EXT [843776->847871] (req 843776->847871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.186637:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca314a lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 30 type: EXT [843776->847871] (req 843776->847871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531960.235930:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531960.235939:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467402112
00000100:00100000:1.0:1651531960.235953:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249816
00000100:00100000:1.0:1651531960.235955:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000374facb9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+33:438149:x1731754467402112:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531960.235965:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3151 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 30 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.235969:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531960.235970:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531960.235971:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3151 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 30 type: EXT [708608->712703] (req 708608->712703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.235974:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3151 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 30 type: EXT [708608->712703] (req 708608->712703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.235985:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3151 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 30 type: EXT [708608->712703] (req 708608->712703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.235988:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3151 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 30 type: EXT [708608->712703] (req 708608->712703) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531960.236008:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000374facb9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+33:438149:x1731754467402112:12345-10.240.43.64@tcp:3:fio.0 Request processed in 52us (78us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531960.236010:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249816
00010000:00010000:0.0:1651531960.236010:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3151 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 30 type: EXT [708608->712703] (req 708608->712703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.236014:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e9b84540 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531960.236015:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3151 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 30 type: EXT [708608->712703] (req 708608->712703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.236018:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3151 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 30 type: EXT [708608->712703] (req 708608->712703) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.236025:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3151 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 30 type: EXT [708608->712703] (req 708608->712703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.236028:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3151 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 30 type: EXT [708608->712703] (req 708608->712703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531960.236084:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531960.236092:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467402240
00000100:00100000:1.0:1651531960.236104:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249817
00000100:00100000:1.0:1651531960.236105:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000052213cb9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+33:438147:x1731754467402240:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531960.236112:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3158 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 30 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.236116:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531960.236118:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531960.236119:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3158 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 30 type: EXT [421888->425983] (req 421888->425983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.236123:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3158 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 30 type: EXT [421888->425983] (req 421888->425983) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.236133:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3158 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 30 type: EXT [421888->425983] (req 421888->425983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.236137:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3158 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 30 type: EXT [421888->425983] (req 421888->425983) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.236147:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3158 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 30 type: EXT [421888->425983] (req 421888->425983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.236150:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006da7a892 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531960.236151:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3158 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 30 type: EXT [421888->425983] (req 421888->425983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531960.236153:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000052213cb9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+33:438147:x1731754467402240:12345-10.240.43.64@tcp:3:fio.0 Request processed in 47us (69us total) trans 0 rc 4096/4096
00010000:00010000:0.0:1651531960.236154:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3158 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 30 type: EXT [421888->425983] (req 421888->425983) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531960.236156:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249817
00010000:00010000:0.0:1651531960.236159:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3158 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 30 type: EXT [421888->425983] (req 421888->425983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.236161:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3158 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 30 type: EXT [421888->425983] (req 421888->425983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531960.236433:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531960.236440:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467402368
00000100:00100000:1.0:1651531960.236452:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249818
00000100:00100000:1.0:1651531960.236454:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009b569a7a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+33:438149:x1731754467402368:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531960.236461:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca315f lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 30 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.236465:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531960.236466:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531960.236467:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca315f lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 30 type: EXT [282624->286719] (req 282624->286719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.236471:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca315f lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 30 type: EXT [282624->286719] (req 282624->286719) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.236482:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca315f lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 30 type: EXT [282624->286719] (req 282624->286719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.236485:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca315f lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 30 type: EXT [282624->286719] (req 282624->286719) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531960.236499:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009b569a7a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+33:438149:x1731754467402368:12345-10.240.43.64@tcp:3:fio.0 Request processed in 44us (66us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531960.236501:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249818
00010000:00010000:1.0:1651531960.236507:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca315f lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 30 type: EXT [282624->286719] (req 282624->286719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.236510:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008558d1b3 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531960.236511:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca315f lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 30 type: EXT [282624->286719] (req 282624->286719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.236514:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca315f lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 30 type: EXT [282624->286719] (req 282624->286719) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.236519:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca315f lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 30 type: EXT [282624->286719] (req 282624->286719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.236521:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca315f lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 30 type: EXT [282624->286719] (req 282624->286719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531960.236902:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531960.236910:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467402688
00000100:00100000:1.0:1651531960.236926:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249819
00000100:00100000:1.0:1651531960.236927:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002512e905 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+33:438148:x1731754467402688:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531960.236934:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3166 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 30 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.236938:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531960.236939:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531960.236940:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3166 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 30 type: EXT [667648->671743] (req 667648->671743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.236944:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3166 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 30 type: EXT [667648->671743] (req 667648->671743) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531960.237082:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531960.237112:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467402880
00000100:00100000:0.0:1651531960.237137:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249820
00000100:00100000:0.0:1651531960.237140:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002ef35a72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+36:438146:x1731754467402880:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531960.237152:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca316d lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 31 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.237167:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531960.237168:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531960.237171:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca316d lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 31 type: EXT [892928->897023] (req 892928->897023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.237177:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca316d lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 31 type: EXT [892928->897023] (req 892928->897023) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.237239:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca316d lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 31 type: EXT [892928->897023] (req 892928->897023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.237244:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca316d lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 31 type: EXT [892928->897023] (req 892928->897023) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531960.237263:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002ef35a72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+36:438146:x1731754467402880:12345-10.240.43.64@tcp:3:fio.0 Request processed in 123us (191us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531960.237267:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249820
00010000:00010000:0.0:1651531960.237275:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca316d lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 31 type: EXT [892928->897023] (req 892928->897023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.237278:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002c5e01dd already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531960.237279:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca316d lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 31 type: EXT [892928->897023] (req 892928->897023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.237282:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca316d lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 31 type: EXT [892928->897023] (req 892928->897023) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.237286:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca316d lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 31 type: EXT [892928->897023] (req 892928->897023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.237290:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca316d lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 31 type: EXT [892928->897023] (req 892928->897023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531960.237380:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531960.237393:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467403072
00000100:00100000:0.0:1651531960.237407:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249821
00000100:00100000:0.0:1651531960.237409:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007d76765b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+36:438148:x1731754467403072:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531960.237417:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3174 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 31 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.237421:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531960.237422:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531960.237423:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3174 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 31 type: EXT [286720->290815] (req 286720->290815) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.237427:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3174 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 31 type: EXT [286720->290815] (req 286720->290815) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.237439:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3174 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 31 type: EXT [286720->290815] (req 286720->290815) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.237442:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3174 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 31 type: EXT [286720->290815] (req 286720->290815) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531960.237461:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007d76765b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+36:438148:x1731754467403072:12345-10.240.43.64@tcp:3:fio.0 Request processed in 51us (81us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531960.237464:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249821
00010000:00010000:0.0:1651531960.237471:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3174 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 31 type: EXT [286720->290815] (req 286720->290815) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.237477:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fb2f6575 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531960.237478:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3174 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 31 type: EXT [286720->290815] (req 286720->290815) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.237481:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3174 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 31 type: EXT [286720->290815] (req 286720->290815) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.237486:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3174 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 31 type: EXT [286720->290815] (req 286720->290815) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.237488:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3174 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 31 type: EXT [286720->290815] (req 286720->290815) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531960.286490:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531960.286514:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467403456
00000100:00100000:0.0:1651531960.286531:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249822
00000100:00100000:0.0:1651531960.286532:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000033723645 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+36:438149:x1731754467403456:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531960.286540:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca317b lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 31 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.286546:0:216323:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca2baf lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 31 type: EXT [466944->479231] (req 466944->471039) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444f48 expref: 36 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.286549:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531960.286550:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531960.286551:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca317b lrc: 4/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 31 type: EXT [471040->475135] (req 471040->475135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.286562:0:216323:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca2baf lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 31 type: EXT [466944->479231] (req 466944->471039) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444f48 expref: 36 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.286566:0:216323:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca2baf lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 31 type: EXT [466944->479231] (req 466944->471039) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444f48 expref: 36 pid: 166113 timeout: 22768 lvb_type: 0
00000100:00100000:0.0:1651531960.286570:0:216323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000089660739 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_010:lustre-OST0001_UUID:216323:1731745997354496:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531960.286588:0:216323:0:(client.c:2492:ptlrpc_set_wait()) set 00000000023652cf going to sleep for 6 seconds
00000100:00100000:1.0:1651531960.286890:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531960.286897:0:166103:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467403520
00000100:00100000:0.0:1651531960.286901:0:216323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000089660739 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_010:lustre-OST0001_UUID:216323:1731745997354496:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651531960.286903:0:166103:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca2baf lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 31 type: EXT [466944->479231] (req 466944->471039) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444f48 expref: 37 pid: 166113 timeout: 22768 lvb_type: 0
00010000:00010000:0.0:1651531960.286906:0:216323:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca317b lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 32 type: EXT [471040->475135] (req 471040->475135) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531960.286914:0:166103:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 190
00000100:00100000:1.0:1651531960.286916:0:166103:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000079498350 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+37:438146:x1731754467403520:12345-10.240.43.64@tcp:103:ldlm_bl_04.0
00010000:00010000:1.0:1651531960.286919:0:166103:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1651531960.286923:0:166103:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca2baf lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 32 type: EXT [466944->479231] (req 466944->471039) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444f48 expref: 37 pid: 166113 timeout: 22768 lvb_type: 0
00010000:00010000:1.0:1651531960.286927:0:166103:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca2baf lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 32 type: EXT [466944->479231] (req 466944->471039) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444f48 expref: 37 pid: 166113 timeout: 22768 lvb_type: 0
00010000:00010000:1.0:1651531960.286935:0:166103:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca2baf lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 32 type: EXT [466944->479231] (req 466944->471039) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444f48 expref: 37 pid: 166113 timeout: 22768 lvb_type: 0
00010000:00010000:1.0:1651531960.286939:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531960.286940:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531960.286941:0:166103:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca317b lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 31 type: EXT [471040->475135] (req 471040->475135) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.286944:0:166103:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca317b lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 31 type: EXT [471040->475135] (req 471040->475135) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.286955:0:166103:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1651531960.286965:0:166103:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000079498350 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+36:438146:x1731754467403520:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 48us (76us total) trans 0 rc 0/0
00010000:00010000:0.0:1651531960.286967:0:216323:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca317b lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 30 type: EXT [471040->475135] (req 471040->475135) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531960.286968:0:166103:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 190
00010000:00010000:0.0:1651531960.286970:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca317b lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 30 type: EXT [471040->475135] (req 471040->475135) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531960.298849:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869138 is committed
00010000:00010000:1.0:1651531960.298878:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3166 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 30 type: EXT [667648->671743] (req 667648->671743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.298882:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3166 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 30 type: EXT [667648->671743] (req 667648->671743) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531960.298897:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002512e905 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+35:438148:x1731754467402688:12345-10.240.43.64@tcp:4:fio.0 Request processed in 61969us (61995us total) trans 21474869138 rc 0/0
00000100:00100000:1.0:1651531960.298900:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249819
00010000:00010000:1.0:1651531960.298906:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3166 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 30 type: EXT [667648->671743] (req 667648->671743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.298913:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d44eb74d already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531960.298914:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3166 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 30 type: EXT [667648->671743] (req 667648->671743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.298917:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3166 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 30 type: EXT [667648->671743] (req 667648->671743) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.298922:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3166 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 30 type: EXT [667648->671743] (req 667648->671743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.298925:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3166 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 30 type: EXT [667648->671743] (req 667648->671743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531960.361560:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869139 is committed
00010000:00010000:0.0:1651531960.361576:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca317b lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 29 type: EXT [471040->475135] (req 471040->475135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.361580:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca317b lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 29 type: EXT [471040->475135] (req 471040->475135) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531960.361606:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000033723645 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+32:438149:x1731754467403456:12345-10.240.43.64@tcp:4:fio.0 Request processed in 75073us (75116us total) trans 21474869139 rc 0/0
00000100:00100000:0.0:1651531960.361610:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249822
00010000:00010000:0.0:1651531960.361618:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca317b lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 29 type: EXT [471040->475135] (req 471040->475135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.361621:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fb2f6575 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531960.361622:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca317b lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 29 type: EXT [471040->475135] (req 471040->475135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.361625:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca317b lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 29 type: EXT [471040->475135] (req 471040->475135) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.361631:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca317b lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 29 type: EXT [471040->475135] (req 471040->475135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.361633:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca317b lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 29 type: EXT [471040->475135] (req 471040->475135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531960.362422:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531960.362441:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467404160
00000100:00100000:0.0:1651531960.362458:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249823
00000100:00100000:0.0:1651531960.362460:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000315bf4eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+32:438147:x1731754467404160:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531960.362467:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3182 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 29 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.362472:0:216323:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000030d4a6f9/0x3234de053ca2ddf lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 29 type: EXT [155648->172031] (req 155648->159743) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4453d2 expref: 32 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.362477:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531960.362478:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531960.362478:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3182 lrc: 4/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 29 type: EXT [167936->172031] (req 167936->172031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.362486:0:216323:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000030d4a6f9/0x3234de053ca2ddf lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 29 type: EXT [155648->172031] (req 155648->159743) gid 0 flags: 0x50000000020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4453d2 expref: 32 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.362489:0:216323:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000030d4a6f9/0x3234de053ca2ddf lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 29 type: EXT [155648->172031] (req 155648->159743) gid 0 flags: 0x70000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4453d2 expref: 32 pid: 166112 timeout: 22769 lvb_type: 0
00000100:00100000:0.0:1651531960.362494:0:216323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000089660739 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_010:lustre-OST0001_UUID:216323:1731745997354560:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531960.362511:0:216323:0:(client.c:2492:ptlrpc_set_wait()) set 00000000023652cf going to sleep for 6 seconds
00000100:00100000:0.0:1651531960.362728:0:216323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000089660739 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_010:lustre-OST0001_UUID:216323:1731745997354560:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531960.362730:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651531960.362732:0:216323:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3182 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 29 type: EXT [167936->172031] (req 167936->172031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531960.362738:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467404288
00000100:00100000:1.0:1651531960.362749:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249824
00000100:00100000:1.0:1651531960.362750:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a23bcd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+33:438148:x1731754467404288:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531960.362758:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3189 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 30 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.362769:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531960.362770:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531960.362771:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3189 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 30 type: EXT [675840->679935] (req 675840->679935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.362775:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3189 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 30 type: EXT [675840->679935] (req 675840->679935) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531960.362865:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531960.362881:0:166103:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467404352
00010000:00010000:1.0:1651531960.362887:0:166103:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000030d4a6f9/0x3234de053ca2ddf lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 30 type: EXT [155648->172031] (req 155648->159743) gid 0 flags: 0x60000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4453d2 expref: 36 pid: 166112 timeout: 22769 lvb_type: 0
00000100:00100000:1.0:1651531960.362909:0:166103:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 191
00000100:00100000:1.0:1651531960.362911:0:166103:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005ec1cbc3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+36:438148:x1731754467404352:12345-10.240.43.64@tcp:103:ldlm_bl_02.0
00010000:00010000:1.0:1651531960.362915:0:166103:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1651531960.362918:0:166103:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000030d4a6f9/0x3234de053ca2ddf lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 31 type: EXT [155648->172031] (req 155648->159743) gid 0 flags: 0x60000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4453d2 expref: 36 pid: 166112 timeout: 22769 lvb_type: 0
00010000:00010000:1.0:1651531960.362922:0:166103:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000030d4a6f9/0x3234de053ca2ddf lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 31 type: EXT [155648->172031] (req 155648->159743) gid 0 flags: 0x50000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4453d2 expref: 36 pid: 166112 timeout: 22769 lvb_type: 0
00010000:00010000:1.0:1651531960.362928:0:166103:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000030d4a6f9/0x3234de053ca2ddf lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 31 type: EXT [155648->172031] (req 155648->159743) gid 0 flags: 0x44801400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4453d2 expref: 36 pid: 166112 timeout: 22769 lvb_type: 0
00010000:00010000:1.0:1651531960.362932:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531960.362933:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531960.362934:0:166103:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3182 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 30 type: EXT [167936->172031] (req 167936->172031) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.362937:0:166103:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3182 lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 30 type: EXT [167936->172031] (req 167936->172031) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.362947:0:166103:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1651531960.362950:0:216323:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3182 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 29 type: EXT [167936->172031] (req 167936->172031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.362954:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3182 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 29 type: EXT [167936->172031] (req 167936->172031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531960.362958:0:166103:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005ec1cbc3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+35:438148:x1731754467404352:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 46us (93us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531960.362962:0:166103:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 191
00000100:00100000:1.0:1651531960.399841:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531960.399851:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467404608
00000100:00100000:1.0:1651531960.399861:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249825
00000100:00100000:1.0:1651531960.399863:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c271a900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+37:438149:x1731754467404608:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531960.399869:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3190 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 30 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.399874:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531960.399874:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531960.399875:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3190 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 30 type: EXT [32768->36863] (req 32768->36863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.399880:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3190 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 30 type: EXT [32768->36863] (req 32768->36863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531960.400175:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531960.400192:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467404736
00000100:00100000:0.0:1651531960.400215:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249826
00000100:00100000:0.0:1651531960.400217:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b9b10d48 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+40:438146:x1731754467404736:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531960.400238:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3197 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 31 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.400243:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531960.400243:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531960.400245:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3197 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 31 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.400249:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3197 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 31 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531960.412715:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869141 is committed
00010000:00010000:0.0:1651531960.412737:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3182 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 31 type: EXT [167936->172031] (req 167936->172031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.412741:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3182 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 31 type: EXT [167936->172031] (req 167936->172031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.412746:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3189 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 31 type: EXT [675840->679935] (req 675840->679935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.412750:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3189 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 31 type: EXT [675840->679935] (req 675840->679935) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531960.412761:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000315bf4eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+38:438147:x1731754467404160:12345-10.240.43.64@tcp:4:fio.0 Request processed in 50300us (50340us total) trans 21474869141 rc 0/0
00000100:00100000:0.0:1651531960.412765:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249823
00000100:00100000:1.0:1651531960.412770:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a23bcd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+37:438148:x1731754467404288:12345-10.240.43.64@tcp:4:fio.0 Request processed in 50018us (50040us total) trans 21474869140 rc 0/0
00000100:00100000:1.0:1651531960.412773:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249824
00010000:00010000:0.0:1651531960.412773:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3182 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 31 type: EXT [167936->172031] (req 167936->172031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.412776:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002c5e01dd already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531960.412777:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3182 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 31 type: EXT [167936->172031] (req 167936->172031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.412780:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3189 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 31 type: EXT [675840->679935] (req 675840->679935) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.412780:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3182 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 32 type: EXT [167936->172031] (req 167936->172031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.412790:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d44eb74d already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531960.412791:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3189 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 31 type: EXT [675840->679935] (req 675840->679935) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.412791:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3182 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 32 type: EXT [167936->172031] (req 167936->172031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.412794:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3189 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 32 type: EXT [675840->679935] (req 675840->679935) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.412794:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3182 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 31 type: EXT [167936->172031] (req 167936->172031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.412800:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3189 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 30 type: EXT [675840->679935] (req 675840->679935) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.412802:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3189 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 30 type: EXT [675840->679935] (req 675840->679935) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531960.450033:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869143 is committed
00010000:00010000:0.0:1651531960.450054:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3197 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 29 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.450058:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3197 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 29 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.450064:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3190 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 29 type: EXT [32768->36863] (req 32768->36863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.450068:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3190 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 29 type: EXT [32768->36863] (req 32768->36863) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531960.450082:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b9b10d48 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+32:438146:x1731754467404736:12345-10.240.43.64@tcp:4:fio.0 Request processed in 49863us (49907us total) trans 21474869143 rc 0/0
00000100:00100000:0.0:1651531960.450085:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249826
00000100:00100000:1.0:1651531960.450087:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c271a900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+32:438149:x1731754467404608:12345-10.240.43.64@tcp:4:fio.0 Request processed in 50224us (50247us total) trans 21474869142 rc 0/0
00000100:00100000:1.0:1651531960.450090:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249825
00010000:00010000:0.0:1651531960.450093:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3197 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 29 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.450097:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fb2f6575 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531960.450098:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3197 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 29 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.450101:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3197 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 29 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.450106:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3197 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 29 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.450110:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3197 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 29 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.450114:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3190 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [32768->36863] (req 32768->36863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.450116:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008558d1b3 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531960.450117:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3190 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [32768->36863] (req 32768->36863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.450120:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3190 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [32768->36863] (req 32768->36863) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.450123:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3190 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [32768->36863] (req 32768->36863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.450126:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3190 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [32768->36863] (req 32768->36863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531960.450442:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531960.450466:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467405120
00000100:00100000:1.0:1651531960.450479:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249827
00000100:00100000:1.0:1651531960.450480:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000089660739 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+31:438147:x1731754467405120:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531960.450487:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca319e lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.450493:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531960.450494:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531960.450495:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca319e lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [954368->958463] (req 954368->958463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.450498:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca319e lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [954368->958463] (req 954368->958463) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.450510:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca319e lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [954368->958463] (req 954368->958463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.450513:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca319e lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [954368->958463] (req 954368->958463) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531960.450534:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000089660739 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+31:438147:x1731754467405120:12345-10.240.43.64@tcp:3:fio.0 Request processed in 53us (93us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531960.450537:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249827
00010000:00010000:1.0:1651531960.450543:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca319e lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [954368->958463] (req 954368->958463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.450547:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d44eb74d already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531960.450548:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca319e lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [954368->958463] (req 954368->958463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.450551:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca319e lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [954368->958463] (req 954368->958463) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.450555:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca319e lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [954368->958463] (req 954368->958463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.450559:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca319e lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [954368->958463] (req 954368->958463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531960.450846:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531960.450857:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467405312
00000100:00100000:1.0:1651531960.450869:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249828
00000100:00100000:1.0:1651531960.450871:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000e33e11e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+31:438146:x1731754467405312:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531960.450877:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca31a5 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.450881:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531960.450882:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531960.450883:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca31a5 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [1011712->1015807] (req 1011712->1015807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.450887:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca31a5 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [1011712->1015807] (req 1011712->1015807) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.450897:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca31a5 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [1011712->1015807] (req 1011712->1015807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.450900:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca31a5 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [1011712->1015807] (req 1011712->1015807) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.450910:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca31a5 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [1011712->1015807] (req 1011712->1015807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.450914:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001e36c601 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531960.450915:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca31a5 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [1011712->1015807] (req 1011712->1015807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531960.450918:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000e33e11e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+31:438146:x1731754467405312:12345-10.240.43.64@tcp:3:fio.0 Request processed in 46us (72us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531960.450921:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249828
00010000:00010000:0.0:1651531960.450927:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca31a5 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [1011712->1015807] (req 1011712->1015807) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.450932:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca31a5 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [1011712->1015807] (req 1011712->1015807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.450935:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca31a5 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [1011712->1015807] (req 1011712->1015807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531960.451201:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531960.451232:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467405440
00000100:00100000:1.0:1651531960.451245:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249829
00000100:00100000:1.0:1651531960.451247:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cc11a3b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+31:438147:x1731754467405440:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531960.451253:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca31ac lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.451258:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531960.451258:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531960.451259:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca31ac lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [196608->200703] (req 196608->200703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.451263:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca31ac lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [196608->200703] (req 196608->200703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531960.462996:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531960.463005:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467405824
00000100:00100000:0.0:1651531960.463021:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249830
00000100:00100000:0.0:1651531960.463023:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aa58c961 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+34:438146:x1731754467405824:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531960.463031:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca31b3 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 29 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.463036:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531960.463036:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531960.463038:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca31b3 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 29 type: EXT [602112->606207] (req 602112->606207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.463042:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca31b3 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 29 type: EXT [602112->606207] (req 602112->606207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531960.504719:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869145 is committed
00010000:00010000:0.0:1651531960.504740:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca31b3 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 29 type: EXT [602112->606207] (req 602112->606207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.504745:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca31b3 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 29 type: EXT [602112->606207] (req 602112->606207) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.504750:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca31ac lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 29 type: EXT [196608->200703] (req 196608->200703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.504755:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca31ac lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 29 type: EXT [196608->200703] (req 196608->200703) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531960.504762:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aa58c961 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+32:438146:x1731754467405824:12345-10.240.43.64@tcp:4:fio.0 Request processed in 41738us (41766us total) trans 21474869145 rc 0/0
00000100:00100000:0.0:1651531960.504765:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249830
00000100:00100000:1.0:1651531960.504770:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cc11a3b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+31:438147:x1731754467405440:12345-10.240.43.64@tcp:4:fio.0 Request processed in 53522us (53570us total) trans 21474869144 rc 0/0
00000100:00100000:1.0:1651531960.504773:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249829
00010000:00010000:0.0:1651531960.504773:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca31b3 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 29 type: EXT [602112->606207] (req 602112->606207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.504776:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fb2f6575 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531960.504777:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca31b3 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 29 type: EXT [602112->606207] (req 602112->606207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.504780:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca31ac lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 30 type: EXT [196608->200703] (req 196608->200703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.504780:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca31b3 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 29 type: EXT [602112->606207] (req 602112->606207) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.504785:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a8889a80 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531960.504786:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca31ac lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 30 type: EXT [196608->200703] (req 196608->200703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.504786:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca31b3 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 29 type: EXT [602112->606207] (req 602112->606207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.504788:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca31b3 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 30 type: EXT [602112->606207] (req 602112->606207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.504794:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca31ac lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [196608->200703] (req 196608->200703) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.504798:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca31ac lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [196608->200703] (req 196608->200703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.504801:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca31ac lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [196608->200703] (req 196608->200703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531960.505637:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531960.505655:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467406720
00000100:00100000:1.0:1651531960.505670:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249831
00000100:00100000:1.0:1651531960.505672:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000021f31110 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+31:438148:x1731754467406720:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531960.505678:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca31ba lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.505682:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531960.505683:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531960.505684:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca31ba lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [720896->724991] (req 720896->724991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.505688:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca31ba lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [720896->724991] (req 720896->724991) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531960.505807:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531960.505819:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467406848
00000100:00100000:0.0:1651531960.505836:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249832
00000100:00100000:0.0:1651531960.505838:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003158b8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+34:438149:x1731754467406848:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531960.505847:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca31c1 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 29 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.505852:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531960.505852:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531960.505854:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca31c1 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 29 type: EXT [536576->540671] (req 536576->540671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.505858:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca31c1 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 29 type: EXT [536576->540671] (req 536576->540671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.505870:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca31c1 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 29 type: EXT [536576->540671] (req 536576->540671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.505873:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca31c1 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 29 type: EXT [536576->540671] (req 536576->540671) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531960.505889:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003158b8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+34:438149:x1731754467406848:12345-10.240.43.64@tcp:3:fio.0 Request processed in 50us (84us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531960.505891:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249832
00010000:00010000:0.0:1651531960.505898:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca31c1 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 29 type: EXT [536576->540671] (req 536576->540671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.505901:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002c5e01dd already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531960.505902:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca31c1 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 29 type: EXT [536576->540671] (req 536576->540671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.505905:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca31c1 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 29 type: EXT [536576->540671] (req 536576->540671) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.505913:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca31c1 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 29 type: EXT [536576->540671] (req 536576->540671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.505916:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca31c1 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 29 type: EXT [536576->540671] (req 536576->540671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531960.506023:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531960.506031:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467406976
00000100:00100000:0.0:1651531960.506044:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249833
00000100:00100000:0.0:1651531960.506046:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000000615301 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+34:438146:x1731754467406976:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531960.506052:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca31c8 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 29 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.506057:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531960.506058:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531960.506059:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca31c8 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 29 type: EXT [712704->716799] (req 712704->716799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.506063:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca31c8 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 29 type: EXT [712704->716799] (req 712704->716799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531960.546440:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869147 is committed
00010000:00010000:0.0:1651531960.546461:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca31c8 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 29 type: EXT [712704->716799] (req 712704->716799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.546465:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca31c8 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 29 type: EXT [712704->716799] (req 712704->716799) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.546474:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca31ba lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 29 type: EXT [720896->724991] (req 720896->724991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.546479:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca31ba lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 29 type: EXT [720896->724991] (req 720896->724991) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531960.546485:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000000615301 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+32:438146:x1731754467406976:12345-10.240.43.64@tcp:4:fio.0 Request processed in 40439us (40463us total) trans 21474869147 rc 0/0
00000100:00100000:0.0:1651531960.546489:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249833
00010000:00010000:0.0:1651531960.546496:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca31c8 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 29 type: EXT [712704->716799] (req 712704->716799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.546499:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000075a78972 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531960.546500:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca31c8 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 29 type: EXT [712704->716799] (req 712704->716799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.546503:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca31c8 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 29 type: EXT [712704->716799] (req 712704->716799) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531960.546508:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000021f31110 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+31:438148:x1731754467406720:12345-10.240.43.64@tcp:4:fio.0 Request processed in 40835us (40871us total) trans 21474869146 rc 0/0
00010000:00010000:0.0:1651531960.546508:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca31c8 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 29 type: EXT [712704->716799] (req 712704->716799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531960.546511:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249831
00010000:00010000:0.0:1651531960.546511:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca31c8 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 29 type: EXT [712704->716799] (req 712704->716799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.546514:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca31ba lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [720896->724991] (req 720896->724991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.546517:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d44eb74d already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531960.546518:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca31ba lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [720896->724991] (req 720896->724991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.546521:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca31ba lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [720896->724991] (req 720896->724991) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.546525:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca31ba lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [720896->724991] (req 720896->724991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.546528:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca31ba lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [720896->724991] (req 720896->724991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531960.546837:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531960.546861:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467407296
00000100:00100000:1.0:1651531960.546877:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249834
00000100:00100000:1.0:1651531960.546878:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000053de45f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+31:438147:x1731754467407296:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531960.546886:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca31cf lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.546890:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531960.546890:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531960.546891:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca31cf lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [483328->487423] (req 483328->487423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.546895:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca31cf lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [483328->487423] (req 483328->487423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.546906:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca31cf lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [483328->487423] (req 483328->487423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.546909:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca31cf lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [483328->487423] (req 483328->487423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.546927:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca31cf lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [483328->487423] (req 483328->487423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531960.546929:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000053de45f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+31:438147:x1731754467407296:12345-10.240.43.64@tcp:3:fio.0 Request processed in 50us (92us total) trans 0 rc 4096/4096
00010000:00010000:0.0:1651531960.546930:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a8889a80 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531960.546931:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca31cf lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [483328->487423] (req 483328->487423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531960.546932:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249834
00010000:00010000:0.0:1651531960.546934:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca31cf lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [483328->487423] (req 483328->487423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.546939:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca31cf lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [483328->487423] (req 483328->487423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.546942:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca31cf lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [483328->487423] (req 483328->487423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531960.547490:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531960.547511:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467407872
00000100:00100000:1.0:1651531960.547526:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249835
00000100:00100000:1.0:1651531960.547528:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006c46ca95 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+31:438147:x1731754467407872:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531960.547535:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca31d6 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.547539:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531960.547539:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531960.547540:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca31d6 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [761856->765951] (req 761856->765951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.547544:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca31d6 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [761856->765951] (req 761856->765951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.547554:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca31d6 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [761856->765951] (req 761856->765951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.547557:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca31d6 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [761856->765951] (req 761856->765951) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531960.547571:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006c46ca95 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+31:438147:x1731754467407872:12345-10.240.43.64@tcp:3:fio.0 Request processed in 43us (82us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531960.547574:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249835
00010000:00010000:1.0:1651531960.547580:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca31d6 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [761856->765951] (req 761856->765951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.547583:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000968553c1 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531960.547584:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca31d6 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [761856->765951] (req 761856->765951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.547591:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca31d6 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [761856->765951] (req 761856->765951) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.547595:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca31d6 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [761856->765951] (req 761856->765951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.547598:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca31d6 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [761856->765951] (req 761856->765951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531960.548285:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531960.548302:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467408256
00000100:00100000:1.0:1651531960.548317:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249836
00000100:00100000:1.0:1651531960.548319:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bedaf1f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+31:438146:x1731754467408256:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531960.548326:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca31dd lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.548330:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531960.548330:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531960.548331:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca31dd lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [487424->491519] (req 487424->491519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.548335:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca31dd lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [487424->491519] (req 487424->491519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.548345:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca31dd lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [487424->491519] (req 487424->491519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.548348:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca31dd lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [487424->491519] (req 487424->491519) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.548369:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca31dd lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [487424->491519] (req 487424->491519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531960.548371:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bedaf1f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+31:438146:x1731754467408256:12345-10.240.43.64@tcp:3:fio.0 Request processed in 51us (87us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531960.548374:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249836
00010000:00010000:0.0:1651531960.548377:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c2b76533 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531960.548378:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca31dd lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [487424->491519] (req 487424->491519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.548381:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca31dd lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [487424->491519] (req 487424->491519) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.548386:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca31dd lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [487424->491519] (req 487424->491519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.548389:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca31dd lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [487424->491519] (req 487424->491519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531960.548653:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531960.548669:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467408384
00000100:00100000:1.0:1651531960.548682:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249837
00000100:00100000:1.0:1651531960.548684:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029096870 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+31:438147:x1731754467408384:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531960.548691:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca31e4 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.548695:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531960.548695:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531960.548696:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca31e4 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.548700:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca31e4 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.548710:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca31e4 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.548713:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca31e4 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.548723:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca31e4 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.548726:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001e36c601 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531960.548727:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca31e4 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531960.548730:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029096870 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+31:438147:x1731754467408384:12345-10.240.43.64@tcp:3:fio.0 Request processed in 45us (78us total) trans 0 rc 4096/4096
00010000:00010000:0.0:1651531960.548731:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca31e4 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531960.548733:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249837
00010000:00010000:0.0:1651531960.548736:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca31e4 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.548738:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca31e4 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531960.571676:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531960.571698:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467408640
00000100:00100000:1.0:1651531960.571713:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249838
00000100:00100000:1.0:1651531960.571715:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003b40261e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+31:438149:x1731754467408640:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531960.571722:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca31eb lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.571726:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531960.571727:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531960.571728:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca31eb lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [512000->516095] (req 512000->516095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.571731:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca31eb lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [512000->516095] (req 512000->516095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.571741:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca31eb lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [512000->516095] (req 512000->516095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.571745:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca31eb lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [512000->516095] (req 512000->516095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531960.571759:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003b40261e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+31:438149:x1731754467408640:12345-10.240.43.64@tcp:3:fio.0 Request processed in 43us (83us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531960.571761:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249838
00010000:00010000:1.0:1651531960.571767:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca31eb lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [512000->516095] (req 512000->516095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.571771:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000968553c1 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531960.571772:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca31eb lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [512000->516095] (req 512000->516095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.571778:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca31eb lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [512000->516095] (req 512000->516095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.571782:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca31eb lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [512000->516095] (req 512000->516095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.571785:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca31eb lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [512000->516095] (req 512000->516095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531960.597123:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531960.597146:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467409152
00000100:00100000:1.0:1651531960.597162:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249839
00000100:00100000:1.0:1651531960.597164:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dfff0362 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+31:438146:x1731754467409152:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531960.597170:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca31f2 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.597175:0:216321:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d2430cf1/0x3234de053ca2d45 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [974848->978943] (req 974848->978943) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44529e expref: 31 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.597178:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531960.597179:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531960.597180:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca31f2 lrc: 4/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [974848->978943] (req 974848->978943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.597187:0:216321:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d2430cf1/0x3234de053ca2d45 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [974848->978943] (req 974848->978943) gid 0 flags: 0x50000000020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44529e expref: 31 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.597191:0:216321:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d2430cf1/0x3234de053ca2d45 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [974848->978943] (req 974848->978943) gid 0 flags: 0x70000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44529e expref: 31 pid: 166112 timeout: 22769 lvb_type: 0
00000100:00100000:1.0:1651531960.597196:0:216321:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000033723645 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997354624:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531960.597221:0:216321:0:(client.c:2492:ptlrpc_set_wait()) set 000000001a1ce0e5 going to sleep for 6 seconds
00000100:00100000:0.0:1651531960.597282:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531960.597290:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467409280
00000100:00100000:0.0:1651531960.597306:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249840
00000100:00100000:0.0:1651531960.597308:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002bf85ab5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+32:438148:x1731754467409280:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531960.597315:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca31f9 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 29 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.597320:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531960.597321:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531960.597322:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca31f9 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 29 type: EXT [602112->606207] (req 602112->606207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.597326:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca31f9 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 29 type: EXT [602112->606207] (req 602112->606207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531960.597523:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531960.597531:0:166103:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467409344
00010000:00010000:1.0:1651531960.597536:0:166103:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d2430cf1/0x3234de053ca2d45 lrc: 5/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 29 type: EXT [974848->978943] (req 974848->978943) gid 0 flags: 0x60000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44529e expref: 35 pid: 166112 timeout: 22769 lvb_type: 0
00000100:00100000:1.0:1651531960.597547:0:166103:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 192
00000100:00100000:1.0:1651531960.597549:0:166103:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000315bf4eb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+35:438147:x1731754467409344:12345-10.240.43.64@tcp:103:ldlm_bl_05.0
00010000:00010000:1.0:1651531960.597552:0:166103:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1651531960.597555:0:166103:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d2430cf1/0x3234de053ca2d45 lrc: 5/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 30 type: EXT [974848->978943] (req 974848->978943) gid 0 flags: 0x60000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44529e expref: 35 pid: 166112 timeout: 22769 lvb_type: 0
00010000:00010000:1.0:1651531960.597559:0:166103:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d2430cf1/0x3234de053ca2d45 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 30 type: EXT [974848->978943] (req 974848->978943) gid 0 flags: 0x50000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44529e expref: 35 pid: 166112 timeout: 22769 lvb_type: 0
00010000:00010000:1.0:1651531960.597566:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531960.597567:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531960.597568:0:166103:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca31f2 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 30 type: EXT [974848->978943] (req 974848->978943) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.597571:0:166103:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca31f2 lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 30 type: EXT [974848->978943] (req 974848->978943) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.597576:0:166103:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1651531960.597587:0:166103:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000315bf4eb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+35:438147:x1731754467409344:12345-10.240.43.64@tcp:103:ldlm_bl_05.0 Request processed in 37us (65us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531960.597592:0:166103:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 192
00010000:00010000:1.0:1651531960.597603:0:216321:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d2430cf1/0x3234de053ca2d45 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 29 type: EXT [974848->978943] (req 974848->978943) gid 0 flags: 0x44801400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44529e expref: 34 pid: 166112 timeout: 22769 lvb_type: 0
00000100:00100000:1.0:1651531960.597607:0:216321:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000033723645 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997354624:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651531960.597611:0:216321:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca31f2 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [974848->978943] (req 974848->978943) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.597623:0:216321:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca31f2 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [974848->978943] (req 974848->978943) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.597626:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca31f2 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [974848->978943] (req 974848->978943) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531960.658768:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869148 is committed
00010000:00010000:1.0:1651531960.658802:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca31f9 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [602112->606207] (req 602112->606207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.658807:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca31f9 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [602112->606207] (req 602112->606207) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531960.658826:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002bf85ab5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+33:438148:x1731754467409280:12345-10.240.43.64@tcp:4:fio.0 Request processed in 61518us (61544us total) trans 21474869148 rc 0/0
00000100:00100000:1.0:1651531960.658829:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249840
00010000:00010000:0.0:1651531960.658841:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca31f9 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [602112->606207] (req 602112->606207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.658848:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000075a78972 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531960.658849:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca31f9 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [602112->606207] (req 602112->606207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.658852:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca31f9 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [602112->606207] (req 602112->606207) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.658867:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca31f9 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [602112->606207] (req 602112->606207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.658873:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca31f9 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [602112->606207] (req 602112->606207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531960.659155:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531960.659177:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467409728
00000100:00100000:1.0:1651531960.659188:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249841
00000100:00100000:1.0:1651531960.659190:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c65d6bc4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+33:438149:x1731754467409728:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531960.659216:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3200 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.659221:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531960.659236:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531960.659237:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3200 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [32768->36863] (req 32768->36863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.659242:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3200 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [32768->36863] (req 32768->36863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531960.696457:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531960.696480:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467409856
00000100:00100000:0.0:1651531960.696494:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249842
00000100:00100000:0.0:1651531960.696496:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000033723645 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+36:438148:x1731754467409856:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531960.696504:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3207 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 29 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.696508:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531960.696509:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531960.696510:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3207 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 29 type: EXT [647168->651263] (req 647168->651263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.696514:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3207 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 29 type: EXT [647168->651263] (req 647168->651263) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.696528:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3207 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 29 type: EXT [647168->651263] (req 647168->651263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.696531:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3207 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 29 type: EXT [647168->651263] (req 647168->651263) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531960.696554:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000033723645 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+36:438148:x1731754467409856:12345-10.240.43.64@tcp:3:fio.0 Request processed in 57us (97us total) trans 0 rc 4096/4096
00010000:00010000:1.0:1651531960.696555:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3207 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 29 type: EXT [647168->651263] (req 647168->651263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531960.696558:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249842
00010000:00010000:1.0:1651531960.696559:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000075a78972 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531960.696561:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3207 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 29 type: EXT [647168->651263] (req 647168->651263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.696564:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3207 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 29 type: EXT [647168->651263] (req 647168->651263) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.696569:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3207 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 29 type: EXT [647168->651263] (req 647168->651263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.696572:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3207 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 29 type: EXT [647168->651263] (req 647168->651263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531960.696913:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531960.696937:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467409984
00000100:00100000:0.0:1651531960.696949:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249843
00000100:00100000:0.0:1651531960.696951:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a23bcd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+36:438149:x1731754467409984:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531960.696957:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca320e lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 29 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.696962:0:216323:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002f2479f0/0x3234de053ca2bc4 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 29 type: EXT [114688->126975] (req 114688->118783) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444f64 expref: 36 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.696965:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531960.696966:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531960.696967:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca320e lrc: 4/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 29 type: EXT [114688->118783] (req 114688->118783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.696974:0:216323:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002f2479f0/0x3234de053ca2bc4 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 29 type: EXT [114688->126975] (req 114688->118783) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444f64 expref: 36 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.696978:0:216323:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002f2479f0/0x3234de053ca2bc4 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 29 type: EXT [114688->126975] (req 114688->118783) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444f64 expref: 36 pid: 166113 timeout: 22769 lvb_type: 0
00000100:00100000:0.0:1651531960.696982:0:216323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000065be21ea pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_010:lustre-OST0001_UUID:216323:1731745997354688:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531960.696995:0:216323:0:(client.c:2492:ptlrpc_set_wait()) set 000000005d1e37de going to sleep for 6 seconds
00000100:00100000:0.0:1651531960.697196:0:216323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000065be21ea pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_010:lustre-OST0001_UUID:216323:1731745997354688:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651531960.697201:0:216323:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca320e lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 29 type: EXT [114688->118783] (req 114688->118783) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531960.697281:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531960.697295:0:166103:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467410048
00010000:00010000:1.0:1651531960.697302:0:166103:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002f2479f0/0x3234de053ca2bc4 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 29 type: EXT [114688->126975] (req 114688->118783) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444f64 expref: 37 pid: 166113 timeout: 22769 lvb_type: 0
00000100:00100000:1.0:1651531960.697313:0:166103:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 193
00000100:00100000:1.0:1651531960.697314:0:166103:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000065be21ea pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+37:438148:x1731754467410048:12345-10.240.43.64@tcp:103:ldlm_bl_06.0
00010000:00010000:1.0:1651531960.697318:0:166103:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1651531960.697321:0:166103:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002f2479f0/0x3234de053ca2bc4 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 30 type: EXT [114688->126975] (req 114688->118783) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444f64 expref: 37 pid: 166113 timeout: 22769 lvb_type: 0
00010000:00010000:1.0:1651531960.697325:0:166103:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002f2479f0/0x3234de053ca2bc4 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 30 type: EXT [114688->126975] (req 114688->118783) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444f64 expref: 37 pid: 166113 timeout: 22769 lvb_type: 0
00010000:00010000:1.0:1651531960.697331:0:166103:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002f2479f0/0x3234de053ca2bc4 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 30 type: EXT [114688->126975] (req 114688->118783) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444f64 expref: 37 pid: 166113 timeout: 22769 lvb_type: 0
00010000:00010000:1.0:1651531960.697335:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531960.697336:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531960.697337:0:166103:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca320e lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 29 type: EXT [114688->118783] (req 114688->118783) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.697340:0:166103:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca320e lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 29 type: EXT [114688->118783] (req 114688->118783) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.697351:0:166103:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1651531960.697361:0:166103:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000065be21ea pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+36:438148:x1731754467410048:12345-10.240.43.64@tcp:103:ldlm_bl_06.0 Request processed in 46us (81us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531960.697364:0:166103:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 193
00010000:00010000:0.0:1651531960.697364:0:216323:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca320e lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [114688->118783] (req 114688->118783) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.697368:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca320e lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [114688->118783] (req 114688->118783) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531960.709900:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869149 is committed
00010000:00010000:1.0:1651531960.709933:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca31f2 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [974848->978943] (req 974848->978943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.709937:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca31f2 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [974848->978943] (req 974848->978943) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531960.709954:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dfff0362 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+35:438146:x1731754467409152:12345-10.240.43.64@tcp:4:fio.0 Request processed in 112789us (112831us total) trans 21474869149 rc 0/0
00000100:00100000:1.0:1651531960.709957:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249839
00010000:00010000:0.0:1651531960.709960:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca31f2 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [974848->978943] (req 974848->978943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.709966:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000968553c1 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531960.709968:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca31f2 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [974848->978943] (req 974848->978943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.709972:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca31f2 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [974848->978943] (req 974848->978943) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.709981:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca31f2 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [974848->978943] (req 974848->978943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.709987:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca31f2 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [974848->978943] (req 974848->978943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531960.735273:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869151 is committed
00010000:00010000:0.0:1651531960.735294:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca320e lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 27 type: EXT [114688->118783] (req 114688->118783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.735301:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca320e lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [114688->118783] (req 114688->118783) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.735306:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3200 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 27 type: EXT [32768->36863] (req 32768->36863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.735310:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3200 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 27 type: EXT [32768->36863] (req 32768->36863) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531960.735321:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a23bcd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+30:438149:x1731754467409984:12345-10.240.43.64@tcp:4:fio.0 Request processed in 38369us (38408us total) trans 21474869151 rc 0/0
00000100:00100000:0.0:1651531960.735325:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249843
00000100:00100000:1.0:1651531960.735330:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c65d6bc4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+29:438149:x1731754467409728:12345-10.240.43.64@tcp:4:fio.0 Request processed in 76139us (76175us total) trans 21474869150 rc 0/0
00000100:00100000:1.0:1651531960.735332:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249841
00010000:00010000:0.0:1651531960.735333:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca320e lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 27 type: EXT [114688->118783] (req 114688->118783) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.735336:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002c5e01dd already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531960.735337:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca320e lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 27 type: EXT [114688->118783] (req 114688->118783) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.735340:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3200 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 27 type: EXT [32768->36863] (req 32768->36863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.735340:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca320e lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [114688->118783] (req 114688->118783) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.735345:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008558d1b3 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531960.735345:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca320e lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 27 type: EXT [114688->118783] (req 114688->118783) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.735346:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3200 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [32768->36863] (req 32768->36863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.735348:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca320e lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [114688->118783] (req 114688->118783) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.735349:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3200 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [32768->36863] (req 32768->36863) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.735354:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3200 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 26 type: EXT [32768->36863] (req 32768->36863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.735358:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3200 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 26 type: EXT [32768->36863] (req 32768->36863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531960.761057:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531960.761065:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467411264
00000100:00100000:1.0:1651531960.761080:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249844
00000100:00100000:1.0:1651531960.761081:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a9fc5082 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+29:438148:x1731754467411264:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531960.761088:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3215 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 26 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.761093:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531960.761093:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531960.761094:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3215 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 26 type: EXT [901120->905215] (req 901120->905215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.761098:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3215 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 26 type: EXT [901120->905215] (req 901120->905215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531960.835056:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869152 is committed
00010000:00010000:1.0:1651531960.835085:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3215 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 26 type: EXT [901120->905215] (req 901120->905215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.835089:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3215 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 26 type: EXT [901120->905215] (req 901120->905215) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531960.835107:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a9fc5082 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+29:438148:x1731754467411264:12345-10.240.43.64@tcp:4:fio.0 Request processed in 74025us (74051us total) trans 21474869152 rc 0/0
00000100:00100000:1.0:1651531960.835110:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249844
00010000:00010000:0.0:1651531960.835113:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3215 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 26 type: EXT [901120->905215] (req 901120->905215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.835117:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008558d1b3 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531960.835120:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3215 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 26 type: EXT [901120->905215] (req 901120->905215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.835123:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3215 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 26 type: EXT [901120->905215] (req 901120->905215) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.835128:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3215 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 26 type: EXT [901120->905215] (req 901120->905215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.835131:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3215 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 26 type: EXT [901120->905215] (req 901120->905215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531960.835865:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531960.835873:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467412096
00000100:00100000:1.0:1651531960.835888:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249845
00000100:00100000:1.0:1651531960.835889:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c62d1815 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+29:438148:x1731754467412096:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531960.835896:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca321c lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 26 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.835900:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531960.835901:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531960.835902:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca321c lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 26 type: EXT [94208->98303] (req 94208->98303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.835906:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca321c lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 26 type: EXT [94208->98303] (req 94208->98303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531960.836970:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531960.836988:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467412480
00000100:00100000:0.0:1651531960.837006:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249846
00000100:00100000:0.0:1651531960.837008:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005dd15341 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+32:438147:x1731754467412480:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531960.837017:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3223 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 27 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.837022:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531960.837022:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531960.837024:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3223 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 27 type: EXT [991232->995327] (req 991232->995327) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.837028:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3223 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 27 type: EXT [991232->995327] (req 991232->995327) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.837041:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3223 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 27 type: EXT [991232->995327] (req 991232->995327) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.837044:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3223 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 27 type: EXT [991232->995327] (req 991232->995327) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531960.837068:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005dd15341 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+32:438147:x1731754467412480:12345-10.240.43.64@tcp:3:fio.0 Request processed in 58us (98us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531960.837071:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249846
00010000:00010000:0.0:1651531960.837078:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3223 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 27 type: EXT [991232->995327] (req 991232->995327) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.837082:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002c5e01dd already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531960.837083:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3223 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 27 type: EXT [991232->995327] (req 991232->995327) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.837086:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3223 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 27 type: EXT [991232->995327] (req 991232->995327) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.837090:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3223 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 27 type: EXT [991232->995327] (req 991232->995327) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.837093:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3223 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 27 type: EXT [991232->995327] (req 991232->995327) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531960.837390:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531960.837401:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467412608
00000100:00100000:0.0:1651531960.837414:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249847
00000100:00100000:0.0:1651531960.837416:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007a05c3e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+32:438146:x1731754467412608:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531960.837422:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca322a lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 27 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.837427:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531960.837429:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531960.837430:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca322a lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 27 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.837434:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca322a lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 27 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531960.860825:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869153 is committed
00010000:00010000:1.0:1651531960.860855:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca321c lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 27 type: EXT [94208->98303] (req 94208->98303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.860859:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca321c lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 27 type: EXT [94208->98303] (req 94208->98303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.860874:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca321c lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 27 type: EXT [94208->98303] (req 94208->98303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531960.860875:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c62d1815 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+32:438148:x1731754467412096:12345-10.240.43.64@tcp:4:fio.0 Request processed in 24984us (25010us total) trans 21474869153 rc 0/0
00000100:00100000:1.0:1651531960.860878:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249845
00010000:00010000:0.0:1651531960.860881:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006da7a892 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531960.860882:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca321c lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 27 type: EXT [94208->98303] (req 94208->98303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.860887:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca321c lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 27 type: EXT [94208->98303] (req 94208->98303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.860896:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca321c lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 27 type: EXT [94208->98303] (req 94208->98303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.860902:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca321c lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 27 type: EXT [94208->98303] (req 94208->98303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531960.861151:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531960.861159:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467412864
00000100:00100000:1.0:1651531960.861168:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249848
00000100:00100000:1.0:1651531960.861171:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e15376c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+32:438149:x1731754467412864:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531960.861177:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3231 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 27 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.861182:0:192755:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004233736c/0x3234de053ca2c1f lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 27 type: EXT [434176->438271] (req 434176->438271) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44500c expref: 32 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.861186:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531960.861186:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531960.861187:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3231 lrc: 4/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 27 type: EXT [434176->438271] (req 434176->438271) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.861194:0:192755:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004233736c/0x3234de053ca2c1f lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 27 type: EXT [434176->438271] (req 434176->438271) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44500c expref: 32 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.861198:0:192755:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004233736c/0x3234de053ca2c1f lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 27 type: EXT [434176->438271] (req 434176->438271) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44500c expref: 32 pid: 166112 timeout: 22769 lvb_type: 0
00000100:00100000:1.0:1651531960.861202:0:192755:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b5b5b4c0 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0001_UUID:192755:1731745997354752:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531960.861239:0:192755:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fc7d2635 going to sleep for 6 seconds
00000100:00100000:1.0:1651531960.861535:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531960.861542:0:166103:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467413056
00010000:00010000:1.0:1651531960.861547:0:166103:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004233736c/0x3234de053ca2c1f lrc: 5/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 27 type: EXT [434176->438271] (req 434176->438271) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44500c expref: 33 pid: 166112 timeout: 22769 lvb_type: 0
00000100:00100000:1.0:1651531960.861558:0:166103:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 194
00000100:00100000:1.0:1651531960.861560:0:166103:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006c903446 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+33:438147:x1731754467413056:12345-10.240.43.64@tcp:103:ldlm_bl_03.0
00010000:00010000:1.0:1651531960.861565:0:166103:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1651531960.861568:0:166103:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004233736c/0x3234de053ca2c1f lrc: 5/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [434176->438271] (req 434176->438271) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44500c expref: 33 pid: 166112 timeout: 22769 lvb_type: 0
00010000:00010000:1.0:1651531960.861572:0:166103:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004233736c/0x3234de053ca2c1f lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [434176->438271] (req 434176->438271) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44500c expref: 33 pid: 166112 timeout: 22769 lvb_type: 0
00010000:00010000:1.0:1651531960.861579:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531960.861580:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531960.861580:0:166103:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3231 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [434176->438271] (req 434176->438271) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.861584:0:166103:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3231 lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 28 type: EXT [434176->438271] (req 434176->438271) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.861589:0:166103:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1651531960.861598:0:166103:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006c903446 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+33:438147:x1731754467413056:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 37us (63us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531960.861601:0:166103:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 194
00010000:00010000:1.0:1651531960.861610:0:192755:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004233736c/0x3234de053ca2c1f lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 27 type: EXT [434176->438271] (req 434176->438271) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44500c expref: 32 pid: 166112 timeout: 22769 lvb_type: 0
00000100:00100000:1.0:1651531960.861614:0:192755:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b5b5b4c0 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0001_UUID:192755:1731745997354752:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651531960.861618:0:192755:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3231 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 26 type: EXT [434176->438271] (req 434176->438271) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.861621:0:192755:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3231 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 26 type: EXT [434176->438271] (req 434176->438271) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.861628:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3231 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 26 type: EXT [434176->438271] (req 434176->438271) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531960.896264:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869154 is committed
00010000:00010000:1.0:1651531960.896301:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca322a lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 26 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.896305:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca322a lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 26 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.896314:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca322a lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 26 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531960.896320:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007a05c3e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+31:438146:x1731754467412608:12345-10.240.43.64@tcp:4:fio.0 Request processed in 58903us (58937us total) trans 21474869154 rc 0/0
00010000:00010000:0.0:1651531960.896321:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fb2f6575 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531960.896322:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca322a lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 26 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531960.896323:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249847
00010000:00010000:0.0:1651531960.896329:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca322a lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 26 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.896338:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca322a lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 26 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.896342:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca322a lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 26 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531960.909481:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531960.909491:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467413824
00000100:00100000:1.0:1651531960.909501:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249849
00000100:00100000:1.0:1651531960.909502:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b5b5b4c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+31:438149:x1731754467413824:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531960.909509:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3238 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 26 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.909513:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531960.909514:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531960.909515:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3238 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 26 type: EXT [929792->933887] (req 929792->933887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.909519:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3238 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 26 type: EXT [929792->933887] (req 929792->933887) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531960.920826:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869155 is committed
00010000:00010000:1.0:1651531960.920854:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3231 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 26 type: EXT [434176->438271] (req 434176->438271) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.920858:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3231 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 26 type: EXT [434176->438271] (req 434176->438271) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531960.920878:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e15376c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+31:438149:x1731754467412864:12345-10.240.43.64@tcp:4:fio.0 Request processed in 59706us (59728us total) trans 21474869155 rc 0/0
00000100:00100000:1.0:1651531960.920881:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249848
00010000:00010000:0.0:1651531960.920881:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3231 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 26 type: EXT [434176->438271] (req 434176->438271) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.920886:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e9b84540 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531960.920887:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3231 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 26 type: EXT [434176->438271] (req 434176->438271) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.920890:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3231 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 26 type: EXT [434176->438271] (req 434176->438271) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.920896:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3231 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 26 type: EXT [434176->438271] (req 434176->438271) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.920899:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3231 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 26 type: EXT [434176->438271] (req 434176->438271) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531960.921200:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531960.921219:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467413952
00000100:00100000:1.0:1651531960.921241:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249850
00000100:00100000:1.0:1651531960.921243:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002bdf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+31:438148:x1731754467413952:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531960.921250:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca323f lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 26 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.921254:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531960.921254:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531960.921256:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca323f lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 26 type: EXT [1044480->1048575] (req 1044480->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.921260:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca323f lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 26 type: EXT [1044480->1048575] (req 1044480->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.921271:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca323f lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 26 type: EXT [1044480->1048575] (req 1044480->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.921277:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca323f lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 26 type: EXT [1044480->1048575] (req 1044480->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.921296:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca323f lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 26 type: EXT [1044480->1048575] (req 1044480->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531960.921298:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002bdf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+31:438148:x1731754467413952:12345-10.240.43.64@tcp:3:fio.0 Request processed in 54us (98us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531960.921301:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249850
00010000:00010000:0.0:1651531960.921305:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008558d1b3 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531960.921306:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca323f lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 26 type: EXT [1044480->1048575] (req 1044480->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.921309:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca323f lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 26 type: EXT [1044480->1048575] (req 1044480->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.921314:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca323f lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 26 type: EXT [1044480->1048575] (req 1044480->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.921316:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca323f lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 26 type: EXT [1044480->1048575] (req 1044480->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531960.954376:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869156 is committed
00010000:00010000:1.0:1651531960.954405:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3238 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 25 type: EXT [929792->933887] (req 929792->933887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.954409:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3238 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 25 type: EXT [929792->933887] (req 929792->933887) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531960.954428:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b5b5b4c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+28:438149:x1731754467413824:12345-10.240.43.64@tcp:4:fio.0 Request processed in 44925us (44947us total) trans 21474869156 rc 0/0
00000100:00100000:1.0:1651531960.954431:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249849
00010000:00010000:0.0:1651531960.954431:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3238 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 25 type: EXT [929792->933887] (req 929792->933887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.954436:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006da7a892 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531960.954437:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3238 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 25 type: EXT [929792->933887] (req 929792->933887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.954440:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3238 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 25 type: EXT [929792->933887] (req 929792->933887) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.954445:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3238 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 25 type: EXT [929792->933887] (req 929792->933887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531960.954452:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3238 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 25 type: EXT [929792->933887] (req 929792->933887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531960.954801:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531960.954809:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467414464
00000100:00100000:1.0:1651531960.954819:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249851
00000100:00100000:1.0:1651531960.954821:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000137fd3d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+28:438148:x1731754467414464:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531960.954827:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3246 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 25 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.954831:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531960.954832:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531960.954833:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3246 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 25 type: EXT [593920->598015] (req 593920->598015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531960.954840:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3246 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 25 type: EXT [593920->598015] (req 593920->598015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531961.002820:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531961.002828:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467415104
00000100:00100000:1.0:1651531961.002843:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249852
00000100:00100000:1.0:1651531961.002844:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000da31c48f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+31:438148:x1731754467415104:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531961.002851:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca324d lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 26 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.002857:0:192755:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e2f464ac/0x3234de053ca2dd1 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 26 type: EXT [1028096->1040383] (req 1028096->1032191) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4453bd expref: 31 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.002860:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531961.002860:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531961.002861:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca324d lrc: 4/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 26 type: EXT [1036288->1040383] (req 1036288->1040383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.002868:0:192755:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e2f464ac/0x3234de053ca2dd1 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 26 type: EXT [1028096->1040383] (req 1028096->1032191) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4453bd expref: 31 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.002872:0:192755:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e2f464ac/0x3234de053ca2dd1 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 26 type: EXT [1028096->1040383] (req 1028096->1032191) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4453bd expref: 31 pid: 166111 timeout: 22769 lvb_type: 0
00000100:00100000:1.0:1651531961.002876:0:192755:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f05c0b82 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0001_UUID:192755:1731745997354816:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531961.002888:0:192755:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ec524534 going to sleep for 6 seconds
00000100:00100000:1.0:1651531961.003174:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531961.003180:0:166103:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467415168
00010000:00010000:1.0:1651531961.003186:0:166103:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e2f464ac/0x3234de053ca2dd1 lrc: 5/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 26 type: EXT [1028096->1040383] (req 1028096->1032191) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4453bd expref: 32 pid: 166111 timeout: 22769 lvb_type: 0
00000100:00100000:1.0:1651531961.003199:0:166103:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 195
00000100:00100000:1.0:1651531961.003200:0:166103:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001eda4376 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+32:438147:x1731754467415168:12345-10.240.43.64@tcp:103:ldlm_bl_04.0
00010000:00010000:1.0:1651531961.003204:0:166103:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1651531961.003214:0:166103:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e2f464ac/0x3234de053ca2dd1 lrc: 5/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 27 type: EXT [1028096->1040383] (req 1028096->1032191) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4453bd expref: 32 pid: 166111 timeout: 22769 lvb_type: 0
00010000:00010000:1.0:1651531961.003218:0:166103:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e2f464ac/0x3234de053ca2dd1 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 27 type: EXT [1028096->1040383] (req 1028096->1032191) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4453bd expref: 32 pid: 166111 timeout: 22769 lvb_type: 0
00010000:00010000:1.0:1651531961.003239:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531961.003240:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531961.003241:0:166103:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca324d lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 27 type: EXT [1036288->1040383] (req 1036288->1040383) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.003245:0:166103:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca324d lrc: 4/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 27 type: EXT [1036288->1040383] (req 1036288->1040383) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.003250:0:166103:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1651531961.003260:0:166103:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001eda4376 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+32:438147:x1731754467415168:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 58us (87us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531961.003263:0:166103:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 195
00010000:00010000:1.0:1651531961.003273:0:192755:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2f464ac/0x3234de053ca2dd1 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 26 type: EXT [1028096->1040383] (req 1028096->1032191) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4453bd expref: 31 pid: 166111 timeout: 22769 lvb_type: 0
00000100:00100000:1.0:1651531961.003281:0:192755:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f05c0b82 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0001_UUID:192755:1731745997354816:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651531961.003284:0:192755:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca324d lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 25 type: EXT [1036288->1040383] (req 1036288->1040383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.003288:0:192755:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca324d lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 25 type: EXT [1036288->1040383] (req 1036288->1040383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.003290:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca324d lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 25 type: EXT [1036288->1040383] (req 1036288->1040383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.003302:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca324d lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 25 type: EXT [1036288->1040383] (req 1036288->1040383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.003305:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca324d lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 25 type: EXT [1036288->1040383] (req 1036288->1040383) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.003320:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca324d lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 25 type: EXT [1036288->1040383] (req 1036288->1040383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531961.003322:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000da31c48f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+30:438148:x1731754467415104:12345-10.240.43.64@tcp:3:fio.0 Request processed in 477us (503us total) trans 0 rc 4096/4096
00010000:00010000:0.0:1651531961.003324:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001e36c601 already unused, calling callback (0000000049fddea7)
00000100:00100000:1.0:1651531961.003325:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249852
00010000:00010000:0.0:1651531961.003326:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca324d lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 25 type: EXT [1036288->1040383] (req 1036288->1040383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.003329:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca324d lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 25 type: EXT [1036288->1040383] (req 1036288->1040383) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.003334:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca324d lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 25 type: EXT [1036288->1040383] (req 1036288->1040383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.003337:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca324d lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 25 type: EXT [1036288->1040383] (req 1036288->1040383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531961.003632:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531961.003640:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467415296
00000100:00100000:1.0:1651531961.003653:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249853
00000100:00100000:1.0:1651531961.003654:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f05c0b82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+30:438149:x1731754467415296:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531961.003661:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3254 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 25 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.003668:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531961.003669:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531961.003670:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3254 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 25 type: EXT [659456->663551] (req 659456->663551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.003674:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3254 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 25 type: EXT [659456->663551] (req 659456->663551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531961.013802:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869157 is committed
00002000:00010000:1.0:1651531961.013828:0:216323:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x34545:0x0] updating lvb mtime from disk: 1651531960 -> 1651531961
00002000:00010000:1.0:1651531961.013830:0:216323:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x34545:0x0] updating lvb ctime from disk: 1651531960 -> 1651531961
00010000:00010000:1.0:1651531961.013832:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3246 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 25 type: EXT [593920->598015] (req 593920->598015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.013836:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3246 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 25 type: EXT [593920->598015] (req 593920->598015) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531961.013856:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000137fd3d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+30:438148:x1731754467414464:12345-10.240.43.64@tcp:4:fio.0 Request processed in 59034us (59055us total) trans 21474869157 rc 0/0
00000100:00100000:1.0:1651531961.013859:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249851
00010000:00010000:0.0:1651531961.013859:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3246 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 25 type: EXT [593920->598015] (req 593920->598015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.013863:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000968553c1 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531961.013864:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3246 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 25 type: EXT [593920->598015] (req 593920->598015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.013871:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3246 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 25 type: EXT [593920->598015] (req 593920->598015) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.013877:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3246 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 25 type: EXT [593920->598015] (req 593920->598015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.013880:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3246 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 25 type: EXT [593920->598015] (req 593920->598015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531961.014163:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531961.014171:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467415424
00000100:00100000:1.0:1651531961.014183:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249854
00000100:00100000:1.0:1651531961.014184:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000530f55ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+30:438149:x1731754467415424:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531961.014191:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca325b lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 25 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.014195:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531961.014197:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531961.014198:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca325b lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 25 type: EXT [270336->274431] (req 270336->274431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.014202:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca325b lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 25 type: EXT [270336->274431] (req 270336->274431) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.014236:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca325b lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 25 type: EXT [270336->274431] (req 270336->274431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.014240:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca325b lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 25 type: EXT [270336->274431] (req 270336->274431) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.014250:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca325b lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 25 type: EXT [270336->274431] (req 270336->274431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.014254:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a8889a80 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531961.014255:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca325b lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 25 type: EXT [270336->274431] (req 270336->274431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531961.014256:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000530f55ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+30:438149:x1731754467415424:12345-10.240.43.64@tcp:3:fio.0 Request processed in 71us (94us total) trans 0 rc 4096/4096
00010000:00010000:0.0:1651531961.014258:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca325b lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 25 type: EXT [270336->274431] (req 270336->274431) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531961.014259:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249854
00010000:00010000:0.0:1651531961.014263:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca325b lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 25 type: EXT [270336->274431] (req 270336->274431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.014265:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca325b lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 25 type: EXT [270336->274431] (req 270336->274431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531961.038044:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531961.038052:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467415744
00000100:00100000:1.0:1651531961.038066:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249855
00000100:00100000:1.0:1651531961.038068:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000880cd1d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+30:438149:x1731754467415744:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531961.038074:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3262 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 25 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.038079:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531961.038079:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531961.038080:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3262 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 25 type: EXT [839680->843775] (req 839680->843775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.038084:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3262 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 25 type: EXT [839680->843775] (req 839680->843775) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531961.038904:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531961.038929:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467416064
00000100:00100000:0.0:1651531961.038943:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249856
00000100:00100000:0.0:1651531961.038945:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003a5ac9b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+33:438147:x1731754467416064:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531961.038955:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3269 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 26 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.038959:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531961.038960:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531961.038961:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3269 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 26 type: EXT [798720->802815] (req 798720->802815) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.038965:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3269 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 26 type: EXT [798720->802815] (req 798720->802815) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.038980:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3269 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 26 type: EXT [798720->802815] (req 798720->802815) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.038983:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3269 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 26 type: EXT [798720->802815] (req 798720->802815) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531961.039006:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003a5ac9b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+33:438147:x1731754467416064:12345-10.240.43.64@tcp:3:fio.0 Request processed in 60us (102us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531961.039009:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249856
00010000:00010000:0.0:1651531961.039017:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3269 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 26 type: EXT [798720->802815] (req 798720->802815) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.039021:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fb2f6575 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531961.039022:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3269 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 26 type: EXT [798720->802815] (req 798720->802815) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.039024:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3269 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 26 type: EXT [798720->802815] (req 798720->802815) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.039033:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3269 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 26 type: EXT [798720->802815] (req 798720->802815) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.039036:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3269 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 26 type: EXT [798720->802815] (req 798720->802815) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531961.074563:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869158 is committed
00010000:00010000:1.0:1651531961.074596:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3254 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 25 type: EXT [659456->663551] (req 659456->663551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.074600:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3254 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 25 type: EXT [659456->663551] (req 659456->663551) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531961.074619:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f05c0b82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+30:438149:x1731754467415296:12345-10.240.43.64@tcp:4:fio.0 Request processed in 70964us (70988us total) trans 21474869158 rc 0/0
00010000:00010000:0.0:1651531961.074621:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3254 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 25 type: EXT [659456->663551] (req 659456->663551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531961.074623:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249853
00010000:00010000:0.0:1651531961.074627:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c2b76533 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531961.074628:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3254 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 25 type: EXT [659456->663551] (req 659456->663551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.074634:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3254 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 25 type: EXT [659456->663551] (req 659456->663551) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.074643:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3254 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 25 type: EXT [659456->663551] (req 659456->663551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.074646:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3254 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 25 type: EXT [659456->663551] (req 659456->663551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531961.098747:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869159 is committed
00010000:00010000:1.0:1651531961.098778:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3262 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 24 type: EXT [839680->843775] (req 839680->843775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.098783:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3262 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 24 type: EXT [839680->843775] (req 839680->843775) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531961.098803:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000880cd1d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+27:438149:x1731754467415744:12345-10.240.43.64@tcp:4:fio.0 Request processed in 60734us (60759us total) trans 21474869159 rc 0/0
00010000:00010000:0.0:1651531961.098804:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3262 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 24 type: EXT [839680->843775] (req 839680->843775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531961.098806:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249855
00010000:00010000:0.0:1651531961.098809:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d44eb74d already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531961.098811:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3262 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 24 type: EXT [839680->843775] (req 839680->843775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.098815:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3262 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 24 type: EXT [839680->843775] (req 839680->843775) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.098820:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3262 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 24 type: EXT [839680->843775] (req 839680->843775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.098823:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3262 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 24 type: EXT [839680->843775] (req 839680->843775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531961.099504:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531961.099512:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467416960
00000100:00100000:1.0:1651531961.099529:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249857
00000100:00100000:1.0:1651531961.099531:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b338475a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+27:438147:x1731754467416960:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531961.099539:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3270 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 24 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.099547:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531961.099547:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531961.099548:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3270 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 24 type: EXT [933888->937983] (req 933888->937983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.099552:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3270 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 24 type: EXT [933888->937983] (req 933888->937983) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.099564:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3270 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 24 type: EXT [933888->937983] (req 933888->937983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.099567:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3270 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 24 type: EXT [933888->937983] (req 933888->937983) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.099586:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3270 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 24 type: EXT [933888->937983] (req 933888->937983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531961.099588:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b338475a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+27:438147:x1731754467416960:12345-10.240.43.64@tcp:3:fio.0 Request processed in 56us (85us total) trans 0 rc 4096/4096
00010000:00010000:0.0:1651531961.099590:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c2b76533 already unused, calling callback (0000000049fddea7)
00000100:00100000:1.0:1651531961.099591:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249857
00010000:00010000:0.0:1651531961.099591:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3270 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 24 type: EXT [933888->937983] (req 933888->937983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.099594:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3270 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 24 type: EXT [933888->937983] (req 933888->937983) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.099599:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3270 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 24 type: EXT [933888->937983] (req 933888->937983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.099602:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3270 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 24 type: EXT [933888->937983] (req 933888->937983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531961.099625:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531961.099634:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467417088
00000100:00100000:1.0:1651531961.099650:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249858
00000100:00100000:1.0:1651531961.099651:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c4db449c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+27:438149:x1731754467417088:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531961.099657:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3277 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 24 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.099662:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531961.099662:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531961.099663:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3277 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 24 type: EXT [729088->733183] (req 729088->733183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.099671:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3277 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 24 type: EXT [729088->733183] (req 729088->733183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531961.099922:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531961.099930:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467417216
00000100:00100000:1.0:1651531961.099943:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249859
00000100:00100000:1.0:1651531961.099944:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000071f9ee43 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+30:438146:x1731754467417216:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531961.099951:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca327e lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 25 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.099955:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531961.099956:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531961.099957:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca327e lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 25 type: EXT [614400->618495] (req 614400->618495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.099961:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca327e lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 25 type: EXT [614400->618495] (req 614400->618495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531961.137997:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531961.138008:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467417984
00000100:00100000:0.0:1651531961.138020:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249860
00000100:00100000:0.0:1651531961.138022:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ecb6b3b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+33:438148:x1731754467417984:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531961.138030:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3285 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 26 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.138035:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531961.138036:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531961.138037:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3285 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 26 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.138041:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3285 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 26 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.138054:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3285 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 26 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.138058:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3285 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 26 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531961.138079:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ecb6b3b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+33:438148:x1731754467417984:12345-10.240.43.64@tcp:3:fio.0 Request processed in 57us (83us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531961.138082:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249860
00010000:00010000:0.0:1651531961.138090:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3285 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 26 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.138093:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fb2f6575 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531961.138094:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3285 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 26 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.138102:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3285 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 26 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.138107:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3285 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 26 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.138110:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3285 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 26 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531961.171360:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869161 is committed
00010000:00010000:1.0:1651531961.171392:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca327e lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 25 type: EXT [614400->618495] (req 614400->618495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.171396:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca327e lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 25 type: EXT [614400->618495] (req 614400->618495) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531961.171418:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000071f9ee43 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+28:438146:x1731754467417216:12345-10.240.43.64@tcp:4:fio.0 Request processed in 71472us (71496us total) trans 21474869161 rc 0/0
00000100:00100000:1.0:1651531961.171421:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249859
00010000:00010000:0.0:1651531961.171422:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca327e lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 25 type: EXT [614400->618495] (req 614400->618495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.171426:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000968553c1 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531961.171427:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca327e lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 25 type: EXT [614400->618495] (req 614400->618495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.171431:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca327e lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 25 type: EXT [614400->618495] (req 614400->618495) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.171438:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3277 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 25 type: EXT [729088->733183] (req 729088->733183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.171442:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3277 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 25 type: EXT [729088->733183] (req 729088->733183) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.171445:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca327e lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 25 type: EXT [614400->618495] (req 614400->618495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.171452:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca327e lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 25 type: EXT [614400->618495] (req 614400->618495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531961.171454:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c4db449c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+27:438149:x1731754467417088:12345-10.240.43.64@tcp:4:fio.0 Request processed in 71802us (71829us total) trans 21474869160 rc 0/0
00010000:00010000:0.0:1651531961.171456:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3277 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 24 type: EXT [729088->733183] (req 729088->733183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531961.171457:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249858
00010000:00010000:0.0:1651531961.171463:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a8889a80 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531961.171464:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3277 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 24 type: EXT [729088->733183] (req 729088->733183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.171466:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3277 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 24 type: EXT [729088->733183] (req 729088->733183) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.171470:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3277 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 24 type: EXT [729088->733183] (req 729088->733183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.171472:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3277 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 24 type: EXT [729088->733183] (req 729088->733183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531961.196834:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531961.196842:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467418752
00000100:00100000:1.0:1651531961.196852:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249861
00000100:00100000:1.0:1651531961.196853:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e4e3ecb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+27:438148:x1731754467418752:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531961.196860:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca328c lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 24 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.196865:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531961.196865:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531961.196866:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca328c lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 24 type: EXT [823296->827391] (req 823296->827391) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.196870:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca328c lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 24 type: EXT [823296->827391] (req 823296->827391) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.196882:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca328c lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 24 type: EXT [823296->827391] (req 823296->827391) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.196885:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca328c lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 24 type: EXT [823296->827391] (req 823296->827391) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531961.196909:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e4e3ecb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+27:438148:x1731754467418752:12345-10.240.43.64@tcp:3:fio.0 Request processed in 55us (75us total) trans 0 rc 4096/4096
00010000:00010000:0.0:1651531961.196911:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca328c lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 24 type: EXT [823296->827391] (req 823296->827391) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531961.196912:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249861
00010000:00010000:0.0:1651531961.196916:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001e36c601 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531961.196917:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca328c lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 24 type: EXT [823296->827391] (req 823296->827391) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.196919:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca328c lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 24 type: EXT [823296->827391] (req 823296->827391) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.196924:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca328c lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 24 type: EXT [823296->827391] (req 823296->827391) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.196927:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca328c lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 24 type: EXT [823296->827391] (req 823296->827391) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531961.197261:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531961.197269:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467418880
00000100:00100000:1.0:1651531961.197278:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249862
00000100:00100000:1.0:1651531961.197280:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fb90eb28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+27:438149:x1731754467418880:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531961.197287:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3293 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 24 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.197291:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531961.197291:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531961.197293:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3293 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 24 type: EXT [49152->53247] (req 49152->53247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.197296:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3293 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 24 type: EXT [49152->53247] (req 49152->53247) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.197307:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3293 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 24 type: EXT [49152->53247] (req 49152->53247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.197310:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3293 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 24 type: EXT [49152->53247] (req 49152->53247) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531961.197329:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fb90eb28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+27:438149:x1731754467418880:12345-10.240.43.64@tcp:3:fio.0 Request processed in 48us (68us total) trans 0 rc 4096/4096
00010000:00010000:0.0:1651531961.197329:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3293 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 24 type: EXT [49152->53247] (req 49152->53247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531961.197332:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249862
00010000:00010000:0.0:1651531961.197333:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006da7a892 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531961.197334:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3293 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 24 type: EXT [49152->53247] (req 49152->53247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.197337:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3293 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 24 type: EXT [49152->53247] (req 49152->53247) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.197341:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3293 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 24 type: EXT [49152->53247] (req 49152->53247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.197344:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3293 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 24 type: EXT [49152->53247] (req 49152->53247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531961.198019:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531961.198028:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467419136
00000100:00100000:1.0:1651531961.198037:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249863
00000100:00100000:1.0:1651531961.198038:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000add44b2e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+27:438149:x1731754467419136:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531961.198044:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca329a lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 24 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.198048:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531961.198049:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531961.198050:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca329a lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 24 type: EXT [745472->749567] (req 745472->749567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.198054:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca329a lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 24 type: EXT [745472->749567] (req 745472->749567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531961.261310:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869162 is committed
00010000:00010000:1.0:1651531961.261325:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca329a lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 24 type: EXT [745472->749567] (req 745472->749567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.261329:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca329a lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 24 type: EXT [745472->749567] (req 745472->749567) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531961.261333:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651531961.261348:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca329a lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 24 type: EXT [745472->749567] (req 745472->749567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531961.261352:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000add44b2e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+27:438149:x1731754467419136:12345-10.240.43.64@tcp:4:fio.0 Request processed in 63313us (63333us total) trans 21474869162 rc 0/0
00010000:00010000:0.0:1651531961.261352:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008558d1b3 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531961.261353:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca329a lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 24 type: EXT [745472->749567] (req 745472->749567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531961.261355:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249863
00010000:00010000:0.0:1651531961.261357:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca329a lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 24 type: EXT [745472->749567] (req 745472->749567) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531961.261361:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467419328
00010000:00010000:0.0:1651531961.261366:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca329a lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 24 type: EXT [745472->749567] (req 745472->749567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531961.261373:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249864
00010000:00010000:0.0:1651531961.261374:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca329a lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 24 type: EXT [745472->749567] (req 745472->749567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531961.261375:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f47fde78 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+27:438148:x1731754467419328:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531961.261381:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca32a1 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 24 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.261386:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531961.261387:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531961.261388:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca32a1 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 24 type: EXT [1044480->1048575] (req 1044480->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.261392:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca32a1 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 24 type: EXT [1044480->1048575] (req 1044480->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.261402:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca32a1 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 24 type: EXT [1044480->1048575] (req 1044480->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.261406:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca32a1 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 24 type: EXT [1044480->1048575] (req 1044480->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.261413:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca32a1 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 24 type: EXT [1044480->1048575] (req 1044480->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.261417:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e9b84540 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531961.261418:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca32a1 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 24 type: EXT [1044480->1048575] (req 1044480->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.261421:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca32a1 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 24 type: EXT [1044480->1048575] (req 1044480->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.261425:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca32a1 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 24 type: EXT [1044480->1048575] (req 1044480->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531961.261430:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f47fde78 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+27:438148:x1731754467419328:12345-10.240.43.64@tcp:3:fio.0 Request processed in 55us (98us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531961.261433:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249864
00010000:00010000:0.0:1651531961.261433:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca32a1 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 24 type: EXT [1044480->1048575] (req 1044480->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531961.261724:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531961.261744:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467419648
00000100:00100000:1.0:1651531961.261756:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249865
00000100:00100000:1.0:1651531961.261758:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bcdb3319 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+27:438148:x1731754467419648:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531961.261764:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca32a8 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 24 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.261769:0:192755:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fd7c5262/0x3234de053ca2d92 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 24 type: EXT [1040384->18446744073709551615] (req 1040384->1044479) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445307 expref: 27 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.261773:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531961.261774:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531961.261775:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca32a8 lrc: 4/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 24 type: EXT [1040384->1044479] (req 1040384->1044479) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.261782:0:192755:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fd7c5262/0x3234de053ca2d92 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 24 type: EXT [1040384->18446744073709551615] (req 1040384->1044479) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445307 expref: 27 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.261787:0:192755:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fd7c5262/0x3234de053ca2d92 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 24 type: EXT [1040384->18446744073709551615] (req 1040384->1044479) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445307 expref: 27 pid: 206699 timeout: 22769 lvb_type: 0
00000100:00100000:1.0:1651531961.261791:0:192755:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000028779db6 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0001_UUID:192755:1731745997354880:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531961.261808:0:192755:0:(client.c:2492:ptlrpc_set_wait()) set 000000001a1ce0e5 going to sleep for 6 seconds
00000100:00100000:0.0:1651531961.261848:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531961.261873:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467419776
00000100:00100000:0.0:1651531961.261885:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249866
00000100:00100000:0.0:1651531961.261887:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001797bd5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+28:438149:x1731754467419776:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531961.261897:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca32af lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 25 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.261901:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531961.261902:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531961.261903:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca32af lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 25 type: EXT [221184->225279] (req 221184->225279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.261907:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca32af lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 25 type: EXT [221184->225279] (req 221184->225279) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531961.262110:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531961.262122:0:192755:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000028779db6 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0001_UUID:192755:1731745997354880:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531961.262124:0:166103:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467419840
00010000:00010000:1.0:1651531961.262127:0:192755:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca32a8 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 25 type: EXT [1040384->1044479] (req 1040384->1044479) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.262131:0:166103:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fd7c5262/0x3234de053ca2d92 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 25 type: EXT [1040384->18446744073709551615] (req 1040384->1044479) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445307 expref: 31 pid: 206699 timeout: 22769 lvb_type: 0
00000100:00100000:0.0:1651531961.262140:0:166103:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 196
00000100:00100000:0.0:1651531961.262142:0:166103:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f817afea pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+31:438147:x1731754467419840:12345-10.240.43.64@tcp:103:ldlm_bl_05.0
00010000:00010000:0.0:1651531961.262145:0:166103:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531961.262149:0:166103:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fd7c5262/0x3234de053ca2d92 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 26 type: EXT [1040384->18446744073709551615] (req 1040384->1044479) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445307 expref: 31 pid: 206699 timeout: 22769 lvb_type: 0
00010000:00010000:0.0:1651531961.262153:0:166103:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fd7c5262/0x3234de053ca2d92 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 26 type: EXT [1040384->18446744073709551615] (req 1040384->1044479) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445307 expref: 31 pid: 206699 timeout: 22769 lvb_type: 0
00010000:00010000:0.0:1651531961.262159:0:166103:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fd7c5262/0x3234de053ca2d92 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 26 type: EXT [1040384->18446744073709551615] (req 1040384->1044479) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445307 expref: 31 pid: 206699 timeout: 22769 lvb_type: 0
00010000:00010000:0.0:1651531961.262167:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531961.262168:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531961.262169:0:166103:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca32a8 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 25 type: EXT [1040384->1044479] (req 1040384->1044479) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.262172:0:166103:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca32a8 lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 25 type: EXT [1040384->1044479] (req 1040384->1044479) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.262182:0:166103:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1651531961.262187:0:192755:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca32a8 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 24 type: EXT [1040384->1044479] (req 1040384->1044479) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.262190:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca32a8 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 24 type: EXT [1040384->1044479] (req 1040384->1044479) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531961.262192:0:166103:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f817afea pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+30:438147:x1731754467419840:12345-10.240.43.64@tcp:103:ldlm_bl_05.0 Request processed in 50us (84us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531961.262195:0:166103:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 196
00000001:00080000:0.0:1651531961.302718:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869164 is committed
00010000:00010000:0.0:1651531961.302740:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca32af lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 24 type: EXT [221184->225279] (req 221184->225279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.302744:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca32af lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 25 type: EXT [221184->225279] (req 221184->225279) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.302750:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca32a8 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 24 type: EXT [1040384->1044479] (req 1040384->1044479) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.302754:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca32a8 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 24 type: EXT [1040384->1044479] (req 1040384->1044479) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531961.302761:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001797bd5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+27:438149:x1731754467419776:12345-10.240.43.64@tcp:4:fio.0 Request processed in 40873us (40913us total) trans 21474869163 rc 0/0
00000100:00100000:0.0:1651531961.302764:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249866
00000100:00100000:1.0:1651531961.302775:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bcdb3319 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+26:438148:x1731754467419648:12345-10.240.43.64@tcp:4:fio.0 Request processed in 41017us (41052us total) trans 21474869164 rc 0/0
00010000:00010000:0.0:1651531961.302778:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca32af lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 24 type: EXT [221184->225279] (req 221184->225279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531961.302779:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249865
00010000:00010000:1.0:1651531961.302791:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca32a8 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 25 type: EXT [1040384->1044479] (req 1040384->1044479) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.302794:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006da7a892 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531961.302795:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca32a8 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 25 type: EXT [1040384->1044479] (req 1040384->1044479) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.302798:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca32a8 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 24 type: EXT [1040384->1044479] (req 1040384->1044479) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.302798:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fb2f6575 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531961.302799:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca32af lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 25 type: EXT [221184->225279] (req 221184->225279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.302803:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca32a8 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 24 type: EXT [1040384->1044479] (req 1040384->1044479) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.302803:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca32af lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 25 type: EXT [221184->225279] (req 221184->225279) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.302806:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca32a8 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 25 type: EXT [1040384->1044479] (req 1040384->1044479) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.302809:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca32af lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 24 type: EXT [221184->225279] (req 221184->225279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.302812:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca32af lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 23 type: EXT [221184->225279] (req 221184->225279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531961.303179:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531961.303188:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467420224
00000100:00100000:0.0:1651531961.303202:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44421
00000100:00100000:0.0:1651531961.303214:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bfdd313b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+26:438148:x1731754467420224:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531961.303218:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531961.303235:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca32b6 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 23 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4454f1 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.303245:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca32b6 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 23 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4454f1 expref: 27 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531961.303250:0:166112:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca32b6 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 23 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4454f1 expref: 27 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531961.303253:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002c5e01dd, rc 0)
00000100:00100000:0.0:1651531961.303268:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bfdd313b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+26:438148:x1731754467420224:12345-10.240.43.64@tcp:101:fio.0 Request processed in 64us (90us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531961.303274:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44421
00000100:00100000:0.0:1651531961.303467:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531961.303474:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467420480
00000100:00100000:0.0:1651531961.303488:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44422
00000100:00100000:0.0:1651531961.303490:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003b5b354a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+26:438146:x1731754467420480:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531961.303494:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531961.303497:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca32bd lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 23 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4454ff expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.303505:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca32bd lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 23 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4454ff expref: 27 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531961.303509:0:166112:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca32bd lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 23 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4454ff expref: 27 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531961.303513:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000080362f27, rc 0)
00000100:00100000:0.0:1651531961.303526:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003b5b354a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+26:438146:x1731754467420480:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (59us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531961.303529:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44422
00000100:00100000:0.0:1651531961.304112:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531961.304130:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467420864
00000100:00100000:1.0:1651531961.304147:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249867
00000100:00100000:1.0:1651531961.304148:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000091075bf7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+26:438149:x1731754467420864:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531961.304155:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca32c4 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 23 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.304160:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531961.304162:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531961.304163:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca32c4 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 23 type: EXT [36864->40959] (req 36864->40959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.304167:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca32c4 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 23 type: EXT [36864->40959] (req 36864->40959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.304178:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca32c4 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 23 type: EXT [36864->40959] (req 36864->40959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.304181:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca32c4 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 23 type: EXT [36864->40959] (req 36864->40959) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.304199:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca32c4 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 23 type: EXT [36864->40959] (req 36864->40959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531961.304201:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000091075bf7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+26:438149:x1731754467420864:12345-10.240.43.64@tcp:3:fio.0 Request processed in 51us (89us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531961.304203:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249867
00010000:00010000:0.0:1651531961.304203:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001e36c601 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531961.304211:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca32c4 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 23 type: EXT [36864->40959] (req 36864->40959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.304219:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca32c4 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 23 type: EXT [36864->40959] (req 36864->40959) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.304234:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca32c4 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 23 type: EXT [36864->40959] (req 36864->40959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.304237:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca32c4 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 23 type: EXT [36864->40959] (req 36864->40959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531961.304525:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531961.304542:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467421120
00000100:00100000:1.0:1651531961.304555:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249868
00000100:00100000:1.0:1651531961.304557:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ac545f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+26:438149:x1731754467421120:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531961.304564:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca32cb lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 23 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.304569:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531961.304569:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531961.304570:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca32cb lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 23 type: EXT [794624->798719] (req 794624->798719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.304574:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca32cb lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 23 type: EXT [794624->798719] (req 794624->798719) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.304589:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca32cb lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 23 type: EXT [794624->798719] (req 794624->798719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.304592:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca32cb lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 23 type: EXT [794624->798719] (req 794624->798719) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531961.304606:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ac545f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+26:438149:x1731754467421120:12345-10.240.43.64@tcp:3:fio.0 Request processed in 49us (81us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531961.304609:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249868
00010000:00010000:1.0:1651531961.304615:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca32cb lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 23 type: EXT [794624->798719] (req 794624->798719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.304618:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a8889a80 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531961.304619:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca32cb lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 23 type: EXT [794624->798719] (req 794624->798719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.304622:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca32cb lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 23 type: EXT [794624->798719] (req 794624->798719) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.304627:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca32cb lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 23 type: EXT [794624->798719] (req 794624->798719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.304629:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca32cb lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 23 type: EXT [794624->798719] (req 794624->798719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531961.304884:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531961.304902:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467421248
00000100:00100000:1.0:1651531961.304915:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249869
00000100:00100000:1.0:1651531961.304918:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b462545d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+26:438148:x1731754467421248:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531961.304925:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca32d2 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 23 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.304929:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531961.304930:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531961.304931:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca32d2 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 23 type: EXT [450560->454655] (req 450560->454655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.304935:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca32d2 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 23 type: EXT [450560->454655] (req 450560->454655) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.304945:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca32d2 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 23 type: EXT [450560->454655] (req 450560->454655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.304948:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca32d2 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 23 type: EXT [450560->454655] (req 450560->454655) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.304958:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca32d2 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 23 type: EXT [450560->454655] (req 450560->454655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.304962:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000968553c1 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531961.304963:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca32d2 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 23 type: EXT [450560->454655] (req 450560->454655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531961.304965:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b462545d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+26:438148:x1731754467421248:12345-10.240.43.64@tcp:3:fio.0 Request processed in 46us (82us total) trans 0 rc 4096/4096
00010000:00010000:0.0:1651531961.304966:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca32d2 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 23 type: EXT [450560->454655] (req 450560->454655) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531961.304968:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249869
00010000:00010000:0.0:1651531961.304971:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca32d2 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 23 type: EXT [450560->454655] (req 450560->454655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.304974:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca32d2 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 23 type: EXT [450560->454655] (req 450560->454655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531961.305246:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531961.305255:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467421376
00000100:00100000:0.0:1651531961.305268:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44423
00000100:00100000:0.0:1651531961.305270:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004d72f458 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+26:438149:x1731754467421376:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531961.305274:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531961.305277:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca32d9 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 23 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44550d expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.305285:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca32d9 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 23 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44550d expref: 27 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531961.305289:0:166112:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca32d9 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 23 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44550d expref: 27 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531961.305293:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c1022d42, rc 0)
00000100:00100000:0.0:1651531961.305307:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004d72f458 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+26:438149:x1731754467421376:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (61us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531961.305310:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44423
00000100:00100000:0.0:1651531961.327668:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531961.327689:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467422144
00000100:00100000:1.0:1651531961.327705:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249870
00000100:00100000:1.0:1651531961.327707:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006a8dcc9d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+26:438149:x1731754467422144:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531961.327714:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca32e0 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 23 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.327718:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531961.327720:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531961.327721:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca32e0 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 23 type: EXT [307200->311295] (req 307200->311295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.327725:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca32e0 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 23 type: EXT [307200->311295] (req 307200->311295) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.327736:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca32e0 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 23 type: EXT [307200->311295] (req 307200->311295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.327739:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca32e0 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 23 type: EXT [307200->311295] (req 307200->311295) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.327756:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca32e0 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 23 type: EXT [307200->311295] (req 307200->311295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531961.327759:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006a8dcc9d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+26:438149:x1731754467422144:12345-10.240.43.64@tcp:3:fio.0 Request processed in 52us (92us total) trans 0 rc 4096/4096
00010000:00010000:0.0:1651531961.327760:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a8889a80 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531961.327761:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca32e0 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 23 type: EXT [307200->311295] (req 307200->311295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531961.327762:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249870
00010000:00010000:0.0:1651531961.327765:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca32e0 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 23 type: EXT [307200->311295] (req 307200->311295) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.327774:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca32e0 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 23 type: EXT [307200->311295] (req 307200->311295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.327777:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca32e0 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 23 type: EXT [307200->311295] (req 307200->311295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531961.328048:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531961.328068:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467422272
00000100:00100000:1.0:1651531961.328080:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249871
00000100:00100000:1.0:1651531961.328082:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009e786cd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+26:438148:x1731754467422272:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531961.328088:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca32e7 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 23 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.328093:0:192755:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca2bb6 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 23 type: EXT [573440->585727] (req 573440->577535) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444f4f expref: 26 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.328097:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531961.328097:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531961.328098:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca32e7 lrc: 4/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 23 type: EXT [577536->581631] (req 577536->581631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.328108:0:192755:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca2bb6 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 23 type: EXT [573440->585727] (req 573440->577535) gid 0 flags: 0x50000000020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444f4f expref: 26 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.328113:0:192755:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca2bb6 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 23 type: EXT [573440->585727] (req 573440->577535) gid 0 flags: 0x70000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444f4f expref: 26 pid: 166113 timeout: 22769 lvb_type: 0
00000100:00100000:1.0:1651531961.328117:0:192755:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000028779db6 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0001_UUID:192755:1731745997354944:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531961.328129:0:192755:0:(client.c:2492:ptlrpc_set_wait()) set 000000001a1ce0e5 going to sleep for 6 seconds
00000100:00100000:1.0:1651531961.328326:0:192755:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000028779db6 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0001_UUID:192755:1731745997354944:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651531961.328330:0:192755:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca32e7 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 23 type: EXT [577536->581631] (req 577536->581631) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531961.328407:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531961.328418:0:166102:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467422336
00010000:00010000:0.0:1651531961.328425:0:166102:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca2bb6 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 23 type: EXT [573440->585727] (req 573440->577535) gid 0 flags: 0x60000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444f4f expref: 27 pid: 166113 timeout: 22769 lvb_type: 0
00000100:00100000:0.0:1651531961.328433:0:166102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 197
00000100:00100000:0.0:1651531961.328435:0:166102:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000edb35b1e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+27:438149:x1731754467422336:12345-10.240.43.64@tcp:103:ldlm_bl_06.0
00010000:00010000:0.0:1651531961.328438:0:166102:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531961.328442:0:166102:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca2bb6 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 24 type: EXT [573440->585727] (req 573440->577535) gid 0 flags: 0x60000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444f4f expref: 27 pid: 166113 timeout: 22769 lvb_type: 0
00010000:00010000:0.0:1651531961.328446:0:166102:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca2bb6 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 24 type: EXT [573440->585727] (req 573440->577535) gid 0 flags: 0x50000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444f4f expref: 27 pid: 166113 timeout: 22769 lvb_type: 0
00010000:00010000:0.0:1651531961.328452:0:166102:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca2bb6 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 24 type: EXT [573440->585727] (req 573440->577535) gid 0 flags: 0x44801400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444f4f expref: 27 pid: 166113 timeout: 22769 lvb_type: 0
00010000:00010000:0.0:1651531961.328456:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531961.328457:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531961.328458:0:166102:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca32e7 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 23 type: EXT [577536->581631] (req 577536->581631) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.328465:0:166102:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca32e7 lrc: 4/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 23 type: EXT [577536->581631] (req 577536->581631) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.328478:0:166102:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651531961.328488:0:166102:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000edb35b1e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+26:438149:x1731754467422336:12345-10.240.43.64@tcp:103:ldlm_bl_06.0 Request processed in 53us (82us total) trans 0 rc 0/0
00010000:00010000:1.0:1651531961.328490:0:192755:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca32e7 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [577536->581631] (req 577536->581631) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531961.328491:0:166102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 197
00010000:00010000:1.0:1651531961.328494:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca32e7 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [577536->581631] (req 577536->581631) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.328506:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca32e7 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [577536->581631] (req 577536->581631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.328509:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca32e7 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [577536->581631] (req 577536->581631) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531961.328535:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009e786cd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+25:438148:x1731754467422272:12345-10.240.43.64@tcp:3:fio.0 Request processed in 441us (476us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531961.328540:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249871
00010000:00010000:0.0:1651531961.328543:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca32e7 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [577536->581631] (req 577536->581631) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.328547:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006da7a892 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531961.328548:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca32e7 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [577536->581631] (req 577536->581631) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.328551:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca32e7 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [577536->581631] (req 577536->581631) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.328556:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca32e7 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [577536->581631] (req 577536->581631) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.328559:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca32e7 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [577536->581631] (req 577536->581631) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531961.328758:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531961.328780:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467422464
00000100:00100000:1.0:1651531961.328792:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249872
00000100:00100000:1.0:1651531961.328794:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008bb4a649 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+25:438149:x1731754467422464:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531961.328800:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca32ee lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.328805:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531961.328805:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531961.328806:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca32ee lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [118784->122879] (req 118784->122879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.328810:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca32ee lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [118784->122879] (req 118784->122879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.328821:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca32ee lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [118784->122879] (req 118784->122879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.328824:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca32ee lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [118784->122879] (req 118784->122879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.328834:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca32ee lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [118784->122879] (req 118784->122879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.328837:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c2b76533 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531961.328840:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca32ee lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [118784->122879] (req 118784->122879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531961.328841:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008bb4a649 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+25:438149:x1731754467422464:12345-10.240.43.64@tcp:3:fio.0 Request processed in 46us (83us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531961.328843:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249872
00010000:00010000:0.0:1651531961.328843:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca32ee lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [118784->122879] (req 118784->122879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.328848:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca32ee lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [118784->122879] (req 118784->122879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.328850:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca32ee lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [118784->122879] (req 118784->122879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531961.351481:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531961.351501:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467422784
00000100:00100000:1.0:1651531961.351516:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249873
00000100:00100000:1.0:1651531961.351518:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b6b1b79d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+25:438146:x1731754467422784:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531961.351529:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca32f5 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.351533:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531961.351534:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531961.351535:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca32f5 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [913408->917503] (req 913408->917503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.351539:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca32f5 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [913408->917503] (req 913408->917503) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.351550:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca32f5 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [913408->917503] (req 913408->917503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.351553:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca32f5 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [913408->917503] (req 913408->917503) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531961.351573:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b6b1b79d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+25:438146:x1731754467422784:12345-10.240.43.64@tcp:3:fio.0 Request processed in 54us (93us total) trans 0 rc 4096/4096
00010000:00010000:0.0:1651531961.351573:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca32f5 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [913408->917503] (req 913408->917503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531961.351576:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249873
00010000:00010000:0.0:1651531961.351578:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d44eb74d already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531961.351579:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca32f5 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [913408->917503] (req 913408->917503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.351582:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca32f5 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [913408->917503] (req 913408->917503) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.351587:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca32f5 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [913408->917503] (req 913408->917503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.351590:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca32f5 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [913408->917503] (req 913408->917503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531961.351861:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531961.351884:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467423104
00000100:00100000:1.0:1651531961.351896:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249874
00000100:00100000:1.0:1651531961.351898:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cb694635 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+25:438147:x1731754467423104:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531961.351905:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca32fc lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.351909:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531961.351910:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531961.351912:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca32fc lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [811008->815103] (req 811008->815103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.351916:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca32fc lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [811008->815103] (req 811008->815103) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.351926:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca32fc lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [811008->815103] (req 811008->815103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.351929:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca32fc lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [811008->815103] (req 811008->815103) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.351939:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca32fc lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [811008->815103] (req 811008->815103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.351943:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c2b76533 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531961.351944:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca32fc lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [811008->815103] (req 811008->815103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531961.351946:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cb694635 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+25:438147:x1731754467423104:12345-10.240.43.64@tcp:3:fio.0 Request processed in 48us (86us total) trans 0 rc 4096/4096
00010000:00010000:0.0:1651531961.351947:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca32fc lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [811008->815103] (req 811008->815103) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531961.351949:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249874
00010000:00010000:0.0:1651531961.351952:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca32fc lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [811008->815103] (req 811008->815103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.351955:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca32fc lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [811008->815103] (req 811008->815103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531961.352035:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531961.352048:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467423232
00000100:00100000:1.0:1651531961.352060:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249875
00000100:00100000:1.0:1651531961.352062:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005ec1cbc3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+25:438148:x1731754467423232:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531961.352076:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3303 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.352080:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531961.352081:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531961.352082:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3303 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [761856->765951] (req 761856->765951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.352086:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3303 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [761856->765951] (req 761856->765951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531961.399184:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531961.399218:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467423488
00000100:00100000:0.0:1651531961.399241:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44424
00000100:00100000:0.0:1651531961.399243:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000028779db6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+28:438149:x1731754467423488:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531961.399247:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531961.399251:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca330a lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 23 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44551b expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.399260:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca330a lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 23 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44551b expref: 29 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531961.399265:0:166112:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca330a lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 23 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44551b expref: 29 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531961.399270:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c1022d42, rc 0)
00000100:00100000:0.0:1651531961.399282:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000028779db6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+28:438149:x1731754467423488:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (98us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531961.399284:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44424
00000100:00100000:1.0:1651531961.400004:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531961.400022:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467423744
00000100:00100000:0.0:1651531961.400034:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249876
00000100:00100000:0.0:1651531961.400036:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000670433b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+28:438148:x1731754467423744:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531961.400043:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca3311 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 23 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.400048:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531961.400048:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531961.400050:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca3311 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 23 type: EXT [299008->303103] (req 299008->303103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.400054:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca3311 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 23 type: EXT [299008->303103] (req 299008->303103) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.400067:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca3311 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 23 type: EXT [299008->303103] (req 299008->303103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.400071:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca3311 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 23 type: EXT [299008->303103] (req 299008->303103) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531961.400086:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000670433b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+28:438148:x1731754467423744:12345-10.240.43.64@tcp:3:fio.0 Request processed in 49us (83us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531961.400093:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249876
00010000:00010000:0.0:1651531961.400100:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca3311 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 23 type: EXT [299008->303103] (req 299008->303103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.400103:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000080362f27 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531961.400104:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca3311 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 23 type: EXT [299008->303103] (req 299008->303103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.400107:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca3311 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 23 type: EXT [299008->303103] (req 299008->303103) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.400111:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca3311 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 23 type: EXT [299008->303103] (req 299008->303103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.400114:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca3311 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 23 type: EXT [299008->303103] (req 299008->303103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531961.409923:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869165 is committed
00010000:00010000:1.0:1651531961.409953:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3303 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [761856->765951] (req 761856->765951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.409958:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3303 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [761856->765951] (req 761856->765951) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531961.409978:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005ec1cbc3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+25:438148:x1731754467423232:12345-10.240.43.64@tcp:4:fio.0 Request processed in 57915us (57943us total) trans 21474869165 rc 0/0
00010000:00010000:0.0:1651531961.409980:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3303 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [761856->765951] (req 761856->765951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531961.409981:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249875
00010000:00010000:0.0:1651531961.409985:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006da7a892 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531961.409986:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3303 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [761856->765951] (req 761856->765951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.409989:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3303 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [761856->765951] (req 761856->765951) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.409998:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3303 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [761856->765951] (req 761856->765951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.410001:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3303 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [761856->765951] (req 761856->765951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531961.432094:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531961.432102:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531961.432115:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467424192
00000100:00100000:0.0:1651531961.432123:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467424256
00000100:00100000:1.0:1651531961.432126:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44425
00000100:00100000:1.0:1651531961.432129:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000315bf4eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+26:438148:x1731754467424192:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651531961.432134:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44426
00000100:00100000:0.0:1651531961.432136:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000065be21ea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+26:438147:x1731754467424256:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531961.432138:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531961.432140:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531961.432142:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3318 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445530 expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.432144:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca331f lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 24 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445537 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.432151:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3318 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 23 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445530 expref: 28 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531961.432153:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca331f lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 24 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445537 expref: 28 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531961.432155:0:166111:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3318 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 24 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445530 expref: 28 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531961.432157:0:166112:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca331f lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 24 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445537 expref: 28 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531961.432159:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a8889a80, rc 0)
00010000:00010000:0.0:1651531961.432161:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000080362f27, rc 0)
00000100:00100000:1.0:1651531961.432169:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000315bf4eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+26:438148:x1731754467424192:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (76us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531961.432169:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000065be21ea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+26:438147:x1731754467424256:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (67us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531961.432172:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44426
00000100:00100000:1.0:1651531961.432175:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44425
00000100:00100000:0.0:1651531961.457152:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531961.457173:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467425024
00000100:00100000:1.0:1651531961.457187:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249877
00000100:00100000:1.0:1651531961.457189:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006c903446 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+25:438148:x1731754467425024:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531961.457196:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3326 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.457201:0:192755:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a4cc8a0d/0x3234de053ca2cce lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [905216->909311] (req 905216->909311) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4451be expref: 25 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.457212:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531961.457213:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531961.457214:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3326 lrc: 4/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [905216->909311] (req 905216->909311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.457233:0:192755:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a4cc8a0d/0x3234de053ca2cce lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [905216->909311] (req 905216->909311) gid 0 flags: 0x50000000020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4451be expref: 25 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.457237:0:192755:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a4cc8a0d/0x3234de053ca2cce lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [905216->909311] (req 905216->909311) gid 0 flags: 0x70000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4451be expref: 25 pid: 166112 timeout: 22770 lvb_type: 0
00000100:00100000:1.0:1651531961.457242:0:192755:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009078ca7d pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0001_UUID:192755:1731745997355008:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531961.457254:0:192755:0:(client.c:2492:ptlrpc_set_wait()) set 000000001a1ce0e5 going to sleep for 6 seconds
00000100:00100000:1.0:1651531961.457464:0:192755:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009078ca7d pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0001_UUID:192755:1731745997355008:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651531961.457469:0:192755:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3326 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [905216->909311] (req 905216->909311) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531961.457524:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531961.457541:0:166103:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467425088
00010000:00010000:0.0:1651531961.457548:0:166103:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a4cc8a0d/0x3234de053ca2cce lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [905216->909311] (req 905216->909311) gid 0 flags: 0x60000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4451be expref: 26 pid: 166112 timeout: 22770 lvb_type: 0
00000100:00100000:0.0:1651531961.457557:0:166103:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 198
00000100:00100000:0.0:1651531961.457558:0:166103:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009078ca7d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+26:438148:x1731754467425088:12345-10.240.43.64@tcp:103:ldlm_bl_01.0
00010000:00010000:0.0:1651531961.457561:0:166103:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531961.457565:0:166103:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a4cc8a0d/0x3234de053ca2cce lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 23 type: EXT [905216->909311] (req 905216->909311) gid 0 flags: 0x60000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4451be expref: 26 pid: 166112 timeout: 22770 lvb_type: 0
00010000:00010000:0.0:1651531961.457569:0:166103:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a4cc8a0d/0x3234de053ca2cce lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 23 type: EXT [905216->909311] (req 905216->909311) gid 0 flags: 0x50000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4451be expref: 26 pid: 166112 timeout: 22770 lvb_type: 0
00010000:00010000:0.0:1651531961.457576:0:166103:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a4cc8a0d/0x3234de053ca2cce lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 23 type: EXT [905216->909311] (req 905216->909311) gid 0 flags: 0x44801400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4451be expref: 26 pid: 166112 timeout: 22770 lvb_type: 0
00010000:00010000:0.0:1651531961.457580:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531961.457581:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531961.457582:0:166103:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3326 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [905216->909311] (req 905216->909311) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.457585:0:166103:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3326 lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [905216->909311] (req 905216->909311) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.457597:0:166103:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651531961.457607:0:166103:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009078ca7d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+25:438148:x1731754467425088:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 48us (83us total) trans 0 rc 0/0
00010000:00010000:1.0:1651531961.457610:0:192755:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3326 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [905216->909311] (req 905216->909311) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531961.457610:0:166103:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 198
00010000:00010000:1.0:1651531961.457614:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3326 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [905216->909311] (req 905216->909311) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531961.504373:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531961.504381:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467425344
00000100:00100000:1.0:1651531961.504390:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44427
00000100:00100000:1.0:1651531961.504392:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dce6a2c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+27:438146:x1731754467425344:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531961.504395:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531961.504399:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca332d lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445545 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.504407:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca332d lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445545 expref: 28 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531961.504412:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca332d lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445545 expref: 28 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531961.504415:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000968553c1, rc 0)
00000100:00100000:1.0:1651531961.504430:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dce6a2c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+27:438146:x1731754467425344:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (58us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531961.504433:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44427
00000100:00100000:1.0:1651531961.505254:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531961.505277:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467425600
00000100:00100000:0.0:1651531961.505291:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249878
00000100:00100000:0.0:1651531961.505293:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dccc50c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+27:438147:x1731754467425600:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531961.505301:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca3334 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.505306:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531961.505306:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531961.505308:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca3334 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [495616->499711] (req 495616->499711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.505312:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca3334 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [495616->499711] (req 495616->499711) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.505325:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca3334 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [495616->499711] (req 495616->499711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.505328:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca3334 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [495616->499711] (req 495616->499711) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531961.505344:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dccc50c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+27:438147:x1731754467425600:12345-10.240.43.64@tcp:3:fio.0 Request processed in 50us (90us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531961.505347:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249878
00010000:00010000:0.0:1651531961.505353:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca3334 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [495616->499711] (req 495616->499711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.505357:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000080362f27 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531961.505358:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca3334 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [495616->499711] (req 495616->499711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.505365:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca3334 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [495616->499711] (req 495616->499711) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.505369:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca3334 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [495616->499711] (req 495616->499711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.505372:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca3334 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [495616->499711] (req 495616->499711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531961.505670:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531961.505681:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467425728
00000100:00100000:0.0:1651531961.505693:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249879
00000100:00100000:0.0:1651531961.505695:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002d3e5ae4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+27:438146:x1731754467425728:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531961.505702:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca333b lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.505706:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531961.505706:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531961.505707:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca333b lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [704512->708607] (req 704512->708607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.505711:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca333b lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [704512->708607] (req 704512->708607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.505722:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca333b lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [704512->708607] (req 704512->708607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.505725:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca333b lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [704512->708607] (req 704512->708607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531961.505743:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002d3e5ae4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+27:438146:x1731754467425728:12345-10.240.43.64@tcp:3:fio.0 Request processed in 48us (73us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531961.505746:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249879
00010000:00010000:0.0:1651531961.505752:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca333b lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [704512->708607] (req 704512->708607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.505756:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c1022d42 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531961.505757:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca333b lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [704512->708607] (req 704512->708607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.505759:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca333b lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [704512->708607] (req 704512->708607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.505764:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca333b lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [704512->708607] (req 704512->708607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.505766:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca333b lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [704512->708607] (req 704512->708607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531961.506044:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531961.506054:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467425856
00000100:00100000:0.0:1651531961.506065:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249880
00000100:00100000:0.0:1651531961.506066:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b67ad021 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+27:438147:x1731754467425856:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531961.506073:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3342 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.506077:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531961.506079:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531961.506080:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3342 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [417792->421887] (req 417792->421887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.506084:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3342 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [417792->421887] (req 417792->421887) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.506094:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3342 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [417792->421887] (req 417792->421887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.506097:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3342 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [417792->421887] (req 417792->421887) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531961.506112:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b67ad021 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+27:438147:x1731754467425856:12345-10.240.43.64@tcp:3:fio.0 Request processed in 45us (68us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531961.506114:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249880
00010000:00010000:0.0:1651531961.506120:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3342 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [417792->421887] (req 417792->421887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.506123:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002c5e01dd already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531961.506124:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3342 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [417792->421887] (req 417792->421887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.506127:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3342 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [417792->421887] (req 417792->421887) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.506131:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3342 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [417792->421887] (req 417792->421887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.506134:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3342 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [417792->421887] (req 417792->421887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531961.506452:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531961.506460:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467425984
00000100:00100000:1.0:1651531961.506466:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44428
00000100:00100000:1.0:1651531961.506468:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ffcdece2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+27:438146:x1731754467425984:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531961.506472:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531961.506475:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3349 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445553 expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.506482:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3349 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445553 expref: 28 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531961.506486:0:166111:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3349 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445553 expref: 28 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531961.506490:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001e36c601, rc 0)
00000100:00100000:1.0:1651531961.506502:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ffcdece2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+27:438146:x1731754467425984:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (50us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531961.506505:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44428
00000001:00080000:0.0:1651531961.516384:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869166 is committed
00010000:00010000:1.0:1651531961.516415:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3326 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [905216->909311] (req 905216->909311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.516419:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3326 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [905216->909311] (req 905216->909311) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531961.516438:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006c903446 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+24:438148:x1731754467425024:12345-10.240.43.64@tcp:4:fio.0 Request processed in 59249us (59287us total) trans 21474869166 rc 0/0
00010000:00010000:0.0:1651531961.516438:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3326 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [905216->909311] (req 905216->909311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.516442:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a8889a80 already unused, calling callback (0000000049fddea7)
00000100:00100000:1.0:1651531961.516443:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249877
00010000:00010000:0.0:1651531961.516444:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3326 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [905216->909311] (req 905216->909311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.516447:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3326 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [905216->909311] (req 905216->909311) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.516452:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3326 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [905216->909311] (req 905216->909311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.516455:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3326 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [905216->909311] (req 905216->909311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531961.516758:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531961.516781:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467426368
00000100:00100000:1.0:1651531961.516790:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44429
00000100:00100000:1.0:1651531961.516791:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001eda4376 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+24:438149:x1731754467426368:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531961.516795:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531961.516798:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3350 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445561 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.516806:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3350 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445561 expref: 25 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531961.516810:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3350 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445561 expref: 25 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531961.516814:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001e36c601, rc 0)
00000100:00100000:1.0:1651531961.516823:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001eda4376 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+24:438149:x1731754467426368:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (66us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531961.516826:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44429
00000100:00100000:0.0:1651531961.528852:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531961.528873:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467426752
00000100:00100000:1.0:1651531961.528888:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249881
00000100:00100000:1.0:1651531961.528890:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f817afea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+24:438148:x1731754467426752:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531961.528896:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3357 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.528901:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531961.528903:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531961.528904:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3357 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [864256->868351] (req 864256->868351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.528908:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3357 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [864256->868351] (req 864256->868351) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.528920:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3357 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [864256->868351] (req 864256->868351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.528923:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3357 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [864256->868351] (req 864256->868351) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531961.528943:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f817afea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+24:438148:x1731754467426752:12345-10.240.43.64@tcp:3:fio.0 Request processed in 53us (91us total) trans 0 rc 4096/4096
00010000:00010000:0.0:1651531961.528944:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3357 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [864256->868351] (req 864256->868351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531961.528946:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249881
00010000:00010000:0.0:1651531961.528949:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001e36c601 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531961.528950:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3357 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [864256->868351] (req 864256->868351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.528953:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3357 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [864256->868351] (req 864256->868351) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.528960:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3357 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [864256->868351] (req 864256->868351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.528963:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3357 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [864256->868351] (req 864256->868351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531961.529279:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531961.529300:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467426880
00000100:00100000:1.0:1651531961.529308:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44430
00000100:00100000:1.0:1651531961.529310:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004237e3f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+24:438149:x1731754467426880:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531961.529313:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531961.529316:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca335e lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44556f expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.529324:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca335e lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44556f expref: 25 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531961.529328:0:166111:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca335e lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44556f expref: 25 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531961.529335:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000968553c1, rc 0)
00000100:00100000:1.0:1651531961.529345:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004237e3f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+24:438149:x1731754467426880:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (66us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531961.529347:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44430
00000100:00100000:0.0:1651531961.529666:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531961.529684:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467427008
00000100:00100000:1.0:1651531961.529699:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249882
00000100:00100000:1.0:1651531961.529701:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f7096c29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+24:438148:x1731754467427008:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531961.529708:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3365 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.529712:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531961.529713:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531961.529714:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3365 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [1024000->1028095] (req 1024000->1028095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.529718:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3365 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [1024000->1028095] (req 1024000->1028095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.529728:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3365 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [1024000->1028095] (req 1024000->1028095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.529731:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3365 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [1024000->1028095] (req 1024000->1028095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.529748:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3365 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [1024000->1028095] (req 1024000->1028095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531961.529750:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f7096c29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+24:438148:x1731754467427008:12345-10.240.43.64@tcp:3:fio.0 Request processed in 48us (85us total) trans 0 rc 4096/4096
00010000:00010000:0.0:1651531961.529753:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e9b84540 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531961.529754:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3365 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [1024000->1028095] (req 1024000->1028095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531961.529756:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249882
00010000:00010000:0.0:1651531961.529757:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3365 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [1024000->1028095] (req 1024000->1028095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.529762:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3365 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [1024000->1028095] (req 1024000->1028095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.529765:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3365 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [1024000->1028095] (req 1024000->1028095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531961.568130:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651531961.568139:0:182071:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951226624
00000100:00100000:0.0:1651531961.568149:0:182071:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 463
00000100:00100000:0.0:1651531961.568151:0:182071:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cebf7380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951226624:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:0.0:1651531961.568158:0:182071:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 351995328 pending 0 free 81277214720 avail 77105729536
00000100:00100000:0.0:1651531961.568175:0:182071:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cebf7380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951226624:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 23us (45us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531961.568178:0:182071:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 463
00000100:00100000:0.0:1651531961.609445:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531961.609466:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467427776
00000100:00100000:1.0:1651531961.609481:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249883
00000100:00100000:1.0:1651531961.609483:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bf4022bf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+24:438146:x1731754467427776:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531961.609490:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca336c lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.609494:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531961.609495:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531961.609496:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca336c lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [446464->450559] (req 446464->450559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.609500:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca336c lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [446464->450559] (req 446464->450559) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531961.609588:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531961.609606:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467427904
00000100:00100000:1.0:1651531961.609615:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44431
00000100:00100000:1.0:1651531961.609616:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007f998d3c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+27:438148:x1731754467427904:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531961.609620:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531961.609623:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3373 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44557d expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.609631:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3373 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44557d expref: 28 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531961.609646:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3373 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44557d expref: 28 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531961.609651:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008558d1b3, rc 0)
00000100:00100000:1.0:1651531961.609665:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007f998d3c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+27:438148:x1731754467427904:12345-10.240.43.64@tcp:101:fio.0 Request processed in 48us (77us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531961.609668:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44431
00000001:00080000:0.0:1651531961.646623:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869167 is committed
00010000:00010000:1.0:1651531961.646652:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca336c lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [446464->450559] (req 446464->450559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.646657:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca336c lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [446464->450559] (req 446464->450559) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531961.646676:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bf4022bf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+24:438146:x1731754467427776:12345-10.240.43.64@tcp:4:fio.0 Request processed in 37192us (37232us total) trans 21474869167 rc 0/0
00000100:00100000:1.0:1651531961.646679:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249883
00010000:00010000:0.0:1651531961.646680:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca336c lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [446464->450559] (req 446464->450559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.646684:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000968553c1 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531961.646686:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca336c lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [446464->450559] (req 446464->450559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.646689:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca336c lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [446464->450559] (req 446464->450559) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.646695:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca336c lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [446464->450559] (req 446464->450559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.646697:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca336c lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [446464->450559] (req 446464->450559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531961.647430:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531961.647446:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467428480
00000100:00100000:1.0:1651531961.647461:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249884
00000100:00100000:1.0:1651531961.647463:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000043b0f16d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+24:438146:x1731754467428480:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531961.647469:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca337a lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.647474:0:192755:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca2d84 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [688128->692223] (req 688128->692223) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4452f9 expref: 24 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.647478:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531961.647478:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531961.647479:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca337a lrc: 4/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [688128->692223] (req 688128->692223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.647490:0:192755:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca2d84 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [688128->692223] (req 688128->692223) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4452f9 expref: 24 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.647494:0:192755:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca2d84 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [688128->692223] (req 688128->692223) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4452f9 expref: 24 pid: 166113 timeout: 22770 lvb_type: 0
00000100:00100000:1.0:1651531961.647498:0:192755:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000053497d pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0001_UUID:192755:1731745997355072:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531961.647511:0:192755:0:(client.c:2492:ptlrpc_set_wait()) set 000000001a1ce0e5 going to sleep for 6 seconds
00000100:00100000:0.0:1651531961.647753:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531961.647761:0:166102:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467428544
00000100:00100000:1.0:1651531961.647764:0:192755:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000053497d pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0001_UUID:192755:1731745997355072:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651531961.647767:0:166102:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca2d84 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [688128->692223] (req 688128->692223) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4452f9 expref: 25 pid: 166113 timeout: 22770 lvb_type: 0
00010000:00010000:1.0:1651531961.647769:0:192755:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca337a lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [688128->692223] (req 688128->692223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531961.647780:0:166102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 199
00000100:00100000:0.0:1651531961.647782:0:166102:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007b76f7f6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+25:438147:x1731754467428544:12345-10.240.43.64@tcp:103:ldlm_bl_03.0
00010000:00010000:0.0:1651531961.647785:0:166102:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531961.647789:0:166102:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca2d84 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [688128->692223] (req 688128->692223) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4452f9 expref: 25 pid: 166113 timeout: 22770 lvb_type: 0
00010000:00010000:0.0:1651531961.647793:0:166102:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca2d84 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [688128->692223] (req 688128->692223) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4452f9 expref: 25 pid: 166113 timeout: 22770 lvb_type: 0
00010000:00010000:0.0:1651531961.647800:0:166102:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca2d84 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [688128->692223] (req 688128->692223) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4452f9 expref: 25 pid: 166113 timeout: 22770 lvb_type: 0
00010000:00010000:0.0:1651531961.647804:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531961.647805:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531961.647806:0:166102:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca337a lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [688128->692223] (req 688128->692223) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.647809:0:166102:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca337a lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [688128->692223] (req 688128->692223) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.647821:0:166102:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651531961.647831:0:166102:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007b76f7f6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+24:438147:x1731754467428544:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 48us (78us total) trans 0 rc 0/0
00010000:00010000:1.0:1651531961.647834:0:192755:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca337a lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [688128->692223] (req 688128->692223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531961.647834:0:166102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 199
00010000:00010000:1.0:1651531961.647838:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca337a lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [688128->692223] (req 688128->692223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531961.670353:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531961.670366:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467428736
00000100:00100000:0.0:1651531961.670385:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249885
00000100:00100000:0.0:1651531961.670389:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000008e0501d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+26:438149:x1731754467428736:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531961.670400:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3381 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.670408:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531961.670409:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531961.670411:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3381 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [274432->278527] (req 274432->278527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.670441:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3381 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [274432->278527] (req 274432->278527) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531961.670569:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531961.670577:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467428928
00000100:00100000:1.0:1651531961.670589:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44432
00000100:00100000:1.0:1651531961.670591:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000053497d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+29:438148:x1731754467428928:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531961.670595:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531961.670599:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca3388 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44558b expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.670610:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca3388 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44558b expref: 30 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531961.670614:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca3388 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44558b expref: 30 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531961.670618:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b4c8742a, rc 0)
00000100:00100000:1.0:1651531961.670631:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000053497d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+29:438148:x1731754467428928:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (63us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531961.670634:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44432
00000100:00100000:1.0:1651531961.671112:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531961.671134:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467429184
00000100:00100000:0.0:1651531961.671147:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249886
00000100:00100000:0.0:1651531961.671149:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000df1eb0d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+29:438149:x1731754467429184:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531961.671156:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca338f lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.671160:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531961.671161:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531961.671162:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca338f lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [552960->557055] (req 552960->557055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.671166:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca338f lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [552960->557055] (req 552960->557055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531961.671685:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531961.671703:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467429440
00000100:00100000:1.0:1651531961.671713:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249887
00000100:00100000:1.0:1651531961.671715:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f99d9ea1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+32:438148:x1731754467429440:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531961.671721:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3396 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 23 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.671726:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531961.671726:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531961.671727:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3396 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 23 type: EXT [970752->974847] (req 970752->974847) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.671731:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3396 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 23 type: EXT [970752->974847] (req 970752->974847) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.671743:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3396 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 23 type: EXT [970752->974847] (req 970752->974847) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.671747:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3396 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 23 type: EXT [970752->974847] (req 970752->974847) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531961.671768:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f99d9ea1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+32:438148:x1731754467429440:12345-10.240.43.64@tcp:3:fio.0 Request processed in 53us (84us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531961.671771:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249887
00010000:00010000:0.0:1651531961.671771:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3396 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 23 type: EXT [970752->974847] (req 970752->974847) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.671776:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000968553c1 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531961.671777:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3396 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 23 type: EXT [970752->974847] (req 970752->974847) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.671781:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3396 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 23 type: EXT [970752->974847] (req 970752->974847) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.671786:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3396 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 23 type: EXT [970752->974847] (req 970752->974847) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.671789:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3396 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 23 type: EXT [970752->974847] (req 970752->974847) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531961.672417:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531961.672428:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467429696
00000100:00100000:1.0:1651531961.672438:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249888
00000100:00100000:1.0:1651531961.672440:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000052cf3c08 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+32:438148:x1731754467429696:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531961.672447:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca339d lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 23 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.672451:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531961.672452:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531961.672453:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca339d lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 23 type: EXT [864256->868351] (req 864256->868351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.672457:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca339d lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 23 type: EXT [864256->868351] (req 864256->868351) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531961.682770:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869168 is committed
00010000:00010000:1.0:1651531961.682796:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca337a lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 23 type: EXT [688128->692223] (req 688128->692223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.682801:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca337a lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 23 type: EXT [688128->692223] (req 688128->692223) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531961.682821:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000043b0f16d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+32:438146:x1731754467428480:12345-10.240.43.64@tcp:4:fio.0 Request processed in 35357us (35392us total) trans 21474869168 rc 0/0
00010000:00010000:0.0:1651531961.682822:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca337a lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 23 type: EXT [688128->692223] (req 688128->692223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531961.682825:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249884
00010000:00010000:0.0:1651531961.682827:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008558d1b3 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531961.682828:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca337a lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 23 type: EXT [688128->692223] (req 688128->692223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.682831:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca337a lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 23 type: EXT [688128->692223] (req 688128->692223) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.682837:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca337a lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 23 type: EXT [688128->692223] (req 688128->692223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.682844:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca337a lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 23 type: EXT [688128->692223] (req 688128->692223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531961.730970:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869171 is committed
00010000:00010000:0.0:1651531961.730993:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3381 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [274432->278527] (req 274432->278527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.730997:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3381 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 23 type: EXT [274432->278527] (req 274432->278527) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.731001:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca339d lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [864256->868351] (req 864256->868351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.731006:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca339d lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [864256->868351] (req 864256->868351) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531961.731019:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000008e0501d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+25:438149:x1731754467428736:12345-10.240.43.64@tcp:4:fio.0 Request processed in 60630us (60667us total) trans 21474869169 rc 0/0
00000100:00100000:1.0:1651531961.731022:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000052cf3c08 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+25:438148:x1731754467429696:12345-10.240.43.64@tcp:4:fio.0 Request processed in 58581us (58605us total) trans 21474869171 rc 0/0
00000100:00100000:0.0:1651531961.731023:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249885
00000100:00100000:1.0:1651531961.731025:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249888
00010000:00010000:0.0:1651531961.731031:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3381 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [274432->278527] (req 274432->278527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.731034:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002c5e01dd already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531961.731035:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3381 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [274432->278527] (req 274432->278527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.731038:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3381 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [274432->278527] (req 274432->278527) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.731046:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca338f lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [552960->557055] (req 552960->557055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.731050:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca338f lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [552960->557055] (req 552960->557055) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.731053:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3381 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [274432->278527] (req 274432->278527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.731061:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3381 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 22 type: EXT [274432->278527] (req 274432->278527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531961.731062:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000df1eb0d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+23:438149:x1731754467429184:12345-10.240.43.64@tcp:4:fio.0 Request processed in 59913us (59951us total) trans 21474869170 rc 0/0
00000100:00100000:1.0:1651531961.731065:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249886
00010000:00010000:0.0:1651531961.731066:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca339d lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [864256->868351] (req 864256->868351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.731069:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e9b84540 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531961.731070:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca339d lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [864256->868351] (req 864256->868351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.731072:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca339d lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [864256->868351] (req 864256->868351) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.731076:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca339d lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [864256->868351] (req 864256->868351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.731078:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca339d lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [864256->868351] (req 864256->868351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.731081:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca338f lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [552960->557055] (req 552960->557055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.731084:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c1022d42 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531961.731085:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca338f lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [552960->557055] (req 552960->557055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.731087:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca338f lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [552960->557055] (req 552960->557055) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.731091:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca338f lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [552960->557055] (req 552960->557055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.731095:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca338f lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [552960->557055] (req 552960->557055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531961.731322:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531961.731330:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467430144
00000100:00100000:1.0:1651531961.731339:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249889
00000100:00100000:1.0:1651531961.731341:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004d249e37 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+23:438147:x1731754467430144:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531961.731348:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca33a4 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.731352:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531961.731363:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531961.731365:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca33a4 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [143360->147455] (req 143360->147455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.731369:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca33a4 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [143360->147455] (req 143360->147455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.731381:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca33a4 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [143360->147455] (req 143360->147455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.731384:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca33a4 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [143360->147455] (req 143360->147455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531961.731399:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004d249e37 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+23:438147:x1731754467430144:12345-10.240.43.64@tcp:3:fio.0 Request processed in 57us (77us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531961.731401:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249889
00010000:00010000:1.0:1651531961.731407:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca33a4 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [143360->147455] (req 143360->147455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.731411:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b4c8742a already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531961.731412:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca33a4 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [143360->147455] (req 143360->147455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.731415:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca33a4 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [143360->147455] (req 143360->147455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.731419:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca33a4 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [143360->147455] (req 143360->147455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.731422:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca33a4 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [143360->147455] (req 143360->147455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531961.731501:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531961.731510:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467430336
00000100:00100000:1.0:1651531961.731520:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44433
00000100:00100000:1.0:1651531961.731522:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009c93d7f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+23:438146:x1731754467430336:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531961.731526:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531961.731529:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca33ab lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445599 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.731537:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca33ab lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445599 expref: 24 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531961.731541:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca33ab lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445599 expref: 24 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531961.731545:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001e36c601, rc 0)
00000100:00100000:1.0:1651531961.731554:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009c93d7f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+23:438146:x1731754467430336:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (54us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531961.731557:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44433
00000100:00100000:1.0:1651531961.731786:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531961.731794:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531961.731800:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467430656
00000100:00100000:1.0:1651531961.731813:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44434
00000100:00100000:1.0:1651531961.731815:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007d76765b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+23:438146:x1731754467430656:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531961.731818:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531961.731821:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca33b2 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4455a7 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.731837:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca33b2 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4455a7 expref: 24 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531961.731841:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca33b2 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4455a7 expref: 24 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531961.731845:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a8889a80, rc 0)
00000100:00100000:1.0:1651531961.731855:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007d76765b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+23:438146:x1731754467430656:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (60us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531961.731857:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44434
00000100:00100000:1.0:1651531961.731864:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467430528
00000100:00100000:1.0:1651531961.731872:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249890
00000100:00100000:1.0:1651531961.731873:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000942b56fd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+23:438147:x1731754467430528:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531961.731879:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca33b9 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.731883:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531961.731884:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531961.731885:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca33b9 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [552960->557055] (req 552960->557055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.731888:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca33b9 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [552960->557055] (req 552960->557055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.731899:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca33b9 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [552960->557055] (req 552960->557055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.731913:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca33b9 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [552960->557055] (req 552960->557055) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.731931:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca33b9 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [552960->557055] (req 552960->557055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531961.731932:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000942b56fd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+23:438147:x1731754467430528:12345-10.240.43.64@tcp:3:fio.0 Request processed in 58us (146us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531961.731935:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249890
00010000:00010000:0.0:1651531961.731935:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006da7a892 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531961.731936:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca33b9 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [552960->557055] (req 552960->557055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.731939:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca33b9 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [552960->557055] (req 552960->557055) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.731944:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca33b9 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [552960->557055] (req 552960->557055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.731947:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca33b9 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [552960->557055] (req 552960->557055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531961.732954:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531961.732962:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531961.732969:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467431424
00000100:00100000:1.0:1651531961.732982:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44435
00000100:00100000:1.0:1651531961.732984:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000033696ffa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+23:438147:x1731754467431424:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531961.732987:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531961.732991:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca33c0 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4455b5 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531961.732995:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467431552
00010000:00010000:1.0:1651531961.732998:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca33c0 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4455b5 expref: 25 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531961.733002:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca33c0 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4455b5 expref: 25 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531961.733006:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c2b76533, rc 0)
00000100:00100000:0.0:1651531961.733011:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249891
00000100:00100000:0.0:1651531961.733013:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000427633c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+24:438147:x1731754467431552:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651531961.733021:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000033696ffa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+24:438147:x1731754467431424:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (68us total) trans 0 rc 301/301
00010000:00010000:0.0:1651531961.733023:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca33c7 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531961.733024:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44435
00010000:00010000:0.0:1651531961.733028:0:216321:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca2e4f lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [585728->589823] (req 585728->589823) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4454b9 expref: 23 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.733035:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531961.733036:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531961.733036:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca33c7 lrc: 4/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [585728->589823] (req 585728->589823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.733044:0:216321:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca2e4f lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [585728->589823] (req 585728->589823) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4454b9 expref: 23 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.733048:0:216321:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca2e4f lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [585728->589823] (req 585728->589823) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4454b9 expref: 23 pid: 166112 timeout: 22770 lvb_type: 0
00000100:00100000:0.0:1651531961.733052:0:216321:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000b1a9136 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997355136:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531961.733072:0:216321:0:(client.c:2492:ptlrpc_set_wait()) set 00000000023652cf going to sleep for 6 seconds
00000100:00100000:0.0:1651531961.733381:0:216321:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000b1a9136 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997355136:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651531961.733386:0:216321:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca33c7 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [585728->589823] (req 585728->589823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531961.733427:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531961.733443:0:166103:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467431744
00010000:00010000:0.0:1651531961.733449:0:166103:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca2e4f lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [585728->589823] (req 585728->589823) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4454b9 expref: 24 pid: 166112 timeout: 22770 lvb_type: 0
00000100:00100000:0.0:1651531961.733458:0:166103:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 200
00000100:00100000:0.0:1651531961.733459:0:166103:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a899ddab pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+24:438148:x1731754467431744:12345-10.240.43.64@tcp:103:ldlm_bl_06.0
00010000:00010000:0.0:1651531961.733463:0:166103:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531961.733467:0:166103:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca2e4f lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [585728->589823] (req 585728->589823) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4454b9 expref: 24 pid: 166112 timeout: 22770 lvb_type: 0
00010000:00010000:0.0:1651531961.733472:0:166103:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca2e4f lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [585728->589823] (req 585728->589823) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4454b9 expref: 24 pid: 166112 timeout: 22770 lvb_type: 0
00010000:00010000:0.0:1651531961.733478:0:166103:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca2e4f lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [585728->589823] (req 585728->589823) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4454b9 expref: 24 pid: 166112 timeout: 22770 lvb_type: 0
00010000:00010000:0.0:1651531961.733482:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531961.733482:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531961.733483:0:166103:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca33c7 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [585728->589823] (req 585728->589823) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.733487:0:166103:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca33c7 lrc: 4/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [585728->589823] (req 585728->589823) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.733493:0:166103:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651531961.733510:0:166103:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a899ddab pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+23:438148:x1731754467431744:12345-10.240.43.64@tcp:103:ldlm_bl_06.0 Request processed in 49us (83us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531961.733513:0:166103:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 200
00010000:00010000:0.0:1651531961.733521:0:216321:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca33c7 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [585728->589823] (req 585728->589823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.733524:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca33c7 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [585728->589823] (req 585728->589823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.733536:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca33c7 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [585728->589823] (req 585728->589823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.733539:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca33c7 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [585728->589823] (req 585728->589823) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531961.733557:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000427633c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+22:438147:x1731754467431552:12345-10.240.43.64@tcp:3:fio.0 Request processed in 544us (595us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531961.733561:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249891
00010000:00010000:0.0:1651531961.733567:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca33c7 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [585728->589823] (req 585728->589823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.733570:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000080362f27 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531961.733571:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca33c7 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [585728->589823] (req 585728->589823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.733574:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca33c7 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [585728->589823] (req 585728->589823) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.733579:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca33c7 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [585728->589823] (req 585728->589823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.733581:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca33c7 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [585728->589823] (req 585728->589823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531961.733703:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531961.733710:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467431872
00000100:00100000:1.0:1651531961.733721:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44436
00000100:00100000:1.0:1651531961.733722:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b10bc064 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+22:438146:x1731754467431872:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531961.733726:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531961.733729:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca33ce lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4455c3 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.733737:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca33ce lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4455c3 expref: 23 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531961.733741:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca33ce lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4455c3 expref: 23 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531961.733744:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d44eb74d, rc 0)
00000100:00100000:1.0:1651531961.733753:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b10bc064 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+22:438146:x1731754467431872:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (51us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531961.733756:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44436
00000100:00100000:1.0:1651531961.734019:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531961.734026:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467432000
00000100:00100000:1.0:1651531961.734038:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44437
00000100:00100000:1.0:1651531961.734040:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000099b6616a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+22:438146:x1731754467432000:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531961.734043:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531961.734047:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca33d5 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4455d1 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.734057:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca33d5 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4455d1 expref: 23 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531961.734061:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca33d5 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4455d1 expref: 23 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531961.734065:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008558d1b3, rc 0)
00000100:00100000:1.0:1651531961.734074:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000099b6616a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+22:438146:x1731754467432000:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (56us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531961.734077:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44437
00000100:00100000:1.0:1651531961.734780:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531961.734797:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467432512
00000100:00100000:0.0:1651531961.734813:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249892
00000100:00100000:0.0:1651531961.734815:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d76314b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+22:438147:x1731754467432512:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531961.734822:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca33dc lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.734826:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531961.734828:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531961.734829:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca33dc lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [643072->647167] (req 643072->647167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.734833:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca33dc lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [643072->647167] (req 643072->647167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531961.780497:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869172 is committed
00010000:00010000:0.0:1651531961.780512:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca33dc lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [643072->647167] (req 643072->647167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.780516:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca33dc lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [643072->647167] (req 643072->647167) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531961.780537:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d76314b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+22:438147:x1731754467432512:12345-10.240.43.64@tcp:4:fio.0 Request processed in 45721us (45758us total) trans 21474869172 rc 0/0
00010000:00010000:1.0:1651531961.780540:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca33dc lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [643072->647167] (req 643072->647167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531961.780541:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249892
00010000:00010000:1.0:1651531961.780544:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c1022d42 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531961.780545:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca33dc lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [643072->647167] (req 643072->647167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.780548:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca33dc lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [643072->647167] (req 643072->647167) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.780554:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca33dc lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [643072->647167] (req 643072->647167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.780557:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca33dc lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [643072->647167] (req 643072->647167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531961.780886:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531961.780902:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467432768
00000100:00100000:0.0:1651531961.780917:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249893
00000100:00100000:0.0:1651531961.780919:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008b42dfe9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+22:438146:x1731754467432768:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531961.780926:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca33e3 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.780931:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531961.780932:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531961.780933:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca33e3 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [589824->593919] (req 589824->593919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.780937:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca33e3 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [589824->593919] (req 589824->593919) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531961.781315:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531961.781324:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467433152
00000100:00100000:1.0:1651531961.781337:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249894
00000100:00100000:1.0:1651531961.781339:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000b1a9136 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+25:438146:x1731754467433152:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531961.781346:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca33ea lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.781350:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531961.781351:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531961.781351:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca33ea lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [516096->520191] (req 516096->520191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.781355:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca33ea lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [516096->520191] (req 516096->520191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531961.805086:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869173 is committed
00010000:00010000:1.0:1651531961.805119:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca33e3 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [589824->593919] (req 589824->593919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.805123:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca33e3 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [589824->593919] (req 589824->593919) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531961.805142:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008b42dfe9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+25:438146:x1731754467432768:12345-10.240.43.64@tcp:4:fio.0 Request processed in 24222us (24257us total) trans 21474869173 rc 0/0
00010000:00010000:0.0:1651531961.805142:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca33e3 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [589824->593919] (req 589824->593919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531961.805145:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249893
00010000:00010000:0.0:1651531961.805149:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000080362f27 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531961.805151:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca33e3 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [589824->593919] (req 589824->593919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.805156:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca33e3 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [589824->593919] (req 589824->593919) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.805165:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca33e3 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [589824->593919] (req 589824->593919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.805168:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca33e3 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [589824->593919] (req 589824->593919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531961.908289:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869174 is committed
00010000:00010000:1.0:1651531961.908320:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca33ea lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [516096->520191] (req 516096->520191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.908328:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca33ea lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [516096->520191] (req 516096->520191) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531961.908349:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000b1a9136 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+22:438146:x1731754467433152:12345-10.240.43.64@tcp:4:fio.0 Request processed in 127009us (127035us total) trans 21474869174 rc 0/0
00010000:00010000:0.0:1651531961.908351:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca33ea lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [516096->520191] (req 516096->520191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531961.908352:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249894
00010000:00010000:0.0:1651531961.908356:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008558d1b3 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531961.908357:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca33ea lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [516096->520191] (req 516096->520191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.908360:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca33ea lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [516096->520191] (req 516096->520191) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.908368:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca33ea lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [516096->520191] (req 516096->520191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.908371:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca33ea lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [516096->520191] (req 516096->520191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531961.908935:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531961.908943:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467433920
00000100:00100000:1.0:1651531961.908953:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249895
00000100:00100000:1.0:1651531961.908955:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b97e3b28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+22:438148:x1731754467433920:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531961.908961:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca33f1 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.908966:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531961.908967:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531961.908968:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca33f1 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [409600->413695] (req 409600->413695) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.908972:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca33f1 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [409600->413695] (req 409600->413695) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531961.957202:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531961.957236:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531961.957246:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467434112
00000100:00100000:1.0:1651531961.957253:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44438
00000100:00100000:1.0:1651531961.957255:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a20162bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+25:438148:x1731754467434112:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651531961.957259:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467434176
00010000:00010000:1.0:1651531961.957261:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531961.957265:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca33f8 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4455df expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531961.957272:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249896
00010000:00010000:1.0:1651531961.957273:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca33f8 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4455df expref: 27 pid: 166113 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651531961.957274:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f3a0807 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+27:438146:x1731754467434176:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531961.957277:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca33f8 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4455df expref: 27 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531961.957281:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c2b76533, rc 0)
00010000:00010000:0.0:1651531961.957282:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca33ff lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531961.957287:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531961.957287:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531961.957289:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca33ff lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [40960->45055] (req 40960->45055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531961.957291:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a20162bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+26:438148:x1731754467434112:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (68us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531961.957293:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44438
00010000:00010000:0.0:1651531961.957293:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca33ff lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [40960->45055] (req 40960->45055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531961.967889:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869175 is committed
00010000:00010000:1.0:1651531961.967917:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca33f1 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [409600->413695] (req 409600->413695) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.967921:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca33f1 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [409600->413695] (req 409600->413695) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531961.967936:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b97e3b28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+25:438148:x1731754467433920:12345-10.240.43.64@tcp:4:fio.0 Request processed in 58980us (59002us total) trans 21474869175 rc 0/0
00000100:00100000:1.0:1651531961.967939:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249895
00010000:00010000:1.0:1651531961.967946:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca33f1 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [409600->413695] (req 409600->413695) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.967949:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d44eb74d already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531961.967952:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca33f1 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [409600->413695] (req 409600->413695) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.967955:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca33f1 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [409600->413695] (req 409600->413695) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.967959:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca33f1 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [409600->413695] (req 409600->413695) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.967962:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca33f1 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [409600->413695] (req 409600->413695) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531961.968300:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531961.968308:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467434560
00000100:00100000:1.0:1651531961.968318:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249897
00000100:00100000:1.0:1651531961.968319:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002ae2aeac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+25:438149:x1731754467434560:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531961.968335:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3406 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.968339:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531961.968340:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531961.968341:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3406 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [466944->471039] (req 466944->471039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531961.968345:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3406 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [466944->471039] (req 466944->471039) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531962.029482:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531962.029490:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467434816
00000100:00100000:1.0:1651531962.029501:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249898
00000100:00100000:1.0:1651531962.029503:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000329eeeee pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+28:438149:x1731754467434816:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531962.029510:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca340d lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.029514:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531962.029515:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531962.029516:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca340d lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [770048->774143] (req 770048->774143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.029520:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca340d lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [770048->774143] (req 770048->774143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.029531:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca340d lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [770048->774143] (req 770048->774143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.029534:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca340d lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [770048->774143] (req 770048->774143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531962.029555:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000329eeeee pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+28:438149:x1731754467434816:12345-10.240.43.64@tcp:3:fio.0 Request processed in 51us (74us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531962.029558:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249898
00010000:00010000:0.0:1651531962.029559:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca340d lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [770048->774143] (req 770048->774143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.029564:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d44eb74d already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531962.029565:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca340d lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [770048->774143] (req 770048->774143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.029572:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca340d lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [770048->774143] (req 770048->774143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.029578:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca340d lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [770048->774143] (req 770048->774143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.029581:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca340d lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [770048->774143] (req 770048->774143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531962.041504:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869177 is committed
00010000:00010000:0.0:1651531962.041526:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca33ff lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [40960->45055] (req 40960->45055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.041530:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca33ff lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [40960->45055] (req 40960->45055) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.041535:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3406 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [466944->471039] (req 466944->471039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.041539:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3406 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [466944->471039] (req 466944->471039) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531962.041550:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f3a0807 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+23:438146:x1731754467434176:12345-10.240.43.64@tcp:4:fio.0 Request processed in 84275us (84349us total) trans 21474869176 rc 0/0
00000100:00100000:0.0:1651531962.041554:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249896
00000100:00100000:1.0:1651531962.041558:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002ae2aeac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+22:438149:x1731754467434560:12345-10.240.43.64@tcp:4:fio.0 Request processed in 73238us (73259us total) trans 21474869177 rc 0/0
00010000:00010000:0.0:1651531962.041562:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca33ff lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [40960->45055] (req 40960->45055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531962.041563:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249897
00010000:00010000:0.0:1651531962.041565:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000080362f27 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531962.041566:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca33ff lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [40960->45055] (req 40960->45055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.041569:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca33ff lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [40960->45055] (req 40960->45055) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.041570:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3406 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [466944->471039] (req 466944->471039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.041573:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c2b76533 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531962.041576:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3406 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [466944->471039] (req 466944->471039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.041576:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca33ff lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [40960->45055] (req 40960->45055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.041579:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3406 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [466944->471039] (req 466944->471039) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.041579:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca33ff lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 21 type: EXT [40960->45055] (req 40960->45055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.041584:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3406 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [466944->471039] (req 466944->471039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.041587:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3406 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [466944->471039] (req 466944->471039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531962.041912:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531962.041921:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531962.041927:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467435200
00000100:00100000:1.0:1651531962.041941:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44439
00000100:00100000:1.0:1651531962.041942:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+22:438147:x1731754467435200:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531962.041946:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531962.041950:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3414 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4455ed expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.041957:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3414 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4455ed expref: 23 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531962.041971:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3414 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4455ed expref: 23 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531962.041975:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a8889a80, rc 0)
00000100:00100000:1.0:1651531962.041989:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+22:438147:x1731754467435200:12345-10.240.43.64@tcp:101:fio.0 Request processed in 46us (77us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531962.041992:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44439
00000100:00100000:1.0:1651531962.042000:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467435136
00000100:00100000:1.0:1651531962.042011:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249899
00000100:00100000:1.0:1651531962.042013:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000567318ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+22:438148:x1731754467435136:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531962.042029:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca341b lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.042034:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531962.042034:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531962.042036:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca341b lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [200704->204799] (req 200704->204799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.042039:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca341b lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [200704->204799] (req 200704->204799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.042051:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca341b lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [200704->204799] (req 200704->204799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.042054:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca341b lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [200704->204799] (req 200704->204799) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.042084:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca341b lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [200704->204799] (req 200704->204799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531962.042085:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000567318ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+22:438148:x1731754467435136:12345-10.240.43.64@tcp:3:fio.0 Request processed in 72us (164us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531962.042088:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249899
00010000:00010000:0.0:1651531962.042088:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001e36c601 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531962.042089:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca341b lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [200704->204799] (req 200704->204799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.042092:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca341b lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [200704->204799] (req 200704->204799) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.042098:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca341b lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [200704->204799] (req 200704->204799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.042101:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca341b lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [200704->204799] (req 200704->204799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531962.043239:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531962.043256:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467435712
00000100:00100000:1.0:1651531962.043272:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249900
00000100:00100000:1.0:1651531962.043273:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000f4bed26 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+22:438147:x1731754467435712:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531962.043280:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca3422 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.043285:0:166118:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000369400b3/0x3234de053ca2c88 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [397312->401407] (req 397312->401407) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44510f expref: 22 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.043288:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531962.043289:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531962.043290:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca3422 lrc: 4/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [397312->401407] (req 397312->401407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.043297:0:166118:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000369400b3/0x3234de053ca2c88 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [397312->401407] (req 397312->401407) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44510f expref: 22 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.043301:0:166118:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000369400b3/0x3234de053ca2c88 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [397312->401407] (req 397312->401407) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44510f expref: 22 pid: 166113 timeout: 22770 lvb_type: 0
00000100:00100000:1.0:1651531962.043305:0:166118:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d9e74b4c pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:166118:1731745997355200:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531962.043318:0:166118:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fc7d2635 going to sleep for 6 seconds
00000100:00100000:1.0:1651531962.043516:0:166118:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d9e74b4c pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:166118:1731745997355200:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651531962.043530:0:166118:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca3422 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [397312->401407] (req 397312->401407) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531962.043601:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531962.043615:0:166102:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467435776
00010000:00010000:0.0:1651531962.043623:0:166102:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000369400b3/0x3234de053ca2c88 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [397312->401407] (req 397312->401407) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44510f expref: 23 pid: 166113 timeout: 22770 lvb_type: 0
00000100:00100000:0.0:1651531962.043631:0:166102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 201
00000100:00100000:0.0:1651531962.043634:0:166102:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d9e74b4c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+23:438148:x1731754467435776:12345-10.240.43.64@tcp:103:ldlm_bl_01.0
00010000:00010000:0.0:1651531962.043638:0:166102:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531962.043642:0:166102:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000369400b3/0x3234de053ca2c88 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [397312->401407] (req 397312->401407) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44510f expref: 23 pid: 166113 timeout: 22770 lvb_type: 0
00010000:00010000:0.0:1651531962.043646:0:166102:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000369400b3/0x3234de053ca2c88 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [397312->401407] (req 397312->401407) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44510f expref: 23 pid: 166113 timeout: 22770 lvb_type: 0
00010000:00010000:0.0:1651531962.043652:0:166102:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000369400b3/0x3234de053ca2c88 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [397312->401407] (req 397312->401407) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44510f expref: 23 pid: 166113 timeout: 22770 lvb_type: 0
00010000:00010000:0.0:1651531962.043656:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531962.043657:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531962.043658:0:166102:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca3422 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [397312->401407] (req 397312->401407) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.043662:0:166102:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca3422 lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [397312->401407] (req 397312->401407) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.043675:0:166102:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1651531962.043682:0:166118:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca3422 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 18 type: EXT [397312->401407] (req 397312->401407) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531962.043685:0:166102:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d9e74b4c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+22:438148:x1731754467435776:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 50us (84us total) trans 0 rc 0/0
00010000:00010000:1.0:1651531962.043686:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca3422 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 18 type: EXT [397312->401407] (req 397312->401407) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531962.043688:0:166102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 201
00000001:00080000:0.0:1651531962.087029:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869178 is committed
00002000:00010000:1.0:1651531962.087056:0:166118:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x34545:0x0] updating lvb mtime from disk: 1651531961 -> 1651531962
00002000:00010000:1.0:1651531962.087058:0:166118:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x34545:0x0] updating lvb ctime from disk: 1651531961 -> 1651531962
00010000:00010000:1.0:1651531962.087060:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca3422 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 18 type: EXT [397312->401407] (req 397312->401407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.087064:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca3422 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 18 type: EXT [397312->401407] (req 397312->401407) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531962.087084:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000f4bed26 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438147:x1731754467435712:12345-10.240.43.64@tcp:4:fio.0 Request processed in 43809us (43845us total) trans 21474869178 rc 0/0
00010000:00010000:0.0:1651531962.087086:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca3422 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 18 type: EXT [397312->401407] (req 397312->401407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531962.087087:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249900
00010000:00010000:0.0:1651531962.087090:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b4c8742a already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531962.087093:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca3422 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 18 type: EXT [397312->401407] (req 397312->401407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.087096:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca3422 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 18 type: EXT [397312->401407] (req 397312->401407) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.087102:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca3422 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 18 type: EXT [397312->401407] (req 397312->401407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.087104:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca3422 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 18 type: EXT [397312->401407] (req 397312->401407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531962.087425:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531962.087441:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467436032
00000100:00100000:1.0:1651531962.087453:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249901
00000100:00100000:1.0:1651531962.087455:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001e61ed2d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438146:x1731754467436032:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531962.087462:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3429 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 18 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.087466:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531962.087476:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531962.087478:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3429 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 18 type: EXT [4096->8191] (req 4096->8191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.087482:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3429 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 18 type: EXT [4096->8191] (req 4096->8191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531962.111748:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869179 is committed
00010000:00010000:1.0:1651531962.111775:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3429 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 18 type: EXT [4096->8191] (req 4096->8191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.111779:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3429 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 18 type: EXT [4096->8191] (req 4096->8191) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531962.111795:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001e61ed2d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438146:x1731754467436032:12345-10.240.43.64@tcp:4:fio.0 Request processed in 24339us (24371us total) trans 21474869179 rc 0/0
00000100:00100000:1.0:1651531962.111798:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249901
00010000:00010000:1.0:1651531962.111804:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3429 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 18 type: EXT [4096->8191] (req 4096->8191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.111808:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a8889a80 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531962.111809:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3429 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 18 type: EXT [4096->8191] (req 4096->8191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.111812:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3429 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 18 type: EXT [4096->8191] (req 4096->8191) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.111816:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3429 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 18 type: EXT [4096->8191] (req 4096->8191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.111819:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3429 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 18 type: EXT [4096->8191] (req 4096->8191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531962.112111:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531962.112128:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467436416
00000100:00100000:1.0:1651531962.112143:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249902
00000100:00100000:1.0:1651531962.112145:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c683c211 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438146:x1731754467436416:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531962.112152:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3430 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 18 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.112156:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531962.112156:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531962.112157:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3430 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 18 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.112161:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3430 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 18 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531962.123567:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531962.123581:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467436544
00000100:00100000:0.0:1651531962.123599:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249903
00000100:00100000:0.0:1651531962.123601:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009acffcb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+24:438146:x1731754467436544:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531962.123609:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca3437 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.123614:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531962.123614:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531962.123616:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca3437 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [577536->581631] (req 577536->581631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.123620:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca3437 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [577536->581631] (req 577536->581631) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531962.134980:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869180 is committed
00010000:00010000:1.0:1651531962.135009:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3430 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.135013:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3430 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531962.135034:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c683c211 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+24:438146:x1731754467436416:12345-10.240.43.64@tcp:4:fio.0 Request processed in 22888us (22924us total) trans 21474869180 rc 0/0
00000100:00100000:1.0:1651531962.135037:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249902
00010000:00010000:0.0:1651531962.135038:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3430 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.135043:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c2b76533 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531962.135044:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3430 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.135047:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3430 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.135053:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3430 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.135056:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3430 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531962.184064:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869181 is committed
00010000:00010000:0.0:1651531962.184080:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca3437 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 18 type: EXT [577536->581631] (req 577536->581631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.184084:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca3437 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 18 type: EXT [577536->581631] (req 577536->581631) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531962.184106:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009acffcb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438146:x1731754467436544:12345-10.240.43.64@tcp:4:fio.0 Request processed in 60504us (60540us total) trans 21474869181 rc 0/0
00000100:00100000:0.0:1651531962.184110:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249903
00010000:00010000:0.0:1651531962.184119:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca3437 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 18 type: EXT [577536->581631] (req 577536->581631) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.184122:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000080362f27 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531962.184123:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca3437 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 18 type: EXT [577536->581631] (req 577536->581631) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.184126:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca3437 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 18 type: EXT [577536->581631] (req 577536->581631) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.184131:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca3437 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 18 type: EXT [577536->581631] (req 577536->581631) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.184134:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca3437 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 18 type: EXT [577536->581631] (req 577536->581631) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531962.184420:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531962.184428:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467437056
00000100:00100000:1.0:1651531962.184440:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44440
00000100:00100000:1.0:1651531962.184443:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000054ed0749 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438147:x1731754467437056:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531962.184447:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531962.184451:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca343e lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 18 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4455fb expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.184459:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca343e lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 18 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4455fb expref: 22 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531962.184464:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca343e lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 18 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4455fb expref: 22 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531962.184467:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a8889a80, rc 0)
00000100:00100000:1.0:1651531962.184477:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000054ed0749 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438147:x1731754467437056:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (58us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531962.184480:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44440
00000100:00100000:1.0:1651531962.185236:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531962.185243:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467437312
00000100:00100000:1.0:1651531962.185256:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44441
00000100:00100000:1.0:1651531962.185257:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ffcc974c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438146:x1731754467437312:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531962.185261:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531962.185264:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3445 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 18 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445609 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.185272:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3445 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 18 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445609 expref: 22 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531962.185279:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3445 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 18 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445609 expref: 22 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531962.185283:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000968553c1, rc 0)
00000100:00100000:1.0:1651531962.185292:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ffcc974c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438146:x1731754467437312:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (57us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531962.185295:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44441
00000100:00100000:1.0:1651531962.219887:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531962.219910:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467438016
00000100:00100000:0.0:1651531962.219927:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249904
00000100:00100000:0.0:1651531962.219928:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003ffbc5dc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438147:x1731754467438016:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531962.219936:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca344c lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 18 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.219940:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531962.219941:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531962.219942:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca344c lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 18 type: EXT [520192->524287] (req 520192->524287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.219946:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca344c lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 18 type: EXT [520192->524287] (req 520192->524287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.219962:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca344c lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 18 type: EXT [520192->524287] (req 520192->524287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.219966:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca344c lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 18 type: EXT [520192->524287] (req 520192->524287) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531962.219985:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003ffbc5dc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438147:x1731754467438016:12345-10.240.43.64@tcp:3:fio.0 Request processed in 56us (98us total) trans 0 rc 4096/4096
00010000:00010000:1.0:1651531962.219987:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca344c lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 18 type: EXT [520192->524287] (req 520192->524287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531962.219988:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249904
00010000:00010000:1.0:1651531962.219992:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000080362f27 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531962.219993:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca344c lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 18 type: EXT [520192->524287] (req 520192->524287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.219996:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca344c lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 18 type: EXT [520192->524287] (req 520192->524287) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.220001:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca344c lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 18 type: EXT [520192->524287] (req 520192->524287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.220004:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca344c lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 18 type: EXT [520192->524287] (req 520192->524287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531962.220088:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531962.220103:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467438208
00000100:00100000:1.0:1651531962.220115:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44442
00000100:00100000:1.0:1651531962.220117:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c43262d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438148:x1731754467438208:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531962.220120:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531962.220124:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3453 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 18 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445617 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.220131:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3453 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 18 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445617 expref: 22 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531962.220135:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3453 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 18 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445617 expref: 22 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531962.220139:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000968553c1, rc 0)
00000100:00100000:1.0:1651531962.220153:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c43262d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438148:x1731754467438208:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (65us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531962.220155:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44442
00000100:00100000:1.0:1651531962.220346:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531962.220354:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467438336
00000100:00100000:1.0:1651531962.220364:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44443
00000100:00100000:1.0:1651531962.220366:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001304ce4c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438147:x1731754467438336:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531962.220369:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531962.220373:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca345a lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 18 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445625 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.220379:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca345a lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 18 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445625 expref: 22 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531962.220387:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca345a lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 18 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445625 expref: 22 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531962.220391:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a8889a80, rc 0)
00000100:00100000:1.0:1651531962.220402:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001304ce4c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438147:x1731754467438336:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (56us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531962.220405:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44443
00000100:00100000:1.0:1651531962.244508:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531962.244516:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467438784
00000100:00100000:1.0:1651531962.244527:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44444
00000100:00100000:1.0:1651531962.244529:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000063869776 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438149:x1731754467438784:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531962.244532:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531962.244535:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3461 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 18 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445633 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.244543:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3461 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 18 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445633 expref: 22 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531962.244547:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3461 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 18 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445633 expref: 22 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531962.244550:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a8889a80, rc 0)
00000100:00100000:1.0:1651531962.244563:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000063869776 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438149:x1731754467438784:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (55us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531962.244565:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44444
00000100:00100000:1.0:1651531962.244689:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531962.244707:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531962.244716:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467438976
00000100:00100000:0.0:1651531962.244719:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467439040
00000100:00100000:1.0:1651531962.244726:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44445
00000100:00100000:1.0:1651531962.244728:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a925fbf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+22:438146:x1731754467438976:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531962.244731:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651531962.244737:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249905
00010000:00010000:1.0:1651531962.244739:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3468 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 18 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445641 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531962.244739:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000be87d738 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+22:438148:x1731754467439040:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531962.244747:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3468 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445641 expref: 23 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531962.244747:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca346f lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.244751:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3468 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445641 expref: 23 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531962.244752:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531962.244752:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531962.244753:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca346f lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [28672->32767] (req 28672->32767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.244755:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000968553c1, rc 0)
00010000:00010000:0.0:1651531962.244757:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca346f lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 18 type: EXT [28672->32767] (req 28672->32767) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531962.244764:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a925fbf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+22:438146:x1731754467438976:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (58us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531962.244766:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44445
00000100:00100000:0.0:1651531962.245574:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531962.245591:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467439552
00000100:00100000:1.0:1651531962.245602:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249906
00000100:00100000:1.0:1651531962.245603:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000059e5b3a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+24:438147:x1731754467439552:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531962.245611:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3476 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.245615:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531962.245616:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531962.245617:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3476 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [110592->114687] (req 110592->114687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.245622:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3476 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [110592->114687] (req 110592->114687) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.245634:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3476 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [110592->114687] (req 110592->114687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.245637:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3476 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [110592->114687] (req 110592->114687) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531962.245659:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000059e5b3a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+24:438147:x1731754467439552:12345-10.240.43.64@tcp:3:fio.0 Request processed in 54us (86us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531962.245661:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249906
00010000:00010000:0.0:1651531962.245662:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3476 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [110592->114687] (req 110592->114687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.245671:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c2b76533 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531962.245672:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3476 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [110592->114687] (req 110592->114687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.245675:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3476 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [110592->114687] (req 110592->114687) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.245681:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3476 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [110592->114687] (req 110592->114687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.245684:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3476 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [110592->114687] (req 110592->114687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531962.293471:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531962.293481:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467439808
00000100:00100000:0.0:1651531962.293495:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44446
00000100:00100000:0.0:1651531962.293497:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003562cf4d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+24:438148:x1731754467439808:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531962.293501:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531962.293505:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca347d lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44564f expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.293514:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca347d lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44564f expref: 25 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531962.293518:0:166111:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca347d lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44564f expref: 25 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531962.293527:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002c5e01dd, rc 0)
00000100:00100000:0.0:1651531962.293542:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003562cf4d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+24:438148:x1731754467439808:12345-10.240.43.64@tcp:101:fio.0 Request processed in 45us (72us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531962.293545:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44446
00000100:00100000:0.0:1651531962.294261:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531962.294281:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467440064
00000100:00100000:1.0:1651531962.294292:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249907
00000100:00100000:1.0:1651531962.294294:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000009c4c564 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+24:438148:x1731754467440064:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531962.294301:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3484 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.294305:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531962.294306:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531962.294307:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3484 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [548864->552959] (req 548864->552959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.294311:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3484 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [548864->552959] (req 548864->552959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.294322:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3484 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [548864->552959] (req 548864->552959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.294326:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3484 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [548864->552959] (req 548864->552959) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531962.294347:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000009c4c564 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+24:438148:x1731754467440064:12345-10.240.43.64@tcp:3:fio.0 Request processed in 52us (87us total) trans 0 rc 4096/4096
00010000:00010000:0.0:1651531962.294347:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3484 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [548864->552959] (req 548864->552959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531962.294350:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249907
00010000:00010000:0.0:1651531962.294351:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000968553c1 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531962.294352:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3484 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [548864->552959] (req 548864->552959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.294355:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3484 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [548864->552959] (req 548864->552959) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.294361:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3484 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [548864->552959] (req 548864->552959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.294364:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3484 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [548864->552959] (req 548864->552959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531962.304196:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869182 is committed
00010000:00010000:0.0:1651531962.304221:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca346f lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 18 type: EXT [28672->32767] (req 28672->32767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.304236:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca346f lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 18 type: EXT [28672->32767] (req 28672->32767) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531962.304261:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000be87d738 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438148:x1731754467439040:12345-10.240.43.64@tcp:4:fio.0 Request processed in 59521us (59572us total) trans 21474869182 rc 0/0
00010000:00010000:1.0:1651531962.304263:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca346f lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 18 type: EXT [28672->32767] (req 28672->32767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531962.304265:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249905
00010000:00010000:1.0:1651531962.304267:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000014685f38 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531962.304268:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca346f lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 18 type: EXT [28672->32767] (req 28672->32767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.304272:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca346f lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 18 type: EXT [28672->32767] (req 28672->32767) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.304277:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca346f lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 18 type: EXT [28672->32767] (req 28672->32767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.304280:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca346f lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 18 type: EXT [28672->32767] (req 28672->32767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531962.341269:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531962.341292:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467440768
00000100:00100000:0.0:1651531962.341308:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249908
00000100:00100000:0.0:1651531962.341310:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000374facb9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438148:x1731754467440768:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531962.341317:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca348b lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 18 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.341322:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531962.341323:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531962.341324:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca348b lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 18 type: EXT [249856->253951] (req 249856->253951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.341328:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca348b lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 18 type: EXT [249856->253951] (req 249856->253951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531962.341472:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531962.341485:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467440896
00000100:00100000:0.0:1651531962.341508:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44447
00000100:00100000:0.0:1651531962.341511:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003d9ef3c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+24:438149:x1731754467440896:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531962.341532:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531962.341555:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3492 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44565d expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.341565:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3492 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44565d expref: 25 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531962.341571:0:166111:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3492 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44565d expref: 25 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531962.341575:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fb2f6575, rc 0)
00000100:00100000:0.0:1651531962.341593:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003d9ef3c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+24:438149:x1731754467440896:12345-10.240.43.64@tcp:101:fio.0 Request processed in 82us (122us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531962.341596:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44447
00000100:00100000:0.0:1651531962.342289:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531962.342303:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467441152
00000100:00100000:1.0:1651531962.342314:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249909
00000100:00100000:1.0:1651531962.342316:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c0b460ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+24:438148:x1731754467441152:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531962.342323:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3499 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.342329:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531962.342329:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531962.342330:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3499 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [159744->163839] (req 159744->163839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.342334:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3499 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [159744->163839] (req 159744->163839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531962.390291:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531962.390300:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467441408
00000100:00100000:1.0:1651531962.390310:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249910
00000100:00100000:1.0:1651531962.390312:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000052213cb9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+27:438147:x1731754467441408:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531962.390319:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca34a0 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.390324:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531962.390325:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531962.390325:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca34a0 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [208896->212991] (req 208896->212991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.390330:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca34a0 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [208896->212991] (req 208896->212991) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.390341:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca34a0 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [208896->212991] (req 208896->212991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.390344:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca34a0 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [208896->212991] (req 208896->212991) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531962.390367:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000052213cb9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+27:438147:x1731754467441408:12345-10.240.43.64@tcp:3:fio.0 Request processed in 54us (77us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531962.390370:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249910
00010000:00010000:0.0:1651531962.390379:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca34a0 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [208896->212991] (req 208896->212991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.390388:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b4c8742a already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531962.390389:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca34a0 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [208896->212991] (req 208896->212991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.390411:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca34a0 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [208896->212991] (req 208896->212991) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.390417:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca34a0 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [208896->212991] (req 208896->212991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.390420:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca34a0 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [208896->212991] (req 208896->212991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651531962.390429:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869183 is committed
00010000:00010000:0.0:1651531962.390449:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca348b lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [249856->253951] (req 249856->253951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.390457:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca348b lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [249856->253951] (req 249856->253951) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.390474:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca348b lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [249856->253951] (req 249856->253951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.390478:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002c5e01dd already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531962.390480:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca348b lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [249856->253951] (req 249856->253951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.390483:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca348b lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [249856->253951] (req 249856->253951) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.390488:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca348b lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [249856->253951] (req 249856->253951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.390491:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca348b lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [249856->253951] (req 249856->253951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531962.390503:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000374facb9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+24:438148:x1731754467440768:12345-10.240.43.64@tcp:4:fio.0 Request processed in 49191us (49233us total) trans 21474869183 rc 0/0
00000100:00100000:0.0:1651531962.390509:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249908
00000100:00100000:1.0:1651531962.390733:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531962.390746:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467441536
00000100:00100000:0.0:1651531962.390758:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44448
00000100:00100000:0.0:1651531962.390760:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009b569a7a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+24:438146:x1731754467441536:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531962.390763:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531962.390768:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca34a7 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44566b expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.390776:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca34a7 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44566b expref: 25 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531962.390780:0:166111:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca34a7 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44566b expref: 25 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531962.390784:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fb2f6575, rc 0)
00000100:00100000:0.0:1651531962.390799:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009b569a7a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+24:438146:x1731754467441536:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (67us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531962.390802:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44448
00000001:00080000:1.0:1651531962.415217:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869184 is committed
00010000:00010000:1.0:1651531962.415243:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3499 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 18 type: EXT [159744->163839] (req 159744->163839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.415247:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3499 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 18 type: EXT [159744->163839] (req 159744->163839) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531962.415266:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c0b460ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438148:x1731754467441152:12345-10.240.43.64@tcp:4:fio.0 Request processed in 72949us (72977us total) trans 21474869184 rc 0/0
00000100:00100000:1.0:1651531962.415269:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249909
00010000:00010000:1.0:1651531962.415276:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3499 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 18 type: EXT [159744->163839] (req 159744->163839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.415279:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a8889a80 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531962.415280:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3499 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 18 type: EXT [159744->163839] (req 159744->163839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.415283:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3499 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 18 type: EXT [159744->163839] (req 159744->163839) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.415288:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3499 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 18 type: EXT [159744->163839] (req 159744->163839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.415291:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3499 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 18 type: EXT [159744->163839] (req 159744->163839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531962.415357:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531962.415364:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467442048
00000100:00100000:1.0:1651531962.415380:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249911
00000100:00100000:1.0:1651531962.415382:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002ef35a72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438149:x1731754467442048:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531962.415391:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca34ae lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 18 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.415396:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531962.415397:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531962.415398:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca34ae lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 18 type: EXT [880640->884735] (req 880640->884735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.415402:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca34ae lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 18 type: EXT [880640->884735] (req 880640->884735) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.415414:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca34ae lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 18 type: EXT [880640->884735] (req 880640->884735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.415417:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca34ae lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 18 type: EXT [880640->884735] (req 880640->884735) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531962.415436:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002ef35a72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438149:x1731754467442048:12345-10.240.43.64@tcp:3:fio.0 Request processed in 53us (80us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531962.415439:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249911
00010000:00010000:0.0:1651531962.415439:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca34ae lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 18 type: EXT [880640->884735] (req 880640->884735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.415447:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001e36c601 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531962.415448:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca34ae lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 18 type: EXT [880640->884735] (req 880640->884735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.415452:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca34ae lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 18 type: EXT [880640->884735] (req 880640->884735) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.415457:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca34ae lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 18 type: EXT [880640->884735] (req 880640->884735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.415460:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca34ae lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 18 type: EXT [880640->884735] (req 880640->884735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531962.438108:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531962.438117:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531962.438129:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467442496
00000100:00100000:1.0:1651531962.438138:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249912
00000100:00100000:1.0:1651531962.438140:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002512e905 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438147:x1731754467442496:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651531962.438142:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467442560
00010000:00010000:1.0:1651531962.438147:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca34b5 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 18 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531962.438153:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44449
00000100:00100000:0.0:1651531962.438155:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d710c5fd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+22:438149:x1731754467442560:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531962.438158:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531962.438158:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531962.438159:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca34b5 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 18 type: EXT [417792->421887] (req 417792->421887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.438159:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531962.438163:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca34b5 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [417792->421887] (req 417792->421887) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.438163:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca34bc lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445679 expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.438171:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca34bc lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445679 expref: 23 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531962.438175:0:166111:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca34bc lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445679 expref: 23 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531962.438176:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca34b5 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [417792->421887] (req 417792->421887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.438179:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca34b5 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [417792->421887] (req 417792->421887) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.438182:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fb2f6575, rc 0)
00000100:00100000:0.0:1651531962.438196:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d710c5fd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+22:438149:x1731754467442560:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (79us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531962.438199:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44449
00000100:00100000:1.0:1651531962.438202:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002512e905 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438147:x1731754467442496:12345-10.240.43.64@tcp:3:fio.0 Request processed in 61us (94us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531962.438215:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249912
00010000:00010000:0.0:1651531962.438235:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca34b5 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 18 type: EXT [417792->421887] (req 417792->421887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.438239:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a8889a80 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531962.438240:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca34b5 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 18 type: EXT [417792->421887] (req 417792->421887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.438243:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca34b5 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 18 type: EXT [417792->421887] (req 417792->421887) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.438248:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca34b5 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 18 type: EXT [417792->421887] (req 417792->421887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.438251:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca34b5 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 18 type: EXT [417792->421887] (req 417792->421887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531962.462650:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531962.462671:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467443328
00000100:00100000:1.0:1651531962.462685:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249913
00000100:00100000:1.0:1651531962.462687:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006e255cae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438149:x1731754467443328:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531962.462694:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca34c3 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 18 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.462699:0:166118:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca2e17 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 18 type: EXT [884736->892927] (req 884736->888831) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445465 expref: 21 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.462703:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531962.462703:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531962.462704:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca34c3 lrc: 4/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 18 type: EXT [884736->888831] (req 884736->888831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.462715:0:166118:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca2e17 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 18 type: EXT [884736->892927] (req 884736->888831) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445465 expref: 21 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.462719:0:166118:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca2e17 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 18 type: EXT [884736->892927] (req 884736->888831) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445465 expref: 21 pid: 166112 timeout: 22771 lvb_type: 0
00000100:00100000:1.0:1651531962.462724:0:166118:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005508963a pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:166118:1731745997355264:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531962.462736:0:166118:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fc7d2635 going to sleep for 6 seconds
00000100:00100000:1.0:1651531962.462772:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531962.462786:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467443456
00000100:00100000:0.0:1651531962.462800:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249914
00000100:00100000:0.0:1651531962.462802:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000503404b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+22:438148:x1731754467443456:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531962.462823:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca34ca lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.462832:0:216321:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000049e48890/0x3234de053ca2da0 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [557056->561151] (req 557056->561151) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445338 expref: 22 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.462835:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531962.462836:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531962.462837:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca34ca lrc: 4/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [557056->561151] (req 557056->561151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.462844:0:216321:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000049e48890/0x3234de053ca2da0 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [557056->561151] (req 557056->561151) gid 0 flags: 0x50000000020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445338 expref: 22 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.462848:0:216321:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000049e48890/0x3234de053ca2da0 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [557056->561151] (req 557056->561151) gid 0 flags: 0x70000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445338 expref: 22 pid: 166111 timeout: 22771 lvb_type: 0
00000100:00100000:0.0:1651531962.462852:0:216321:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f7006631 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997355328:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531962.462866:0:216321:0:(client.c:2492:ptlrpc_set_wait()) set 0000000044420fb0 going to sleep for 6 seconds
00000100:00100000:1.0:1651531962.463029:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531962.463041:0:166118:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005508963a pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:166118:1731745997355264:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651531962.463045:0:166118:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca34c3 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [884736->888831] (req 884736->888831) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531962.463064:0:166103:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467443520
00010000:00010000:0.0:1651531962.463070:0:166103:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca2e17 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [884736->892927] (req 884736->888831) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445465 expref: 23 pid: 166112 timeout: 22771 lvb_type: 0
00000100:00100000:0.0:1651531962.463078:0:166103:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 202
00000100:00100000:0.0:1651531962.463080:0:166103:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a7929b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+23:438146:x1731754467443520:12345-10.240.43.64@tcp:103:ldlm_bl_04.0
00010000:00010000:0.0:1651531962.463083:0:166103:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531962.463087:0:166103:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca2e17 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [884736->892927] (req 884736->888831) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445465 expref: 23 pid: 166112 timeout: 22771 lvb_type: 0
00010000:00010000:0.0:1651531962.463095:0:166103:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca2e17 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [884736->892927] (req 884736->888831) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445465 expref: 23 pid: 166112 timeout: 22771 lvb_type: 0
00010000:00010000:0.0:1651531962.463101:0:166103:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca2e17 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [884736->892927] (req 884736->888831) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445465 expref: 23 pid: 166112 timeout: 22771 lvb_type: 0
00010000:00010000:0.0:1651531962.463105:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531962.463106:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531962.463107:0:166103:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca34c3 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [884736->888831] (req 884736->888831) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.463110:0:166103:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca34c3 lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [884736->888831] (req 884736->888831) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.463122:0:166103:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651531962.463131:0:166103:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a7929b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+22:438146:x1731754467443520:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 50us (103us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531962.463134:0:166103:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 202
00010000:00010000:1.0:1651531962.463135:0:166118:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca34c3 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 18 type: EXT [884736->888831] (req 884736->888831) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.463139:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca34c3 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 18 type: EXT [884736->888831] (req 884736->888831) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531962.463193:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531962.463216:0:166102:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467443584
00010000:00010000:0.0:1651531962.463243:0:166102:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000049e48890/0x3234de053ca2da0 lrc: 5/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 18 type: EXT [557056->561151] (req 557056->561151) gid 0 flags: 0x60000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445338 expref: 24 pid: 166111 timeout: 22771 lvb_type: 0
00000100:00100000:0.0:1651531962.463259:0:166102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 203
00000100:00100000:0.0:1651531962.463262:0:166102:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c4ea889e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+24:438149:x1731754467443584:12345-10.240.43.64@tcp:103:ldlm_bl_02.0
00010000:00010000:0.0:1651531962.463269:0:166102:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531962.463276:0:166102:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000049e48890/0x3234de053ca2da0 lrc: 5/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [557056->561151] (req 557056->561151) gid 0 flags: 0x60000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445338 expref: 24 pid: 166111 timeout: 22771 lvb_type: 0
00010000:00010000:0.0:1651531962.463283:0:166102:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000049e48890/0x3234de053ca2da0 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [557056->561151] (req 557056->561151) gid 0 flags: 0x50000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445338 expref: 24 pid: 166111 timeout: 22771 lvb_type: 0
00010000:00010000:0.0:1651531962.463293:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531962.463294:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531962.463295:0:166102:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca34ca lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [557056->561151] (req 557056->561151) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.463300:0:166102:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca34ca lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [557056->561151] (req 557056->561151) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.463309:0:166102:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651531962.463326:0:166102:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c4ea889e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+24:438149:x1731754467443584:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 62us (133us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531962.463331:0:166102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 203
00010000:00010000:0.0:1651531962.463351:0:216321:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000049e48890/0x3234de053ca2da0 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 18 type: EXT [557056->561151] (req 557056->561151) gid 0 flags: 0x44801400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445338 expref: 23 pid: 166111 timeout: 22771 lvb_type: 0
00000100:00100000:0.0:1651531962.463358:0:216321:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f7006631 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997355328:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651531962.463364:0:216321:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca34ca lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 17 type: EXT [557056->561151] (req 557056->561151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.463367:0:216321:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca34ca lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 17 type: EXT [557056->561151] (req 557056->561151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.463370:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca34ca lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 17 type: EXT [557056->561151] (req 557056->561151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651531962.513498:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869185 is committed
00010000:00010000:1.0:1651531962.513542:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca34c3 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 17 type: EXT [884736->888831] (req 884736->888831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531962.513542:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651531962.513547:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca34c3 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 17 type: EXT [884736->888831] (req 884736->888831) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531962.513568:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531962.513573:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006e255cae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+22:438149:x1731754467443328:12345-10.240.43.64@tcp:4:fio.0 Request processed in 50884us (50923us total) trans 21474869185 rc 0/0
00000100:00100000:1.0:1651531962.513576:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249913
00000100:00100000:1.0:1651531962.513582:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467443776
00000100:00100000:1.0:1651531962.513593:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249915
00000100:00100000:1.0:1651531962.513595:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f7006631 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+22:438148:x1731754467443776:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531962.513602:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca34d1 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 18 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531962.513623:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467443840
00010000:00010000:1.0:1651531962.513628:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531962.513629:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531962.513630:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca34d1 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 18 type: EXT [176128->180223] (req 176128->180223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.513634:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca34d1 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 18 type: EXT [176128->180223] (req 176128->180223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531962.513634:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44450
00000100:00100000:0.0:1651531962.513636:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006ba3fd79 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+23:438147:x1731754467443840:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531962.513640:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531962.513644:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca34d8 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445687 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.513646:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca34d1 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 20 type: EXT [176128->180223] (req 176128->180223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.513649:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca34d1 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [176128->180223] (req 176128->180223) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.513663:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca34d8 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445687 expref: 24 pid: 166113 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651531962.513669:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f7006631 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+24:438148:x1731754467443776:12345-10.240.43.64@tcp:3:fio.0 Request processed in 73us (129us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531962.513672:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249915
00010000:00010000:0.0:1651531962.513672:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca34d8 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445687 expref: 24 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531962.513676:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f765708a, rc 0)
00010000:00010000:1.0:1651531962.513680:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca34c3 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 18 type: EXT [884736->888831] (req 884736->888831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.513683:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d44eb74d already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531962.513684:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca34c3 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 18 type: EXT [884736->888831] (req 884736->888831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531962.513685:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006ba3fd79 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+22:438147:x1731754467443840:12345-10.240.43.64@tcp:101:fio.0 Request processed in 49us (119us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531962.513688:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44450
00010000:00010000:1.0:1651531962.513691:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca34c3 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 18 type: EXT [884736->888831] (req 884736->888831) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.513696:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca34c3 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [884736->888831] (req 884736->888831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.513696:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca34d1 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 18 type: EXT [176128->180223] (req 176128->180223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.513699:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca34c3 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 18 type: EXT [884736->888831] (req 884736->888831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.513699:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008558d1b3 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531962.513700:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca34d1 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 19 type: EXT [176128->180223] (req 176128->180223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.513707:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca34d1 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 17 type: EXT [176128->180223] (req 176128->180223) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.513712:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca34d1 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 17 type: EXT [176128->180223] (req 176128->180223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.513715:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca34d1 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 17 type: EXT [176128->180223] (req 176128->180223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531962.514050:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531962.514068:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467444224
00000100:00100000:1.0:1651531962.514078:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249916
00000100:00100000:1.0:1651531962.514080:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ab80d9e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+22:438148:x1731754467444224:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531962.514086:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca34df lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 17 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.514090:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531962.514091:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531962.514092:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca34df lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 17 type: EXT [700416->704511] (req 700416->704511) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.514096:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca34df lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 17 type: EXT [700416->704511] (req 700416->704511) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651531962.560741:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869186 is committed
00010000:00010000:0.0:1651531962.560777:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca34ca lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 17 type: EXT [557056->561151] (req 557056->561151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.560784:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca34ca lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 17 type: EXT [557056->561151] (req 557056->561151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531962.560809:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000503404b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+22:438148:x1731754467443456:12345-10.240.43.64@tcp:4:fio.0 Request processed in 98005us (98036us total) trans 21474869186 rc 0/0
00000100:00100000:0.0:1651531962.560815:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249914
00010000:00010000:0.0:1651531962.560827:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca34ca lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 17 type: EXT [557056->561151] (req 557056->561151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.560833:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fb2f6575 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531962.560835:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca34ca lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 17 type: EXT [557056->561151] (req 557056->561151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.560841:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca34ca lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 17 type: EXT [557056->561151] (req 557056->561151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.560852:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca34ca lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 17 type: EXT [557056->561151] (req 557056->561151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.560858:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca34ca lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 17 type: EXT [557056->561151] (req 557056->561151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531962.561166:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531962.561174:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467444608
00000100:00100000:0.0:1651531962.561182:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44451
00000100:00100000:0.0:1651531962.561184:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007f2040bf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+22:438149:x1731754467444608:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531962.561188:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531962.561191:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca34e6 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 17 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445695 expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.561199:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca34e6 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 17 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445695 expref: 23 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531962.561204:0:166111:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca34e6 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 17 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445695 expref: 23 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531962.561219:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f765708a, rc 0)
00000100:00100000:0.0:1651531962.561250:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007f2040bf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+22:438149:x1731754467444608:12345-10.240.43.64@tcp:101:fio.0 Request processed in 65us (85us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531962.561253:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44451
00000100:00100000:0.0:1651531962.561944:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531962.561952:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467444864
00000100:00100000:0.0:1651531962.561970:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249917
00000100:00100000:0.0:1651531962.561971:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000611952cb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+22:438148:x1731754467444864:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531962.561985:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca34ed lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 17 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.561989:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531962.561990:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531962.561991:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca34ed lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 17 type: EXT [540672->544767] (req 540672->544767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.561995:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca34ed lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 17 type: EXT [540672->544767] (req 540672->544767) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.562007:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca34ed lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 17 type: EXT [540672->544767] (req 540672->544767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.562010:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca34ed lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 17 type: EXT [540672->544767] (req 540672->544767) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531962.562030:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000611952cb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+22:438148:x1731754467444864:12345-10.240.43.64@tcp:3:fio.0 Request processed in 57us (86us total) trans 0 rc 4096/4096
00010000:00010000:1.0:1651531962.562031:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca34ed lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 17 type: EXT [540672->544767] (req 540672->544767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531962.562033:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249917
00010000:00010000:1.0:1651531962.562036:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002c5e01dd already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531962.562038:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca34ed lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 17 type: EXT [540672->544767] (req 540672->544767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.562042:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca34ed lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 17 type: EXT [540672->544767] (req 540672->544767) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.562047:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca34ed lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 17 type: EXT [540672->544767] (req 540672->544767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.562050:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca34ed lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 17 type: EXT [540672->544767] (req 540672->544767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531962.574078:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531962.574103:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467445376
00000100:00100000:1.0:1651531962.574116:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44452
00000100:00100000:1.0:1651531962.574118:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000040c27bff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+22:438149:x1731754467445376:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531962.574122:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531962.574126:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca34f4 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 17 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4456a3 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.574134:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca34f4 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 17 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4456a3 expref: 23 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531962.574138:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca34f4 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 17 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4456a3 expref: 23 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531962.574142:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d44eb74d, rc 0)
00000100:00100000:1.0:1651531962.574156:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000040c27bff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+22:438149:x1731754467445376:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (79us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531962.574162:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44452
00000001:00080000:1.0:1651531962.585314:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869187 is committed
00010000:00010000:1.0:1651531962.585329:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca34df lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [700416->704511] (req 700416->704511) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.585332:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca34df lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [700416->704511] (req 700416->704511) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531962.585351:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ab80d9e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754467444224:12345-10.240.43.64@tcp:4:fio.0 Request processed in 71271us (71302us total) trans 21474869187 rc 0/0
00000100:00100000:1.0:1651531962.585354:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249916
00010000:00010000:0.0:1651531962.585360:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca34df lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [700416->704511] (req 700416->704511) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.585365:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006da7a892 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531962.585366:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca34df lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [700416->704511] (req 700416->704511) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.585373:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca34df lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [700416->704511] (req 700416->704511) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.585379:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca34df lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [700416->704511] (req 700416->704511) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.585382:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca34df lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [700416->704511] (req 700416->704511) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531962.585679:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531962.585701:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467445760
00000100:00100000:1.0:1651531962.585714:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249918
00000100:00100000:1.0:1651531962.585715:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000039cc242c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754467445760:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531962.585722:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca34fb lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.585727:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531962.585727:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531962.585728:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca34fb lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [245760->249855] (req 245760->249855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.585733:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca34fb lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [245760->249855] (req 245760->249855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651531962.634360:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869188 is committed
00010000:00010000:1.0:1651531962.634374:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca34fb lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [245760->249855] (req 245760->249855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.634379:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca34fb lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [245760->249855] (req 245760->249855) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531962.634394:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000039cc242c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754467445760:12345-10.240.43.64@tcp:4:fio.0 Request processed in 48678us (48715us total) trans 21474869188 rc 0/0
00000100:00100000:1.0:1651531962.634397:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249918
00010000:00010000:1.0:1651531962.634404:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca34fb lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [245760->249855] (req 245760->249855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.634407:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d44eb74d already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531962.634408:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca34fb lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [245760->249855] (req 245760->249855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.634411:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca34fb lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [245760->249855] (req 245760->249855) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.634415:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca34fb lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [245760->249855] (req 245760->249855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.634418:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca34fb lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [245760->249855] (req 245760->249855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531962.634722:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531962.634742:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467445888
00000100:00100000:1.0:1651531962.634758:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249919
00000100:00100000:1.0:1651531962.634759:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e1b41679 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754467445888:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531962.634775:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3502 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.634780:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531962.634781:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531962.634782:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3502 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [618496->622591] (req 618496->622591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.634786:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3502 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [618496->622591] (req 618496->622591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.634798:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3502 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [618496->622591] (req 618496->622591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.634801:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3502 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [618496->622591] (req 618496->622591) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531962.634821:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e1b41679 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754467445888:12345-10.240.43.64@tcp:3:fio.0 Request processed in 61us (99us total) trans 0 rc 4096/4096
00010000:00010000:0.0:1651531962.634823:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3502 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [618496->622591] (req 618496->622591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531962.634824:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249919
00010000:00010000:0.0:1651531962.634828:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e9b84540 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531962.634829:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3502 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [618496->622591] (req 618496->622591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.634832:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3502 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [618496->622591] (req 618496->622591) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.634838:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3502 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [618496->622591] (req 618496->622591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.634840:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3502 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [618496->622591] (req 618496->622591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531962.636047:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531962.636069:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467446528
00000100:00100000:1.0:1651531962.636082:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44453
00000100:00100000:1.0:1651531962.636084:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cc815335 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754467446528:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531962.636087:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531962.636091:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3509 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4456b1 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.636099:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3509 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4456b1 expref: 20 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531962.636108:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3509 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4456b1 expref: 20 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531962.636111:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006da7a892, rc 0)
00000100:00100000:1.0:1651531962.636122:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cc815335 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754467446528:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (76us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531962.636124:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44453
00000100:00100000:0.0:1651531962.674623:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531962.674645:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467446976
00000100:00100000:1.0:1651531962.674660:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249920
00000100:00100000:1.0:1651531962.674661:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000a49f24e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754467446976:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531962.674669:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3510 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.674673:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531962.674674:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531962.674675:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3510 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [667648->671743] (req 667648->671743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.674678:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3510 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [667648->671743] (req 667648->671743) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531962.674966:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531962.674986:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467447296
00000100:00100000:0.0:1651531962.675001:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249921
00000100:00100000:0.0:1651531962.675003:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005508963a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+22:438149:x1731754467447296:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531962.675011:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca3517 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 17 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.675016:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531962.675016:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531962.675017:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca3517 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 17 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.675022:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca3517 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 17 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531962.675146:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531962.675168:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467447488
00000100:00100000:1.0:1651531962.675179:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44454
00000100:00100000:1.0:1651531962.675181:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e65ac653 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+25:438148:x1731754467447488:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531962.675194:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531962.675198:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca351e lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 18 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4456bf expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.675215:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca351e lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 18 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4456bf expref: 26 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531962.675219:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca351e lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 18 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4456bf expref: 26 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531962.675234:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d44eb74d, rc 0)
00000100:00100000:1.0:1651531962.675245:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e65ac653 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+25:438148:x1731754467447488:12345-10.240.43.64@tcp:101:fio.0 Request processed in 64us (100us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531962.675248:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44454
00000001:00080000:1.0:1651531962.699312:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869189 is committed
00010000:00010000:0.0:1651531962.699356:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3510 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 17 type: EXT [667648->671743] (req 667648->671743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.699362:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3510 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 17 type: EXT [667648->671743] (req 667648->671743) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531962.699387:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000a49f24e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+22:438148:x1731754467446976:12345-10.240.43.64@tcp:4:fio.0 Request processed in 24724us (24764us total) trans 21474869189 rc 0/0
00000100:00100000:0.0:1651531962.699391:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249920
00010000:00010000:0.0:1651531962.699401:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3510 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 17 type: EXT [667648->671743] (req 667648->671743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.699407:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006da7a892 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531962.699414:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3510 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 17 type: EXT [667648->671743] (req 667648->671743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.699420:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3510 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 17 type: EXT [667648->671743] (req 667648->671743) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.699429:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3510 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 17 type: EXT [667648->671743] (req 667648->671743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.699434:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3510 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 17 type: EXT [667648->671743] (req 667648->671743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651531962.723845:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869190 is committed
00010000:00010000:0.0:1651531962.723879:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca3517 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.723884:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca3517 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531962.723904:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005508963a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754467447296:12345-10.240.43.64@tcp:4:fio.0 Request processed in 48900us (48938us total) trans 21474869190 rc 0/0
00010000:00010000:1.0:1651531962.723908:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca3517 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531962.723908:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249921
00010000:00010000:1.0:1651531962.723912:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f765708a already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531962.723913:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca3517 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.723916:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca3517 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.723922:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca3517 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.723933:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca3517 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531962.724648:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531962.724656:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467448640
00000100:00100000:0.0:1651531962.724667:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249922
00000100:00100000:0.0:1651531962.724669:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b1386bf7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754467448640:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531962.724676:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3525 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.724681:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531962.724683:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531962.724684:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3525 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [987136->991231] (req 987136->991231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.724688:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3525 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [987136->991231] (req 987136->991231) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.724700:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3525 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [987136->991231] (req 987136->991231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.724703:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3525 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [987136->991231] (req 987136->991231) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531962.724718:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b1386bf7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754467448640:12345-10.240.43.64@tcp:3:fio.0 Request processed in 49us (70us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531962.724721:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249922
00010000:00010000:0.0:1651531962.724727:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3525 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [987136->991231] (req 987136->991231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.724730:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fb2f6575 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531962.724731:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3525 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [987136->991231] (req 987136->991231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.724734:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3525 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [987136->991231] (req 987136->991231) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.724739:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3525 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [987136->991231] (req 987136->991231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.724742:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3525 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [987136->991231] (req 987136->991231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531962.748312:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531962.748320:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467448960
00000100:00100000:0.0:1651531962.748330:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249923
00000100:00100000:0.0:1651531962.748332:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000054d8b112 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754467448960:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531962.748341:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca352c lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.748346:0:192755:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca2c50 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [561152->565247] (req 561152->565247) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445091 expref: 19 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.748350:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531962.748350:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531962.748351:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca352c lrc: 4/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [561152->565247] (req 561152->565247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.748358:0:192755:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca2c50 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [561152->565247] (req 561152->565247) gid 0 flags: 0x50000000020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445091 expref: 19 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.748362:0:192755:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca2c50 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [561152->565247] (req 561152->565247) gid 0 flags: 0x70000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445091 expref: 19 pid: 166112 timeout: 22771 lvb_type: 0
00000100:00100000:0.0:1651531962.748367:0:192755:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000989af618 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0001_UUID:192755:1731745997355392:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531962.748379:0:192755:0:(client.c:2492:ptlrpc_set_wait()) set 0000000044420fb0 going to sleep for 6 seconds
00000100:00100000:0.0:1651531962.748575:0:192755:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000989af618 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0001_UUID:192755:1731745997355392:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651531962.748580:0:192755:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca352c lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [561152->565247] (req 561152->565247) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531962.748669:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531962.748677:0:166103:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467449088
00010000:00010000:0.0:1651531962.748682:0:166103:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca2c50 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [561152->565247] (req 561152->565247) gid 0 flags: 0x60000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445091 expref: 20 pid: 166112 timeout: 22771 lvb_type: 0
00000100:00100000:0.0:1651531962.748690:0:166103:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 204
00000100:00100000:0.0:1651531962.748692:0:166103:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b40d18ce pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754467449088:12345-10.240.43.64@tcp:103:ldlm_bl_06.0
00010000:00010000:0.0:1651531962.748695:0:166103:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531962.748699:0:166103:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca2c50 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 17 type: EXT [561152->565247] (req 561152->565247) gid 0 flags: 0x60000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445091 expref: 20 pid: 166112 timeout: 22771 lvb_type: 0
00010000:00010000:0.0:1651531962.748702:0:166103:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca2c50 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 17 type: EXT [561152->565247] (req 561152->565247) gid 0 flags: 0x50000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445091 expref: 20 pid: 166112 timeout: 22771 lvb_type: 0
00010000:00010000:0.0:1651531962.748709:0:166103:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca2c50 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 17 type: EXT [561152->565247] (req 561152->565247) gid 0 flags: 0x44801400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445091 expref: 20 pid: 166112 timeout: 22771 lvb_type: 0
00010000:00010000:0.0:1651531962.748713:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531962.748714:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531962.748714:0:166103:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca352c lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [561152->565247] (req 561152->565247) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.748718:0:166103:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca352c lrc: 4/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [561152->565247] (req 561152->565247) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.748724:0:166103:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651531962.748733:0:166103:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b40d18ce pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754467449088:12345-10.240.43.64@tcp:103:ldlm_bl_06.0 Request processed in 40us (64us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531962.748737:0:166103:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 204
00010000:00010000:0.0:1651531962.748748:0:192755:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca352c lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [561152->565247] (req 561152->565247) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.748751:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca352c lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [561152->565247] (req 561152->565247) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.748763:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca352c lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [561152->565247] (req 561152->565247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.748766:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca352c lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [561152->565247] (req 561152->565247) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531962.748778:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000054d8b112 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754467448960:12345-10.240.43.64@tcp:3:fio.0 Request processed in 446us (467us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531962.748781:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249923
00010000:00010000:0.0:1651531962.748787:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca352c lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [561152->565247] (req 561152->565247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.748790:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fb2f6575 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531962.748791:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca352c lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [561152->565247] (req 561152->565247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.748794:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca352c lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [561152->565247] (req 561152->565247) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.748798:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca352c lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [561152->565247] (req 561152->565247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.748804:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca352c lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [561152->565247] (req 561152->565247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531962.772945:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531962.772966:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467449472
00000100:00100000:1.0:1651531962.772980:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44455
00000100:00100000:1.0:1651531962.772981:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000989af618 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754467449472:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531962.772985:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531962.772988:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3533 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4456cd expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.772996:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3533 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4456cd expref: 19 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531962.773001:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3533 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4456cd expref: 19 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531962.773004:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d44eb74d, rc 0)
00000100:00100000:1.0:1651531962.773019:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000989af618 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754467449472:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (75us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531962.773022:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44455
00000100:00100000:0.0:1651531962.773755:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531962.773763:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467449728
00000100:00100000:0.0:1651531962.773773:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249924
00000100:00100000:0.0:1651531962.773775:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008adf1b39 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754467449728:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531962.773782:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca353a lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.773787:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531962.773787:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531962.773788:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca353a lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.773792:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca353a lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.773803:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca353a lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.773807:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca353a lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.773826:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca353a lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531962.773828:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008adf1b39 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754467449728:12345-10.240.43.64@tcp:3:fio.0 Request processed in 52us (73us total) trans 0 rc 4096/4096
00010000:00010000:1.0:1651531962.773830:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fb2f6575 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531962.773831:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca353a lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531962.773833:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249924
00010000:00010000:1.0:1651531962.773844:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca353a lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.773849:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca353a lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.773852:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca353a lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531962.774124:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531962.774141:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467449856
00000100:00100000:1.0:1651531962.774152:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44456
00000100:00100000:1.0:1651531962.774153:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009078ca7d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754467449856:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531962.774157:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531962.774160:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3541 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4456db expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.774167:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3541 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4456db expref: 19 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531962.774171:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3541 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4456db expref: 19 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531962.774174:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008558d1b3, rc 0)
00000100:00100000:1.0:1651531962.774189:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009078ca7d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754467449856:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (65us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531962.774191:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44456
00000100:00100000:0.0:1651531962.796175:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531962.796196:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467450368
00000100:00100000:1.0:1651531962.796215:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44457
00000100:00100000:1.0:1651531962.796217:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007b76f7f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754467450368:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531962.796220:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531962.796233:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3548 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4456e9 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.796241:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3548 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4456e9 expref: 19 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531962.796245:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3548 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4456e9 expref: 19 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531962.796248:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008558d1b3, rc 0)
00000100:00100000:1.0:1651531962.796263:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007b76f7f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754467450368:12345-10.240.43.64@tcp:101:fio.0 Request processed in 45us (88us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531962.796265:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44457
00000100:00100000:0.0:1651531962.820652:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531962.820660:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467450880
00000100:00100000:0.0:1651531962.820670:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249925
00000100:00100000:0.0:1651531962.820671:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a899ddab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754467450880:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531962.820679:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca354f lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.820683:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531962.820684:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531962.820685:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca354f lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [671744->675839] (req 671744->675839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.820689:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca354f lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [671744->675839] (req 671744->675839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.820700:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca354f lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [671744->675839] (req 671744->675839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.820703:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca354f lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [671744->675839] (req 671744->675839) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531962.820717:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a899ddab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754467450880:12345-10.240.43.64@tcp:3:fio.0 Request processed in 45us (65us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531962.820719:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249925
00010000:00010000:0.0:1651531962.820726:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca354f lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [671744->675839] (req 671744->675839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.820730:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000014685f38 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531962.820731:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca354f lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [671744->675839] (req 671744->675839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.820734:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca354f lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [671744->675839] (req 671744->675839) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.820738:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca354f lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [671744->675839] (req 671744->675839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.820741:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca354f lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [671744->675839] (req 671744->675839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531962.845557:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531962.845565:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467451392
00000100:00100000:0.0:1651531962.845575:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249926
00000100:00100000:0.0:1651531962.845576:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d9e74b4c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754467451392:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531962.845583:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca3556 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.845588:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531962.845588:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531962.845589:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca3556 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [737280->741375] (req 737280->741375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.845593:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca3556 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [737280->741375] (req 737280->741375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.845608:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca3556 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [737280->741375] (req 737280->741375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.845611:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca3556 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [737280->741375] (req 737280->741375) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531962.845624:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d9e74b4c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754467451392:12345-10.240.43.64@tcp:3:fio.0 Request processed in 47us (68us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531962.845627:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249926
00010000:00010000:0.0:1651531962.845633:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca3556 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [737280->741375] (req 737280->741375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.845636:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000014685f38 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531962.845637:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca3556 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [737280->741375] (req 737280->741375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.845640:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca3556 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [737280->741375] (req 737280->741375) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.845644:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca3556 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [737280->741375] (req 737280->741375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.845647:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca3556 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [737280->741375] (req 737280->741375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531962.894195:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531962.894243:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531962.894261:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467451968
00000100:00100000:1.0:1651531962.894274:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44458
00000100:00100000:1.0:1651531962.894275:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000086b59493 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754467451968:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531962.894279:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531962.894282:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca355d lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4456f7 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.894289:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca355d lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4456f7 expref: 19 pid: 166113 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651531962.894293:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467452032
00010000:00010000:1.0:1651531962.894297:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca355d lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4456f7 expref: 20 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531962.894301:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008558d1b3, rc 0)
00000100:00100000:0.0:1651531962.894303:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249927
00000100:00100000:0.0:1651531962.894305:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c4ea889e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754467452032:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651531962.894313:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000086b59493 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754467451968:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (71us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531962.894316:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44458
00010000:00010000:0.0:1651531962.894321:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca3564 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.894326:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531962.894326:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531962.894327:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca3564 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [364544->368639] (req 364544->368639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.894331:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca3564 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [364544->368639] (req 364544->368639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.894342:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca3564 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [364544->368639] (req 364544->368639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.894346:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca3564 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [364544->368639] (req 364544->368639) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531962.894365:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c4ea889e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754467452032:12345-10.240.43.64@tcp:3:fio.0 Request processed in 59us (170us total) trans 0 rc 4096/4096
00010000:00010000:1.0:1651531962.894367:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca3564 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [364544->368639] (req 364544->368639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531962.894368:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249927
00010000:00010000:1.0:1651531962.894372:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000014685f38 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531962.894373:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca3564 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [364544->368639] (req 364544->368639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.894376:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca3564 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [364544->368639] (req 364544->368639) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.894381:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca3564 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [364544->368639] (req 364544->368639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.894384:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca3564 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [364544->368639] (req 364544->368639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531962.894666:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531962.894674:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467452288
00000100:00100000:1.0:1651531962.894685:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44459
00000100:00100000:1.0:1651531962.894688:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d5703b86 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754467452288:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531962.894691:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531962.894694:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca356b lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445705 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.894701:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca356b lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445705 expref: 19 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531962.894705:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca356b lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445705 expref: 19 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531962.894709:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d44eb74d, rc 0)
00000100:00100000:1.0:1651531962.894720:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d5703b86 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754467452288:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (54us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531962.894722:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44459
00000100:00100000:1.0:1651531962.895117:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531962.895140:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467452544
00000100:00100000:0.0:1651531962.895154:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249928
00000100:00100000:0.0:1651531962.895156:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000017b5519b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754467452544:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531962.895163:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca3572 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.895171:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531962.895172:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531962.895172:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca3572 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [249856->253951] (req 249856->253951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.895176:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca3572 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [249856->253951] (req 249856->253951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531962.941978:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531962.942000:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467452928
00000100:00100000:1.0:1651531962.942013:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44460
00000100:00100000:1.0:1651531962.942015:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c1f549f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438147:x1731754467452928:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531962.942018:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531962.942022:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3579 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445713 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.942030:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3579 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445713 expref: 22 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531962.942038:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3579 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445713 expref: 22 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531962.942041:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d44eb74d, rc 0)
00000100:00100000:1.0:1651531962.942052:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c1f549f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438147:x1731754467452928:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (75us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531962.942055:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44460
00000100:00100000:0.0:1651531962.942873:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531962.942890:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467453184
00000100:00100000:1.0:1651531962.942901:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249929
00000100:00100000:1.0:1651531962.942902:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e62b9827 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438146:x1731754467453184:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531962.942909:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3580 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.942914:0:192755:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b93c49e9/0x3234de053ca2c8f lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [892928->897023] (req 892928->897023) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445124 expref: 21 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.942918:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531962.942919:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531962.942919:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3580 lrc: 4/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [892928->897023] (req 892928->897023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.942927:0:192755:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b93c49e9/0x3234de053ca2c8f lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [892928->897023] (req 892928->897023) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445124 expref: 21 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.942930:0:192755:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b93c49e9/0x3234de053ca2c8f lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [892928->897023] (req 892928->897023) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445124 expref: 21 pid: 166113 timeout: 22771 lvb_type: 0
00000100:00100000:1.0:1651531962.942939:0:192755:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009c5a362f pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0001_UUID:192755:1731745997355456:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531962.942951:0:192755:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ec524534 going to sleep for 6 seconds
00000100:00100000:1.0:1651531962.943154:0:192755:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009c5a362f pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0001_UUID:192755:1731745997355456:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651531962.943158:0:192755:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3580 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [892928->897023] (req 892928->897023) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531962.943205:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531962.943244:0:166102:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467453248
00010000:00010000:0.0:1651531962.943252:0:166102:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b93c49e9/0x3234de053ca2c8f lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [892928->897023] (req 892928->897023) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445124 expref: 22 pid: 166113 timeout: 22771 lvb_type: 0
00000100:00100000:0.0:1651531962.943260:0:166102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 205
00000100:00100000:0.0:1651531962.943262:0:166102:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009c5a362f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+22:438148:x1731754467453248:12345-10.240.43.64@tcp:103:ldlm_bl_01.0
00010000:00010000:0.0:1651531962.943265:0:166102:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531962.943269:0:166102:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b93c49e9/0x3234de053ca2c8f lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 17 type: EXT [892928->897023] (req 892928->897023) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445124 expref: 22 pid: 166113 timeout: 22771 lvb_type: 0
00010000:00010000:0.0:1651531962.943273:0:166102:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b93c49e9/0x3234de053ca2c8f lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 17 type: EXT [892928->897023] (req 892928->897023) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445124 expref: 22 pid: 166113 timeout: 22771 lvb_type: 0
00010000:00010000:0.0:1651531962.943280:0:166102:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b93c49e9/0x3234de053ca2c8f lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 17 type: EXT [892928->897023] (req 892928->897023) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445124 expref: 22 pid: 166113 timeout: 22771 lvb_type: 0
00010000:00010000:0.0:1651531962.943284:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531962.943286:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531962.943287:0:166102:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3580 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [892928->897023] (req 892928->897023) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.943290:0:166102:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3580 lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [892928->897023] (req 892928->897023) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.943302:0:166102:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1651531962.943311:0:192755:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3580 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [892928->897023] (req 892928->897023) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.943315:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3580 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [892928->897023] (req 892928->897023) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531962.943322:0:166102:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009c5a362f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438148:x1731754467453248:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 59us (117us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531962.943325:0:166102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 205
00000001:00080000:1.0:1651531962.953924:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869191 is committed
00010000:00010000:0.0:1651531962.953954:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca3572 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [249856->253951] (req 249856->253951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.953959:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca3572 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [249856->253951] (req 249856->253951) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531962.953982:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000017b5519b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438148:x1731754467452544:12345-10.240.43.64@tcp:4:fio.0 Request processed in 58825us (58865us total) trans 21474869191 rc 0/0
00000100:00100000:0.0:1651531962.953986:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249928
00010000:00010000:0.0:1651531962.953993:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca3572 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [249856->253951] (req 249856->253951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.953997:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000080362f27 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531962.953998:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca3572 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [249856->253951] (req 249856->253951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.954001:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca3572 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [249856->253951] (req 249856->253951) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.954010:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca3572 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [249856->253951] (req 249856->253951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.954013:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca3572 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [249856->253951] (req 249856->253951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531962.954308:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531962.954331:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467453376
00000100:00100000:1.0:1651531962.954343:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44461
00000100:00100000:1.0:1651531962.954344:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000094ff6232 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754467453376:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531962.954348:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531962.954352:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3587 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445721 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531962.954360:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3587 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445721 expref: 21 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531962.954364:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3587 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445721 expref: 21 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531962.954370:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d44eb74d, rc 0)
00000100:00100000:1.0:1651531962.954381:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000094ff6232 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438149:x1731754467453376:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (74us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531962.954384:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44461
00000100:00100000:0.0:1651531962.955138:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531962.955146:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467453632
00000100:00100000:0.0:1651531962.955161:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249930
00000100:00100000:0.0:1651531962.955163:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005cfcbd50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438148:x1731754467453632:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531962.955171:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca358e lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.955175:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531962.955176:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531962.955177:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca358e lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [290816->294911] (req 290816->294911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531962.955181:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca358e lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [290816->294911] (req 290816->294911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531963.005374:0:39100:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d349b145 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:39100:1731745997355584:10.240.43.61@tcp:400:kworker/u4:0.0
00000100:00100000:0.0:1651531963.005391:0:39099:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f148f36a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9063caa-b124-4cb6-99ef-d01a735595c3:39099:1731745997355520:10.240.43.61@tcp:400:kworker/u4:0.0
00000100:00100000:0.0:1651531963.005877:0:39099:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f148f36a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9063caa-b124-4cb6-99ef-d01a735595c3:39099:1731745997355520:10.240.43.61@tcp:400:kworker/u4:0.0
00000100:00100000:1.0:1651531963.005894:0:39100:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d349b145 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:39100:1731745997355584:10.240.43.61@tcp:400:kworker/u4:0.0
00000100:00100000:1.0:1651531963.015555:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531963.015563:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467453888
00000100:00100000:1.0:1651531963.015576:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44462
00000100:00100000:1.0:1651531963.015578:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d349b145 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+23:438148:x1731754467453888:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531963.015581:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531963.015585:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3595 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44572f expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.015593:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3595 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44572f expref: 24 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531963.015597:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3595 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44572f expref: 24 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531963.015601:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d44eb74d, rc 0)
00000100:00100000:1.0:1651531963.015614:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d349b145 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+23:438148:x1731754467453888:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (60us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531963.015620:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44462
00000100:00100000:1.0:1651531963.016376:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531963.016385:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467454144
00000100:00100000:1.0:1651531963.016394:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249931
00000100:00100000:1.0:1651531963.016396:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ac499271 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+23:438149:x1731754467454144:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531963.016403:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca359c lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.016407:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531963.016408:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531963.016409:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca359c lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [53248->57343] (req 53248->57343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.016413:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca359c lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [53248->57343] (req 53248->57343) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651531963.026234:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869193 is committed
00002000:00010000:1.0:1651531963.026251:0:192755:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x34545:0x0] updating lvb mtime from disk: 1651531962 -> 1651531963
00002000:00010000:1.0:1651531963.026252:0:192755:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x34545:0x0] updating lvb ctime from disk: 1651531962 -> 1651531963
00010000:00010000:1.0:1651531963.026255:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3580 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [892928->897023] (req 892928->897023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.026258:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3580 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [892928->897023] (req 892928->897023) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531963.026278:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e62b9827 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438146:x1731754467453184:12345-10.240.43.64@tcp:4:fio.0 Request processed in 83374us (83405us total) trans 21474869192 rc 0/0
00010000:00010000:0.0:1651531963.026280:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca358e lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [290816->294911] (req 290816->294911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531963.026284:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249929
00010000:00010000:0.0:1651531963.026289:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca358e lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [290816->294911] (req 290816->294911) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.026305:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3580 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [892928->897023] (req 892928->897023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.026308:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008558d1b3 already unused, calling callback (0000000049fddea7)
00000100:00100000:0.0:1651531963.026308:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005cfcbd50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438148:x1731754467453632:12345-10.240.43.64@tcp:4:fio.0 Request processed in 71144us (71171us total) trans 21474869193 rc 0/0
00010000:00010000:1.0:1651531963.026309:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3580 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [892928->897023] (req 892928->897023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531963.026312:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249930
00010000:00010000:1.0:1651531963.026313:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3580 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [892928->897023] (req 892928->897023) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.026318:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3580 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [892928->897023] (req 892928->897023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.026321:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3580 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [892928->897023] (req 892928->897023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.026324:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca358e lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [290816->294911] (req 290816->294911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.026327:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c1022d42 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531963.026328:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca358e lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [290816->294911] (req 290816->294911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.026330:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca358e lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [290816->294911] (req 290816->294911) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.026333:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca358e lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [290816->294911] (req 290816->294911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.026337:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca358e lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [290816->294911] (req 290816->294911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531963.026654:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531963.026677:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467454336
00000100:00100000:0.0:1651531963.026693:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249932
00000100:00100000:0.0:1651531963.026695:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000082a985f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754467454336:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531963.026703:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca35a3 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.026707:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531963.026708:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531963.026709:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca35a3 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [745472->749567] (req 745472->749567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.026714:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca35a3 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [745472->749567] (req 745472->749567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531963.027033:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531963.027040:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467454528
00000100:00100000:1.0:1651531963.027051:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44463
00000100:00100000:1.0:1651531963.027053:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000765f877 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+23:438149:x1731754467454528:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531963.027057:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531963.027060:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca35aa lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44573d expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.027068:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca35aa lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44573d expref: 24 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531963.027072:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca35aa lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44573d expref: 24 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531963.027075:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d44eb74d, rc 0)
00000100:00100000:1.0:1651531963.027085:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000765f877 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+23:438149:x1731754467454528:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (53us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531963.027088:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44463
00000100:00100000:1.0:1651531963.038683:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531963.038691:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467455296
00000100:00100000:1.0:1651531963.038703:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44464
00000100:00100000:1.0:1651531963.038705:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007a6934a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+23:438147:x1731754467455296:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531963.038710:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531963.038713:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca35b1 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44574b expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.038720:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca35b1 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44574b expref: 24 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531963.038725:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca35b1 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44574b expref: 24 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531963.038728:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d44eb74d, rc 0)
00000100:00100000:1.0:1651531963.038737:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007a6934a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+23:438147:x1731754467455296:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (55us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531963.038740:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44464
00000001:00080000:1.0:1651531963.095731:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869195 is committed
00010000:00010000:1.0:1651531963.095751:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca359c lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [53248->57343] (req 53248->57343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.095755:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca359c lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [53248->57343] (req 53248->57343) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.095770:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca35a3 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [745472->749567] (req 745472->749567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531963.095773:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ac499271 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754467454144:12345-10.240.43.64@tcp:4:fio.0 Request processed in 79376us (79398us total) trans 21474869194 rc 0/0
00010000:00010000:0.0:1651531963.095775:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca35a3 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [745472->749567] (req 745472->749567) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531963.095776:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249931
00000100:00100000:0.0:1651531963.095795:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000082a985f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754467454336:12345-10.240.43.64@tcp:4:fio.0 Request processed in 69099us (69141us total) trans 21474869195 rc 0/0
00000100:00100000:0.0:1651531963.095799:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249932
00010000:00010000:0.0:1651531963.095808:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca359c lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [53248->57343] (req 53248->57343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.095811:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a8889a80 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531963.095812:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca359c lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [53248->57343] (req 53248->57343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.095814:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca35a3 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [745472->749567] (req 745472->749567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.095815:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca359c lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [53248->57343] (req 53248->57343) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.095821:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca359c lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [53248->57343] (req 53248->57343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.095824:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca359c lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [53248->57343] (req 53248->57343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.095829:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000080362f27 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531963.095830:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca35a3 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 14 type: EXT [745472->749567] (req 745472->749567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.095833:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca35a3 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 14 type: EXT [745472->749567] (req 745472->749567) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.095839:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca35a3 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 14 type: EXT [745472->749567] (req 745472->749567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.095841:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca35a3 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 14 type: EXT [745472->749567] (req 745472->749567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531963.096103:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531963.096111:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467455744
00000100:00100000:1.0:1651531963.096124:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44465
00000100:00100000:1.0:1651531963.096126:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007dc97d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754467455744:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531963.096129:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531963.096133:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca35b8 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445759 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.096140:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca35b8 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445759 expref: 18 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531963.096145:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca35b8 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 14 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445759 expref: 18 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531963.096152:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d44eb74d, rc 0)
00000100:00100000:1.0:1651531963.096162:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007dc97d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754467455744:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (59us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531963.096164:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44465
00000100:00100000:1.0:1651531963.096680:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531963.096699:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467455936
00000100:00100000:0.0:1651531963.096716:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249933
00000100:00100000:0.0:1651531963.096718:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cb76f437 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754467455936:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531963.096725:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca35bf lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.096730:0:216321:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca2b5b lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 14 type: EXT [454656->458751] (req 454656->458751) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444e4c expref: 17 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.096733:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531963.096737:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531963.096737:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca35bf lrc: 4/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 14 type: EXT [454656->458751] (req 454656->458751) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.096745:0:216321:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca2b5b lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 14 type: EXT [454656->458751] (req 454656->458751) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444e4c expref: 17 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.096750:0:216321:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca2b5b lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 14 type: EXT [454656->458751] (req 454656->458751) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444e4c expref: 17 pid: 166111 timeout: 22771 lvb_type: 0
00000100:00100000:0.0:1651531963.096754:0:216321:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e62b9827 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997355648:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531963.096772:0:216321:0:(client.c:2492:ptlrpc_set_wait()) set 000000008ce9bece going to sleep for 6 seconds
00000100:00100000:1.0:1651531963.097172:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531963.097182:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531963.097184:0:216321:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e62b9827 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997355648:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651531963.097189:0:216321:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca35bf lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 14 type: EXT [454656->458751] (req 454656->458751) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531963.097190:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467456384
00000100:00100000:0.0:1651531963.097197:0:166103:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467456256
00000100:00100000:1.0:1651531963.097199:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249934
00000100:00100000:1.0:1651531963.097201:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005508963a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754467456384:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531963.097202:0:166103:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca2b5b lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 14 type: EXT [454656->458751] (req 454656->458751) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444e4c expref: 19 pid: 166111 timeout: 22771 lvb_type: 0
00010000:00010000:1.0:1651531963.097216:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca35c6 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531963.097220:0:166103:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 206
00010000:00010000:1.0:1651531963.097221:0:216323:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000958e71ef/0x3234de053ca2c34 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [438272->442367] (req 438272->442367) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445059 expref: 19 pid: 166112 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531963.097234:0:166103:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000503404b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754467456256:12345-10.240.43.64@tcp:103:ldlm_bl_03.0
00010000:00010000:1.0:1651531963.097236:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531963.097237:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531963.097237:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca35c6 lrc: 4/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [438272->442367] (req 438272->442367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.097238:0:166103:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531963.097242:0:166103:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca2b5b lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [454656->458751] (req 454656->458751) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444e4c expref: 19 pid: 166111 timeout: 22771 lvb_type: 0
00010000:00010000:1.0:1651531963.097245:0:216323:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000958e71ef/0x3234de053ca2c34 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [438272->442367] (req 438272->442367) gid 0 flags: 0x50000000020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445059 expref: 19 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.097249:0:216323:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000958e71ef/0x3234de053ca2c34 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [438272->442367] (req 438272->442367) gid 0 flags: 0x70000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445059 expref: 19 pid: 166112 timeout: 22771 lvb_type: 0
00000100:00100000:1.0:1651531963.097257:0:216323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000017b5519b pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_010:lustre-OST0001_UUID:216323:1731745997355712:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651531963.097258:0:166103:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca2b5b lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [454656->458751] (req 454656->458751) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444e4c expref: 19 pid: 166111 timeout: 22771 lvb_type: 0
00010000:00010000:0.0:1651531963.097265:0:166103:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca2b5b lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 16 type: EXT [454656->458751] (req 454656->458751) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444e4c expref: 19 pid: 166111 timeout: 22771 lvb_type: 0
00000100:00100000:1.0:1651531963.097269:0:216323:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fc7d2635 going to sleep for 6 seconds
00010000:00010000:0.0:1651531963.097270:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531963.097270:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531963.097271:0:166103:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca35bf lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [454656->458751] (req 454656->458751) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.097275:0:166103:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca35bf lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [454656->458751] (req 454656->458751) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.097282:0:166103:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651531963.097290:0:166103:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000503404b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754467456256:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 67us (118us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531963.097293:0:166103:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 206
00010000:00010000:0.0:1651531963.097301:0:216321:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca35bf lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 14 type: EXT [454656->458751] (req 454656->458751) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.097304:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca35bf lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 14 type: EXT [454656->458751] (req 454656->458751) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531963.097551:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531963.097564:0:216323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000017b5519b pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_010:lustre-OST0001_UUID:216323:1731745997355712:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531963.097566:0:166102:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467456448
00010000:00010000:1.0:1651531963.097569:0:216323:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca35c6 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 14 type: EXT [438272->442367] (req 438272->442367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.097573:0:166102:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000958e71ef/0x3234de053ca2c34 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 14 type: EXT [438272->442367] (req 438272->442367) gid 0 flags: 0x60000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445059 expref: 20 pid: 166112 timeout: 22771 lvb_type: 0
00000100:00100000:0.0:1651531963.097582:0:166102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 207
00000100:00100000:0.0:1651531963.097584:0:166102:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f148f36a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754467456448:12345-10.240.43.64@tcp:103:ldlm_bl_04.0
00010000:00010000:0.0:1651531963.097590:0:166102:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531963.097593:0:166102:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000958e71ef/0x3234de053ca2c34 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [438272->442367] (req 438272->442367) gid 0 flags: 0x60000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445059 expref: 20 pid: 166112 timeout: 22771 lvb_type: 0
00010000:00010000:0.0:1651531963.097597:0:166102:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000958e71ef/0x3234de053ca2c34 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [438272->442367] (req 438272->442367) gid 0 flags: 0x50000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445059 expref: 20 pid: 166112 timeout: 22771 lvb_type: 0
00010000:00010000:0.0:1651531963.097603:0:166102:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000958e71ef/0x3234de053ca2c34 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [438272->442367] (req 438272->442367) gid 0 flags: 0x44801400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445059 expref: 20 pid: 166112 timeout: 22771 lvb_type: 0
00010000:00010000:0.0:1651531963.097607:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531963.097608:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531963.097609:0:166102:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca35c6 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 14 type: EXT [438272->442367] (req 438272->442367) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.097612:0:166102:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca35c6 lrc: 4/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 14 type: EXT [438272->442367] (req 438272->442367) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.097626:0:166102:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1651531963.097634:0:216323:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca35c6 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 13 type: EXT [438272->442367] (req 438272->442367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531963.097639:0:166102:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f148f36a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754467456448:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 54us (88us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531963.097642:0:166102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 207
00010000:00010000:1.0:1651531963.097643:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca35c6 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 13 type: EXT [438272->442367] (req 438272->442367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.097658:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca35c6 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 13 type: EXT [438272->442367] (req 438272->442367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.097661:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca35c6 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 13 type: EXT [438272->442367] (req 438272->442367) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531963.097676:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005508963a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754467456384:12345-10.240.43.64@tcp:3:fio.0 Request processed in 474us (493us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531963.097679:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249934
00010000:00010000:1.0:1651531963.097685:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca35c6 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 13 type: EXT [438272->442367] (req 438272->442367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.097689:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008558d1b3 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531963.097691:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca35c6 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 13 type: EXT [438272->442367] (req 438272->442367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.097694:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca35c6 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 13 type: EXT [438272->442367] (req 438272->442367) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.097699:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca35c6 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 13 type: EXT [438272->442367] (req 438272->442367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.097702:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca35c6 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 13 type: EXT [438272->442367] (req 438272->442367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531963.097991:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531963.097999:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467456576
00000100:00100000:1.0:1651531963.098008:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249935
00000100:00100000:1.0:1651531963.098010:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000017b5519b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754467456576:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531963.098016:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca35cd lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.098020:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531963.098021:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531963.098022:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca35cd lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 13 type: EXT [36864->40959] (req 36864->40959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.098026:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca35cd lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 13 type: EXT [36864->40959] (req 36864->40959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.098036:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca35cd lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 13 type: EXT [36864->40959] (req 36864->40959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.098043:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca35cd lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 13 type: EXT [36864->40959] (req 36864->40959) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.098057:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca35cd lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 13 type: EXT [36864->40959] (req 36864->40959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.098061:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001e36c601 already unused, calling callback (0000000049fddea7)
00000100:00100000:1.0:1651531963.098062:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000017b5519b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754467456576:12345-10.240.43.64@tcp:3:fio.0 Request processed in 52us (72us total) trans 0 rc 4096/4096
00010000:00010000:0.0:1651531963.098062:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca35cd lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 13 type: EXT [36864->40959] (req 36864->40959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531963.098065:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249935
00010000:00010000:0.0:1651531963.098069:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca35cd lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 13 type: EXT [36864->40959] (req 36864->40959) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.098074:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca35cd lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 13 type: EXT [36864->40959] (req 36864->40959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.098077:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca35cd lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 13 type: EXT [36864->40959] (req 36864->40959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531963.098728:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531963.098736:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467456832
00000100:00100000:1.0:1651531963.098745:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249936
00000100:00100000:1.0:1651531963.098747:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a7929b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754467456832:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531963.098753:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca35d4 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.098757:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531963.098758:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531963.098759:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca35d4 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 13 type: EXT [491520->495615] (req 491520->495615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.098763:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca35d4 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 13 type: EXT [491520->495615] (req 491520->495615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651531963.131915:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869196 is committed
00010000:00010000:0.0:1651531963.131952:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca35bf lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 13 type: EXT [454656->458751] (req 454656->458751) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.131959:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca35bf lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 13 type: EXT [454656->458751] (req 454656->458751) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.131987:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca35bf lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 13 type: EXT [454656->458751] (req 454656->458751) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531963.131995:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cb76f437 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754467455936:12345-10.240.43.64@tcp:4:fio.0 Request processed in 35275us (35313us total) trans 21474869196 rc 0/0
00010000:00010000:1.0:1651531963.131996:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000075a78972 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531963.131997:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca35bf lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 13 type: EXT [454656->458751] (req 454656->458751) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531963.132001:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249933
00010000:00010000:1.0:1651531963.132002:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca35bf lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 13 type: EXT [454656->458751] (req 454656->458751) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.132007:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca35bf lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 13 type: EXT [454656->458751] (req 454656->458751) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.132010:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca35bf lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 13 type: EXT [454656->458751] (req 454656->458751) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531963.132370:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531963.132395:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467456960
00000100:00100000:0.0:1651531963.132409:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249937
00000100:00100000:0.0:1651531963.132411:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000df1eb0d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754467456960:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531963.132419:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca35db lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.132424:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531963.132424:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531963.132425:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca35db lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 13 type: EXT [180224->184319] (req 180224->184319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.132431:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca35db lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 13 type: EXT [180224->184319] (req 180224->184319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651531963.168334:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869197 is committed
00010000:00010000:0.0:1651531963.168379:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca35d4 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 13 type: EXT [491520->495615] (req 491520->495615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.168385:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca35d4 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 13 type: EXT [491520->495615] (req 491520->495615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.168413:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca35d4 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 13 type: EXT [491520->495615] (req 491520->495615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.168418:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b4c8742a already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531963.168419:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca35d4 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 13 type: EXT [491520->495615] (req 491520->495615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531963.168419:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a7929b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754467456832:12345-10.240.43.64@tcp:4:fio.0 Request processed in 69669us (69689us total) trans 21474869197 rc 0/0
00010000:00010000:1.0:1651531963.168422:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca35d4 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 13 type: EXT [491520->495615] (req 491520->495615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531963.168425:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249936
00010000:00010000:1.0:1651531963.168428:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca35d4 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 13 type: EXT [491520->495615] (req 491520->495615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.168430:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca35d4 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 13 type: EXT [491520->495615] (req 491520->495615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531963.168522:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531963.168547:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467457344
00000100:00100000:1.0:1651531963.168573:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249938
00000100:00100000:1.0:1651531963.168575:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004d249e37 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754467457344:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531963.168584:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca35e2 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.168588:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531963.168588:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531963.168589:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca35e2 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 13 type: EXT [212992->217087] (req 212992->217087) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.168594:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca35e2 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 13 type: EXT [212992->217087] (req 212992->217087) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.168606:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca35e2 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 13 type: EXT [212992->217087] (req 212992->217087) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.168610:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca35e2 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 13 type: EXT [212992->217087] (req 212992->217087) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531963.168630:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004d249e37 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754467457344:12345-10.240.43.64@tcp:3:fio.0 Request processed in 54us (108us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531963.168633:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249938
00010000:00010000:0.0:1651531963.168635:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca35e2 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 13 type: EXT [212992->217087] (req 212992->217087) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.168639:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008558d1b3 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531963.168641:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca35e2 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 13 type: EXT [212992->217087] (req 212992->217087) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.168644:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca35e2 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 13 type: EXT [212992->217087] (req 212992->217087) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.168650:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca35e2 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 13 type: EXT [212992->217087] (req 212992->217087) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.168652:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca35e2 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 13 type: EXT [212992->217087] (req 212992->217087) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531963.168773:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531963.168780:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467457472
00000100:00100000:1.0:1651531963.168791:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44466
00000100:00100000:1.0:1651531963.168793:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000942b56fd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754467457472:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531963.168797:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531963.168800:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca35e9 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445767 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.168810:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca35e9 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445767 expref: 19 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531963.168814:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca35e9 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445767 expref: 19 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531963.168817:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d44eb74d, rc 0)
00000100:00100000:1.0:1651531963.168829:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000942b56fd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754467457472:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (56us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531963.168831:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44466
00000100:00100000:1.0:1651531963.169581:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531963.169588:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467457984
00000100:00100000:1.0:1651531963.169601:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44467
00000100:00100000:1.0:1651531963.169602:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006d50fdfc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754467457984:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531963.169606:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531963.169609:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca35f0 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445775 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.169616:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca35f0 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445775 expref: 19 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531963.169620:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca35f0 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445775 expref: 19 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531963.169624:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000968553c1, rc 0)
00000100:00100000:1.0:1651531963.169638:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006d50fdfc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438147:x1731754467457984:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (57us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531963.169641:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44467
00000100:00100000:1.0:1651531963.169774:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531963.169781:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467458112
00000100:00100000:1.0:1651531963.169794:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249939
00000100:00100000:1.0:1651531963.169796:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ffcdece2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754467458112:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531963.169802:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca35f7 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.169807:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531963.169807:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531963.169808:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca35f7 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 13 type: EXT [106496->110591] (req 106496->110591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.169812:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca35f7 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 13 type: EXT [106496->110591] (req 106496->110591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.169824:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca35f7 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 13 type: EXT [106496->110591] (req 106496->110591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.169827:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca35f7 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 13 type: EXT [106496->110591] (req 106496->110591) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531963.169846:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ffcdece2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754467458112:12345-10.240.43.64@tcp:3:fio.0 Request processed in 49us (73us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531963.169849:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249939
00010000:00010000:1.0:1651531963.169856:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca35f7 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 13 type: EXT [106496->110591] (req 106496->110591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.169860:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c2b76533 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531963.169861:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca35f7 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 13 type: EXT [106496->110591] (req 106496->110591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.169864:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca35f7 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 13 type: EXT [106496->110591] (req 106496->110591) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.169869:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca35f7 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 13 type: EXT [106496->110591] (req 106496->110591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.169871:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca35f7 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 13 type: EXT [106496->110591] (req 106496->110591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651531963.204234:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869198 is committed
00010000:00010000:0.0:1651531963.204271:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca35db lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 12 type: EXT [180224->184319] (req 180224->184319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.204276:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca35db lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 12 type: EXT [180224->184319] (req 180224->184319) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531963.204297:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000df1eb0d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754467456960:12345-10.240.43.64@tcp:4:fio.0 Request processed in 71885us (71927us total) trans 21474869198 rc 0/0
00010000:00010000:1.0:1651531963.204300:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca35db lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 12 type: EXT [180224->184319] (req 180224->184319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531963.204300:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249937
00010000:00010000:1.0:1651531963.204304:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fab23815 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531963.204306:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca35db lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 12 type: EXT [180224->184319] (req 180224->184319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.204309:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca35db lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 12 type: EXT [180224->184319] (req 180224->184319) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.204314:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca35db lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 12 type: EXT [180224->184319] (req 180224->184319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.204317:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca35db lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 12 type: EXT [180224->184319] (req 180224->184319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531963.217668:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531963.217683:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531963.217691:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467458880
00000100:00100000:0.0:1651531963.217691:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467459008
00000100:00100000:1.0:1651531963.217702:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44468
00000100:00100000:1.0:1651531963.217704:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e62b9827 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754467458880:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531963.217707:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651531963.217708:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44469
00000100:00100000:0.0:1651531963.217710:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b82e604e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754467459008:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531963.217711:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca35fe lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445783 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.217714:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531963.217718:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca35fe lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445783 expref: 17 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531963.217722:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca35fe lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445783 expref: 17 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531963.217725:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca3605 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445791 expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.217726:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c2b76533, rc 0)
00010000:00010000:0.0:1651531963.217735:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca3605 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445791 expref: 17 pid: 166111 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651531963.217738:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e62b9827 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754467458880:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (71us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531963.217741:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44468
00010000:00010000:0.0:1651531963.217745:0:166111:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca3605 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445791 expref: 16 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531963.217749:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e2ec18e1, rc 0)
00000100:00100000:0.0:1651531963.217758:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b82e604e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754467459008:12345-10.240.43.64@tcp:101:fio.0 Request processed in 47us (75us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531963.217762:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44469
00000100:00100000:0.0:1651531963.218262:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531963.218296:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531963.218304:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467459200
00000100:00100000:0.0:1651531963.218314:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44470
00000100:00100000:0.0:1651531963.218316:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085e7e36c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754467459200:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531963.218320:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651531963.218323:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467459392
00010000:00010000:0.0:1651531963.218324:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca360c lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44579f expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.218332:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca360c lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44579f expref: 17 pid: 166111 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651531963.218334:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249940
00000100:00100000:1.0:1651531963.218336:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0251a23 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754467459392:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531963.218336:0:166111:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca360c lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44579f expref: 17 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531963.218340:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000032ee36ee, rc 0)
00010000:00010000:1.0:1651531963.218343:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3613 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.218347:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531963.218347:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:0.0:1651531963.218352:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085e7e36c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754467459200:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (90us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531963.218354:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44470
00010000:00010000:1.0:1651531963.218356:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3613 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 12 type: EXT [1015808->1019903] (req 1015808->1019903) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.218360:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3613 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 12 type: EXT [1015808->1019903] (req 1015808->1019903) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.218373:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3613 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 12 type: EXT [1015808->1019903] (req 1015808->1019903) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.218376:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3613 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 12 type: EXT [1015808->1019903] (req 1015808->1019903) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.218392:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3613 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 12 type: EXT [1015808->1019903] (req 1015808->1019903) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.218397:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000968553c1 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531963.218398:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3613 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 12 type: EXT [1015808->1019903] (req 1015808->1019903) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531963.218403:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0251a23 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754467459392:12345-10.240.43.64@tcp:3:fio.0 Request processed in 67us (107us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531963.218406:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249940
00010000:00010000:0.0:1651531963.218410:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3613 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 12 type: EXT [1015808->1019903] (req 1015808->1019903) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.218415:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3613 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 12 type: EXT [1015808->1019903] (req 1015808->1019903) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.218418:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3613 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 12 type: EXT [1015808->1019903] (req 1015808->1019903) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531963.218824:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531963.218842:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467459712
00000100:00100000:1.0:1651531963.218856:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249941
00000100:00100000:1.0:1651531963.218858:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000733c9403 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754467459712:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531963.218865:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca361a lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.218869:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531963.218869:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531963.218870:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca361a lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 12 type: EXT [94208->98303] (req 94208->98303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.218874:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca361a lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 12 type: EXT [94208->98303] (req 94208->98303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.218888:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca361a lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 12 type: EXT [94208->98303] (req 94208->98303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.218891:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca361a lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 12 type: EXT [94208->98303] (req 94208->98303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531963.218910:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000733c9403 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754467459712:12345-10.240.43.64@tcp:3:fio.0 Request processed in 51us (87us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531963.218913:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249941
00010000:00010000:1.0:1651531963.218920:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca361a lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 12 type: EXT [94208->98303] (req 94208->98303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.218923:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d44eb74d already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531963.218925:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca361a lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 12 type: EXT [94208->98303] (req 94208->98303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.218927:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca361a lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 12 type: EXT [94208->98303] (req 94208->98303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.218932:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca361a lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 12 type: EXT [94208->98303] (req 94208->98303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.218935:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca361a lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 12 type: EXT [94208->98303] (req 94208->98303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531963.242005:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531963.242013:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467459968
00000100:00100000:0.0:1651531963.242026:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44471
00000100:00100000:0.0:1651531963.242028:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bea48126 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754467459968:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531963.242031:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531963.242035:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3621 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4457ad expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.242043:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3621 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4457ad expref: 16 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531963.242047:0:166111:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3621 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4457ad expref: 16 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531963.242051:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000032ee36ee, rc 0)
00000100:00100000:0.0:1651531963.242061:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bea48126 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754467459968:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (56us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531963.242065:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44471
00000100:00100000:0.0:1651531963.242468:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531963.242489:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467460096
00000100:00100000:1.0:1651531963.242502:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249942
00000100:00100000:1.0:1651531963.242505:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000027d50205 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754467460096:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531963.242511:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3628 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.242515:0:216321:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000940bc691/0x3234de053ca2dfb lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 12 type: EXT [569344->573439] (req 569344->573439) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445403 expref: 15 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.242519:0:216321:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000083070e4b/0x3234de053ca2bee lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 12 type: EXT [565248->569343] (req 565248->569343) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444fcd expref: 15 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.242521:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:1.0:1651531963.242522:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 2
00010000:00010000:1.0:1651531963.242523:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3628 lrc: 5/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 12 type: EXT [393216->962559] (req 393216->962559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.242530:0:216321:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000083070e4b/0x3234de053ca2bee lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 12 type: EXT [565248->569343] (req 565248->569343) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444fcd expref: 15 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.242534:0:216321:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000083070e4b/0x3234de053ca2bee lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 12 type: EXT [565248->569343] (req 565248->569343) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444fcd expref: 15 pid: 166111 timeout: 22771 lvb_type: 0
00000100:00100000:1.0:1651531963.242538:0:216321:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007f998d3c pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997355776:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651531963.242557:0:216321:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000940bc691/0x3234de053ca2dfb lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 12 type: EXT [569344->573439] (req 569344->573439) gid 0 flags: 0x50000000020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445403 expref: 15 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.242561:0:216321:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000940bc691/0x3234de053ca2dfb lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 12 type: EXT [569344->573439] (req 569344->573439) gid 0 flags: 0x70000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445403 expref: 15 pid: 166112 timeout: 22771 lvb_type: 0
00000100:00100000:1.0:1651531963.242568:0:216321:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000053497d pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997355840:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531963.242574:0:216321:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b0ded350 going to sleep for 6 seconds
00000100:00100000:0.0:1651531963.242905:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531963.242913:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531963.242920:0:216321:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007f998d3c pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997355776:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531963.242920:0:166103:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467460352
00000100:00100000:1.0:1651531963.242923:0:216321:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000053497d pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997355840:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651531963.242926:0:166103:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000083070e4b/0x3234de053ca2bee lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 12 type: EXT [565248->569343] (req 565248->569343) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444fcd expref: 16 pid: 166111 timeout: 22771 lvb_type: 0
00010000:00010000:1.0:1651531963.242927:0:216321:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3628 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 13 type: EXT [393216->962559] (req 393216->962559) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531963.242937:0:166103:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467460416
00010000:00010000:0.0:1651531963.242940:0:166103:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000940bc691/0x3234de053ca2dfb lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 12 type: EXT [569344->573439] (req 569344->573439) gid 0 flags: 0x60000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445403 expref: 17 pid: 166112 timeout: 22771 lvb_type: 0
00000100:00100000:0.0:1651531963.242946:0:166103:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 208
00000100:00100000:0.0:1651531963.242947:0:166103:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000efdaa0c8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754467460352:12345-10.240.43.64@tcp:103:ldlm_bl_02.0
00000100:00100000:1.0:1651531963.242948:0:166102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 209
00000100:00100000:1.0:1651531963.242950:0:166102:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b5efe414 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754467460416:12345-10.240.43.64@tcp:103:ldlm_bl_05.0
00010000:00010000:0.0:1651531963.242950:0:166103:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1651531963.242954:0:166102:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531963.242954:0:166103:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000083070e4b/0x3234de053ca2bee lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 13 type: EXT [565248->569343] (req 565248->569343) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444fcd expref: 17 pid: 166111 timeout: 22771 lvb_type: 0
00010000:00010000:1.0:1651531963.242958:0:166102:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000940bc691/0x3234de053ca2dfb lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [569344->573439] (req 569344->573439) gid 0 flags: 0x60000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445403 expref: 17 pid: 166112 timeout: 22771 lvb_type: 0
00010000:00010000:0.0:1651531963.242958:0:166103:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000083070e4b/0x3234de053ca2bee lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 15 type: EXT [565248->569343] (req 565248->569343) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444fcd expref: 17 pid: 166111 timeout: 22771 lvb_type: 0
00010000:00010000:1.0:1651531963.242962:0:166102:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000940bc691/0x3234de053ca2dfb lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 14 type: EXT [569344->573439] (req 569344->573439) gid 0 flags: 0x50000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445403 expref: 17 pid: 166112 timeout: 22771 lvb_type: 0
00010000:00010000:0.0:1651531963.242969:0:166103:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000083070e4b/0x3234de053ca2bee lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 14 type: EXT [565248->569343] (req 565248->569343) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444fcd expref: 17 pid: 166111 timeout: 22771 lvb_type: 0
00010000:00010000:1.0:1651531963.242973:0:166102:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000940bc691/0x3234de053ca2dfb lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 13 type: EXT [569344->573439] (req 569344->573439) gid 0 flags: 0x44801400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445403 expref: 16 pid: 166112 timeout: 22771 lvb_type: 0
00010000:00010000:0.0:1651531963.242973:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531963.242974:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531963.242989:0:166103:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3628 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 14 type: EXT [393216->962559] (req 393216->962559) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.242995:0:166103:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3628 lrc: 4/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 12 type: EXT [393216->962559] (req 393216->962559) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.242999:0:166102:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1651531963.243005:0:166103:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1651531963.243016:0:166102:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b5efe414 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754467460416:12345-10.240.43.64@tcp:103:ldlm_bl_05.0 Request processed in 65us (103us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531963.243019:0:166102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 209
00000100:00100000:0.0:1651531963.243025:0:166103:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000efdaa0c8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754467460352:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 77us (120us total) trans 0 rc 0/0
00010000:00010000:1.0:1651531963.243027:0:216321:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3628 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [393216->962559] (req 393216->962559) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531963.243028:0:166103:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 208
00010000:00010000:1.0:1651531963.243032:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3628 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [393216->962559] (req 393216->962559) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531963.243044:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531963.243054:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467460544
00000100:00100000:1.0:1651531963.243067:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249943
00000100:00100000:1.0:1651531963.243068:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002d631b42 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754467460544:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531963.243075:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca362f lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.243090:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531963.243091:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531963.243092:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca362f lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 11 type: EXT [229376->233471] (req 229376->233471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.243102:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca362f lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 11 type: EXT [229376->233471] (req 229376->233471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.243112:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca362f lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 11 type: EXT [229376->233471] (req 229376->233471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.243115:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca362f lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 11 type: EXT [229376->233471] (req 229376->233471) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531963.243133:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002d631b42 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754467460544:12345-10.240.43.64@tcp:3:fio.0 Request processed in 63us (88us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531963.243135:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249943
00010000:00010000:1.0:1651531963.243142:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca362f lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 11 type: EXT [229376->233471] (req 229376->233471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.243147:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c2b76533 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531963.243148:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca362f lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 11 type: EXT [229376->233471] (req 229376->233471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.243151:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca362f lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 11 type: EXT [229376->233471] (req 229376->233471) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.243155:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca362f lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 11 type: EXT [229376->233471] (req 229376->233471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.243158:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca362f lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 11 type: EXT [229376->233471] (req 229376->233471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.243233:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3628 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [393216->962559] (req 393216->962559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.243237:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3628 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [393216->962559] (req 393216->962559) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.243248:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3628 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [393216->962559] (req 393216->962559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.243252:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d44eb74d already unused, calling callback (0000000049fddea7)
00000100:00100000:1.0:1651531963.243256:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000027d50205 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754467460096:12345-10.240.43.64@tcp:3:fio.0 Request processed in 750us (788us total) trans 0 rc 8192/8192
00010000:00010000:0.0:1651531963.243258:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3628 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [393216->962559] (req 393216->962559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531963.243259:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249942
00010000:00010000:0.0:1651531963.243262:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3628 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [393216->962559] (req 393216->962559) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.243267:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3628 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [393216->962559] (req 393216->962559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.243270:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3628 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [393216->962559] (req 393216->962559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531963.243424:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531963.243431:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467460672
00000100:00100000:0.0:1651531963.243445:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44472
00000100:00100000:0.0:1651531963.243448:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f1f50889 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754467460672:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531963.243452:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531963.243455:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca3636 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4457bb expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.243463:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca3636 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4457bb expref: 14 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531963.243467:0:166111:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca3636 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4457bb expref: 14 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531963.243470:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e2ec18e1, rc 0)
00000100:00100000:0.0:1651531963.243481:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f1f50889 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754467460672:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (57us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531963.243483:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44472
00000100:00100000:0.0:1651531963.243574:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531963.243583:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467460864
00000100:00100000:1.0:1651531963.243593:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249944
00000100:00100000:1.0:1651531963.243595:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000086b59493 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467460864:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531963.243601:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca363d lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.243606:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531963.243607:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531963.243608:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca363d lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.243612:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca363d lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.243622:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca363d lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.243625:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca363d lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531963.243643:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000086b59493 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467460864:12345-10.240.43.64@tcp:3:fio.0 Request processed in 47us (70us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531963.243646:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249944
00010000:00010000:1.0:1651531963.243652:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca363d lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.243655:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b4c8742a already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531963.243656:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca363d lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.243659:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca363d lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.243664:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca363d lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.243676:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca363d lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531963.243935:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531963.243943:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467461056
00000100:00100000:0.0:1651531963.243953:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44473
00000100:00100000:0.0:1651531963.243954:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c1f549f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467461056:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531963.243958:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531963.243961:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca3644 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4457c9 expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.243968:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca3644 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4457c9 expref: 14 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531963.243977:0:166111:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca3644 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4457c9 expref: 14 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531963.243980:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000820577fb, rc 0)
00000100:00100000:0.0:1651531963.243990:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c1f549f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467461056:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (55us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531963.243992:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44473
00000100:00100000:0.0:1651531963.244751:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531963.244768:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467461568
00000100:00100000:1.0:1651531963.244778:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249945
00000100:00100000:1.0:1651531963.244779:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000094ff6232 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467461568:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531963.244786:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca364b lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.244790:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531963.244790:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531963.244791:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca364b lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [581632->585727] (req 581632->585727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.244795:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca364b lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [581632->585727] (req 581632->585727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.244805:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca364b lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [581632->585727] (req 581632->585727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.244808:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca364b lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [581632->585727] (req 581632->585727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531963.244828:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000094ff6232 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467461568:12345-10.240.43.64@tcp:3:fio.0 Request processed in 48us (78us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531963.244831:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249945
00010000:00010000:1.0:1651531963.244838:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca364b lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [581632->585727] (req 581632->585727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.244843:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000968553c1 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531963.244843:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca364b lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [581632->585727] (req 581632->585727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.244846:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca364b lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [581632->585727] (req 581632->585727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.244851:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca364b lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [581632->585727] (req 581632->585727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.244853:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca364b lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [581632->585727] (req 581632->585727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531963.281972:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531963.281979:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467461888
00000100:00100000:0.0:1651531963.281991:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44474
00000100:00100000:0.0:1651531963.281993:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000089660739 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467461888:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531963.281996:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531963.282000:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca3652 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4457d7 expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.282007:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca3652 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4457d7 expref: 14 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531963.282011:0:166111:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca3652 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4457d7 expref: 14 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531963.282015:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000820577fb, rc 0)
00000100:00100000:0.0:1651531963.282024:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000089660739 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467461888:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (54us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531963.282030:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44474
00000100:00100000:0.0:1651531963.282259:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531963.282266:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467462144
00000100:00100000:0.0:1651531963.282276:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44475
00000100:00100000:0.0:1651531963.282277:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000e33e11e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754467462144:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531963.282281:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531963.282284:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca3659 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4457e5 expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.282291:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca3659 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4457e5 expref: 14 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531963.282295:0:166111:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca3659 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4457e5 expref: 14 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531963.282298:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e2ec18e1, rc 0)
00000100:00100000:0.0:1651531963.282308:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000e33e11e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754467462144:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (49us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531963.282310:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44475
00000100:00100000:0.0:1651531963.323119:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531963.323141:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467462656
00000100:00100000:1.0:1651531963.323152:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249946
00000100:00100000:1.0:1651531963.323154:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aa58c961 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467462656:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531963.323160:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3660 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.323165:0:216321:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca2e1e lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [151552->155647] (req 151552->155647) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44546c expref: 13 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.323169:0:216321:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000dfdae7d6/0x3234de053ca2c57 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [61440->65535] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4450b4 expref: 13 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.323172:0:216321:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca2ba1 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [126976->131071] (req 126976->131071) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db444f1e expref: 13 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.323179:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 3
00010000:00010000:1.0:1651531963.323180:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 3
00010000:00010000:1.0:1651531963.323180:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3660 lrc: 6/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [45056->319487] (req 45056->319487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.323187:0:216321:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca2ba1 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [126976->131071] (req 126976->131071) gid 0 flags: 0x50000000020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444f1e expref: 13 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.323191:0:216321:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca2ba1 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [126976->131071] (req 126976->131071) gid 0 flags: 0x70000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444f1e expref: 13 pid: 166113 timeout: 22771 lvb_type: 0
00000100:00100000:1.0:1651531963.323195:0:216321:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000053497d pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997355904:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651531963.323238:0:216321:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000dfdae7d6/0x3234de053ca2c57 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [61440->65535] (req 61440->65535) gid 0 flags: 0x50000000020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4450b4 expref: 13 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.323242:0:216321:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dfdae7d6/0x3234de053ca2c57 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [61440->65535] (req 61440->65535) gid 0 flags: 0x70000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4450b4 expref: 13 pid: 166112 timeout: 22771 lvb_type: 0
00000100:00100000:1.0:1651531963.323246:0:216321:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007f998d3c pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997355968:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651531963.323254:0:216321:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca2e1e lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [151552->155647] (req 151552->155647) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44546c expref: 13 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.323257:0:216321:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca2e1e lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [151552->155647] (req 151552->155647) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44546c expref: 13 pid: 166112 timeout: 22771 lvb_type: 0
00000100:00100000:1.0:1651531963.323288:0:216321:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009c93d7f2 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997356032:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531963.323303:0:216321:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b0ded350 going to sleep for 6 seconds
00000100:00100000:0.0:1651531963.323609:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531963.323618:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531963.323627:0:216321:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000053497d pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997355904:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531963.323627:0:166103:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467462976
00000100:00100000:1.0:1651531963.323631:0:216321:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007f998d3c pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997355968:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651531963.323633:0:166103:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca2ba1 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [126976->131071] (req 126976->131071) gid 0 flags: 0x60000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444f1e expref: 14 pid: 166113 timeout: 22771 lvb_type: 0
00000100:00100000:1.0:1651531963.323636:0:169267:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467463040
00010000:00010000:1.0:1651531963.323641:0:169267:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dfdae7d6/0x3234de053ca2c57 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [61440->65535] (req 61440->65535) gid 0 flags: 0x60000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4450b4 expref: 15 pid: 166112 timeout: 22771 lvb_type: 0
00000100:00100000:0.0:1651531963.323648:0:166103:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 210
00000100:00100000:0.0:1651531963.323650:0:166103:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cc11a3b9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754467462976:12345-10.240.43.64@tcp:103:ldlm_bl_03.0
00010000:00010000:0.0:1651531963.323653:0:166103:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00000100:00100000:1.0:1651531963.323655:0:169267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 211
00000100:00100000:1.0:1651531963.323656:0:169267:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002554c6d6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754467463040:12345-10.240.43.64@tcp:103:ldlm_bl_04.0
00010000:00010000:0.0:1651531963.323657:0:166103:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca2ba1 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 11 type: EXT [126976->131071] (req 126976->131071) gid 0 flags: 0x60000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444f1e expref: 15 pid: 166113 timeout: 22771 lvb_type: 0
00010000:00010000:1.0:1651531963.323660:0:169267:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1651531963.323664:0:169267:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dfdae7d6/0x3234de053ca2c57 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 12 type: EXT [61440->65535] (req 61440->65535) gid 0 flags: 0x60000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4450b4 expref: 15 pid: 166112 timeout: 22771 lvb_type: 0
00010000:00010000:1.0:1651531963.323668:0:169267:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dfdae7d6/0x3234de053ca2c57 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 12 type: EXT [61440->65535] (req 61440->65535) gid 0 flags: 0x50000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4450b4 expref: 15 pid: 166112 timeout: 22771 lvb_type: 0
00010000:00010000:1.0:1651531963.323674:0:169267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dfdae7d6/0x3234de053ca2c57 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 12 type: EXT [61440->65535] (req 61440->65535) gid 0 flags: 0x44801400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4450b4 expref: 15 pid: 166112 timeout: 22771 lvb_type: 0
00010000:00010000:0.0:1651531963.323676:0:166103:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca2ba1 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 13 type: EXT [126976->131071] (req 126976->131071) gid 0 flags: 0x50000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444f1e expref: 15 pid: 166113 timeout: 22771 lvb_type: 0
00010000:00010000:1.0:1651531963.323682:0:169267:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1651531963.323685:0:166103:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca2ba1 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [126976->131071] (req 126976->131071) gid 0 flags: 0x44801400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db444f1e expref: 14 pid: 166113 timeout: 22771 lvb_type: 0
00010000:00010000:0.0:1651531963.323690:0:166103:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1651531963.323694:0:169267:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002554c6d6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754467463040:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 37us (76us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531963.323697:0:169267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 211
00000100:00100000:0.0:1651531963.323704:0:166103:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cc11a3b9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754467462976:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 53us (96us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531963.323707:0:166103:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 210
00000100:00100000:1.0:1651531963.323758:0:216321:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009c93d7f2 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997356032:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651531963.323763:0:216321:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3660 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [45056->319487] (req 45056->319487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531963.323774:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531963.323795:0:166103:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467463104
00010000:00010000:0.0:1651531963.323801:0:166103:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca2e1e lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [151552->155647] (req 151552->155647) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44546c expref: 12 pid: 166112 timeout: 22771 lvb_type: 0
00000100:00100000:0.0:1651531963.323816:0:166103:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 212
00000100:00100000:0.0:1651531963.323817:0:166103:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cc11a3b9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438149:x1731754467463104:12345-10.240.43.64@tcp:103:ldlm_bl_02.0
00010000:00010000:0.0:1651531963.323820:0:166103:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531963.323824:0:166103:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca2e1e lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [151552->155647] (req 151552->155647) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44546c expref: 12 pid: 166112 timeout: 22771 lvb_type: 0
00010000:00010000:0.0:1651531963.323829:0:166103:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca2e1e lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [151552->155647] (req 151552->155647) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44546c expref: 12 pid: 166112 timeout: 22771 lvb_type: 0
00010000:00010000:0.0:1651531963.323835:0:166103:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca2e1e lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [151552->155647] (req 151552->155647) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44546c expref: 12 pid: 166112 timeout: 22771 lvb_type: 0
00010000:00010000:0.0:1651531963.323839:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531963.323840:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531963.323841:0:166103:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3660 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [45056->319487] (req 45056->319487) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.323844:0:166103:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3660 lrc: 4/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [45056->319487] (req 45056->319487) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.323855:0:166103:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1651531963.323862:0:216321:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3660 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [45056->319487] (req 45056->319487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531963.323864:0:166103:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cc11a3b9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754467463104:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 46us (90us total) trans 0 rc 0/0
00010000:00010000:1.0:1651531963.323866:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3660 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [45056->319487] (req 45056->319487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531963.323867:0:166103:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 212
00010000:00010000:1.0:1651531963.324034:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3660 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [45056->319487] (req 45056->319487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.324038:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3660 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [45056->319487] (req 45056->319487) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.324050:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3660 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [45056->319487] (req 45056->319487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.324054:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000968553c1 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531963.324055:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3660 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [45056->319487] (req 45056->319487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531963.324057:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aa58c961 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754467462656:12345-10.240.43.64@tcp:3:fio.0 Request processed in 902us (939us total) trans 0 rc 8192/8192
00010000:00010000:0.0:1651531963.324059:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3660 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [45056->319487] (req 45056->319487) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531963.324060:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249946
00010000:00010000:0.0:1651531963.324069:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3660 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [45056->319487] (req 45056->319487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.324072:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3660 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [45056->319487] (req 45056->319487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531963.324463:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531963.324474:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531963.324486:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467463232
00000100:00100000:1.0:1651531963.324489:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467463360
00000100:00100000:0.0:1651531963.324497:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44476
00000100:00100000:0.0:1651531963.324498:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003158b8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754467463232:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531963.324502:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651531963.324507:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249947
00000100:00100000:1.0:1651531963.324509:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000000615301 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754467463360:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531963.324513:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca3667 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4457f3 expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.324516:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca366e lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.324521:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531963.324521:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531963.324522:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca366e lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [131072->135167] (req 131072->135167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.324526:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca366e lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [131072->135167] (req 131072->135167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.324528:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca3667 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4457f3 expref: 12 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531963.324533:0:166111:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca3667 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4457f3 expref: 12 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531963.324536:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e2ec18e1, rc 0)
00000100:00100000:0.0:1651531963.324548:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003158b8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754467463232:12345-10.240.43.64@tcp:101:fio.0 Request processed in 49us (85us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531963.324550:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44476
00000100:00100000:0.0:1651531963.325283:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531963.325293:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467463616
00000100:00100000:0.0:1651531963.325304:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249948
00000100:00100000:0.0:1651531963.325306:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000021f31110 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467463616:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531963.325313:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca3675 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.325317:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531963.325318:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531963.325319:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca3675 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [659456->663551] (req 659456->663551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.325323:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca3675 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [659456->663551] (req 659456->663551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651531963.358889:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869199 is committed
00010000:00010000:0.0:1651531963.358930:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca366e lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [131072->135167] (req 131072->135167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.358936:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca366e lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [131072->135167] (req 131072->135167) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.358965:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca366e lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [131072->135167] (req 131072->135167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531963.358971:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000000615301 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754467463360:12345-10.240.43.64@tcp:4:fio.0 Request processed in 34460us (34496us total) trans 21474869199 rc 0/0
00010000:00010000:1.0:1651531963.358974:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b4c8742a already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531963.358975:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca366e lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [131072->135167] (req 131072->135167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531963.358977:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249947
00010000:00010000:1.0:1651531963.358978:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca366e lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [131072->135167] (req 131072->135167) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.358984:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca366e lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [131072->135167] (req 131072->135167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.358987:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca366e lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [131072->135167] (req 131072->135167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531963.396763:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531963.396772:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467464128
00000100:00100000:0.0:1651531963.396783:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249949
00000100:00100000:0.0:1651531963.396785:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000053de45f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467464128:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531963.396792:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca367c lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.396798:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531963.396798:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531963.396799:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca367c lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [716800->720895] (req 716800->720895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.396803:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca367c lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [716800->720895] (req 716800->720895) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651531963.407925:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869200 is committed
00010000:00010000:0.0:1651531963.407957:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca3675 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [659456->663551] (req 659456->663551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.407962:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca3675 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [659456->663551] (req 659456->663551) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531963.407984:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000021f31110 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467463616:12345-10.240.43.64@tcp:4:fio.0 Request processed in 82677us (82701us total) trans 21474869200 rc 0/0
00010000:00010000:1.0:1651531963.407985:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca3675 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [659456->663551] (req 659456->663551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531963.407987:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249948
00010000:00010000:1.0:1651531963.407989:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000820577fb already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531963.407990:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca3675 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [659456->663551] (req 659456->663551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.407993:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca3675 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [659456->663551] (req 659456->663551) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.408002:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca3675 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [659456->663551] (req 659456->663551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.408005:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca3675 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [659456->663551] (req 659456->663551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531963.408330:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531963.408338:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467464256
00000100:00100000:0.0:1651531963.408346:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44477
00000100:00100000:0.0:1651531963.408348:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006c46ca95 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754467464256:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531963.408351:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531963.408355:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca3683 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445801 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.408363:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca3683 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445801 expref: 14 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531963.408371:0:166112:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca3683 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445801 expref: 14 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531963.408375:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f5657138, rc 0)
00000100:00100000:0.0:1651531963.408384:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006c46ca95 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754467464256:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (55us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531963.408387:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44477
00000100:00100000:0.0:1651531963.409168:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531963.409176:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467464512
00000100:00100000:0.0:1651531963.409185:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249950
00000100:00100000:0.0:1651531963.409187:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b5efe414 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467464512:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531963.409194:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca368a lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.409198:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531963.409199:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531963.409199:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca368a lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [339968->344063] (req 339968->344063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.409204:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca368a lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [339968->344063] (req 339968->344063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651531963.479724:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869202 is committed
00010000:00010000:0.0:1651531963.479760:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca368a lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [339968->344063] (req 339968->344063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.479764:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca368a lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [339968->344063] (req 339968->344063) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531963.479783:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b5efe414 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754467464512:12345-10.240.43.64@tcp:4:fio.0 Request processed in 70595us (70615us total) trans 21474869202 rc 0/0
00000100:00100000:0.0:1651531963.479786:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249950
00010000:00010000:0.0:1651531963.479793:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca368a lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [339968->344063] (req 339968->344063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.479796:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000032ee36ee already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531963.479798:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca368a lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [339968->344063] (req 339968->344063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.479800:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca368a lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [339968->344063] (req 339968->344063) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.479805:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca368a lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [339968->344063] (req 339968->344063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.479808:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca368a lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [339968->344063] (req 339968->344063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.479818:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca367c lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [716800->720895] (req 716800->720895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.479821:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca367c lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [716800->720895] (req 716800->720895) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531963.479838:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000053de45f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754467464128:12345-10.240.43.64@tcp:4:fio.0 Request processed in 83053us (83076us total) trans 21474869201 rc 0/0
00010000:00010000:1.0:1651531963.479844:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca367c lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [716800->720895] (req 716800->720895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531963.479844:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249949
00010000:00010000:1.0:1651531963.479849:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e2ec18e1 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531963.479850:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca367c lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [716800->720895] (req 716800->720895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.479853:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca367c lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [716800->720895] (req 716800->720895) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.479858:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca367c lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [716800->720895] (req 716800->720895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.479861:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca367c lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [716800->720895] (req 716800->720895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531963.480272:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531963.480280:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467464896
00000100:00100000:0.0:1651531963.480288:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44478
00000100:00100000:0.0:1651531963.480290:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000efdaa0c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438148:x1731754467464896:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531963.480293:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531963.480297:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca3691 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44580f expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.480304:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca3691 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44580f expref: 11 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531963.480309:0:166111:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca3691 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44580f expref: 11 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531963.480312:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f5657138, rc 0)
00000100:00100000:0.0:1651531963.480321:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000efdaa0c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438148:x1731754467464896:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (50us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531963.480324:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44478
00000100:00100000:0.0:1651531963.481037:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531963.481044:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467465280
00000100:00100000:0.0:1651531963.481051:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44479
00000100:00100000:0.0:1651531963.481053:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bedaf1f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754467465280:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531963.481056:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531963.481059:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca3698 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44581d expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.481067:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca3698 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44581d expref: 11 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531963.481071:0:166112:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca3698 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44581d expref: 11 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531963.481075:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000820577fb, rc 0)
00000100:00100000:0.0:1651531963.481084:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bedaf1f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754467465280:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (47us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531963.481086:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44479
00000100:00100000:0.0:1651531963.481843:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531963.481851:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467465536
00000100:00100000:0.0:1651531963.481861:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249951
00000100:00100000:0.0:1651531963.481863:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029096870 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438148:x1731754467465536:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531963.481869:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca369f lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.481873:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531963.481874:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531963.481875:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca369f lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [155648->159743] (req 155648->159743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.481879:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca369f lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [155648->159743] (req 155648->159743) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531963.541405:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531963.541415:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467465856
00000100:00100000:0.0:1651531963.541423:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44480
00000100:00100000:0.0:1651531963.541425:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003b40261e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467465856:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531963.541428:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531963.541432:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca36a6 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44582b expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.541440:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca36a6 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44582b expref: 14 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531963.541444:0:166111:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca36a6 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44582b expref: 14 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531963.541447:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000820577fb, rc 0)
00000100:00100000:0.0:1651531963.541457:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003b40261e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467465856:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (53us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531963.541460:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44480
00000100:00100000:0.0:1651531963.541929:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531963.541936:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467466176
00000100:00100000:0.0:1651531963.541943:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44481
00000100:00100000:0.0:1651531963.541944:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dfff0362 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467466176:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531963.541948:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531963.541951:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca36ad lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445839 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.541964:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca36ad lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445839 expref: 14 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531963.541982:0:166112:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca36ad lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445839 expref: 14 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531963.541986:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f5657138, rc 0)
00000100:00100000:0.0:1651531963.541996:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dfff0362 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467466176:12345-10.240.43.64@tcp:101:fio.0 Request processed in 51us (68us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531963.541999:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44481
00000100:00100000:0.0:1651531963.542379:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531963.542386:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467466368
00000100:00100000:0.0:1651531963.542393:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44482
00000100:00100000:0.0:1651531963.542394:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001304ce4c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754467466368:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531963.542398:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531963.542401:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca36b4 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445847 expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.542408:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca36b4 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445847 expref: 14 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531963.542412:0:166111:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca36b4 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445847 expref: 14 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531963.542415:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000032ee36ee, rc 0)
00000100:00100000:0.0:1651531963.542424:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001304ce4c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754467466368:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (46us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531963.542427:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44482
00000100:00100000:0.0:1651531963.542816:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531963.542823:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467466688
00000100:00100000:0.0:1651531963.542833:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249952
00000100:00100000:0.0:1651531963.542835:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000063869776 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467466688:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531963.542841:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca36bb lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.542845:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531963.542846:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531963.542847:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca36bb lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [544768->548863] (req 544768->548863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.542851:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca36bb lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [544768->548863] (req 544768->548863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.542863:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca36bb lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [544768->548863] (req 544768->548863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.542866:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca36bb lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [544768->548863] (req 544768->548863) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.542889:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca36bb lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [544768->548863] (req 544768->548863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531963.542889:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000063869776 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467466688:12345-10.240.43.64@tcp:3:fio.0 Request processed in 54us (74us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531963.542892:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249952
00010000:00010000:1.0:1651531963.542894:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000075a78972 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531963.542895:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca36bb lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [544768->548863] (req 544768->548863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.542909:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca36bb lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [544768->548863] (req 544768->548863) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.542914:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca36bb lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [544768->548863] (req 544768->548863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.542917:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca36bb lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [544768->548863] (req 544768->548863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531963.543166:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531963.543175:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531963.543181:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467466944
00000100:00100000:0.0:1651531963.543188:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44483
00000100:00100000:0.0:1651531963.543190:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d710c5fd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467466944:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531963.543202:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531963.543215:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca36c2 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445855 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.543238:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca36c2 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445855 expref: 14 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531963.543242:0:166112:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca36c2 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445855 expref: 14 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531963.543246:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000080362f27, rc 0)
00000100:00100000:0.0:1651531963.543257:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d710c5fd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467466944:12345-10.240.43.64@tcp:101:fio.0 Request processed in 66us (82us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531963.543259:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44483
00000100:00100000:0.0:1651531963.543288:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467466880
00000100:00100000:0.0:1651531963.543298:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249953
00000100:00100000:0.0:1651531963.543299:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009b569a7a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467466880:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531963.543306:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca36c9 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.543310:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531963.543311:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531963.543312:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca36c9 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.543316:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca36c9 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.543339:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca36c9 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.543342:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca36c9 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531963.543357:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009b569a7a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467466880:12345-10.240.43.64@tcp:3:fio.0 Request processed in 57us (191us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531963.543359:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249953
00010000:00010000:0.0:1651531963.543366:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca36c9 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.543369:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c1022d42 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531963.543370:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca36c9 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.543373:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca36c9 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.543377:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca36c9 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.543380:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca36c9 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531963.543665:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531963.543673:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467467200
00000100:00100000:0.0:1651531963.543692:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249954
00000100:00100000:0.0:1651531963.543693:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000be87d738 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467467200:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531963.543700:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca36d0 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.543704:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531963.543705:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531963.543706:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca36d0 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [663552->667647] (req 663552->667647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.543710:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca36d0 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [663552->667647] (req 663552->667647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531963.543909:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531963.543917:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467467328
00000100:00100000:0.0:1651531963.543933:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249955
00000100:00100000:0.0:1651531963.543935:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000052213cb9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754467467328:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531963.543942:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca36d7 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.543947:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531963.543947:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531963.543948:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca36d7 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [823296->827391] (req 823296->827391) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.543953:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca36d7 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [823296->827391] (req 823296->827391) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651531963.553336:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869203 is committed
00010000:00010000:0.0:1651531963.553368:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca369f lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [155648->159743] (req 155648->159743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.553381:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca369f lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [155648->159743] (req 155648->159743) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531963.553402:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029096870 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754467465536:12345-10.240.43.64@tcp:4:fio.0 Request processed in 71539us (71559us total) trans 21474869203 rc 0/0
00010000:00010000:1.0:1651531963.553404:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca369f lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [155648->159743] (req 155648->159743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531963.553406:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249951
00010000:00010000:1.0:1651531963.553408:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fab23815 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531963.553409:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca369f lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [155648->159743] (req 155648->159743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.553412:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca369f lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [155648->159743] (req 155648->159743) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.553417:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca369f lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [155648->159743] (req 155648->159743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.553420:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca369f lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [155648->159743] (req 155648->159743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531963.553713:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531963.553721:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467467456
00000100:00100000:0.0:1651531963.553728:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44484
00000100:00100000:0.0:1651531963.553730:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000374facb9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754467467456:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531963.553733:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531963.553737:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca36de lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445863 expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.553745:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca36de lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445863 expref: 17 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531963.553749:0:166111:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca36de lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445863 expref: 17 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531963.553753:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c1022d42, rc 0)
00000100:00100000:0.0:1651531963.553762:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000374facb9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754467467456:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (49us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531963.553764:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44484
00000100:00100000:0.0:1651531963.578814:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531963.578831:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467467968
00000100:00100000:0.0:1651531963.578839:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44485
00000100:00100000:0.0:1651531963.578841:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002ef35a72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754467467968:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531963.578845:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531963.578848:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca36e5 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445871 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.578856:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca36e5 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445871 expref: 17 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531963.578860:0:166112:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca36e5 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445871 expref: 17 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531963.578863:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c1022d42, rc 0)
00000100:00100000:0.0:1651531963.578873:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002ef35a72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754467467968:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (60us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531963.578875:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44485
00000100:00100000:0.0:1651531963.579562:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531963.579570:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467468224
00000100:00100000:0.0:1651531963.579585:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249956
00000100:00100000:0.0:1651531963.579587:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002512e905 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754467468224:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531963.579593:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca36ec lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.579598:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531963.579598:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531963.579599:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca36ec lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [16384->20479] (req 16384->20479) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.579606:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca36ec lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [16384->20479] (req 16384->20479) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651531963.614033:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869205 is committed
00010000:00010000:0.0:1651531963.614069:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca36d0 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [663552->667647] (req 663552->667647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.614076:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca36d0 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [663552->667647] (req 663552->667647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.614084:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca36d7 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [823296->827391] (req 823296->827391) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.614102:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca36d7 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [823296->827391] (req 823296->827391) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531963.614106:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000be87d738 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754467467200:12345-10.240.43.64@tcp:4:fio.0 Request processed in 70411us (70440us total) trans 21474869204 rc 0/0
00000100:00100000:1.0:1651531963.614122:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000052213cb9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754467467328:12345-10.240.43.64@tcp:4:fio.0 Request processed in 70185us (70213us total) trans 21474869205 rc 0/0
00000100:00100000:0.0:1651531963.614122:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249954
00000100:00100000:1.0:1651531963.614125:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249955
00010000:00010000:1.0:1651531963.614134:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca36d0 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [663552->667647] (req 663552->667647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.614135:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca36d7 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [823296->827391] (req 823296->827391) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.614138:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000014685f38 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531963.614142:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fb2f6575 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531963.614144:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca36d7 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [823296->827391] (req 823296->827391) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.614150:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca36d7 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [823296->827391] (req 823296->827391) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.614152:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca36d0 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [663552->667647] (req 663552->667647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.614160:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca36d0 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [663552->667647] (req 663552->667647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.614161:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca36d7 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [823296->827391] (req 823296->827391) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.614164:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca36d7 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [823296->827391] (req 823296->827391) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.614166:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca36d0 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [663552->667647] (req 663552->667647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.614169:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca36d0 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [663552->667647] (req 663552->667647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531963.614513:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531963.614530:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467468480
00000100:00100000:1.0:1651531963.614547:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249957
00000100:00100000:1.0:1651531963.614549:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000033696ffa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467468480:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531963.614557:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca36f3 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.614570:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531963.614570:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531963.614571:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca36f3 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [847872->851967] (req 847872->851967) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.614575:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca36f3 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [847872->851967] (req 847872->851967) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651531963.639107:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869206 is committed
00010000:00010000:1.0:1651531963.639147:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca36ec lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [16384->20479] (req 16384->20479) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.639152:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca36ec lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [16384->20479] (req 16384->20479) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531963.639173:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002512e905 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754467468224:12345-10.240.43.64@tcp:4:fio.0 Request processed in 59585us (59611us total) trans 21474869206 rc 0/0
00000100:00100000:1.0:1651531963.639176:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249956
00010000:00010000:1.0:1651531963.639184:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca36ec lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [16384->20479] (req 16384->20479) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.639187:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000080362f27 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531963.639188:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca36ec lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [16384->20479] (req 16384->20479) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.639191:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca36ec lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [16384->20479] (req 16384->20479) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.639251:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca36ec lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [16384->20479] (req 16384->20479) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.639254:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca36ec lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [16384->20479] (req 16384->20479) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531963.639519:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531963.639528:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467468800
00000100:00100000:0.0:1651531963.639536:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44486
00000100:00100000:0.0:1651531963.639538:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b10bc064 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467468800:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531963.639542:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531963.639546:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca36fa lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44587f expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.639554:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca36fa lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44587f expref: 14 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531963.639558:0:166111:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca36fa lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44587f expref: 14 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531963.639561:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fb2f6575, rc 0)
00000100:00100000:0.0:1651531963.639571:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b10bc064 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467468800:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (52us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531963.639573:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44486
00000100:00100000:0.0:1651531963.640310:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531963.640321:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467469056
00000100:00100000:1.0:1651531963.640335:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249958
00000100:00100000:1.0:1651531963.640337:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000099b6616a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754467469056:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531963.640351:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3701 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.640356:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531963.640356:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531963.640357:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3701 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [524288->528383] (req 524288->528383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.640361:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3701 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [524288->528383] (req 524288->528383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651531963.686799:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869207 is committed
00010000:00010000:0.0:1651531963.686836:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca36f3 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [847872->851967] (req 847872->851967) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.686843:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca36f3 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [847872->851967] (req 847872->851967) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.686887:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca36f3 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [847872->851967] (req 847872->851967) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.686892:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b4c8742a already unused, calling callback (0000000049fddea7)
00000100:00100000:0.0:1651531963.686892:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000033696ffa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467468480:12345-10.240.43.64@tcp:4:fio.0 Request processed in 72341us (72378us total) trans 21474869207 rc 0/0
00010000:00010000:1.0:1651531963.686893:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca36f3 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [847872->851967] (req 847872->851967) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531963.686898:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249957
00010000:00010000:1.0:1651531963.686907:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca36f3 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [847872->851967] (req 847872->851967) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.686925:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca36f3 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [847872->851967] (req 847872->851967) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.686928:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca36f3 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [847872->851967] (req 847872->851967) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531963.699720:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531963.699729:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467469440
00000100:00100000:0.0:1651531963.699745:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249959
00000100:00100000:0.0:1651531963.699748:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a20162bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754467469440:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531963.699760:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3708 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.699766:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531963.699767:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531963.699768:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3708 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [991232->995327] (req 991232->995327) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.699773:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3708 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [991232->995327] (req 991232->995327) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.699785:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3708 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [991232->995327] (req 991232->995327) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.699789:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3708 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [991232->995327] (req 991232->995327) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531963.699811:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a20162bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754467469440:12345-10.240.43.64@tcp:3:fio.0 Request processed in 63us (92us total) trans 0 rc 4096/4096
00010000:00010000:1.0:1651531963.699813:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3708 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [991232->995327] (req 991232->995327) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531963.699815:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249959
00010000:00010000:1.0:1651531963.699817:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fb2f6575 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531963.699818:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3708 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [991232->995327] (req 991232->995327) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.699821:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3708 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [991232->995327] (req 991232->995327) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.699826:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3708 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [991232->995327] (req 991232->995327) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.699829:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3708 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [991232->995327] (req 991232->995327) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531963.700173:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531963.700183:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467469568
00000100:00100000:0.0:1651531963.700191:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44487
00000100:00100000:0.0:1651531963.700193:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000427633c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467469568:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531963.700197:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531963.700200:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca370f lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44588d expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.700220:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca370f lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44588d expref: 14 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531963.700240:0:166112:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca370f lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44588d expref: 14 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531963.700243:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c1022d42, rc 0)
00000100:00100000:0.0:1651531963.700255:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000427633c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467469568:12345-10.240.43.64@tcp:101:fio.0 Request processed in 61us (82us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531963.700257:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44487
00000100:00100000:0.0:1651531963.700901:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531963.700908:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467469824
00000100:00100000:0.0:1651531963.700922:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44488
00000100:00100000:0.0:1651531963.700924:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d76314b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754467469824:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531963.700927:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531963.700931:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3716 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44589b expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.700938:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3716 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44589b expref: 14 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531963.700952:0:166112:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3716 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44589b expref: 14 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531963.700955:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000032ee36ee, rc 0)
00000100:00100000:0.0:1651531963.700966:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d76314b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754467469824:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (65us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531963.700968:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44488
00000100:00100000:0.0:1651531963.701590:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531963.701609:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467470080
00000100:00100000:1.0:1651531963.701625:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249960
00000100:00100000:1.0:1651531963.701627:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008b42dfe9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467470080:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531963.701636:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca371d lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.701640:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531963.701641:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531963.701642:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca371d lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [790528->794623] (req 790528->794623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.701646:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca371d lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [790528->794623] (req 790528->794623) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.701659:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca371d lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [790528->794623] (req 790528->794623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.701662:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca371d lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [790528->794623] (req 790528->794623) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.701679:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca371d lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [790528->794623] (req 790528->794623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531963.701684:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008b42dfe9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467470080:12345-10.240.43.64@tcp:3:fio.0 Request processed in 55us (94us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531963.701687:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249960
00010000:00010000:0.0:1651531963.701688:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b4c8742a already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531963.701690:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca371d lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [790528->794623] (req 790528->794623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.701693:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca371d lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [790528->794623] (req 790528->794623) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.701699:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca371d lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [790528->794623] (req 790528->794623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.701701:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca371d lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [790528->794623] (req 790528->794623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531963.701972:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531963.701988:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467470208
00000100:00100000:1.0:1651531963.702002:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249961
00000100:00100000:1.0:1651531963.702003:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b97e3b28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754467470208:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531963.702010:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3724 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.702014:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531963.702015:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531963.702017:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3724 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [811008->815103] (req 811008->815103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.702021:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3724 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [811008->815103] (req 811008->815103) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.702032:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3724 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [811008->815103] (req 811008->815103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.702035:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3724 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [811008->815103] (req 811008->815103) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531963.702049:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b97e3b28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754467470208:12345-10.240.43.64@tcp:3:fio.0 Request processed in 45us (78us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531963.702052:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249961
00010000:00010000:1.0:1651531963.702059:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3724 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [811008->815103] (req 811008->815103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.702062:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008558d1b3 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531963.702063:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3724 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [811008->815103] (req 811008->815103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.702066:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3724 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [811008->815103] (req 811008->815103) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.702070:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3724 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [811008->815103] (req 811008->815103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.702073:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3724 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [811008->815103] (req 811008->815103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651531963.711387:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869208 is committed
00010000:00010000:1.0:1651531963.711399:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3701 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [524288->528383] (req 524288->528383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.711403:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3701 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [524288->528383] (req 524288->528383) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531963.711423:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000099b6616a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438148:x1731754467469056:12345-10.240.43.64@tcp:4:fio.0 Request processed in 71084us (71113us total) trans 21474869208 rc 0/0
00000100:00100000:1.0:1651531963.711426:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249958
00010000:00010000:1.0:1651531963.711432:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3701 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [524288->528383] (req 524288->528383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.711436:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c2b76533 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531963.711437:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3701 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [524288->528383] (req 524288->528383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.711439:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3701 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [524288->528383] (req 524288->528383) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.711444:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3701 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [524288->528383] (req 524288->528383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.711447:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3701 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [524288->528383] (req 524288->528383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531963.768311:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531963.768334:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467471040
00000100:00100000:0.0:1651531963.768356:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44489
00000100:00100000:0.0:1651531963.768357:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009c93d7f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754467471040:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531963.768361:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531963.768365:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca372b lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4458a9 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.768373:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca372b lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4458a9 expref: 11 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531963.768377:0:166112:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca372b lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4458a9 expref: 11 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531963.768381:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000032ee36ee, rc 0)
00000100:00100000:0.0:1651531963.768392:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009c93d7f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754467471040:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (82us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531963.768395:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44489
00000100:00100000:1.0:1651531963.769030:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531963.769046:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467471296
00000100:00100000:0.0:1651531963.769059:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44490
00000100:00100000:0.0:1651531963.769061:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007f998d3c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438148:x1731754467471296:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531963.769064:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531963.769068:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3732 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4458b7 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.769075:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3732 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4458b7 expref: 11 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531963.769079:0:166112:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3732 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4458b7 expref: 11 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531963.769084:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c1022d42, rc 0)
00000100:00100000:0.0:1651531963.769094:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007f998d3c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438148:x1731754467471296:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (65us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531963.769097:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44490
00000100:00100000:1.0:1651531963.800921:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531963.800929:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467471744
00000100:00100000:1.0:1651531963.800939:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249962
00000100:00100000:1.0:1651531963.800941:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000053497d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438148:x1731754467471744:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531963.800948:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3739 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.800952:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531963.800953:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531963.800954:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3739 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [241664->245759] (req 241664->245759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.800957:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3739 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [241664->245759] (req 241664->245759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.800968:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3739 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [241664->245759] (req 241664->245759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.800971:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3739 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [241664->245759] (req 241664->245759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531963.800991:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000053497d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438148:x1731754467471744:12345-10.240.43.64@tcp:3:fio.0 Request processed in 49us (70us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531963.800994:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249962
00010000:00010000:0.0:1651531963.800996:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3739 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [241664->245759] (req 241664->245759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.801001:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c2b76533 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531963.801002:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3739 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [241664->245759] (req 241664->245759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.801005:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3739 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [241664->245759] (req 241664->245759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.801011:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3739 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [241664->245759] (req 241664->245759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.801014:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3739 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [241664->245759] (req 241664->245759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531963.801322:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531963.801331:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467471872
00000100:00100000:1.0:1651531963.801340:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249963
00000100:00100000:1.0:1651531963.801342:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007d76765b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754467471872:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531963.801358:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3740 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.801363:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531963.801363:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531963.801364:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3740 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.801368:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3740 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.801379:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3740 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.801382:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3740 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531963.801396:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007d76765b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754467471872:12345-10.240.43.64@tcp:3:fio.0 Request processed in 53us (74us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531963.801398:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249963
00010000:00010000:1.0:1651531963.801405:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3740 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.801408:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008558d1b3 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531963.801409:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3740 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.801412:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3740 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.801428:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3740 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.801431:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3740 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531963.801739:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531963.801746:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467472000
00000100:00100000:1.0:1651531963.801754:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249964
00000100:00100000:1.0:1651531963.801756:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000942b56fd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438148:x1731754467472000:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531963.801762:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3747 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.801766:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531963.801767:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531963.801768:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3747 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [933888->937983] (req 933888->937983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.801772:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3747 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [933888->937983] (req 933888->937983) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.801782:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3747 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [933888->937983] (req 933888->937983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.801785:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3747 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [933888->937983] (req 933888->937983) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531963.801798:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000942b56fd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438148:x1731754467472000:12345-10.240.43.64@tcp:3:fio.0 Request processed in 41us (60us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531963.801811:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249964
00010000:00010000:1.0:1651531963.801818:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3747 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [933888->937983] (req 933888->937983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.801821:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001e36c601 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531963.801822:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3747 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [933888->937983] (req 933888->937983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.801825:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3747 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [933888->937983] (req 933888->937983) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.801830:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3747 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [933888->937983] (req 933888->937983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.801833:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3747 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [933888->937983] (req 933888->937983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531963.802157:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531963.802169:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467472128
00000100:00100000:0.0:1651531963.802182:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44491
00000100:00100000:0.0:1651531963.802184:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009c5a362f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754467472128:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531963.802187:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531963.802191:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca374e lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4458c5 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.802202:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca374e lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4458c5 expref: 11 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531963.802216:0:166112:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca374e lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4458c5 expref: 11 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531963.802220:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c1022d42, rc 0)
00000100:00100000:0.0:1651531963.802244:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009c5a362f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754467472128:12345-10.240.43.64@tcp:101:fio.0 Request processed in 60us (88us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531963.802247:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44491
00000100:00100000:1.0:1651531963.825640:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531963.825648:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467472640
00000100:00100000:1.0:1651531963.825657:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249965
00000100:00100000:1.0:1651531963.825659:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000503404b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438146:x1731754467472640:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531963.825666:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3755 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.825670:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531963.825670:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531963.825671:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3755 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [978944->983039] (req 978944->983039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.825684:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3755 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [978944->983039] (req 978944->983039) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.825695:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3755 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [978944->983039] (req 978944->983039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.825699:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3755 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [978944->983039] (req 978944->983039) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531963.825718:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000503404b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438146:x1731754467472640:12345-10.240.43.64@tcp:3:fio.0 Request processed in 58us (79us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531963.825721:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249965
00010000:00010000:0.0:1651531963.825723:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3755 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [978944->983039] (req 978944->983039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.825727:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001e36c601 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531963.825728:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3755 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [978944->983039] (req 978944->983039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.825731:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3755 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [978944->983039] (req 978944->983039) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.825737:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3755 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [978944->983039] (req 978944->983039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.825740:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3755 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [978944->983039] (req 978944->983039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531963.849940:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531963.849948:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467473152
00000100:00100000:1.0:1651531963.849958:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249966
00000100:00100000:1.0:1651531963.849960:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f148f36a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754467473152:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531963.849966:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca375c lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.849970:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531963.849971:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531963.849972:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca375c lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [929792->933887] (req 929792->933887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.849976:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca375c lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [929792->933887] (req 929792->933887) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531963.850696:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531963.850721:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467473408
00000100:00100000:0.0:1651531963.850736:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44492
00000100:00100000:0.0:1651531963.850737:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d5703b86 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754467473408:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531963.850741:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531963.850745:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3763 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4458d3 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.850753:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3763 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4458d3 expref: 14 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531963.850757:0:166112:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3763 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4458d3 expref: 14 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531963.850760:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c1022d42, rc 0)
00000100:00100000:0.0:1651531963.850776:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d5703b86 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754467473408:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (80us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531963.850778:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44492
00000100:00100000:1.0:1651531963.851400:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531963.851408:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467473664
00000100:00100000:1.0:1651531963.851423:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249967
00000100:00100000:1.0:1651531963.851425:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d349b145 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467473664:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531963.851432:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca376a lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.851436:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531963.851437:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531963.851438:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca376a lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [815104->819199] (req 815104->819199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.851442:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca376a lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [815104->819199] (req 815104->819199) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.851454:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca376a lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [815104->819199] (req 815104->819199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.851457:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca376a lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [815104->819199] (req 815104->819199) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531963.851472:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d349b145 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467473664:12345-10.240.43.64@tcp:3:fio.0 Request processed in 46us (72us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531963.851474:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249967
00010000:00010000:1.0:1651531963.851480:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca376a lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [815104->819199] (req 815104->819199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.851488:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a8889a80 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531963.851489:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca376a lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [815104->819199] (req 815104->819199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.851492:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca376a lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [815104->819199] (req 815104->819199) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.851496:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca376a lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [815104->819199] (req 815104->819199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.851498:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca376a lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [815104->819199] (req 815104->819199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531963.851803:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531963.851811:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467473792
00000100:00100000:1.0:1651531963.851824:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249968
00000100:00100000:1.0:1651531963.851826:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000765f877 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467473792:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531963.851833:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3771 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.851837:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531963.851837:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531963.851838:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3771 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [77824->81919] (req 77824->81919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.851842:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3771 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [77824->81919] (req 77824->81919) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.851866:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3771 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [77824->81919] (req 77824->81919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.851869:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3771 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [77824->81919] (req 77824->81919) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531963.851883:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000765f877 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467473792:12345-10.240.43.64@tcp:3:fio.0 Request processed in 56us (80us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531963.851885:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249968
00010000:00010000:1.0:1651531963.851892:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3771 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [77824->81919] (req 77824->81919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.851895:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006da7a892 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531963.851896:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3771 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [77824->81919] (req 77824->81919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.851899:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3771 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [77824->81919] (req 77824->81919) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.851903:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3771 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [77824->81919] (req 77824->81919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.851906:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3771 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [77824->81919] (req 77824->81919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531963.897912:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531963.897920:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467474304
00000100:00100000:1.0:1651531963.897944:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249969
00000100:00100000:1.0:1651531963.897945:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007a6934a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467474304:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531963.897952:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3778 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.897956:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531963.897957:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531963.897958:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3778 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [102400->106495] (req 102400->106495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.897962:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3778 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [102400->106495] (req 102400->106495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.897973:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3778 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [102400->106495] (req 102400->106495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.897976:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3778 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [102400->106495] (req 102400->106495) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531963.897995:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007a6934a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467474304:12345-10.240.43.64@tcp:3:fio.0 Request processed in 49us (84us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531963.897998:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249969
00010000:00010000:0.0:1651531963.897998:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3778 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [102400->106495] (req 102400->106495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.898003:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006da7a892 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531963.898004:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3778 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [102400->106495] (req 102400->106495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.898008:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3778 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [102400->106495] (req 102400->106495) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.898013:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3778 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [102400->106495] (req 102400->106495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.898018:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3778 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [102400->106495] (req 102400->106495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531963.898313:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531963.898321:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467474432
00000100:00100000:1.0:1651531963.898333:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249970
00000100:00100000:1.0:1651531963.898334:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007dc97d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467474432:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531963.898341:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca377f lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.898356:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531963.898357:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531963.898358:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca377f lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [585728->589823] (req 585728->589823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.898361:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca377f lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [585728->589823] (req 585728->589823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651531963.909562:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869209 is committed
00010000:00010000:1.0:1651531963.909575:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca375c lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [929792->933887] (req 929792->933887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.909578:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca375c lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [929792->933887] (req 929792->933887) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531963.909593:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f148f36a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467473152:12345-10.240.43.64@tcp:4:fio.0 Request processed in 59633us (59653us total) trans 21474869209 rc 0/0
00000100:00100000:1.0:1651531963.909596:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249966
00010000:00010000:1.0:1651531963.909603:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca375c lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [929792->933887] (req 929792->933887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.909606:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008558d1b3 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531963.909607:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca375c lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [929792->933887] (req 929792->933887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.909610:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca375c lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [929792->933887] (req 929792->933887) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.909618:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca375c lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [929792->933887] (req 929792->933887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.909621:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca375c lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [929792->933887] (req 929792->933887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531963.909951:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531963.909959:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467474560
00000100:00100000:1.0:1651531963.909974:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249971
00000100:00100000:1.0:1651531963.909976:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754467474560:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531963.909983:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3786 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.909987:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531963.909988:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531963.909989:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3786 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [532480->536575] (req 532480->536575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.909992:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3786 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [532480->536575] (req 532480->536575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.910003:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3786 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [532480->536575] (req 532480->536575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.910006:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3786 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [532480->536575] (req 532480->536575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531963.910020:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754467474560:12345-10.240.43.64@tcp:3:fio.0 Request processed in 43us (69us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531963.910024:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249971
00010000:00010000:1.0:1651531963.910030:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3786 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [532480->536575] (req 532480->536575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.910033:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e9b84540 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531963.910034:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3786 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [532480->536575] (req 532480->536575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.910037:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3786 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [532480->536575] (req 532480->536575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.910041:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3786 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [532480->536575] (req 532480->536575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.910044:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3786 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [532480->536575] (req 532480->536575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531963.935096:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531963.935119:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531963.935147:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467474944
00000100:00100000:1.0:1651531963.935149:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467474880
00000100:00100000:1.0:1651531963.935167:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249972
00000100:00100000:1.0:1651531963.935169:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000054ed0749 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754467474880:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651531963.935173:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44493
00010000:00010000:1.0:1651531963.935176:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca378d lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531963.935177:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ffcc974c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754467474944:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531963.935180:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531963.935181:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531963.935181:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca378d lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [487424->491519] (req 487424->491519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.935183:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531963.935187:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca378d lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [487424->491519] (req 487424->491519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.935188:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3794 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4458e1 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.935200:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3794 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4458e1 expref: 15 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531963.935220:0:166112:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3794 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4458e1 expref: 15 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531963.935246:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c1022d42, rc 0)
00000100:00100000:0.0:1651531963.935268:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ffcc974c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754467474944:12345-10.240.43.64@tcp:101:fio.0 Request processed in 90us (147us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531963.935273:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44493
00000001:00080000:1.0:1651531963.946962:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869210 is committed
00010000:00010000:1.0:1651531963.946975:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca377f lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [585728->589823] (req 585728->589823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.946979:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca377f lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [585728->589823] (req 585728->589823) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531963.947000:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007dc97d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467474432:12345-10.240.43.64@tcp:4:fio.0 Request processed in 48664us (48687us total) trans 21474869210 rc 0/0
00000100:00100000:1.0:1651531963.947003:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249970
00010000:00010000:0.0:1651531963.947006:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca377f lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [585728->589823] (req 585728->589823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.947011:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a8889a80 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531963.947012:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca377f lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [585728->589823] (req 585728->589823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.947017:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca377f lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [585728->589823] (req 585728->589823) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.947023:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca377f lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [585728->589823] (req 585728->589823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.947026:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca377f lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [585728->589823] (req 585728->589823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531963.947314:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531963.947337:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467475328
00000100:00100000:1.0:1651531963.947350:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249973
00000100:00100000:1.0:1651531963.947351:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000329eeeee pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467475328:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531963.947359:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca379b lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.947363:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531963.947363:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531963.947364:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca379b lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.947368:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca379b lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.947383:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca379b lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.947386:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca379b lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531963.947400:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000329eeeee pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467475328:12345-10.240.43.64@tcp:3:fio.0 Request processed in 48us (87us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531963.947403:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249973
00010000:00010000:1.0:1651531963.947409:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca379b lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.947413:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008558d1b3 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531963.947414:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca379b lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.947416:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca379b lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.947421:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca379b lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.947423:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca379b lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531963.948097:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531963.948105:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467475584
00000100:00100000:1.0:1651531963.948120:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249974
00000100:00100000:1.0:1651531963.948130:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f3a0807 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467475584:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531963.948137:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca37a2 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.948141:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531963.948142:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531963.948143:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca37a2 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [675840->679935] (req 675840->679935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.948147:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca37a2 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [675840->679935] (req 675840->679935) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.948158:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca37a2 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [675840->679935] (req 675840->679935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.948161:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca37a2 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [675840->679935] (req 675840->679935) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531963.948175:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f3a0807 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467475584:12345-10.240.43.64@tcp:3:fio.0 Request processed in 44us (78us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531963.948177:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249974
00010000:00010000:1.0:1651531963.948184:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca37a2 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [675840->679935] (req 675840->679935) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.948187:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006da7a892 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531963.948188:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca37a2 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [675840->679935] (req 675840->679935) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.948191:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca37a2 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [675840->679935] (req 675840->679935) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.948204:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca37a2 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [675840->679935] (req 675840->679935) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531963.948217:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca37a2 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [675840->679935] (req 675840->679935) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531963.948510:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531963.948518:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467475712
00000100:00100000:0.0:1651531963.948526:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44494
00000100:00100000:0.0:1651531963.948527:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002ae2aeac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467475712:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531963.948531:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531963.948535:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca37a9 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4458ef expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531963.948543:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca37a9 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4458ef expref: 14 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531963.948548:0:166111:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca37a9 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4458ef expref: 14 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531963.948551:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c1022d42, rc 0)
00000100:00100000:0.0:1651531963.948569:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002ae2aeac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467475712:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (60us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531963.948572:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44494
00000001:00080000:1.0:1651531964.006401:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869211 is committed
00010000:00010000:1.0:1651531964.006415:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca378d lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [487424->491519] (req 487424->491519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.006419:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca378d lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [487424->491519] (req 487424->491519) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531964.006441:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000054ed0749 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438148:x1731754467474880:12345-10.240.43.64@tcp:4:fio.0 Request processed in 71271us (71345us total) trans 21474869211 rc 0/0
00000100:00100000:1.0:1651531964.006444:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249972
00010000:00010000:0.0:1651531964.006447:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca378d lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [487424->491519] (req 487424->491519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.006452:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e9b84540 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531964.006453:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca378d lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [487424->491519] (req 487424->491519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.006456:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca378d lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [487424->491519] (req 487424->491519) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.006462:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca378d lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [487424->491519] (req 487424->491519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.006465:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca378d lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [487424->491519] (req 487424->491519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531964.008127:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531964.008140:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531964.008153:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467476608
00000100:00100000:0.0:1651531964.008166:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467476736
00000100:00100000:0.0:1651531964.008171:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44495
00000100:00100000:0.0:1651531964.008173:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c43262d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438146:x1731754467476608:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531964.008176:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531964.008180:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca37b0 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4458fd expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531964.008181:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44496
00000100:00100000:1.0:1651531964.008183:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000567318ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438147:x1731754467476736:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531964.008187:0:206699:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531964.008189:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca37b0 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4458fd expref: 12 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531964.008191:0:206699:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca37b7 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44590b expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.008195:0:166112:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca37b0 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4458fd expref: 13 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531964.008199:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c1022d42, rc 0)
00010000:00010000:1.0:1651531964.008200:0:206699:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca37b7 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44590b expref: 12 pid: 206699 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651531964.008220:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c43262d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754467476608:12345-10.240.43.64@tcp:101:fio.0 Request processed in 47us (93us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531964.008235:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44495
00010000:00010000:1.0:1651531964.008240:0:206699:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca37b7 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44590b expref: 11 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531964.008244:0:206699:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006da7a892, rc 0)
00000100:00100000:1.0:1651531964.008253:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000567318ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438147:x1731754467476736:12345-10.240.43.64@tcp:101:fio.0 Request processed in 70us (113us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531964.008256:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44496
00000100:00100000:1.0:1651531964.008635:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531964.008643:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467476864
00000100:00100000:1.0:1651531964.008653:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249975
00000100:00100000:1.0:1651531964.008654:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009acffcb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438147:x1731754467476864:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531964.008662:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca37be lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.008666:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531964.008666:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531964.008667:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca37be lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [1011712->1015807] (req 1011712->1015807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.008671:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca37be lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [1011712->1015807] (req 1011712->1015807) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.008682:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca37be lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [1011712->1015807] (req 1011712->1015807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.008685:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca37be lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [1011712->1015807] (req 1011712->1015807) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531964.008716:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009acffcb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438147:x1731754467476864:12345-10.240.43.64@tcp:3:fio.0 Request processed in 61us (82us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531964.008719:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249975
00010000:00010000:1.0:1651531964.008726:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca37be lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [1011712->1015807] (req 1011712->1015807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.008730:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008558d1b3 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531964.008731:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca37be lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [1011712->1015807] (req 1011712->1015807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.008734:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca37be lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [1011712->1015807] (req 1011712->1015807) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.008738:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca37be lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [1011712->1015807] (req 1011712->1015807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.008741:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca37be lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [1011712->1015807] (req 1011712->1015807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531964.009122:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531964.009129:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467477120
00000100:00100000:1.0:1651531964.009138:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249976
00000100:00100000:1.0:1651531964.009140:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003ffbc5dc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438147:x1731754467477120:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531964.009146:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca37c5 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.009154:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531964.009154:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531964.009155:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca37c5 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [339968->344063] (req 339968->344063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.009159:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca37c5 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [339968->344063] (req 339968->344063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.009169:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca37c5 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [339968->344063] (req 339968->344063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.009172:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca37c5 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [339968->344063] (req 339968->344063) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531964.009192:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003ffbc5dc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438147:x1731754467477120:12345-10.240.43.64@tcp:3:fio.0 Request processed in 51us (70us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531964.009195:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249976
00010000:00010000:1.0:1651531964.009202:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca37c5 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [339968->344063] (req 339968->344063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.009205:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001e36c601 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531964.009213:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca37c5 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [339968->344063] (req 339968->344063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.009216:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca37c5 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [339968->344063] (req 339968->344063) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.009221:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca37c5 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [339968->344063] (req 339968->344063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.009247:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca37c5 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [339968->344063] (req 339968->344063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531964.009496:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531964.009504:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467477376
00000100:00100000:1.0:1651531964.009514:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44497
00000100:00100000:1.0:1651531964.009516:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d9e74b4c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438146:x1731754467477376:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531964.009519:0:206699:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531964.009523:0:206699:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca37cc lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445919 expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.009530:0:206699:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca37cc lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445919 expref: 11 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531964.009535:0:206699:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca37cc lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445919 expref: 11 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531964.009538:0:206699:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c2b76533, rc 0)
00000100:00100000:1.0:1651531964.009549:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d9e74b4c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438146:x1731754467477376:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (54us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531964.009552:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44497
00000100:00100000:1.0:1651531964.031920:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531964.031928:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467477888
00000100:00100000:1.0:1651531964.031940:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44498
00000100:00100000:1.0:1651531964.031941:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a925fbf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754467477888:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531964.031947:0:206699:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531964.031950:0:206699:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca37d3 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445927 expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.031958:0:206699:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca37d3 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445927 expref: 11 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531964.031962:0:206699:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca37d3 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445927 expref: 11 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531964.031965:0:206699:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c2b76533, rc 0)
00000100:00100000:1.0:1651531964.031979:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a925fbf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754467477888:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (60us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531964.031982:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44498
00000100:00100000:1.0:1651531964.058490:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531964.058499:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531964.058505:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467478400
00000100:00100000:1.0:1651531964.058518:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467478528
00000100:00100000:1.0:1651531964.058524:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249977
00000100:00100000:1.0:1651531964.058526:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003562cf4d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438146:x1731754467478400:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531964.058533:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca37da lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531964.058534:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249978
00000100:00100000:0.0:1651531964.058536:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003d9ef3c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438147:x1731754467478528:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531964.058537:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531964.058538:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531964.058539:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca37da lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.058546:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca37da lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.058546:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca37e1 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.058550:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531964.058551:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531964.058552:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca37e1 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [53248->57343] (req 53248->57343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.058557:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca37da lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.058557:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca37e1 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [53248->57343] (req 53248->57343) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.058560:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca37da lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531964.058579:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003562cf4d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438146:x1731754467478400:12345-10.240.43.64@tcp:3:fio.0 Request processed in 52us (89us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531964.058581:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249977
00010000:00010000:0.0:1651531964.058581:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca37e1 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [53248->57343] (req 53248->57343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.058584:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca37e1 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [53248->57343] (req 53248->57343) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.058603:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca37da lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531964.058605:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003d9ef3c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438147:x1731754467478528:12345-10.240.43.64@tcp:3:fio.0 Request processed in 69us (106us total) trans 0 rc 4096/4096
00010000:00010000:1.0:1651531964.058606:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c2b76533 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531964.058607:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca37da lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531964.058608:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249978
00010000:00010000:1.0:1651531964.058610:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca37da lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.058615:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca37da lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.058618:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca37da lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.058626:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca37e1 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [53248->57343] (req 53248->57343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.058629:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c1022d42 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531964.058630:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca37e1 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [53248->57343] (req 53248->57343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.058632:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca37e1 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [53248->57343] (req 53248->57343) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.058636:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca37e1 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [53248->57343] (req 53248->57343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.058638:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca37e1 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [53248->57343] (req 53248->57343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531964.059099:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531964.059107:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531964.059108:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467478656
00000100:00100000:1.0:1651531964.059118:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44499
00000100:00100000:1.0:1651531964.059120:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c683c211 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438146:x1731754467478656:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651531964.059120:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467478784
00010000:00010000:1.0:1651531964.059123:0:206699:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531964.059126:0:206699:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca37e8 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445935 expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531964.059135:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249979
00000100:00100000:0.0:1651531964.059136:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a899ddab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754467478784:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531964.059140:0:206699:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca37e8 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445935 expref: 12 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531964.059143:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca37ef lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.059148:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531964.059148:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531964.059150:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca37ef lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [909312->913407] (req 909312->913407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.059154:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca37ef lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [909312->913407] (req 909312->913407) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.059155:0:206699:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca37e8 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445935 expref: 12 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531964.059158:0:206699:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001e36c601, rc 0)
00000100:00100000:1.0:1651531964.059168:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c683c211 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438146:x1731754467478656:12345-10.240.43.64@tcp:101:fio.0 Request processed in 48us (70us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531964.059171:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44499
00000100:00100000:0.0:1651531964.059886:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531964.059903:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467479040
00000100:00100000:1.0:1651531964.059919:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249980
00000100:00100000:1.0:1651531964.059921:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005dd15341 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467479040:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531964.059927:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca37f6 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.059932:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531964.059932:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531964.059933:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca37f6 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [901120->905215] (req 901120->905215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.059937:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca37f6 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [901120->905215] (req 901120->905215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651531964.120611:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869213 is committed
00002000:00010000:1.0:1651531964.120629:0:216321:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x34545:0x0] updating lvb mtime from disk: 1651531963 -> 1651531964
00002000:00010000:1.0:1651531964.120631:0:216321:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x34545:0x0] updating lvb ctime from disk: 1651531963 -> 1651531964
00010000:00010000:1.0:1651531964.120633:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca37f6 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [901120->905215] (req 901120->905215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.120640:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca37f6 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [901120->905215] (req 901120->905215) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.120648:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca37ef lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [909312->913407] (req 909312->913407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.120653:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca37ef lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [909312->913407] (req 909312->913407) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531964.120655:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005dd15341 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438147:x1731754467479040:12345-10.240.43.64@tcp:4:fio.0 Request processed in 60733us (60770us total) trans 21474869213 rc 0/0
00000100:00100000:1.0:1651531964.120658:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249980
00010000:00010000:1.0:1651531964.120665:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca37f6 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [901120->905215] (req 901120->905215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.120668:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008558d1b3 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531964.120669:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca37f6 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [901120->905215] (req 901120->905215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531964.120669:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a899ddab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438147:x1731754467478784:12345-10.240.43.64@tcp:4:fio.0 Request processed in 61532us (61563us total) trans 21474869212 rc 0/0
00010000:00010000:1.0:1651531964.120672:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca37f6 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [901120->905215] (req 901120->905215) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.120677:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca37f6 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [901120->905215] (req 901120->905215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.120679:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca37f6 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [901120->905215] (req 901120->905215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.120683:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca37ef lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [909312->913407] (req 909312->913407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531964.120684:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249979
00010000:00010000:1.0:1651531964.120685:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000032ee36ee already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531964.120686:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca37ef lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [909312->913407] (req 909312->913407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.120690:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca37ef lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [909312->913407] (req 909312->913407) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.120693:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca37ef lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [909312->913407] (req 909312->913407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.120696:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca37ef lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [909312->913407] (req 909312->913407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531964.121138:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531964.121146:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531964.121161:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467479360
00000100:00100000:1.0:1651531964.121164:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467479488
00000100:00100000:0.0:1651531964.121175:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249981
00000100:00100000:0.0:1651531964.121177:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007a05c3e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438146:x1731754467479360:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651531964.121182:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249982
00000100:00100000:1.0:1651531964.121184:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000065be21ea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438146:x1731754467479488:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531964.121184:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca37fd lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.121188:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531964.121189:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531964.121190:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca37fd lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [651264->655359] (req 651264->655359) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.121195:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca37fd lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [651264->655359] (req 651264->655359) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.121200:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3804 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.121204:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531964.121205:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531964.121205:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3804 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [704512->708607] (req 704512->708607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.121219:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3804 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [704512->708607] (req 704512->708607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.121249:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3804 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [704512->708607] (req 704512->708607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.121252:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3804 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [704512->708607] (req 704512->708607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531964.121273:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000065be21ea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438146:x1731754467479488:12345-10.240.43.64@tcp:3:fio.0 Request processed in 89us (127us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531964.121277:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249982
00010000:00010000:1.0:1651531964.121287:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3804 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [704512->708607] (req 704512->708607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.121290:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001e36c601 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531964.121292:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3804 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [704512->708607] (req 704512->708607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.121294:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3804 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [704512->708607] (req 704512->708607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.121299:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3804 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [704512->708607] (req 704512->708607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.121302:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3804 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [704512->708607] (req 704512->708607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531964.121589:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531964.121606:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467479616
00000100:00100000:1.0:1651531964.121617:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249983
00000100:00100000:1.0:1651531964.121618:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002bf85ab5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467479616:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531964.121625:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca380b lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.121629:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531964.121631:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531964.121632:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca380b lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [172032->176127] (req 172032->176127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.121636:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca380b lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [172032->176127] (req 172032->176127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.121646:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca380b lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [172032->176127] (req 172032->176127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.121649:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca380b lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [172032->176127] (req 172032->176127) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531964.121668:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002bf85ab5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467479616:12345-10.240.43.64@tcp:3:fio.0 Request processed in 49us (80us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531964.121671:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249983
00010000:00010000:0.0:1651531964.121674:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca380b lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [172032->176127] (req 172032->176127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.121679:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c2b76533 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531964.121680:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca380b lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [172032->176127] (req 172032->176127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.121683:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca380b lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [172032->176127] (req 172032->176127) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.121695:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca380b lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [172032->176127] (req 172032->176127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.121698:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca380b lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [172032->176127] (req 172032->176127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531964.121955:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531964.121972:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467479744
00000100:00100000:1.0:1651531964.121982:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249984
00000100:00100000:1.0:1651531964.121984:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c65d6bc4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467479744:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531964.121990:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3812 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.121994:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531964.121994:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531964.121995:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3812 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [434176->438271] (req 434176->438271) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.121999:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3812 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [434176->438271] (req 434176->438271) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.122012:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3812 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [434176->438271] (req 434176->438271) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.122015:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3812 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [434176->438271] (req 434176->438271) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531964.122033:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c65d6bc4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467479744:12345-10.240.43.64@tcp:3:fio.0 Request processed in 48us (78us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531964.122035:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249984
00010000:00010000:1.0:1651531964.122042:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3812 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [434176->438271] (req 434176->438271) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.122045:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006da7a892 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531964.122046:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3812 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [434176->438271] (req 434176->438271) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.122049:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3812 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [434176->438271] (req 434176->438271) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.122053:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3812 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [434176->438271] (req 434176->438271) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.122063:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3812 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [434176->438271] (req 434176->438271) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531964.133378:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531964.133398:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467480256
00000100:00100000:1.0:1651531964.133408:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249985
00000100:00100000:1.0:1651531964.133411:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ecb6b3b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467480256:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531964.133417:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3819 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.133421:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531964.133421:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531964.133422:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3819 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [339968->344063] (req 339968->344063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.133426:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3819 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [339968->344063] (req 339968->344063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.133436:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3819 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [339968->344063] (req 339968->344063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.133439:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3819 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [339968->344063] (req 339968->344063) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531964.133458:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ecb6b3b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467480256:12345-10.240.43.64@tcp:3:fio.0 Request processed in 46us (80us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531964.133461:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249985
00010000:00010000:1.0:1651531964.133468:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3819 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [339968->344063] (req 339968->344063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.133471:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006da7a892 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531964.133472:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3819 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [339968->344063] (req 339968->344063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.133475:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3819 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [339968->344063] (req 339968->344063) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.133489:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3819 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [339968->344063] (req 339968->344063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.133500:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3819 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [339968->344063] (req 339968->344063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651531964.191564:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869214 is committed
00010000:00010000:0.0:1651531964.191599:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca37fd lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [651264->655359] (req 651264->655359) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.191603:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca37fd lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [651264->655359] (req 651264->655359) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531964.191621:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007a05c3e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438146:x1731754467479360:12345-10.240.43.64@tcp:4:fio.0 Request processed in 70443us (70483us total) trans 21474869214 rc 0/0
00000100:00100000:0.0:1651531964.191624:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249981
00010000:00010000:0.0:1651531964.191631:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca37fd lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [651264->655359] (req 651264->655359) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.191635:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f5657138 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531964.191636:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca37fd lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [651264->655359] (req 651264->655359) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.191639:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca37fd lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [651264->655359] (req 651264->655359) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.191647:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca37fd lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [651264->655359] (req 651264->655359) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.191650:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca37fd lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [651264->655359] (req 651264->655359) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531964.191971:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531964.191994:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467480512
00000100:00100000:1.0:1651531964.192004:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44500
00000100:00100000:1.0:1651531964.192006:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f47fde78 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438147:x1731754467480512:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531964.192009:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531964.192014:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3820 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445943 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.192022:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3820 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445943 expref: 11 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531964.192026:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3820 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445943 expref: 11 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531964.192030:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006da7a892, rc 0)
00000100:00100000:1.0:1651531964.192045:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f47fde78 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438147:x1731754467480512:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (75us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531964.192048:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44500
00000100:00100000:0.0:1651531964.192596:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531964.192603:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467480960
00000100:00100000:0.0:1651531964.192614:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249986
00000100:00100000:0.0:1651531964.192616:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bcdb3319 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438146:x1731754467480960:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531964.192624:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca3827 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.192629:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531964.192629:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531964.192630:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca3827 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [139264->143359] (req 139264->143359) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.192634:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca3827 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [139264->143359] (req 139264->143359) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.192646:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca3827 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [139264->143359] (req 139264->143359) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.192650:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca3827 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [139264->143359] (req 139264->143359) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.192674:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca3827 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [139264->143359] (req 139264->143359) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531964.192677:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bcdb3319 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438146:x1731754467480960:12345-10.240.43.64@tcp:3:fio.0 Request processed in 60us (81us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531964.192680:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249986
00010000:00010000:1.0:1651531964.192690:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000820577fb already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531964.192691:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca3827 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [139264->143359] (req 139264->143359) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.192694:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca3827 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [139264->143359] (req 139264->143359) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.192700:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca3827 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [139264->143359] (req 139264->143359) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.192702:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca3827 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [139264->143359] (req 139264->143359) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531964.193278:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531964.193289:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467481216
00000100:00100000:1.0:1651531964.193297:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44501
00000100:00100000:1.0:1651531964.193299:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006a8dcc9d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438147:x1731754467481216:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531964.193302:0:206699:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531964.193305:0:206699:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca382e lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445951 expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.193313:0:206699:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca382e lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445951 expref: 11 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531964.193317:0:206699:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca382e lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445951 expref: 11 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531964.193332:0:206699:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001e36c601, rc 0)
00000100:00100000:1.0:1651531964.193347:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006a8dcc9d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438147:x1731754467481216:12345-10.240.43.64@tcp:101:fio.0 Request processed in 47us (69us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531964.193350:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44501
00000100:00100000:0.0:1651531964.194409:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531964.194417:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467481984
00000100:00100000:0.0:1651531964.194427:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249987
00000100:00100000:0.0:1651531964.194429:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009e786cd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438146:x1731754467481984:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531964.194436:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca3835 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.194440:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531964.194441:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531964.194442:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca3835 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [401408->405503] (req 401408->405503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.194446:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca3835 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [401408->405503] (req 401408->405503) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651531964.234307:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869215 is committed
00010000:00010000:0.0:1651531964.234341:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca3835 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [401408->405503] (req 401408->405503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.234345:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca3835 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [401408->405503] (req 401408->405503) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531964.234367:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009e786cd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438146:x1731754467481984:12345-10.240.43.64@tcp:4:fio.0 Request processed in 39938us (39958us total) trans 21474869215 rc 0/0
00010000:00010000:1.0:1651531964.234369:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca3835 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [401408->405503] (req 401408->405503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.234373:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f765708a already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531964.234374:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca3835 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [401408->405503] (req 401408->405503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531964.234374:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249987
00010000:00010000:1.0:1651531964.234377:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca3835 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [401408->405503] (req 401408->405503) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.234382:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca3835 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [401408->405503] (req 401408->405503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.234385:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca3835 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [401408->405503] (req 401408->405503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531964.234838:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531964.234846:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467482496
00000100:00100000:0.0:1651531964.234856:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249988
00000100:00100000:0.0:1651531964.234858:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008bb4a649 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438147:x1731754467482496:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531964.234865:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca383c lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.234869:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531964.234870:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531964.234871:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca383c lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [1003520->1007615] (req 1003520->1007615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.234875:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca383c lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [1003520->1007615] (req 1003520->1007615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531964.235035:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531964.235050:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467482624
00000100:00100000:0.0:1651531964.235075:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249989
00000100:00100000:0.0:1651531964.235078:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b6b1b79d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467482624:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531964.235087:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3843 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.235092:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531964.235092:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531964.235093:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3843 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [1040384->1044479] (req 1040384->1044479) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.235101:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3843 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [1040384->1044479] (req 1040384->1044479) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651531964.259657:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869216 is committed
00010000:00010000:0.0:1651531964.259689:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca383c lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [1003520->1007615] (req 1003520->1007615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.259694:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca383c lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [1003520->1007615] (req 1003520->1007615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.259706:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca383c lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [1003520->1007615] (req 1003520->1007615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.259710:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f5657138 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531964.259711:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca383c lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [1003520->1007615] (req 1003520->1007615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531964.259719:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008bb4a649 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467482496:12345-10.240.43.64@tcp:4:fio.0 Request processed in 24859us (24880us total) trans 21474869216 rc 0/0
00010000:00010000:1.0:1651531964.259722:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca383c lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [1003520->1007615] (req 1003520->1007615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531964.259725:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249988
00010000:00010000:1.0:1651531964.259727:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca383c lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [1003520->1007615] (req 1003520->1007615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.259730:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca383c lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [1003520->1007615] (req 1003520->1007615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531964.259795:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531964.259804:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467482752
00000100:00100000:0.0:1651531964.259825:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249990
00000100:00100000:0.0:1651531964.259828:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cb694635 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467482752:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531964.259841:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca384a lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.259846:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531964.259846:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531964.259847:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca384a lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [958464->962559] (req 958464->962559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.259851:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca384a lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [958464->962559] (req 958464->962559) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.259867:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca384a lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [958464->962559] (req 958464->962559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.259871:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca384a lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [958464->962559] (req 958464->962559) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.259890:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca384a lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [958464->962559] (req 958464->962559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531964.259894:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cb694635 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467482752:12345-10.240.43.64@tcp:3:fio.0 Request processed in 65us (99us total) trans 0 rc 4096/4096
00010000:00010000:1.0:1651531964.259895:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f765708a already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531964.259896:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca384a lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [958464->962559] (req 958464->962559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531964.259897:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249990
00010000:00010000:1.0:1651531964.259899:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca384a lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [958464->962559] (req 958464->962559) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.259904:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca384a lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [958464->962559] (req 958464->962559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.259906:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca384a lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [958464->962559] (req 958464->962559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531964.260205:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531964.260242:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467483008
00000100:00100000:0.0:1651531964.260257:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249991
00000100:00100000:0.0:1651531964.260258:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000059e5b3a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467483008:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531964.260266:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca3851 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.260270:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531964.260270:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531964.260271:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca3851 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [692224->696319] (req 692224->696319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.260275:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca3851 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [692224->696319] (req 692224->696319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.260286:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca3851 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [692224->696319] (req 692224->696319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.260289:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca3851 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [692224->696319] (req 692224->696319) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.260308:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca3851 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [692224->696319] (req 692224->696319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531964.260310:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000059e5b3a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467483008:12345-10.240.43.64@tcp:3:fio.0 Request processed in 51us (106us total) trans 0 rc 4096/4096
00010000:00010000:1.0:1651531964.260313:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000820577fb already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531964.260314:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca3851 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [692224->696319] (req 692224->696319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531964.260314:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249991
00010000:00010000:1.0:1651531964.260317:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca3851 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [692224->696319] (req 692224->696319) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.260322:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca3851 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [692224->696319] (req 692224->696319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.260325:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca3851 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [692224->696319] (req 692224->696319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531964.260635:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531964.260650:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467483264
00000100:00100000:0.0:1651531964.260664:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249992
00000100:00100000:0.0:1651531964.260666:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000009c4c564 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467483264:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531964.260673:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3858 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.260677:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531964.260677:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531964.260678:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3858 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [512000->516095] (req 512000->516095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.260682:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3858 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [512000->516095] (req 512000->516095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531964.261247:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531964.261264:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467483520
00000100:00100000:1.0:1651531964.261275:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249993
00000100:00100000:1.0:1651531964.261277:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000315bf4eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754467483520:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531964.261284:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca385f lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.261288:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531964.261289:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531964.261290:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca385f lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [290816->294911] (req 290816->294911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.261294:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca385f lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [290816->294911] (req 290816->294911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.261311:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca385f lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [290816->294911] (req 290816->294911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.261314:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca385f lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [290816->294911] (req 290816->294911) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531964.261328:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000315bf4eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754467483520:12345-10.240.43.64@tcp:3:fio.0 Request processed in 51us (83us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531964.261331:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249993
00010000:00010000:1.0:1651531964.261337:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca385f lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [290816->294911] (req 290816->294911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.261340:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001e36c601 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531964.261341:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca385f lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [290816->294911] (req 290816->294911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.261344:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca385f lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [290816->294911] (req 290816->294911) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.261349:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca385f lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [290816->294911] (req 290816->294911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.261351:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca385f lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [290816->294911] (req 290816->294911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531964.262075:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531964.262092:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467483776
00000100:00100000:1.0:1651531964.262100:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44502
00000100:00100000:1.0:1651531964.262103:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b9b10d48 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754467483776:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531964.262106:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531964.262110:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3866 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44595f expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.262118:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3866 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44595f expref: 17 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531964.262122:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3866 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44595f expref: 17 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531964.262126:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006da7a892, rc 0)
00000100:00100000:1.0:1651531964.262136:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b9b10d48 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754467483776:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (61us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531964.262138:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44502
00000001:00080000:1.0:1651531964.284987:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869217 is committed
00010000:00010000:0.0:1651531964.285021:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3843 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [1040384->1044479] (req 1040384->1044479) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.285028:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3843 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [1040384->1044479] (req 1040384->1044479) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.285058:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3843 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [1040384->1044479] (req 1040384->1044479) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.285062:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002c5e01dd already unused, calling callback (0000000049fddea7)
00000100:00100000:0.0:1651531964.285062:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b6b1b79d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467482624:12345-10.240.43.64@tcp:4:fio.0 Request processed in 49983us (50027us total) trans 21474869217 rc 0/0
00010000:00010000:1.0:1651531964.285064:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3843 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [1040384->1044479] (req 1040384->1044479) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.285067:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3843 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [1040384->1044479] (req 1040384->1044479) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.285072:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3843 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [1040384->1044479] (req 1040384->1044479) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531964.285072:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249989
00010000:00010000:1.0:1651531964.285078:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3843 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [1040384->1044479] (req 1040384->1044479) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531964.285172:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531964.285193:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467484160
00000100:00100000:0.0:1651531964.285243:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249994
00000100:00100000:0.0:1651531964.285245:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c0b460ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467484160:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531964.285254:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca386d lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.285258:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531964.285258:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531964.285259:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca386d lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [827392->831487] (req 827392->831487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.285263:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca386d lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [827392->831487] (req 827392->831487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.285276:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca386d lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [827392->831487] (req 827392->831487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.285279:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca386d lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [827392->831487] (req 827392->831487) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.285297:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca386d lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [827392->831487] (req 827392->831487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531964.285300:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c0b460ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467484160:12345-10.240.43.64@tcp:3:fio.0 Request processed in 54us (128us total) trans 0 rc 4096/4096
00010000:00010000:1.0:1651531964.285301:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c1022d42 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531964.285302:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca386d lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [827392->831487] (req 827392->831487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531964.285303:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249994
00010000:00010000:1.0:1651531964.285306:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca386d lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [827392->831487] (req 827392->831487) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.285311:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca386d lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [827392->831487] (req 827392->831487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.285314:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca386d lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [827392->831487] (req 827392->831487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531964.285456:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531964.285468:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467484288
00000100:00100000:0.0:1651531964.285480:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249995
00000100:00100000:0.0:1651531964.285482:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006e255cae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467484288:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531964.285492:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3874 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.285496:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531964.285497:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531964.285498:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3874 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [475136->479231] (req 475136->479231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.285502:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3874 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [475136->479231] (req 475136->479231) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.285512:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3874 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [475136->479231] (req 475136->479231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.285515:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3874 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [475136->479231] (req 475136->479231) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.285526:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3874 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [475136->479231] (req 475136->479231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.285529:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fb2f6575 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531964.285530:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3874 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [475136->479231] (req 475136->479231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531964.285534:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006e255cae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467484288:12345-10.240.43.64@tcp:3:fio.0 Request processed in 51us (78us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531964.285536:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249995
00010000:00010000:1.0:1651531964.285537:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3874 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [475136->479231] (req 475136->479231) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.285542:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3874 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [475136->479231] (req 475136->479231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.285544:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3874 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [475136->479231] (req 475136->479231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531964.285613:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531964.285623:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467484416
00000100:00100000:0.0:1651531964.285636:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249996
00000100:00100000:0.0:1651531964.285637:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f7006631 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467484416:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531964.285644:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca387b lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.285648:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531964.285649:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531964.285660:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca387b lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [360448->364543] (req 360448->364543) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.285664:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca387b lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [360448->364543] (req 360448->364543) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531964.285844:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531964.285854:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467484544
00000100:00100000:1.0:1651531964.285863:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44503
00000100:00100000:1.0:1651531964.285865:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000033723645 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754467484544:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531964.285868:0:206699:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531964.285872:0:206699:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3882 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44596d expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.285879:0:206699:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3882 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44596d expref: 17 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531964.285884:0:206699:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3882 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44596d expref: 17 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531964.285887:0:206699:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006da7a892, rc 0)
00000100:00100000:1.0:1651531964.285897:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000033723645 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754467484544:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (54us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531964.285903:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44503
00000100:00100000:0.0:1651531964.286276:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531964.286294:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467484672
00000100:00100000:1.0:1651531964.286305:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249997
00000100:00100000:1.0:1651531964.286306:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a23bcd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754467484672:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531964.286313:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3889 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.286317:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531964.286318:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531964.286319:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3889 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [1028096->1032191] (req 1028096->1032191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.286323:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3889 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [1028096->1032191] (req 1028096->1032191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.286336:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3889 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [1028096->1032191] (req 1028096->1032191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.286339:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3889 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [1028096->1032191] (req 1028096->1032191) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531964.286353:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a23bcd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754467484672:12345-10.240.43.64@tcp:3:fio.0 Request processed in 45us (77us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531964.286355:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249997
00010000:00010000:1.0:1651531964.286361:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3889 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [1028096->1032191] (req 1028096->1032191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.286365:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001e36c601 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531964.286367:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3889 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [1028096->1032191] (req 1028096->1032191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.286370:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3889 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [1028096->1032191] (req 1028096->1032191) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.286374:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3889 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [1028096->1032191] (req 1028096->1032191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.286377:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3889 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [1028096->1032191] (req 1028096->1032191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531964.287034:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531964.287051:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467484928
00000100:00100000:1.0:1651531964.287062:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249998
00000100:00100000:1.0:1651531964.287063:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a9fc5082 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754467484928:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531964.287070:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3890 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.287074:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531964.287074:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531964.287075:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3890 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [753664->757759] (req 753664->757759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.287079:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3890 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [753664->757759] (req 753664->757759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651531964.310303:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869218 is committed
00010000:00010000:0.0:1651531964.310338:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3858 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [512000->516095] (req 512000->516095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.310345:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3858 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [512000->516095] (req 512000->516095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.310376:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3858 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [512000->516095] (req 512000->516095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531964.310382:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000009c4c564 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754467483264:12345-10.240.43.64@tcp:4:fio.0 Request processed in 49714us (49747us total) trans 21474869218 rc 0/0
00000100:00100000:0.0:1651531964.310389:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249992
00010000:00010000:1.0:1651531964.310393:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000032ee36ee already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531964.310395:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3858 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [512000->516095] (req 512000->516095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.310398:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3858 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [512000->516095] (req 512000->516095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.310403:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3858 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [512000->516095] (req 512000->516095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.310406:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3858 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [512000->516095] (req 512000->516095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531964.310478:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531964.310492:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467485056
00000100:00100000:0.0:1651531964.310508:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249999
00000100:00100000:0.0:1651531964.310510:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c4ea889e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754467485056:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531964.310517:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca3897 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.310521:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531964.310522:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531964.310523:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca3897 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [589824->593919] (req 589824->593919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.310540:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca3897 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [589824->593919] (req 589824->593919) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531964.310690:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531964.310708:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467485184
00000100:00100000:1.0:1651531964.310719:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250000
00000100:00100000:1.0:1651531964.310720:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c62d1815 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754467485184:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531964.310728:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca389e lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.310732:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531964.310732:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531964.310733:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca389e lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [659456->663551] (req 659456->663551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.310737:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca389e lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [659456->663551] (req 659456->663551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.310753:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca389e lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [659456->663551] (req 659456->663551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.310756:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca389e lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [659456->663551] (req 659456->663551) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531964.310771:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c62d1815 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754467485184:12345-10.240.43.64@tcp:3:fio.0 Request processed in 49us (81us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531964.310773:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250000
00010000:00010000:1.0:1651531964.310780:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca389e lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [659456->663551] (req 659456->663551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.310783:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001e36c601 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531964.310784:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca389e lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [659456->663551] (req 659456->663551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.310787:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca389e lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [659456->663551] (req 659456->663551) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.310792:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca389e lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [659456->663551] (req 659456->663551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.310794:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca389e lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [659456->663551] (req 659456->663551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531964.311094:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531964.311111:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467485312
00000100:00100000:1.0:1651531964.311120:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44504
00000100:00100000:1.0:1651531964.311123:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005ec1cbc3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754467485312:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531964.311126:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531964.311129:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca38a5 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44597b expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.311137:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca38a5 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44597b expref: 20 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531964.311141:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca38a5 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44597b expref: 20 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531964.311144:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006da7a892, rc 0)
00000100:00100000:1.0:1651531964.311154:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005ec1cbc3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754467485312:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (60us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531964.311157:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44504
00000100:00100000:0.0:1651531964.312288:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531964.312299:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467485696
00000100:00100000:1.0:1651531964.312310:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250001
00000100:00100000:1.0:1651531964.312311:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000028779db6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754467485696:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531964.312318:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca38ac lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.312322:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531964.312323:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531964.312324:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca38ac lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [221184->225279] (req 221184->225279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.312327:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca38ac lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [221184->225279] (req 221184->225279) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651531964.333610:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869220 is committed
00010000:00010000:0.0:1651531964.333653:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca387b lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [360448->364543] (req 360448->364543) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.333659:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca387b lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 11 type: EXT [360448->364543] (req 360448->364543) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.333665:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3890 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [753664->757759] (req 753664->757759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.333675:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3890 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [753664->757759] (req 753664->757759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531964.333692:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f7006631 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754467484416:12345-10.240.43.64@tcp:4:fio.0 Request processed in 48052us (48078us total) trans 21474869219 rc 0/0
00000100:00100000:1.0:1651531964.333696:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a9fc5082 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754467484928:12345-10.240.43.64@tcp:4:fio.0 Request processed in 46631us (46661us total) trans 21474869220 rc 0/0
00000100:00100000:0.0:1651531964.333698:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249996
00000100:00100000:1.0:1651531964.333700:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249998
00010000:00010000:1.0:1651531964.333707:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca387b lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [360448->364543] (req 360448->364543) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.333711:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000080362f27 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531964.333712:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca387b lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [360448->364543] (req 360448->364543) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.333715:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca387b lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [360448->364543] (req 360448->364543) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.333716:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3890 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 11 type: EXT [753664->757759] (req 753664->757759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.333723:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008558d1b3 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531964.333725:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3890 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 11 type: EXT [753664->757759] (req 753664->757759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.333730:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3890 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 11 type: EXT [753664->757759] (req 753664->757759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.333734:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca387b lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 11 type: EXT [360448->364543] (req 360448->364543) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.333736:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca387b lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [360448->364543] (req 360448->364543) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.333739:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3890 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 11 type: EXT [753664->757759] (req 753664->757759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.333755:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3890 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [753664->757759] (req 753664->757759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531964.334084:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531964.334095:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531964.334108:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467485888
00000100:00100000:1.0:1651531964.334112:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467485824
00000100:00100000:0.0:1651531964.334121:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250002
00000100:00100000:0.0:1651531964.334123:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dce6a2c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754467485888:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651531964.334129:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250003
00010000:00010000:0.0:1651531964.334130:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca38b3 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531964.334131:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009078ca7d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754467485824:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531964.334135:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531964.334135:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531964.334136:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca38b3 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [286720->290815] (req 286720->290815) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.334138:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca38ba lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.334141:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca38b3 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 11 type: EXT [286720->290815] (req 286720->290815) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.334142:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531964.334143:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531964.334144:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca38ba lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [794624->798719] (req 794624->798719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.334148:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca38ba lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [794624->798719] (req 794624->798719) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.334152:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca38b3 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [286720->290815] (req 286720->290815) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.334156:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca38b3 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [286720->290815] (req 286720->290815) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531964.334174:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dce6a2c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754467485888:12345-10.240.43.64@tcp:3:fio.0 Request processed in 50us (90us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531964.334187:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250002
00010000:00010000:1.0:1651531964.334219:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca38b3 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [286720->290815] (req 286720->290815) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.334246:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fab23815 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531964.334247:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca38b3 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [286720->290815] (req 286720->290815) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.334251:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca38b3 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [286720->290815] (req 286720->290815) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.334256:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca38b3 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [286720->290815] (req 286720->290815) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.334258:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca38b3 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [286720->290815] (req 286720->290815) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531964.334912:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531964.334920:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467486208
00000100:00100000:0.0:1651531964.334936:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250004
00000100:00100000:0.0:1651531964.334937:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000071f9ee43 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438146:x1731754467486208:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531964.334945:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca38c1 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.334949:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531964.334950:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531964.334951:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca38c1 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [872448->876543] (req 872448->876543) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.334955:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca38c1 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [872448->876543] (req 872448->876543) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651531964.358914:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869222 is committed
00010000:00010000:0.0:1651531964.358952:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca38ac lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [221184->225279] (req 221184->225279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.358959:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca38ac lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [221184->225279] (req 221184->225279) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.358967:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca3897 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [589824->593919] (req 589824->593919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.358977:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca3897 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [589824->593919] (req 589824->593919) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531964.358999:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c4ea889e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754467485056:12345-10.240.43.64@tcp:4:fio.0 Request processed in 48488us (48521us total) trans 21474869221 rc 0/0
00000100:00100000:0.0:1651531964.359000:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000028779db6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754467485696:12345-10.240.43.64@tcp:4:fio.0 Request processed in 46686us (46711us total) trans 21474869222 rc 0/0
00000100:00100000:1.0:1651531964.359002:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249999
00000100:00100000:0.0:1651531964.359007:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250001
00010000:00010000:1.0:1651531964.359010:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca38ac lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [221184->225279] (req 221184->225279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.359013:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b4c8742a already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531964.359014:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca38ac lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [221184->225279] (req 221184->225279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.359017:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca38ac lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [221184->225279] (req 221184->225279) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.359020:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca3897 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 11 type: EXT [589824->593919] (req 589824->593919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.359040:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000014685f38 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531964.359041:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca38ac lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [221184->225279] (req 221184->225279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.359041:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca3897 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 11 type: EXT [589824->593919] (req 589824->593919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.359044:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca38ac lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 11 type: EXT [221184->225279] (req 221184->225279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.359045:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca3897 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 11 type: EXT [589824->593919] (req 589824->593919) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.359051:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca3897 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [589824->593919] (req 589824->593919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.359054:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca3897 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [589824->593919] (req 589824->593919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651531964.397551:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869224 is committed
00010000:00010000:1.0:1651531964.397570:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca38ba lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [794624->798719] (req 794624->798719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.397578:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca38ba lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [794624->798719] (req 794624->798719) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.397588:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca38c1 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [872448->876543] (req 872448->876543) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531964.397595:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009078ca7d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438146:x1731754467485824:12345-10.240.43.64@tcp:4:fio.0 Request processed in 63463us (63500us total) trans 21474869223 rc 0/0
00010000:00010000:0.0:1651531964.397598:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca38c1 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [872448->876543] (req 872448->876543) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531964.397599:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250003
00010000:00010000:1.0:1651531964.397614:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca38ba lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [794624->798719] (req 794624->798719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.397617:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006da7a892 already unused, calling callback (0000000049fddea7)
00000100:00100000:0.0:1651531964.397617:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000071f9ee43 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438146:x1731754467486208:12345-10.240.43.64@tcp:4:fio.0 Request processed in 62679us (62706us total) trans 21474869224 rc 0/0
00010000:00010000:1.0:1651531964.397618:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca38ba lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [794624->798719] (req 794624->798719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.397621:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca38ba lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [794624->798719] (req 794624->798719) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531964.397621:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250004
00010000:00010000:1.0:1651531964.397626:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca38ba lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [794624->798719] (req 794624->798719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.397629:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca38ba lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [794624->798719] (req 794624->798719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.397632:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca38c1 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [872448->876543] (req 872448->876543) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.397635:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000075a78972 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531964.397636:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca38c1 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [872448->876543] (req 872448->876543) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.397640:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca38c1 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [872448->876543] (req 872448->876543) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.397643:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca38c1 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [872448->876543] (req 872448->876543) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.397646:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca38c1 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [872448->876543] (req 872448->876543) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531964.397999:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531964.398008:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467486784
00000100:00100000:0.0:1651531964.398023:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250005
00000100:00100000:0.0:1651531964.398025:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e4e3ecb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438148:x1731754467486784:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531964.398034:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca38c8 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.398039:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531964.398039:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531964.398041:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca38c8 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [36864->40959] (req 36864->40959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.398045:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca38c8 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [36864->40959] (req 36864->40959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531964.398479:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531964.398498:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467486912
00000100:00100000:1.0:1651531964.398512:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250006
00000100:00100000:1.0:1651531964.398514:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fb90eb28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467486912:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531964.398521:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca38cf lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.398525:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531964.398526:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531964.398527:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca38cf lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [40960->45055] (req 40960->45055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.398530:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca38cf lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [40960->45055] (req 40960->45055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.398543:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca38cf lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [40960->45055] (req 40960->45055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.398546:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca38cf lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [40960->45055] (req 40960->45055) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.398563:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca38cf lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [40960->45055] (req 40960->45055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531964.398569:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fb90eb28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467486912:12345-10.240.43.64@tcp:3:fio.0 Request processed in 54us (91us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531964.398572:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250006
00010000:00010000:0.0:1651531964.398572:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b4c8742a already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531964.398574:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca38cf lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [40960->45055] (req 40960->45055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.398577:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca38cf lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [40960->45055] (req 40960->45055) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.398583:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca38cf lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [40960->45055] (req 40960->45055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.398586:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca38cf lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [40960->45055] (req 40960->45055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531964.410550:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531964.410564:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531964.410568:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467487168
00000100:00100000:0.0:1651531964.410572:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467487296
00000100:00100000:1.0:1651531964.410579:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250007
00000100:00100000:1.0:1651531964.410581:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000add44b2e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754467487168:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651531964.410587:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250008
00000100:00100000:0.0:1651531964.410589:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000670433b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754467487296:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531964.410593:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca38d6 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.410597:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531964.410597:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca38dd lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.410598:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531964.410599:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca38d6 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [520192->524287] (req 520192->524287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.410603:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca38d6 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [520192->524287] (req 520192->524287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.410605:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531964.410605:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531964.410606:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca38dd lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [528384->532479] (req 528384->532479) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.410611:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca38dd lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [528384->532479] (req 528384->532479) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.410614:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca38d6 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [520192->524287] (req 520192->524287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.410617:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca38d6 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [520192->524287] (req 520192->524287) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.410623:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca38dd lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [528384->532479] (req 528384->532479) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.410626:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca38dd lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [528384->532479] (req 528384->532479) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531964.410631:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000add44b2e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754467487168:12345-10.240.43.64@tcp:3:fio.0 Request processed in 50us (81us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531964.410641:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250007
00000100:00100000:0.0:1651531964.410643:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000670433b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754467487296:12345-10.240.43.64@tcp:3:fio.0 Request processed in 53us (78us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531964.410645:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250008
00010000:00010000:1.0:1651531964.410648:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca38d6 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [520192->524287] (req 520192->524287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.410653:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006da7a892 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531964.410654:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca38d6 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [520192->524287] (req 520192->524287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.410657:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca38d6 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [520192->524287] (req 520192->524287) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.410661:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca38d6 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [520192->524287] (req 520192->524287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.410664:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca38d6 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [520192->524287] (req 520192->524287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.410668:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca38dd lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [528384->532479] (req 528384->532479) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.410670:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e2ec18e1 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531964.410671:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca38dd lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [528384->532479] (req 528384->532479) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.410674:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca38dd lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [528384->532479] (req 528384->532479) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.410677:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca38dd lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [528384->532479] (req 528384->532479) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.410679:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca38dd lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [528384->532479] (req 528384->532479) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651531964.422912:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869225 is committed
00010000:00010000:0.0:1651531964.422945:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca38c8 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [36864->40959] (req 36864->40959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.422950:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca38c8 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [36864->40959] (req 36864->40959) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531964.422970:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e4e3ecb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438148:x1731754467486784:12345-10.240.43.64@tcp:4:fio.0 Request processed in 24944us (24971us total) trans 21474869225 rc 0/0
00000100:00100000:0.0:1651531964.422973:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250005
00010000:00010000:0.0:1651531964.422980:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca38c8 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [36864->40959] (req 36864->40959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.422984:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000014685f38 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531964.422985:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca38c8 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [36864->40959] (req 36864->40959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.422988:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca38c8 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [36864->40959] (req 36864->40959) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.422993:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca38c8 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [36864->40959] (req 36864->40959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.422995:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca38c8 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [36864->40959] (req 36864->40959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531964.456633:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531964.456657:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467488640
00000100:00100000:1.0:1651531964.456665:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44505
00000100:00100000:1.0:1651531964.456667:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dccc50c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438147:x1731754467488640:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531964.456671:0:206699:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531964.456674:0:206699:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca38e4 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445989 expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.456682:0:206699:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca38e4 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445989 expref: 11 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531964.456686:0:206699:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca38e4 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445989 expref: 11 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531964.456690:0:206699:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006da7a892, rc 0)
00000100:00100000:1.0:1651531964.456705:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dccc50c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438147:x1731754467488640:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (72us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531964.456708:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44505
00000100:00100000:0.0:1651531964.457376:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531964.457393:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467488896
00000100:00100000:1.0:1651531964.457400:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44506
00000100:00100000:1.0:1651531964.457402:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002d3e5ae4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438146:x1731754467488896:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531964.457405:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531964.457408:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca38eb lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445997 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.457420:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca38eb lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445997 expref: 11 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531964.457424:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca38eb lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445997 expref: 11 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531964.457427:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001e36c601, rc 0)
00000100:00100000:1.0:1651531964.457443:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002d3e5ae4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438146:x1731754467488896:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (67us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531964.457445:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44506
00000100:00100000:0.0:1651531964.480964:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531964.480972:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467489280
00000100:00100000:0.0:1651531964.480982:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250009
00000100:00100000:0.0:1651531964.480984:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b67ad021 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438146:x1731754467489280:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531964.480991:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca38f2 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.480996:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531964.480997:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531964.480998:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca38f2 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [729088->733183] (req 729088->733183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.481002:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca38f2 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [729088->733183] (req 729088->733183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651531964.531658:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869226 is committed
00010000:00010000:0.0:1651531964.531695:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca38f2 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [729088->733183] (req 729088->733183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.531700:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca38f2 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [729088->733183] (req 729088->733183) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531964.531723:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b67ad021 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438146:x1731754467489280:12345-10.240.43.64@tcp:4:fio.0 Request processed in 50738us (50760us total) trans 21474869226 rc 0/0
00010000:00010000:1.0:1651531964.531724:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca38f2 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [729088->733183] (req 729088->733183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531964.531726:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250009
00010000:00010000:1.0:1651531964.531728:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000014685f38 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531964.531729:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca38f2 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [729088->733183] (req 729088->733183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.531732:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca38f2 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [729088->733183] (req 729088->733183) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.531737:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca38f2 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [729088->733183] (req 729088->733183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.531740:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca38f2 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [729088->733183] (req 729088->733183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531964.573891:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531964.573905:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531964.573925:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467489728
00000100:00100000:1.0:1651531964.573939:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467490048
00000100:00100000:1.0:1651531964.573944:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44507
00000100:00100000:1.0:1651531964.573945:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001eda4376 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438146:x1731754467489728:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531964.573949:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531964.573953:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca38f9 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4459a5 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531964.573954:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44508
00000100:00100000:0.0:1651531964.573957:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e15376c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754467490048:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531964.573961:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca38f9 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4459a5 expref: 12 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531964.573961:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531964.573965:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca38f9 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4459a5 expref: 12 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531964.573969:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001e36c601, rc 0)
00010000:00010000:0.0:1651531964.573973:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca3900 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4459b3 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531964.573982:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001eda4376 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754467489728:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (92us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531964.573985:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44507
00010000:00010000:0.0:1651531964.573988:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca3900 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4459b3 expref: 11 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531964.573997:0:166112:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca3900 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4459b3 expref: 11 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531964.574001:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000014685f38, rc 0)
00000100:00100000:0.0:1651531964.574010:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e15376c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438147:x1731754467490048:12345-10.240.43.64@tcp:101:fio.0 Request processed in 53us (104us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531964.574012:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44508
00000100:00100000:0.0:1651531964.575282:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531964.575290:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467490624
00000100:00100000:1.0:1651531964.575296:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531964.575309:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467490752
00000100:00100000:1.0:1651531964.575313:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250010
00000100:00100000:1.0:1651531964.575315:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002bdf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438146:x1731754467490624:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651531964.575321:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250011
00000100:00100000:0.0:1651531964.575322:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bfdd313b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438146:x1731754467490752:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531964.575329:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3907 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.575330:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca390e lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.575333:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531964.575335:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531964.575336:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3907 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [802816->806911] (req 802816->806911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.575340:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3907 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [802816->806911] (req 802816->806911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.575341:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531964.575342:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531964.575343:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca390e lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [733184->737279] (req 733184->737279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.575348:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca390e lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [733184->737279] (req 733184->737279) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.575353:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3907 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [802816->806911] (req 802816->806911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.575357:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3907 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [802816->806911] (req 802816->806911) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531964.575376:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002bdf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438146:x1731754467490624:12345-10.240.43.64@tcp:3:fio.0 Request processed in 60us (94us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531964.575379:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250010
00010000:00010000:1.0:1651531964.575387:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3907 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [802816->806911] (req 802816->806911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.575390:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006da7a892 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531964.575391:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3907 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [802816->806911] (req 802816->806911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.575394:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3907 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [802816->806911] (req 802816->806911) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.575399:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3907 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [802816->806911] (req 802816->806911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.575401:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3907 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [802816->806911] (req 802816->806911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651531964.610535:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869227 is committed
00010000:00010000:0.0:1651531964.610572:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca390e lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [733184->737279] (req 733184->737279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.610576:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca390e lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [733184->737279] (req 733184->737279) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531964.610601:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bfdd313b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438146:x1731754467490752:12345-10.240.43.64@tcp:4:fio.0 Request processed in 35277us (35305us total) trans 21474869227 rc 0/0
00000100:00100000:0.0:1651531964.610605:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250011
00010000:00010000:0.0:1651531964.610613:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca390e lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [733184->737279] (req 733184->737279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.610616:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e2ec18e1 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531964.610617:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca390e lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [733184->737279] (req 733184->737279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.610620:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca390e lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [733184->737279] (req 733184->737279) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.610625:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca390e lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [733184->737279] (req 733184->737279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.610628:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca390e lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [733184->737279] (req 733184->737279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531964.624517:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531964.624520:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531964.624534:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531964.624541:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467491264
00000100:00100000:0.0:1651531964.624545:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467491456
00000100:00100000:1.0:1651531964.624552:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467491520
00000100:00100000:0.0:1651531964.624556:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44509
00000100:00100000:0.0:1651531964.624558:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003b5b354a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438146:x1731754467491456:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531964.624562:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651531964.624564:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250012
00010000:00010000:0.0:1651531964.624565:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca3915 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4459c1 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531964.624566:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b5b5b4c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754467491264:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531964.624573:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca391c lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.624575:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca3915 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4459c1 expref: 13 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531964.624577:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531964.624578:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531964.624579:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca391c lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [69632->73727] (req 69632->73727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.624583:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca391c lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [69632->73727] (req 69632->73727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.624584:0:166112:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca3915 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4459c1 expref: 13 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531964.624588:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e2ec18e1, rc 0)
00000100:00100000:0.0:1651531964.624600:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003b5b354a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754467491456:12345-10.240.43.64@tcp:101:fio.0 Request processed in 42us (81us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531964.624603:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44509
00000100:00100000:0.0:1651531964.624617:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250013
00000100:00100000:0.0:1651531964.624619:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000da31c48f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438146:x1731754467491520:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531964.624625:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca3923 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.624629:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531964.624630:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531964.624631:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca3923 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [266240->270335] (req 266240->270335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.624635:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca3923 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [266240->270335] (req 266240->270335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531964.625700:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531964.625722:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467491904
00000100:00100000:1.0:1651531964.625733:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250014
00000100:00100000:1.0:1651531964.625735:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000137fd3d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754467491904:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531964.625742:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca392a lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.625746:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531964.625747:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531964.625748:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca392a lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [225280->229375] (req 225280->229375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.625756:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca392a lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [225280->229375] (req 225280->229375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531964.661599:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531964.661624:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467492032
00000100:00100000:0.0:1651531964.661634:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44510
00000100:00100000:0.0:1651531964.661637:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004d72f458 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754467492032:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531964.661643:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531964.661649:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca3931 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4459cf expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.661662:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca3931 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4459cf expref: 20 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531964.661670:0:166111:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca3931 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4459cf expref: 20 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531964.661677:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e2ec18e1, rc 0)
00000100:00100000:0.0:1651531964.661694:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004d72f458 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754467492032:12345-10.240.43.64@tcp:101:fio.0 Request processed in 56us (96us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531964.661698:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44510
00000100:00100000:1.0:1651531964.662890:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531964.662898:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467492416
00000100:00100000:1.0:1651531964.662908:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250015
00000100:00100000:1.0:1651531964.662910:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001797bd5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754467492416:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531964.662917:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3938 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.662921:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531964.662922:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531964.662923:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3938 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [454656->458751] (req 454656->458751) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.662927:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3938 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [454656->458751] (req 454656->458751) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651531964.674484:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869229 is committed
00010000:00010000:0.0:1651531964.674523:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca3923 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [266240->270335] (req 266240->270335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.674530:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca3923 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [266240->270335] (req 266240->270335) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.674537:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca391c lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [69632->73727] (req 69632->73727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.674548:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca391c lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [69632->73727] (req 69632->73727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531964.674568:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b5b5b4c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438147:x1731754467491264:12345-10.240.43.64@tcp:4:fio.0 Request processed in 50001us (50052us total) trans 21474869228 rc 0/0
00000100:00100000:0.0:1651531964.674570:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000da31c48f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754467491520:12345-10.240.43.64@tcp:4:fio.0 Request processed in 49948us (50035us total) trans 21474869229 rc 0/0
00000100:00100000:1.0:1651531964.674572:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250012
00000100:00100000:0.0:1651531964.674576:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250013
00010000:00010000:1.0:1651531964.674580:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca3923 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [266240->270335] (req 266240->270335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.674583:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000014685f38 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531964.674584:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca3923 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [266240->270335] (req 266240->270335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.674587:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca3923 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [266240->270335] (req 266240->270335) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.674590:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca391c lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 11 type: EXT [69632->73727] (req 69632->73727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.674593:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca3923 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 11 type: EXT [266240->270335] (req 266240->270335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.674602:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006da7a892 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531964.674604:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca391c lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 11 type: EXT [69632->73727] (req 69632->73727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.674609:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca3923 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 11 type: EXT [266240->270335] (req 266240->270335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.674610:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca391c lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 11 type: EXT [69632->73727] (req 69632->73727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.674618:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca391c lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [69632->73727] (req 69632->73727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.674621:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca391c lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [69632->73727] (req 69632->73727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651531964.711823:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869231 is committed
00010000:00010000:1.0:1651531964.711837:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3938 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [454656->458751] (req 454656->458751) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.711841:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3938 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [454656->458751] (req 454656->458751) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531964.711855:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001797bd5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438147:x1731754467492416:12345-10.240.43.64@tcp:4:fio.0 Request processed in 48945us (48966us total) trans 21474869231 rc 0/0
00000100:00100000:1.0:1651531964.711858:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250015
00010000:00010000:1.0:1651531964.711865:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3938 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [454656->458751] (req 454656->458751) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.711869:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000968553c1 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531964.711870:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3938 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [454656->458751] (req 454656->458751) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.711873:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3938 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [454656->458751] (req 454656->458751) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.711877:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3938 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [454656->458751] (req 454656->458751) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.711880:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3938 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [454656->458751] (req 454656->458751) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.711890:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca392a lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [225280->229375] (req 225280->229375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.711893:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca392a lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [225280->229375] (req 225280->229375) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531964.711903:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000137fd3d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438147:x1731754467491904:12345-10.240.43.64@tcp:4:fio.0 Request processed in 86167us (86204us total) trans 21474869230 rc 0/0
00000100:00100000:1.0:1651531964.711905:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250014
00010000:00010000:1.0:1651531964.711910:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca392a lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [225280->229375] (req 225280->229375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.711913:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001e36c601 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531964.711914:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca392a lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [225280->229375] (req 225280->229375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.711918:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca392a lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [225280->229375] (req 225280->229375) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.711922:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca392a lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [225280->229375] (req 225280->229375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.711925:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca392a lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [225280->229375] (req 225280->229375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531964.712425:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531964.712434:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467492992
00000100:00100000:0.0:1651531964.712442:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44511
00000100:00100000:0.0:1651531964.712444:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000530f55ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438146:x1731754467492992:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531964.712447:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531964.712451:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca393f lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4459dd expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.712459:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca393f lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4459dd expref: 11 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531964.712464:0:166112:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca393f lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4459dd expref: 11 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531964.712471:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e2ec18e1, rc 0)
00000100:00100000:0.0:1651531964.712487:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000530f55ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438146:x1731754467492992:12345-10.240.43.64@tcp:101:fio.0 Request processed in 42us (62us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531964.712490:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44511
00000100:00100000:0.0:1651531964.713177:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531964.713196:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467493376
00000100:00100000:1.0:1651531964.713219:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250016
00000100:00100000:1.0:1651531964.713221:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003a5ac9b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438147:x1731754467493376:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531964.713241:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3946 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.713245:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531964.713246:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531964.713247:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3946 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [532480->536575] (req 532480->536575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.713251:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3946 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [532480->536575] (req 532480->536575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.713263:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3946 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [532480->536575] (req 532480->536575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.713266:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3946 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [532480->536575] (req 532480->536575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.713297:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3946 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [532480->536575] (req 532480->536575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531964.713299:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003a5ac9b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438147:x1731754467493376:12345-10.240.43.64@tcp:3:fio.0 Request processed in 77us (121us total) trans 0 rc 4096/4096
00010000:00010000:0.0:1651531964.713301:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d44eb74d already unused, calling callback (0000000049fddea7)
00000100:00100000:1.0:1651531964.713302:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250016
00010000:00010000:0.0:1651531964.713302:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3946 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [532480->536575] (req 532480->536575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.713305:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3946 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [532480->536575] (req 532480->536575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.713311:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3946 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [532480->536575] (req 532480->536575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.713314:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3946 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [532480->536575] (req 532480->536575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531964.713945:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531964.713952:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467493632
00000100:00100000:1.0:1651531964.713963:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250017
00000100:00100000:1.0:1651531964.713964:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f05c0b82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438147:x1731754467493632:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531964.713972:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca394d lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.713976:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531964.713977:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531964.713977:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca394d lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [45056->49151] (req 45056->49151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.713981:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca394d lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [45056->49151] (req 45056->49151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.713992:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca394d lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [45056->49151] (req 45056->49151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.713995:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca394d lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [45056->49151] (req 45056->49151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531964.714008:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f05c0b82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438147:x1731754467493632:12345-10.240.43.64@tcp:3:fio.0 Request processed in 43us (63us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531964.714011:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250017
00010000:00010000:1.0:1651531964.714017:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca394d lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [45056->49151] (req 45056->49151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.714031:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006da7a892 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531964.714032:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca394d lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [45056->49151] (req 45056->49151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.714035:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca394d lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [45056->49151] (req 45056->49151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.714039:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca394d lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [45056->49151] (req 45056->49151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.714042:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca394d lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [45056->49151] (req 45056->49151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531964.714306:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531964.714324:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467493760
00000100:00100000:1.0:1651531964.714334:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250018
00000100:00100000:1.0:1651531964.714336:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000880cd1d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438146:x1731754467493760:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531964.714342:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca3954 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.714346:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531964.714347:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531964.714348:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca3954 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [798720->802815] (req 798720->802815) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.714351:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca3954 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [798720->802815] (req 798720->802815) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.714362:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca3954 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [798720->802815] (req 798720->802815) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.714375:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca3954 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [798720->802815] (req 798720->802815) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531964.714390:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000880cd1d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438146:x1731754467493760:12345-10.240.43.64@tcp:3:fio.0 Request processed in 53us (84us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531964.714393:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250018
00010000:00010000:1.0:1651531964.714399:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca3954 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [798720->802815] (req 798720->802815) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.714402:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b4c8742a already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531964.714403:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca3954 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [798720->802815] (req 798720->802815) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.714406:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca3954 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [798720->802815] (req 798720->802815) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.714410:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca3954 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [798720->802815] (req 798720->802815) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.714413:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca3954 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [798720->802815] (req 798720->802815) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531964.714681:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531964.714691:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467493888
00000100:00100000:1.0:1651531964.714701:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250019
00000100:00100000:1.0:1651531964.714703:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b338475a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438147:x1731754467493888:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531964.714709:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca395b lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.714723:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531964.714723:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531964.714724:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca395b lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [729088->733183] (req 729088->733183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.714728:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca395b lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [729088->733183] (req 729088->733183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.714739:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca395b lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [729088->733183] (req 729088->733183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.714742:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca395b lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [729088->733183] (req 729088->733183) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.714753:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca395b lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [729088->733183] (req 729088->733183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531964.714759:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b338475a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438147:x1731754467493888:12345-10.240.43.64@tcp:3:fio.0 Request processed in 56us (79us total) trans 0 rc 4096/4096
00010000:00010000:0.0:1651531964.714761:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008558d1b3 already unused, calling callback (0000000049fddea7)
00000100:00100000:1.0:1651531964.714762:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250019
00010000:00010000:0.0:1651531964.714762:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca395b lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [729088->733183] (req 729088->733183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.714765:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca395b lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [729088->733183] (req 729088->733183) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.714770:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca395b lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [729088->733183] (req 729088->733183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.714773:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca395b lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [729088->733183] (req 729088->733183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531964.715033:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531964.715040:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467494016
00000100:00100000:0.0:1651531964.715047:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44512
00000100:00100000:0.0:1651531964.715049:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c4db449c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438146:x1731754467494016:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531964.715052:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531964.715056:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3962 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4459eb expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.715064:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3962 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4459eb expref: 11 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531964.715068:0:166111:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3962 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4459eb expref: 11 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531964.715075:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000075a78972, rc 0)
00000100:00100000:0.0:1651531964.715092:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c4db449c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438146:x1731754467494016:12345-10.240.43.64@tcp:101:fio.0 Request processed in 42us (59us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531964.715095:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44512
00000100:00100000:0.0:1651531964.766434:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531964.766444:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531964.766452:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467494912
00000100:00100000:0.0:1651531964.766453:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467494656
00000100:00100000:0.0:1651531964.766460:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44513
00000100:00100000:1.0:1651531964.766462:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250020
00000100:00100000:0.0:1651531964.766462:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000091075bf7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438147:x1731754467494656:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651531964.766464:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006c903446 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438146:x1731754467494912:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531964.766465:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531964.766469:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3969 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4459f9 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.766470:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca3970 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.766474:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531964.766475:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531964.766476:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca3970 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.766493:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca3970 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.766495:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3969 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4459f9 expref: 12 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531964.766500:0:166112:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3969 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4459f9 expref: 12 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531964.766503:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000075a78972, rc 0)
00000100:00100000:0.0:1651531964.766513:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000091075bf7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438147:x1731754467494656:12345-10.240.43.64@tcp:101:fio.0 Request processed in 51us (76us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531964.766516:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44513
00000100:00100000:1.0:1651531964.767170:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531964.767189:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467495360
00000100:00100000:0.0:1651531964.767201:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250021
00000100:00100000:0.0:1651531964.767203:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ac545f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754467495360:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531964.767221:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca3977 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.767246:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531964.767247:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531964.767248:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca3977 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [974848->978943] (req 974848->978943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.767252:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca3977 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [974848->978943] (req 974848->978943) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531964.767358:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531964.767382:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467495488
00000100:00100000:1.0:1651531964.767394:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250022
00000100:00100000:1.0:1651531964.767396:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004237e3f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754467495488:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531964.767415:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca397e lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.767420:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531964.767420:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531964.767422:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca397e lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [983040->987135] (req 983040->987135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.767426:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca397e lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [983040->987135] (req 983040->987135) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531964.804870:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531964.804894:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467495616
00000100:00100000:0.0:1651531964.804905:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44514
00000100:00100000:0.0:1651531964.804907:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a202dd67 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754467495616:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531964.804910:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531964.804914:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3985 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445a07 expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.804922:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3985 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445a07 expref: 20 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531964.804926:0:166111:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3985 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445a07 expref: 20 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531964.804930:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000075a78972, rc 0)
00000100:00100000:0.0:1651531964.804941:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a202dd67 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438149:x1731754467495616:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (72us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531964.804947:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44514
00000001:00080000:1.0:1651531964.816476:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869234 is committed
00010000:00010000:1.0:1651531964.816498:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca397e lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [983040->987135] (req 983040->987135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.816502:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca397e lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [983040->987135] (req 983040->987135) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.816513:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca3977 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [974848->978943] (req 974848->978943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.816517:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca3977 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [974848->978943] (req 974848->978943) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531964.816531:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004237e3f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754467495488:12345-10.240.43.64@tcp:4:fio.0 Request processed in 49134us (49174us total) trans 21474869234 rc 0/0
00000100:00100000:0.0:1651531964.816535:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ac545f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754467495360:12345-10.240.43.64@tcp:4:fio.0 Request processed in 49332us (49366us total) trans 21474869233 rc 0/0
00000100:00100000:0.0:1651531964.816539:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250021
00000100:00100000:1.0:1651531964.816542:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250022
00010000:00010000:1.0:1651531964.816552:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca397e lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [983040->987135] (req 983040->987135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.816552:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca3977 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [974848->978943] (req 974848->978943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.816556:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006da7a892 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531964.816556:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e2ec18e1 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531964.816557:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca397e lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [983040->987135] (req 983040->987135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.816557:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca3977 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [974848->978943] (req 974848->978943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.816560:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca397e lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [983040->987135] (req 983040->987135) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.816560:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca3977 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [974848->978943] (req 974848->978943) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.816566:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca397e lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [983040->987135] (req 983040->987135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.816568:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca3977 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [974848->978943] (req 974848->978943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.816569:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca397e lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [983040->987135] (req 983040->987135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.816571:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca3977 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [974848->978943] (req 974848->978943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.816581:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca3970 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.816588:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca3970 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.816611:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca3970 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531964.816611:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006c903446 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438146:x1731754467494912:12345-10.240.43.64@tcp:4:fio.0 Request processed in 50147us (50177us total) trans 21474869232 rc 0/0
00000100:00100000:0.0:1651531964.816614:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250020
00010000:00010000:1.0:1651531964.816615:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b4c8742a already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531964.816616:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca3970 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.816619:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca3970 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.816623:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca3970 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.816634:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca3970 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531964.817009:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531964.817023:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531964.817032:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467496128
00000100:00100000:0.0:1651531964.817041:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44515
00000100:00100000:0.0:1651531964.817042:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b462545d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754467496128:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531964.817046:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531964.817050:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca398c lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445a15 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.817057:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca398c lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445a15 expref: 11 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531964.817062:0:166112:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca398c lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445a15 expref: 11 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531964.817065:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000075a78972, rc 0)
00000100:00100000:0.0:1651531964.817075:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b462545d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754467496128:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (67us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531964.817078:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44515
00000100:00100000:0.0:1651531964.817085:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467496192
00000100:00100000:0.0:1651531964.817100:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250023
00000100:00100000:0.0:1651531964.817101:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f817afea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438146:x1731754467496192:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531964.817109:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca3993 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.817113:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531964.817113:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531964.817115:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca3993 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [307200->659455] (req 307200->659455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.817119:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca3993 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [307200->659455] (req 307200->659455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.817329:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca3993 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [307200->659455] (req 307200->659455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.817333:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca3993 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [307200->659455] (req 307200->659455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.817344:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca3993 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [307200->659455] (req 307200->659455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.817348:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fab23815 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531964.817349:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca3993 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [307200->659455] (req 307200->659455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531964.817351:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f817afea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438146:x1731754467496192:12345-10.240.43.64@tcp:3:fio.0 Request processed in 249us (328us total) trans 0 rc 8192/8192
00010000:00010000:1.0:1651531964.817352:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca3993 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [307200->659455] (req 307200->659455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531964.817354:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250023
00010000:00010000:1.0:1651531964.817357:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca3993 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [307200->659455] (req 307200->659455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.817360:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca3993 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [307200->659455] (req 307200->659455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531964.817729:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531964.817741:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531964.817753:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467496512
00000100:00100000:0.0:1651531964.817765:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467496640
00000100:00100000:0.0:1651531964.817770:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44516
00000100:00100000:0.0:1651531964.817771:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003b5b354a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438147:x1731754467496512:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531964.817775:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651531964.817776:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44517
00000100:00100000:1.0:1651531964.817778:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004d72f458 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438147:x1731754467496640:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531964.817779:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca399a lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445a23 expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.817782:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531964.817786:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca39a1 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445a31 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.817786:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca399a lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445a23 expref: 12 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531964.817798:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca39a1 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445a31 expref: 13 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531964.817801:0:166111:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca399a lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445a23 expref: 13 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531964.817803:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca39a1 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445a31 expref: 13 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531964.817805:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000080362f27, rc 0)
00010000:00010000:1.0:1651531964.817806:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001e36c601, rc 0)
00000100:00100000:1.0:1651531964.817816:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004d72f458 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438147:x1731754467496640:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (74us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531964.817816:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003b5b354a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438147:x1731754467496512:12345-10.240.43.64@tcp:101:fio.0 Request processed in 44us (88us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531964.817819:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44516
00000100:00100000:1.0:1651531964.817820:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44517
00000100:00100000:1.0:1651531964.858785:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531964.858793:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467497088
00000100:00100000:1.0:1651531964.858806:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44518
00000100:00100000:1.0:1651531964.858808:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000091075bf7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754467497088:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531964.858811:0:206699:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531964.858815:0:206699:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca39a8 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445a3f expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.858822:0:206699:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca39a8 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445a3f expref: 11 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531964.858826:0:206699:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca39a8 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445a3f expref: 11 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531964.858830:0:206699:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001e36c601, rc 0)
00000100:00100000:1.0:1651531964.858844:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000091075bf7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754467497088:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (59us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531964.858847:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44518
00000100:00100000:1.0:1651531964.859372:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531964.859395:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467497472
00000100:00100000:0.0:1651531964.859410:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250024
00000100:00100000:0.0:1651531964.859411:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ffcc974c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438146:x1731754467497472:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531964.859418:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca39af lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.859422:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531964.859423:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531964.859424:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca39af lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [593920->708607] (req 593920->708607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.859428:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca39af lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [593920->708607] (req 593920->708607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651531964.900905:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869235 is committed
00010000:00010000:0.0:1651531964.900938:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca39af lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [593920->708607] (req 593920->708607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.900943:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca39af lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [593920->708607] (req 593920->708607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531964.900964:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ffcc974c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438146:x1731754467497472:12345-10.240.43.64@tcp:4:fio.0 Request processed in 41552us (41592us total) trans 21474869235 rc 0/0
00000100:00100000:0.0:1651531964.900967:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250024
00010000:00010000:0.0:1651531964.900974:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca39af lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [593920->708607] (req 593920->708607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.900978:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000080362f27 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531964.900979:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca39af lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [593920->708607] (req 593920->708607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.900982:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca39af lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [593920->708607] (req 593920->708607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.900987:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca39af lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [593920->708607] (req 593920->708607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.900989:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca39af lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [593920->708607] (req 593920->708607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531964.942891:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531964.942893:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531964.942910:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467498624
00000100:00100000:0.0:1651531964.942912:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467498560
00000100:00100000:1.0:1651531964.942921:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44519
00000100:00100000:1.0:1651531964.942923:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007b76f7f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754467498624:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531964.942927:0:206699:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651531964.942931:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250025
00000100:00100000:0.0:1651531964.942933:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c43262d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438147:x1731754467498560:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531964.942935:0:206699:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca39b6 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445a4d expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.942941:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca39bd lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.942943:0:206699:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca39b6 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445a4d expref: 12 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531964.942945:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531964.942947:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531964.942948:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca39bd lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [528384->532479] (req 528384->532479) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.942953:0:206699:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca39b6 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445a4d expref: 12 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531964.942953:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca39bd lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [528384->532479] (req 528384->532479) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.942957:0:206699:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001e36c601, rc 0)
00000100:00100000:1.0:1651531964.942967:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007b76f7f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754467498624:12345-10.240.43.64@tcp:101:fio.0 Request processed in 44us (75us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531964.942970:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44519
00000100:00100000:0.0:1651531964.943251:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531964.943260:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467498752
00000100:00100000:1.0:1651531964.943269:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44520
00000100:00100000:1.0:1651531964.943270:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f7096c29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467498752:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531964.943276:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531964.943280:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca39c4 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445a5b expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.943287:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca39c4 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445a5b expref: 14 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531964.943291:0:166112:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca39c4 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445a5b expref: 14 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531964.943295:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b4c8742a, rc 0)
00000100:00100000:1.0:1651531964.943305:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f7096c29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467498752:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (55us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531964.943307:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44520
00000001:00080000:1.0:1651531964.979740:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869236 is committed
00010000:00010000:0.0:1651531964.979774:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca39bd lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [528384->532479] (req 528384->532479) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.979779:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca39bd lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [528384->532479] (req 528384->532479) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531964.979800:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c43262d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438147:x1731754467498560:12345-10.240.43.64@tcp:4:fio.0 Request processed in 36866us (36910us total) trans 21474869236 rc 0/0
00010000:00010000:1.0:1651531964.979802:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca39bd lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [528384->532479] (req 528384->532479) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531964.979803:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250025
00010000:00010000:1.0:1651531964.979806:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000080362f27 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531964.979807:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca39bd lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [528384->532479] (req 528384->532479) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.979810:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca39bd lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [528384->532479] (req 528384->532479) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.979816:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca39bd lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [528384->532479] (req 528384->532479) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.979823:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca39bd lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [528384->532479] (req 528384->532479) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531964.980139:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531964.980146:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467499456
00000100:00100000:1.0:1651531964.980154:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44521
00000100:00100000:1.0:1651531964.980156:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000567318ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438146:x1731754467499456:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531964.980159:0:206699:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531964.980163:0:206699:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca39cb lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445a69 expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.980170:0:206699:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca39cb lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445a69 expref: 11 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531964.980174:0:206699:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca39cb lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445a69 expref: 11 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531964.980178:0:206699:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b4c8742a, rc 0)
00000100:00100000:1.0:1651531964.980193:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000567318ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438146:x1731754467499456:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (55us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531964.980196:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44521
00000100:00100000:1.0:1651531964.992146:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531964.992187:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467499904
00000100:00100000:0.0:1651531964.992202:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250026
00000100:00100000:0.0:1651531964.992203:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d9e74b4c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438148:x1731754467499904:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531964.992234:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca39d2 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531964.992238:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651531964.992239:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531964.992239:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531964.992240:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca39d2 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [524288->528383] (req 524288->528383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531964.992245:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467500096
00010000:00010000:0.0:1651531964.992245:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca39d2 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [524288->528383] (req 524288->528383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531964.992258:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250027
00000100:00100000:1.0:1651531964.992260:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a925fbf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754467500096:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531964.992264:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca39d2 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [524288->528383] (req 524288->528383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.992268:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca39d2 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [524288->528383] (req 524288->528383) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.992270:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca39d9 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.992281:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531964.992282:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531964.992283:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca39d9 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [348160->352255] (req 348160->352255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531964.992288:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d9e74b4c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754467499904:12345-10.240.43.64@tcp:3:fio.0 Request processed in 83us (142us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531964.992291:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250026
00010000:00010000:1.0:1651531964.992292:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca39d9 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [348160->352255] (req 348160->352255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.992303:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca39d2 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [524288->528383] (req 524288->528383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.992306:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca39d9 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [348160->352255] (req 348160->352255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.992310:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca39d9 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [348160->352255] (req 348160->352255) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.992313:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000075a78972 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531964.992314:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca39d2 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [524288->528383] (req 524288->528383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531964.992326:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a925fbf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754467500096:12345-10.240.43.64@tcp:3:fio.0 Request processed in 66us (89us total) trans 0 rc 4096/4096
00010000:00010000:0.0:1651531964.992328:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca39d2 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [524288->528383] (req 524288->528383) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531964.992329:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250027
00010000:00010000:0.0:1651531964.992333:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca39d2 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [524288->528383] (req 524288->528383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.992336:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca39d2 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [524288->528383] (req 524288->528383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.992339:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca39d9 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [348160->352255] (req 348160->352255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.992346:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b4c8742a already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531964.992347:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca39d9 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [348160->352255] (req 348160->352255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.992349:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca39d9 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [348160->352255] (req 348160->352255) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.992352:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca39d9 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [348160->352255] (req 348160->352255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531964.992355:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca39d9 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [348160->352255] (req 348160->352255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531964.992613:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531964.992620:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467500224
00000100:00100000:1.0:1651531964.992632:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250028
00000100:00100000:1.0:1651531964.992634:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c683c211 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438146:x1731754467500224:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531964.992641:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca39e0 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.992645:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531964.992647:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531964.992648:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca39e0 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [671744->675839] (req 671744->675839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.992652:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca39e0 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [671744->675839] (req 671744->675839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.992663:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca39e0 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [671744->675839] (req 671744->675839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.992667:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca39e0 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [671744->675839] (req 671744->675839) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531964.992681:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c683c211 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438146:x1731754467500224:12345-10.240.43.64@tcp:3:fio.0 Request processed in 46us (68us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531964.992683:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250028
00010000:00010000:1.0:1651531964.992689:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca39e0 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [671744->675839] (req 671744->675839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.992693:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001e36c601 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531964.992694:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca39e0 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [671744->675839] (req 671744->675839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.992696:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca39e0 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [671744->675839] (req 671744->675839) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.992701:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca39e0 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [671744->675839] (req 671744->675839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.992704:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca39e0 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [671744->675839] (req 671744->675839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531964.992777:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531964.992784:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467500416
00000100:00100000:1.0:1651531964.992797:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250029
00000100:00100000:1.0:1651531964.992798:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006a8dcc9d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438146:x1731754467500416:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531964.992805:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca39e7 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.992809:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531964.992810:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531964.992811:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca39e7 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [794624->798719] (req 794624->798719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531964.992815:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca39e7 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [794624->798719] (req 794624->798719) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651531965.034180:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869237 is committed
00010000:00010000:1.0:1651531965.034194:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca39e7 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [794624->798719] (req 794624->798719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.034197:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca39e7 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [794624->798719] (req 794624->798719) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.034229:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca39e7 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [794624->798719] (req 794624->798719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.034234:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006da7a892 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531965.034235:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca39e7 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [794624->798719] (req 794624->798719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.034238:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca39e7 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [794624->798719] (req 794624->798719) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531965.034239:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006a8dcc9d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438146:x1731754467500416:12345-10.240.43.64@tcp:4:fio.0 Request processed in 41439us (41462us total) trans 21474869237 rc 0/0
00000100:00100000:1.0:1651531965.034242:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250029
00010000:00010000:0.0:1651531965.034244:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca39e7 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [794624->798719] (req 794624->798719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.034247:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca39e7 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [794624->798719] (req 794624->798719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531965.034608:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531965.034625:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467500736
00000100:00100000:1.0:1651531965.034644:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44522
00000100:00100000:1.0:1651531965.034645:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f47fde78 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438146:x1731754467500736:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531965.034649:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531965.034653:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca39ee lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445a77 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.034660:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca39ee lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445a77 expref: 11 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531965.034665:0:166112:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca39ee lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445a77 expref: 11 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531965.034668:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001e36c601, rc 0)
00000100:00100000:1.0:1651531965.034677:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f47fde78 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438146:x1731754467500736:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (70us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531965.034680:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44522
00000100:00100000:1.0:1651531965.034996:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531965.035003:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467501120
00000100:00100000:1.0:1651531965.035010:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44523
00000100:00100000:1.0:1651531965.035011:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b9b10d48 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438148:x1731754467501120:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531965.035015:0:206699:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531965.035018:0:206699:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca39f5 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445a85 expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.035025:0:206699:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca39f5 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445a85 expref: 11 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531965.035042:0:206699:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca39f5 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445a85 expref: 11 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531965.035046:0:206699:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000968553c1, rc 0)
00000100:00100000:1.0:1651531965.035056:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b9b10d48 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438148:x1731754467501120:12345-10.240.43.64@tcp:101:fio.0 Request processed in 44us (61us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531965.035059:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44523
00000100:00100000:1.0:1651531965.035862:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531965.035870:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467501632
00000100:00100000:1.0:1651531965.035885:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250030
00000100:00100000:1.0:1651531965.035887:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000033723645 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754467501632:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531965.035894:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca39fc lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.035899:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531965.035899:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531965.035900:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca39fc lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [884736->888831] (req 884736->888831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.035904:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca39fc lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [884736->888831] (req 884736->888831) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.035916:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca39fc lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [884736->888831] (req 884736->888831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.035919:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca39fc lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [884736->888831] (req 884736->888831) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.035946:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca39fc lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [884736->888831] (req 884736->888831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531965.035947:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000033723645 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754467501632:12345-10.240.43.64@tcp:3:fio.0 Request processed in 59us (85us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531965.035950:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250030
00010000:00010000:0.0:1651531965.035950:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c2b76533 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531965.035951:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca39fc lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [884736->888831] (req 884736->888831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.035954:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca39fc lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [884736->888831] (req 884736->888831) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.035959:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca39fc lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [884736->888831] (req 884736->888831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.035961:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca39fc lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [884736->888831] (req 884736->888831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531965.036636:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531965.036644:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467501888
00000100:00100000:1.0:1651531965.036659:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250031
00000100:00100000:1.0:1651531965.036660:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005ec1cbc3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754467501888:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531965.036674:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3a03 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.036678:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531965.036679:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531965.036680:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3a03 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [57344->61439] (req 57344->61439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.036684:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3a03 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [57344->61439] (req 57344->61439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.036695:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3a03 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [57344->61439] (req 57344->61439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.036699:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3a03 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [57344->61439] (req 57344->61439) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531965.036713:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005ec1cbc3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754467501888:12345-10.240.43.64@tcp:3:fio.0 Request processed in 52us (77us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531965.036715:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250031
00010000:00010000:1.0:1651531965.036723:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3a03 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [57344->61439] (req 57344->61439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.036726:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e9b84540 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531965.036727:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3a03 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [57344->61439] (req 57344->61439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.036730:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3a03 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [57344->61439] (req 57344->61439) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.036735:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3a03 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [57344->61439] (req 57344->61439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.036737:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3a03 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [57344->61439] (req 57344->61439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531965.076326:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531965.076334:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467502464
00000100:00100000:1.0:1651531965.076351:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250032
00000100:00100000:1.0:1651531965.076353:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dccc50c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438147:x1731754467502464:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531965.076360:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3a0a lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.076365:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531965.076365:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531965.076366:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3a0a lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [634880->638975] (req 634880->638975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.076371:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3a0a lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [634880->638975] (req 634880->638975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531965.076740:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531965.076753:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531965.076763:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467502656
00000100:00100000:0.0:1651531965.076776:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467502784
00000100:00100000:0.0:1651531965.076782:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250033
00000100:00100000:0.0:1651531965.076784:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002d3e5ae4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754467502656:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651531965.076785:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250034
00000100:00100000:1.0:1651531965.076787:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001eda4376 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754467502784:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531965.076792:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3a11 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.076797:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531965.076798:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3a18 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.076798:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531965.076799:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3a11 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [913408->917503] (req 913408->917503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.076807:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3a11 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [913408->917503] (req 913408->917503) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.076808:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531965.076808:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531965.076810:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3a18 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [569344->573439] (req 569344->573439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.076814:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3a18 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [569344->573439] (req 569344->573439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.076819:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3a11 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [913408->917503] (req 913408->917503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.076822:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3a11 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [913408->917503] (req 913408->917503) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.076826:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3a18 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [569344->573439] (req 569344->573439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.076830:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3a18 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [569344->573439] (req 569344->573439) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531965.076849:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002d3e5ae4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754467502656:12345-10.240.43.64@tcp:3:fio.0 Request processed in 64us (109us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531965.076852:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001eda4376 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754467502784:12345-10.240.43.64@tcp:3:fio.0 Request processed in 64us (99us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531965.076852:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250033
00000100:00100000:1.0:1651531965.076856:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250034
00010000:00010000:0.0:1651531965.076860:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3a11 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [913408->917503] (req 913408->917503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.076863:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000075a78972 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531965.076864:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3a11 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [913408->917503] (req 913408->917503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.076867:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3a11 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [913408->917503] (req 913408->917503) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.076872:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3a11 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [913408->917503] (req 913408->917503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.076875:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3a11 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [913408->917503] (req 913408->917503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.076881:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3a18 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [569344->573439] (req 569344->573439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.076884:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000968553c1 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531965.076885:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3a18 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [569344->573439] (req 569344->573439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.076888:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3a18 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [569344->573439] (req 569344->573439) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.076891:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3a18 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [569344->573439] (req 569344->573439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.076893:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3a18 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [569344->573439] (req 569344->573439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531965.077708:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531965.077726:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467503168
00000100:00100000:0.0:1651531965.077742:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250035
00000100:00100000:0.0:1651531965.077743:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e15376c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467503168:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531965.077750:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca3a1f lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.077754:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531965.077755:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531965.077756:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca3a1f lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.077760:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca3a1f lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.077772:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca3a1f lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.077775:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca3a1f lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531965.077794:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e15376c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467503168:12345-10.240.43.64@tcp:3:fio.0 Request processed in 50us (86us total) trans 0 rc 4096/4096
00010000:00010000:1.0:1651531965.077797:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca3a1f lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531965.077797:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250035
00010000:00010000:1.0:1651531965.077805:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e2ec18e1 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531965.077806:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca3a1f lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.077809:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca3a1f lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.077814:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca3a1f lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.077817:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca3a1f lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651531965.101793:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869238 is committed
00002000:00010000:1.0:1651531965.101805:0:192753:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x34545:0x0] updating lvb mtime from disk: 1651531964 -> 1651531965
00002000:00010000:1.0:1651531965.101807:0:192753:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x34545:0x0] updating lvb ctime from disk: 1651531964 -> 1651531965
00010000:00010000:1.0:1651531965.101810:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3a0a lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [634880->638975] (req 634880->638975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.101813:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3a0a lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [634880->638975] (req 634880->638975) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531965.101835:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dccc50c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438147:x1731754467502464:12345-10.240.43.64@tcp:4:fio.0 Request processed in 25481us (25510us total) trans 21474869238 rc 0/0
00000100:00100000:1.0:1651531965.101838:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250032
00010000:00010000:0.0:1651531965.101841:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3a0a lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [634880->638975] (req 634880->638975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.101845:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e9b84540 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531965.101846:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3a0a lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [634880->638975] (req 634880->638975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.101850:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3a0a lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [634880->638975] (req 634880->638975) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.101855:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3a0a lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [634880->638975] (req 634880->638975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.101858:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3a0a lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [634880->638975] (req 634880->638975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531965.102122:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531965.102146:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467503552
00000100:00100000:1.0:1651531965.102161:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250036
00000100:00100000:1.0:1651531965.102164:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bf4022bf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438146:x1731754467503552:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531965.102171:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3a26 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.102175:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531965.102176:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531965.102177:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3a26 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [503808->507903] (req 503808->507903) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.102181:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3a26 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [503808->507903] (req 503808->507903) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.102192:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3a26 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [503808->507903] (req 503808->507903) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.102196:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3a26 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [503808->507903] (req 503808->507903) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.102220:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3a26 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [503808->507903] (req 503808->507903) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531965.102239:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bf4022bf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438146:x1731754467503552:12345-10.240.43.64@tcp:3:fio.0 Request processed in 70us (113us total) trans 0 rc 4096/4096
00010000:00010000:0.0:1651531965.102240:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001e36c601 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531965.102241:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3a26 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [503808->507903] (req 503808->507903) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531965.102242:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250036
00010000:00010000:0.0:1651531965.102244:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3a26 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [503808->507903] (req 503808->507903) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.102249:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3a26 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [503808->507903] (req 503808->507903) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.102252:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3a26 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [503808->507903] (req 503808->507903) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531965.135162:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531965.135183:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467504000
00000100:00100000:1.0:1651531965.135197:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250037
00000100:00100000:1.0:1651531965.135199:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f99d9ea1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438146:x1731754467504000:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531965.135206:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3a2d lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.135220:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531965.135232:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531965.135233:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3a2d lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [946176->950271] (req 946176->950271) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.135238:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3a2d lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [946176->950271] (req 946176->950271) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.135249:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3a2d lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [946176->950271] (req 946176->950271) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.135253:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3a2d lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [946176->950271] (req 946176->950271) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531965.135267:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f99d9ea1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438146:x1731754467504000:12345-10.240.43.64@tcp:3:fio.0 Request processed in 67us (106us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531965.135269:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250037
00010000:00010000:1.0:1651531965.135276:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3a2d lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [946176->950271] (req 946176->950271) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.135279:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a8889a80 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531965.135280:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3a2d lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [946176->950271] (req 946176->950271) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.135283:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3a2d lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [946176->950271] (req 946176->950271) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.135288:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3a2d lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [946176->950271] (req 946176->950271) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.135290:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3a2d lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [946176->950271] (req 946176->950271) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531965.135581:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531965.135601:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467504192
00000100:00100000:1.0:1651531965.135614:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250038
00000100:00100000:1.0:1651531965.135615:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000043b0f16d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438146:x1731754467504192:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531965.135622:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3a34 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.135626:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531965.135626:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531965.135628:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3a34 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [598016->602111] (req 598016->602111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.135631:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3a34 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [598016->602111] (req 598016->602111) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651531965.196794:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869239 is committed
00010000:00010000:1.0:1651531965.196808:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3a34 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [598016->602111] (req 598016->602111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.196812:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3a34 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [598016->602111] (req 598016->602111) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531965.196833:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000043b0f16d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438146:x1731754467504192:12345-10.240.43.64@tcp:4:fio.0 Request processed in 61217us (61252us total) trans 21474869239 rc 0/0
00000100:00100000:1.0:1651531965.196836:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250038
00010000:00010000:0.0:1651531965.196838:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3a34 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [598016->602111] (req 598016->602111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.196843:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001e36c601 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531965.196844:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3a34 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [598016->602111] (req 598016->602111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.196847:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3a34 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [598016->602111] (req 598016->602111) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.196853:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3a34 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [598016->602111] (req 598016->602111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.196860:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3a34 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [598016->602111] (req 598016->602111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531965.235203:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531965.235244:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467505088
00000100:00100000:1.0:1651531965.235246:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531965.235256:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44524
00000100:00100000:0.0:1651531965.235258:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000008e0501d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438147:x1731754467505088:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651531965.235261:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467504960
00010000:00010000:0.0:1651531965.235262:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531965.235266:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3a3b lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445a93 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531965.235275:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250039
00000100:00100000:1.0:1651531965.235277:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000530f55ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754467504960:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531965.235280:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3a3b lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445a93 expref: 12 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531965.235285:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3a42 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.235285:0:166112:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3a3b lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445a93 expref: 12 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531965.235289:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531965.235289:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531965.235289:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000075a78972, rc 0)
00010000:00010000:1.0:1651531965.235291:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3a42 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [827392->831487] (req 827392->831487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.235295:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3a42 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [827392->831487] (req 827392->831487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531965.235299:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000008e0501d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438147:x1731754467505088:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (97us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531965.235302:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44524
00000100:00100000:1.0:1651531965.285745:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531965.285767:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467505536
00000100:00100000:0.0:1651531965.285769:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531965.285786:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467505472
00000100:00100000:0.0:1651531965.285788:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250040
00000100:00100000:0.0:1651531965.285791:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c4db449c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754467505536:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651531965.285796:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250041
00000100:00100000:1.0:1651531965.285798:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000052cf3c08 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754467505472:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531965.285805:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3a49 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.285806:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3a50 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.285809:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531965.285810:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531965.285811:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3a49 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [823296->827391] (req 823296->827391) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.285815:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3a49 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [823296->827391] (req 823296->827391) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.285816:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531965.285817:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531965.285818:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3a50 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [561152->565247] (req 561152->565247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.285823:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3a50 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [561152->565247] (req 561152->565247) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.285835:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3a50 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [561152->565247] (req 561152->565247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.285838:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3a50 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [561152->565247] (req 561152->565247) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531965.285858:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c4db449c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754467505536:12345-10.240.43.64@tcp:3:fio.0 Request processed in 66us (113us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531965.285863:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250040
00010000:00010000:0.0:1651531965.285876:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3a50 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [561152->565247] (req 561152->565247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.285881:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000075a78972 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531965.285883:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3a50 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [561152->565247] (req 561152->565247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.285888:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3a50 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [561152->565247] (req 561152->565247) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.285896:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3a50 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [561152->565247] (req 561152->565247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.285902:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3a50 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [561152->565247] (req 561152->565247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531965.286185:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531965.286215:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467505728
00000100:00100000:1.0:1651531965.286239:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250042
00000100:00100000:1.0:1651531965.286241:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000b1a9136 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754467505728:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531965.286254:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3a57 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.286258:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531965.286258:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531965.286260:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3a57 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [303104->307199] (req 303104->307199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.286264:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3a57 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [303104->307199] (req 303104->307199) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651531965.298107:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869240 is committed
00010000:00010000:1.0:1651531965.298120:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3a42 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [827392->831487] (req 827392->831487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.298124:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3a42 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [827392->831487] (req 827392->831487) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531965.298139:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000530f55ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754467504960:12345-10.240.43.64@tcp:4:fio.0 Request processed in 62861us (62893us total) trans 21474869240 rc 0/0
00000100:00100000:1.0:1651531965.298142:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250039
00010000:00010000:1.0:1651531965.298149:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3a42 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [827392->831487] (req 827392->831487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.298152:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a8889a80 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531965.298153:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3a42 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [827392->831487] (req 827392->831487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.298160:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3a42 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [827392->831487] (req 827392->831487) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.298165:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3a42 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [827392->831487] (req 827392->831487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.298167:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3a42 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [827392->831487] (req 827392->831487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531965.324403:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531965.324411:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467505984
00000100:00100000:0.0:1651531965.324420:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44525
00000100:00100000:0.0:1651531965.324421:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000f4bed26 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754467505984:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531965.324425:0:206699:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531965.324429:0:206699:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3a5e lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445aa1 expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.324438:0:206699:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3a5e lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445aa1 expref: 17 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531965.324442:0:206699:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3a5e lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445aa1 expref: 17 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531965.324445:0:206699:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000075a78972, rc 0)
00000100:00100000:0.0:1651531965.324461:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000f4bed26 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438147:x1731754467505984:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (60us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531965.324464:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44525
00000001:00080000:1.0:1651531965.360792:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869242 is committed
00010000:00010000:1.0:1651531965.360808:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3a49 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [823296->827391] (req 823296->827391) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.360812:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3a49 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [823296->827391] (req 823296->827391) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531965.360835:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000052cf3c08 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754467505472:12345-10.240.43.64@tcp:4:fio.0 Request processed in 75036us (75066us total) trans 21474869241 rc 0/0
00000100:00100000:1.0:1651531965.360839:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250041
00010000:00010000:0.0:1651531965.360845:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3a49 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [823296->827391] (req 823296->827391) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.360850:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e9b84540 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531965.360851:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3a57 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [303104->307199] (req 303104->307199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.360854:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3a57 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [303104->307199] (req 303104->307199) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.360857:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3a49 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [823296->827391] (req 823296->827391) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531965.360867:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000b1a9136 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438146:x1731754467505728:12345-10.240.43.64@tcp:4:fio.0 Request processed in 74625us (74682us total) trans 21474869242 rc 0/0
00010000:00010000:0.0:1651531965.360871:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3a49 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [823296->827391] (req 823296->827391) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531965.360872:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250042
00010000:00010000:0.0:1651531965.360878:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3a49 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [823296->827391] (req 823296->827391) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.360880:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3a49 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [823296->827391] (req 823296->827391) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.360884:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3a57 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [303104->307199] (req 303104->307199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.360887:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000968553c1 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531965.360888:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3a57 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [303104->307199] (req 303104->307199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.360890:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3a57 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [303104->307199] (req 303104->307199) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.360894:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3a57 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [303104->307199] (req 303104->307199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.360896:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3a57 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [303104->307199] (req 303104->307199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531965.361959:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531965.361967:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467506624
00000100:00100000:1.0:1651531965.361977:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250043
00000100:00100000:1.0:1651531965.361979:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004d810c74 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438148:x1731754467506624:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531965.361986:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3a65 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.361990:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531965.361990:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531965.361991:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3a65 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [647168->651263] (req 647168->651263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.361995:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3a65 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [647168->651263] (req 647168->651263) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.362007:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3a65 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [647168->651263] (req 647168->651263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.362010:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3a65 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [647168->651263] (req 647168->651263) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531965.362023:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004d810c74 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438148:x1731754467506624:12345-10.240.43.64@tcp:3:fio.0 Request processed in 44us (65us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531965.362026:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250043
00010000:00010000:1.0:1651531965.362032:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3a65 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [647168->651263] (req 647168->651263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.362039:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a8889a80 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531965.362040:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3a65 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [647168->651263] (req 647168->651263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.362043:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3a65 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [647168->651263] (req 647168->651263) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.362048:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3a65 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [647168->651263] (req 647168->651263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.362050:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3a65 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [647168->651263] (req 647168->651263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531965.362379:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531965.362387:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467506752
00000100:00100000:1.0:1651531965.362396:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250044
00000100:00100000:1.0:1651531965.362398:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a552d36e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438148:x1731754467506752:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531965.362407:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3a6c lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.362411:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531965.362412:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531965.362412:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3a6c lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [466944->471039] (req 466944->471039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.362416:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3a6c lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [466944->471039] (req 466944->471039) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.362430:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3a6c lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [466944->471039] (req 466944->471039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.362433:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3a6c lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [466944->471039] (req 466944->471039) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.362453:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3a6c lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [466944->471039] (req 466944->471039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531965.362454:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a552d36e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438148:x1731754467506752:12345-10.240.43.64@tcp:3:fio.0 Request processed in 56us (76us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531965.362457:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250044
00010000:00010000:0.0:1651531965.362459:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c2b76533 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531965.362460:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3a6c lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [466944->471039] (req 466944->471039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.362463:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3a6c lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [466944->471039] (req 466944->471039) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.362468:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3a6c lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [466944->471039] (req 466944->471039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.362471:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3a6c lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [466944->471039] (req 466944->471039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531965.387059:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531965.387070:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467507136
00000100:00100000:1.0:1651531965.387082:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250045
00000100:00100000:1.0:1651531965.387084:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b0d90290 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438147:x1731754467507136:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531965.387092:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3a73 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.387097:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531965.387098:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531965.387099:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3a73 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [262144->266239] (req 262144->266239) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.387104:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3a73 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [262144->266239] (req 262144->266239) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651531965.448756:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869243 is committed
00010000:00010000:1.0:1651531965.448772:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3a73 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [262144->266239] (req 262144->266239) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.448780:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3a73 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [262144->266239] (req 262144->266239) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531965.448803:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b0d90290 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438147:x1731754467507136:12345-10.240.43.64@tcp:4:fio.0 Request processed in 61718us (61745us total) trans 21474869243 rc 0/0
00000100:00100000:1.0:1651531965.448806:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250045
00010000:00010000:0.0:1651531965.448809:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3a73 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [262144->266239] (req 262144->266239) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.448814:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a8889a80 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531965.448815:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3a73 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [262144->266239] (req 262144->266239) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.448818:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3a73 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [262144->266239] (req 262144->266239) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.448824:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3a73 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [262144->266239] (req 262144->266239) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.448826:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3a73 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [262144->266239] (req 262144->266239) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531965.461664:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531965.461688:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467507648
00000100:00100000:0.0:1651531965.461698:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44526
00000100:00100000:0.0:1651531965.461700:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000065cbff98 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438148:x1731754467507648:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531965.461703:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531965.461707:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3a7a lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445aaf expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.461715:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3a7a lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445aaf expref: 11 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531965.461719:0:166112:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3a7a lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445aaf expref: 11 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531965.461723:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000075a78972, rc 0)
00000100:00100000:0.0:1651531965.461739:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000065cbff98 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438148:x1731754467507648:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (76us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531965.461742:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44526
00000100:00100000:1.0:1651531965.462473:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531965.462482:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467507904
00000100:00100000:1.0:1651531965.462493:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250046
00000100:00100000:1.0:1651531965.462495:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a8cded1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754467507904:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531965.462503:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3a81 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.462507:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531965.462508:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531965.462509:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3a81 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [557056->561151] (req 557056->561151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.462513:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3a81 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [557056->561151] (req 557056->561151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651531965.511913:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869244 is committed
00010000:00010000:1.0:1651531965.511930:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3a81 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [557056->561151] (req 557056->561151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.511935:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3a81 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [557056->561151] (req 557056->561151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531965.511954:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a8cded1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754467507904:12345-10.240.43.64@tcp:4:fio.0 Request processed in 49458us (49481us total) trans 21474869244 rc 0/0
00000100:00100000:1.0:1651531965.511958:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250046
00010000:00010000:1.0:1651531965.512036:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3a81 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [557056->561151] (req 557056->561151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.512041:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006da7a892 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531965.512042:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3a81 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [557056->561151] (req 557056->561151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.512045:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3a81 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [557056->561151] (req 557056->561151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.512051:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3a81 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [557056->561151] (req 557056->561151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.512053:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3a81 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [557056->561151] (req 557056->561151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531965.513022:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531965.513030:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467508416
00000100:00100000:1.0:1651531965.513041:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250047
00000100:00100000:1.0:1651531965.513043:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004d810c74 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438146:x1731754467508416:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531965.513051:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca3a88 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.513055:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531965.513057:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531965.513058:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca3a88 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [294912->299007] (req 294912->299007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.513062:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca3a88 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [294912->299007] (req 294912->299007) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.513074:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca3a88 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [294912->299007] (req 294912->299007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.513078:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca3a88 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [294912->299007] (req 294912->299007) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531965.513101:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004d810c74 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438146:x1731754467508416:12345-10.240.43.64@tcp:3:fio.0 Request processed in 57us (79us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531965.513104:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250047
00010000:00010000:0.0:1651531965.513104:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca3a88 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [294912->299007] (req 294912->299007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.513109:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b4c8742a already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531965.513110:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca3a88 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [294912->299007] (req 294912->299007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.513113:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca3a88 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [294912->299007] (req 294912->299007) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.513120:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca3a88 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [294912->299007] (req 294912->299007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.513123:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca3a88 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [294912->299007] (req 294912->299007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531965.513594:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531965.513606:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467508672
00000100:00100000:0.0:1651531965.513616:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44527
00000100:00100000:0.0:1651531965.513617:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a552d36e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438146:x1731754467508672:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531965.513621:0:206699:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531965.513625:0:206699:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3a8f lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445abd expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.513632:0:206699:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3a8f lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445abd expref: 11 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531965.513636:0:206699:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3a8f lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445abd expref: 11 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531965.513640:0:206699:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000075a78972, rc 0)
00000100:00100000:0.0:1651531965.513658:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a552d36e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438146:x1731754467508672:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (65us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531965.513661:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44527
00000100:00100000:1.0:1651531965.554500:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531965.554509:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531965.554518:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531965.554526:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467509184
00000100:00100000:1.0:1651531965.554542:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467509248
00000100:00100000:1.0:1651531965.554549:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467509312
00000100:00100000:1.0:1651531965.554554:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250048
00000100:00100000:1.0:1651531965.554556:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b0d90290 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754467509184:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531965.554563:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3a96 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531965.554564:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250049
00000100:00100000:0.0:1651531965.554566:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000af037a35 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754467509248:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531965.554568:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531965.554570:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531965.554571:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3a96 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [53248->57343] (req 53248->57343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.554576:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3a96 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [53248->57343] (req 53248->57343) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.554578:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3a9d lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.554582:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531965.554583:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531965.554584:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3a9d lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [679936->684031] (req 679936->684031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.554589:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3a9d lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [679936->684031] (req 679936->684031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.554601:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3a9d lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [679936->684031] (req 679936->684031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.554605:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3a9d lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [679936->684031] (req 679936->684031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531965.554625:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000af037a35 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754467509248:12345-10.240.43.64@tcp:3:fio.0 Request processed in 57us (114us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531965.554632:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250049
00000100:00100000:0.0:1651531965.554640:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250050
00000100:00100000:0.0:1651531965.554643:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f690960f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467509312:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531965.554652:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3aa4 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.554658:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531965.554659:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531965.554661:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3aa4 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [815104->819199] (req 815104->819199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.554669:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3aa4 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [815104->819199] (req 815104->819199) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.554687:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3a9d lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [679936->684031] (req 679936->684031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.554692:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000075a78972 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531965.554693:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3a9d lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [679936->684031] (req 679936->684031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.554696:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3a9d lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [679936->684031] (req 679936->684031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.554702:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3a9d lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [679936->684031] (req 679936->684031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.554705:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3a9d lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [679936->684031] (req 679936->684031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651531965.596380:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869246 is committed
00010000:00010000:1.0:1651531965.596401:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3a96 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [53248->57343] (req 53248->57343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.596405:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3a96 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [53248->57343] (req 53248->57343) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.596423:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3aa4 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [815104->819199] (req 815104->819199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.596427:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3aa4 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [815104->819199] (req 815104->819199) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531965.596435:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b0d90290 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438146:x1731754467509184:12345-10.240.43.64@tcp:4:fio.0 Request processed in 41877us (41935us total) trans 21474869245 rc 0/0
00000100:00100000:1.0:1651531965.596438:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250048
00000100:00100000:0.0:1651531965.596444:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f690960f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438146:x1731754467509312:12345-10.240.43.64@tcp:4:fio.0 Request processed in 41801us (41926us total) trans 21474869246 rc 0/0
00010000:00010000:1.0:1651531965.596446:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3a96 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [53248->57343] (req 53248->57343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531965.596448:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250050
00010000:00010000:1.0:1651531965.596449:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006da7a892 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531965.596450:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3a96 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [53248->57343] (req 53248->57343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.596453:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3a96 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [53248->57343] (req 53248->57343) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.596456:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3aa4 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [815104->819199] (req 815104->819199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.596458:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3a96 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [53248->57343] (req 53248->57343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.596459:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000032ee36ee already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531965.596460:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3aa4 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [815104->819199] (req 815104->819199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.596461:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3a96 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [53248->57343] (req 53248->57343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.596463:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3aa4 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [815104->819199] (req 815104->819199) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.596469:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3aa4 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [815104->819199] (req 815104->819199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.596471:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3aa4 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [815104->819199] (req 815104->819199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531965.596809:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531965.596828:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467509760
00000100:00100000:0.0:1651531965.596845:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250051
00000100:00100000:0.0:1651531965.596847:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f0234546 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438147:x1731754467509760:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531965.596854:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3aab lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.596858:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531965.596859:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531965.596860:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3aab lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [69632->73727] (req 69632->73727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.596864:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3aab lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [69632->73727] (req 69632->73727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651531965.634994:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869247 is committed
00010000:00010000:0.0:1651531965.635030:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3aab lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [69632->73727] (req 69632->73727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.635034:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3aab lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [69632->73727] (req 69632->73727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531965.635055:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f0234546 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438147:x1731754467509760:12345-10.240.43.64@tcp:4:fio.0 Request processed in 38207us (38246us total) trans 21474869247 rc 0/0
00010000:00010000:1.0:1651531965.635057:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3aab lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [69632->73727] (req 69632->73727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531965.635058:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250051
00010000:00010000:1.0:1651531965.635061:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fb2f6575 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531965.635062:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3aab lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [69632->73727] (req 69632->73727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.635077:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3aab lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [69632->73727] (req 69632->73727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.635082:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3aab lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [69632->73727] (req 69632->73727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.635085:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3aab lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [69632->73727] (req 69632->73727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531965.648871:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531965.648879:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531965.648879:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467510400
00000100:00100000:1.0:1651531965.648888:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531965.648892:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467510464
00000100:00100000:0.0:1651531965.648905:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250052
00000100:00100000:1.0:1651531965.648908:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250053
00000100:00100000:0.0:1651531965.648908:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001e61ed2d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754467510400:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651531965.648911:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085951ded pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754467510464:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531965.648915:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3ab2 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.648919:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531965.648920:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3ab9 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.648920:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531965.648921:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3ab2 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [253952->258047] (req 253952->258047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.648925:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3ab2 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [253952->258047] (req 253952->258047) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.648926:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531965.648927:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531965.648928:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3ab9 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [909312->913407] (req 909312->913407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.648932:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3ab9 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [909312->913407] (req 909312->913407) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.648945:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3ab9 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [909312->913407] (req 909312->913407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.648948:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3ab9 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [909312->913407] (req 909312->913407) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531965.648978:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085951ded pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754467510464:12345-10.240.43.64@tcp:3:fio.0 Request processed in 66us (100us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531965.648981:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250053
00010000:00010000:1.0:1651531965.648989:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3ab9 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [909312->913407] (req 909312->913407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.648993:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006da7a892 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531965.648994:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3ab9 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [909312->913407] (req 909312->913407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531965.649006:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467510656
00010000:00010000:1.0:1651531965.649008:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3ab9 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [909312->913407] (req 909312->913407) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.649013:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3ab9 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [909312->913407] (req 909312->913407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.649016:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3ab9 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [909312->913407] (req 909312->913407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531965.649020:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44528
00000100:00100000:0.0:1651531965.649023:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009486b685 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467510656:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531965.649029:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531965.649034:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3ac0 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445acb expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.649047:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3ac0 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445acb expref: 14 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531965.649071:0:166112:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3ac0 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445acb expref: 14 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531965.649078:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c1022d42, rc 0)
00000100:00100000:0.0:1651531965.649103:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009486b685 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467510656:12345-10.240.43.64@tcp:101:fio.0 Request processed in 79us (213us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531965.649113:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44528
00000100:00100000:0.0:1651531965.650251:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531965.650269:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467511168
00000100:00100000:1.0:1651531965.650281:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250054
00000100:00100000:1.0:1651531965.650283:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004237e3f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467511168:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531965.650290:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3ac7 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.650294:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531965.650305:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531965.650306:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3ac7 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.650310:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3ac7 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651531965.685594:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869248 is committed
00010000:00010000:0.0:1651531965.685633:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3ab2 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [253952->258047] (req 253952->258047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.685639:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3ab2 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [253952->258047] (req 253952->258047) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531965.685670:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001e61ed2d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754467510400:12345-10.240.43.64@tcp:4:fio.0 Request processed in 36761us (36799us total) trans 21474869248 rc 0/0
00000100:00100000:0.0:1651531965.685674:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250052
00010000:00010000:0.0:1651531965.685685:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3ab2 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [253952->258047] (req 253952->258047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.685691:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000032ee36ee already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531965.685693:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3ab2 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [253952->258047] (req 253952->258047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.685699:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3ab2 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [253952->258047] (req 253952->258047) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.685708:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3ab2 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [253952->258047] (req 253952->258047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.685714:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3ab2 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [253952->258047] (req 253952->258047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531965.686010:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531965.686019:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467511296
00000100:00100000:0.0:1651531965.686034:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44529
00000100:00100000:0.0:1651531965.686036:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bf4022bf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467511296:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531965.686040:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531965.686044:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3ace lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445ad9 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.686052:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3ace lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445ad9 expref: 14 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531965.686056:0:166112:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3ace lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445ad9 expref: 14 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531965.686060:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c1022d42, rc 0)
00000100:00100000:0.0:1651531965.686074:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bf4022bf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467511296:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (65us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531965.686077:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44529
00000100:00100000:0.0:1651531965.686791:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531965.686799:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467511552
00000100:00100000:0.0:1651531965.686815:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250055
00000100:00100000:0.0:1651531965.686817:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f99d9ea1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467511552:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531965.686824:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3ad5 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.686828:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531965.686829:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531965.686830:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3ad5 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [413696->417791] (req 413696->417791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.686836:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3ad5 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [413696->417791] (req 413696->417791) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.686847:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3ad5 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [413696->417791] (req 413696->417791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.686851:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3ad5 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [413696->417791] (req 413696->417791) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531965.686869:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f99d9ea1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467511552:12345-10.240.43.64@tcp:3:fio.0 Request processed in 51us (78us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531965.686872:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250055
00010000:00010000:1.0:1651531965.686873:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3ad5 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [413696->417791] (req 413696->417791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.686878:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002c5e01dd already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531965.686879:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3ad5 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [413696->417791] (req 413696->417791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.686882:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3ad5 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [413696->417791] (req 413696->417791) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.686888:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3ad5 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [413696->417791] (req 413696->417791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.686890:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3ad5 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [413696->417791] (req 413696->417791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531965.722900:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531965.722909:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467511936
00000100:00100000:0.0:1651531965.722924:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250056
00000100:00100000:0.0:1651531965.722926:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000043b0f16d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467511936:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531965.722934:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3adc lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.722938:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531965.722939:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531965.722940:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3adc lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [626688->630783] (req 626688->630783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.722944:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3adc lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [626688->630783] (req 626688->630783) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.722960:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3adc lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [626688->630783] (req 626688->630783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.722963:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3adc lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [626688->630783] (req 626688->630783) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531965.722978:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000043b0f16d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467511936:12345-10.240.43.64@tcp:3:fio.0 Request processed in 51us (78us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531965.722981:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250056
00010000:00010000:0.0:1651531965.722987:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3adc lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [626688->630783] (req 626688->630783) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.722990:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c1022d42 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531965.722991:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3adc lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [626688->630783] (req 626688->630783) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.722994:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3adc lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [626688->630783] (req 626688->630783) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.722999:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3adc lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [626688->630783] (req 626688->630783) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.723001:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3adc lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [626688->630783] (req 626688->630783) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531965.723311:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531965.723319:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467512064
00000100:00100000:0.0:1651531965.723334:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44530
00000100:00100000:0.0:1651531965.723336:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000052cf3c08 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467512064:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531965.723339:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531965.723343:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3ae3 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445ae7 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.723351:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3ae3 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445ae7 expref: 14 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531965.723355:0:166112:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3ae3 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445ae7 expref: 14 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531965.723359:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000032ee36ee, rc 0)
00000100:00100000:0.0:1651531965.723369:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000052cf3c08 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467512064:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (59us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531965.723372:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44530
00000001:00080000:1.0:1651531965.736262:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869249 is committed
00010000:00010000:1.0:1651531965.736277:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3ac7 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.736281:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3ac7 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531965.736308:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004237e3f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438147:x1731754467511168:12345-10.240.43.64@tcp:4:fio.0 Request processed in 86024us (86058us total) trans 21474869249 rc 0/0
00000100:00100000:1.0:1651531965.736312:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250054
00010000:00010000:1.0:1651531965.736320:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3ac7 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.736323:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008558d1b3 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531965.736324:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3ac7 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.736327:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3ac7 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.736332:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3ac7 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.736335:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3ac7 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531965.782519:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531965.782528:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531965.782541:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467512704
00000100:00100000:0.0:1651531965.782548:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467512832
00000100:00100000:1.0:1651531965.782553:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44531
00000100:00100000:1.0:1651531965.782556:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000b1a9136 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754467512704:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651531965.782557:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44532
00000100:00100000:0.0:1651531965.782559:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aa58c961 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438147:x1731754467512832:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531965.782560:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531965.782563:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531965.782564:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3aea lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445afc expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.782567:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3af1 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445b03 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.782573:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3aea lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445afc expref: 13 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531965.782575:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3af1 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445b03 expref: 13 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531965.782581:0:166112:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3af1 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445b03 expref: 13 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531965.782584:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000032ee36ee, rc 0)
00010000:00010000:1.0:1651531965.782587:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3aea lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445afc expref: 12 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531965.782591:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008558d1b3, rc 0)
00000100:00100000:0.0:1651531965.782594:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aa58c961 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438147:x1731754467512832:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (66us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531965.782597:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44532
00000100:00100000:1.0:1651531965.782601:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000b1a9136 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754467512704:12345-10.240.43.64@tcp:101:fio.0 Request processed in 45us (82us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531965.782604:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44531
00000100:00100000:0.0:1651531965.783881:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531965.783899:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467513600
00000100:00100000:1.0:1651531965.783908:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44533
00000100:00100000:1.0:1651531965.783909:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000000615301 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438148:x1731754467513600:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531965.783913:0:206699:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531965.783916:0:206699:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3af8 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445b11 expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.783923:0:206699:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3af8 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445b11 expref: 11 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531965.783928:0:206699:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3af8 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445b11 expref: 11 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531965.783931:0:206699:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006da7a892, rc 0)
00000100:00100000:1.0:1651531965.783947:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000000615301 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438148:x1731754467513600:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (67us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531965.783950:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44533
00000100:00100000:0.0:1651531965.784614:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531965.784632:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467513856
00000100:00100000:1.0:1651531965.784648:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250057
00000100:00100000:1.0:1651531965.784650:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000021f31110 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754467513856:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531965.784658:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3aff lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.784662:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531965.784663:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531965.784664:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3aff lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [708608->712703] (req 708608->712703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.784668:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3aff lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [708608->712703] (req 708608->712703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.784680:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3aff lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [708608->712703] (req 708608->712703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.784683:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3aff lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [708608->712703] (req 708608->712703) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531965.784703:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000021f31110 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754467513856:12345-10.240.43.64@tcp:3:fio.0 Request processed in 52us (89us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531965.784706:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250057
00010000:00010000:1.0:1651531965.784714:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3aff lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [708608->712703] (req 708608->712703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.784717:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d44eb74d already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531965.784718:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3aff lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [708608->712703] (req 708608->712703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.784746:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3aff lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [708608->712703] (req 708608->712703) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.784751:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3aff lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [708608->712703] (req 708608->712703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.784754:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3aff lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [708608->712703] (req 708608->712703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531965.807663:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531965.807683:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467514112
00000100:00100000:1.0:1651531965.807698:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250058
00000100:00100000:1.0:1651531965.807700:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000053de45f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438146:x1731754467514112:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531965.807713:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3b06 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.807718:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531965.807718:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531965.807719:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3b06 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [798720->802815] (req 798720->802815) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.807723:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3b06 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [798720->802815] (req 798720->802815) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651531965.858404:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869250 is committed
00010000:00010000:1.0:1651531965.858418:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3b06 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [798720->802815] (req 798720->802815) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.858422:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3b06 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [798720->802815] (req 798720->802815) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531965.858452:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000053de45f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438146:x1731754467514112:12345-10.240.43.64@tcp:4:fio.0 Request processed in 50751us (50790us total) trans 21474869250 rc 0/0
00000100:00100000:1.0:1651531965.858456:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250058
00010000:00010000:0.0:1651531965.858475:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3b06 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [798720->802815] (req 798720->802815) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531965.858477:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651531965.858480:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d44eb74d already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531965.858481:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3b06 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [798720->802815] (req 798720->802815) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.858485:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3b06 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [798720->802815] (req 798720->802815) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.858490:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3b06 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [798720->802815] (req 798720->802815) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.858493:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3b06 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [798720->802815] (req 798720->802815) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531965.858510:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467514432
00000100:00100000:1.0:1651531965.858515:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531965.858521:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44534
00000100:00100000:0.0:1651531965.858523:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000c821e29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438146:x1731754467514432:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531965.858527:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531965.858530:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3b0d lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445b1f expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531965.858532:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467514496
00010000:00010000:0.0:1651531965.858537:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3b0d lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445b1f expref: 12 pid: 166113 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651531965.858546:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250059
00000100:00100000:1.0:1651531965.858548:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a6e5c9ad pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754467514496:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531965.858548:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3b0d lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445b1f expref: 12 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531965.858552:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000032ee36ee, rc 0)
00010000:00010000:1.0:1651531965.858555:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3b14 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.858559:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531965.858560:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531965.858561:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3b14 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [950272->954367] (req 950272->954367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531965.858563:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000c821e29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438146:x1731754467514432:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (86us total) trans 0 rc 301/301
00010000:00010000:1.0:1651531965.858565:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3b14 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [950272->954367] (req 950272->954367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531965.858566:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44534
00010000:00010000:1.0:1651531965.858577:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3b14 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [950272->954367] (req 950272->954367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.858580:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3b14 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [950272->954367] (req 950272->954367) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531965.858606:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a6e5c9ad pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438146:x1731754467514496:12345-10.240.43.64@tcp:3:fio.0 Request processed in 58us (92us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531965.858613:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250059
00010000:00010000:1.0:1651531965.858620:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3b14 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [950272->954367] (req 950272->954367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.858630:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006da7a892 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531965.858631:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3b14 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [950272->954367] (req 950272->954367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.858634:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3b14 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [950272->954367] (req 950272->954367) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.858639:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3b14 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [950272->954367] (req 950272->954367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.858642:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3b14 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [950272->954367] (req 950272->954367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531965.858848:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531965.858868:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467514624
00000100:00100000:1.0:1651531965.858882:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250060
00000100:00100000:1.0:1651531965.858883:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000089660739 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438147:x1731754467514624:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531965.858889:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3b1b lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.858894:0:216323:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003dec1fa8/0x3234de053ca2c73 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [49152->53247] (req 49152->53247) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4450d0 expref: 10 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.858897:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531965.858899:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531965.858900:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3b1b lrc: 4/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [16384->425983] (req 16384->425983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.858908:0:216323:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003dec1fa8/0x3234de053ca2c73 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [49152->53247] (req 49152->53247) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4450d0 expref: 10 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.858913:0:216323:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003dec1fa8/0x3234de053ca2c73 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [49152->53247] (req 49152->53247) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4450d0 expref: 10 pid: 166112 timeout: 22774 lvb_type: 0
00000100:00100000:1.0:1651531965.858918:0:216323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000008174da5 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_010:lustre-OST0001_UUID:216323:1731745997356096:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531965.858931:0:216323:0:(client.c:2492:ptlrpc_set_wait()) set 000000009a3b53d0 going to sleep for 6 seconds
00000100:00100000:0.0:1651531965.859158:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531965.859165:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467514880
00000100:00100000:0.0:1651531965.859181:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250061
00000100:00100000:0.0:1651531965.859183:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000e33e11e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438147:x1731754467514880:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531965.859191:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3b22 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.859199:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531965.859200:0:192754:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3b1b lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [16384->425983] (req 16384->425983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.859203:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531965.859204:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3b22 lrc: 4/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [57344->61439] (req 57344->61439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.859217:0:192754:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3b1b lrc: 4/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [16384->425983] (req 16384->425983) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.859221:0:192754:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3b22 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [57344->61439] (req 57344->61439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531965.859359:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531965.859375:0:216323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000008174da5 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_010:lustre-OST0001_UUID:216323:1731745997356096:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531965.859378:0:166103:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467515008
00010000:00010000:1.0:1651531965.859380:0:216323:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3b1b lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [16384->425983] (req 16384->425983) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.859384:0:166103:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003dec1fa8/0x3234de053ca2c73 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [49152->53247] (req 49152->53247) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4450d0 expref: 12 pid: 166112 timeout: 22774 lvb_type: 0
00000100:00100000:0.0:1651531965.859396:0:166103:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 213
00000100:00100000:0.0:1651531965.859398:0:166103:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e2c70225 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754467515008:12345-10.240.43.64@tcp:103:ldlm_bl_03.0
00010000:00010000:0.0:1651531965.859401:0:166103:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531965.859405:0:166103:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003dec1fa8/0x3234de053ca2c73 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [49152->53247] (req 49152->53247) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4450d0 expref: 12 pid: 166112 timeout: 22774 lvb_type: 0
00010000:00010000:0.0:1651531965.859409:0:166103:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003dec1fa8/0x3234de053ca2c73 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [49152->53247] (req 49152->53247) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4450d0 expref: 12 pid: 166112 timeout: 22774 lvb_type: 0
00010000:00010000:0.0:1651531965.859419:0:166103:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003dec1fa8/0x3234de053ca2c73 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [49152->53247] (req 49152->53247) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4450d0 expref: 12 pid: 166112 timeout: 22774 lvb_type: 0
00010000:00010000:0.0:1651531965.859423:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531965.859424:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531965.859425:0:166103:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3b1b lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [16384->425983] (req 16384->425983) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.859428:0:166103:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3b1b lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [16384->425983] (req 16384->425983) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.859439:0:166103:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1651531965.859447:0:216323:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3b1b lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [16384->425983] (req 16384->425983) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531965.859450:0:166103:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e2c70225 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438147:x1731754467515008:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 52us (91us total) trans 0 rc 0/0
00010000:00010000:1.0:1651531965.859451:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3b1b lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [16384->425983] (req 16384->425983) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531965.859453:0:166103:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 213
00000001:00080000:1.0:1651531965.883711:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869251 is committed
00010000:00010000:1.0:1651531965.883725:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3b1b lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [16384->425983] (req 16384->425983) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.883729:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3b1b lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [16384->425983] (req 16384->425983) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531965.883755:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000089660739 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438147:x1731754467514624:12345-10.240.43.64@tcp:4:fio.0 Request processed in 24870us (24907us total) trans 21474869251 rc 0/0
00000100:00100000:1.0:1651531965.883758:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250060
00010000:00010000:1.0:1651531965.883766:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3b1b lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [16384->425983] (req 16384->425983) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.883770:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008558d1b3 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531965.883771:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3b1b lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [16384->425983] (req 16384->425983) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.883774:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3b1b lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [16384->425983] (req 16384->425983) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.883779:0:166105:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531965.883780:0:166105:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531965.883780:0:166105:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3b22 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [57344->61439] (req 57344->61439) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.883783:0:166105:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3b22 lrc: 4/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [57344->61439] (req 57344->61439) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.883793:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3b1b lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [16384->425983] (req 16384->425983) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.883796:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3b1b lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [16384->425983] (req 16384->425983) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.883800:0:192754:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3b22 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [57344->61439] (req 57344->61439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.883805:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3b22 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [57344->61439] (req 57344->61439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.883819:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3b22 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [57344->61439] (req 57344->61439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.883822:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3b22 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [57344->61439] (req 57344->61439) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531965.883844:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000e33e11e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438147:x1731754467514880:12345-10.240.43.64@tcp:3:fio.0 Request processed in 24660us (24686us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531965.883850:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250061
00010000:00010000:0.0:1651531965.883858:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3b22 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [57344->61439] (req 57344->61439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.883862:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c1022d42 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531965.883863:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3b22 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [57344->61439] (req 57344->61439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.883866:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3b22 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [57344->61439] (req 57344->61439) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.883871:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3b22 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [57344->61439] (req 57344->61439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.883874:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3b22 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [57344->61439] (req 57344->61439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531965.884266:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531965.884273:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467515520
00000100:00100000:0.0:1651531965.884290:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250062
00000100:00100000:0.0:1651531965.884292:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003158b8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438149:x1731754467515520:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531965.884300:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3b29 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.884304:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531965.884305:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531965.884306:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3b29 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [180224->184319] (req 180224->184319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.884313:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3b29 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [180224->184319] (req 180224->184319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.884325:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3b29 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [180224->184319] (req 180224->184319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.884328:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3b29 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [180224->184319] (req 180224->184319) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.884346:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3b29 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [180224->184319] (req 180224->184319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531965.884349:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003158b8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438149:x1731754467515520:12345-10.240.43.64@tcp:3:fio.0 Request processed in 56us (84us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531965.884352:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250062
00010000:00010000:1.0:1651531965.884356:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000032ee36ee already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531965.884357:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3b29 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [180224->184319] (req 180224->184319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.884360:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3b29 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [180224->184319] (req 180224->184319) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.884366:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3b29 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [180224->184319] (req 180224->184319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.884368:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3b29 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [180224->184319] (req 180224->184319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531965.909025:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531965.909034:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467516032
00000100:00100000:0.0:1651531965.909045:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44535
00000100:00100000:0.0:1651531965.909047:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006c46ca95 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438146:x1731754467516032:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531965.909050:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531965.909054:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3b30 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445b2d expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.909062:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3b30 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445b2d expref: 10 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531965.909067:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3b30 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445b2d expref: 10 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531965.909074:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c1022d42, rc 0)
00000100:00100000:0.0:1651531965.909088:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006c46ca95 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438146:x1731754467516032:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (64us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531965.909091:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44535
00000100:00100000:0.0:1651531965.909179:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531965.909186:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467516160
00000100:00100000:0.0:1651531965.909202:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250063
00000100:00100000:0.0:1651531965.909204:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e0251a23 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438149:x1731754467516160:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531965.909221:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca3b37 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.909236:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531965.909237:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531965.909238:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca3b37 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [188416->192511] (req 188416->192511) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.909242:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca3b37 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [188416->192511] (req 188416->192511) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.909254:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca3b37 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [188416->192511] (req 188416->192511) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.909258:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca3b37 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [188416->192511] (req 188416->192511) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531965.909277:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e0251a23 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438149:x1731754467516160:12345-10.240.43.64@tcp:3:fio.0 Request processed in 72us (98us total) trans 0 rc 4096/4096
00010000:00010000:1.0:1651531965.909279:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca3b37 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [188416->192511] (req 188416->192511) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531965.909282:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250063
00010000:00010000:1.0:1651531965.909284:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000820577fb already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531965.909285:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca3b37 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [188416->192511] (req 188416->192511) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.909288:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca3b37 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [188416->192511] (req 188416->192511) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.909294:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca3b37 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [188416->192511] (req 188416->192511) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.909296:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca3b37 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [188416->192511] (req 188416->192511) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531965.909945:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531965.909953:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467516736
00000100:00100000:0.0:1651531965.909966:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250064
00000100:00100000:0.0:1651531965.909967:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000733c9403 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438147:x1731754467516736:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531965.909974:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca3b3e lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531965.909977:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651531965.909978:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531965.909979:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531965.909980:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca3b3e lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [40960->45055] (req 40960->45055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.909991:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca3b3e lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [40960->45055] (req 40960->45055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531965.909995:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467516800
00000100:00100000:1.0:1651531965.910004:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44536
00000100:00100000:1.0:1651531965.910006:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000008174da5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754467516800:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531965.910010:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531965.910014:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3b45 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445b3b expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.910022:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3b45 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445b3b expref: 11 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531965.910027:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3b45 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445b3b expref: 11 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531965.910030:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008558d1b3, rc 0)
00000100:00100000:1.0:1651531965.910043:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000008174da5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754467516800:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (67us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531965.910046:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44536
00000100:00100000:1.0:1651531965.946342:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531965.946351:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467517312
00000100:00100000:1.0:1651531965.946362:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250065
00000100:00100000:1.0:1651531965.946364:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d5b4a165 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754467517312:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531965.946371:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3b4c lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.946388:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531965.946388:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531965.946389:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3b4c lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [462848->466943] (req 462848->466943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.946394:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3b4c lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [462848->466943] (req 462848->466943) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.946407:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3b4c lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [462848->466943] (req 462848->466943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.946410:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3b4c lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [462848->466943] (req 462848->466943) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531965.946430:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d5b4a165 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754467517312:12345-10.240.43.64@tcp:3:fio.0 Request processed in 66us (89us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531965.946433:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250065
00010000:00010000:0.0:1651531965.946437:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3b4c lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [462848->466943] (req 462848->466943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.946442:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008558d1b3 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531965.946443:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3b4c lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [462848->466943] (req 462848->466943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.946446:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3b4c lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [462848->466943] (req 462848->466943) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.946452:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3b4c lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [462848->466943] (req 462848->466943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.946459:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3b4c lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [462848->466943] (req 462848->466943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531965.946732:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531965.946740:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467517440
00000100:00100000:1.0:1651531965.946750:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250066
00000100:00100000:1.0:1651531965.946752:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005dd15341 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754467517440:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531965.946759:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3b53 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.946763:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531965.946763:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531965.946765:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3b53 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [987136->991231] (req 987136->991231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.946781:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3b53 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [987136->991231] (req 987136->991231) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.946792:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3b53 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [987136->991231] (req 987136->991231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.946795:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3b53 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [987136->991231] (req 987136->991231) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531965.946810:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005dd15341 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754467517440:12345-10.240.43.64@tcp:3:fio.0 Request processed in 58us (79us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531965.946813:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250066
00010000:00010000:1.0:1651531965.946819:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3b53 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [987136->991231] (req 987136->991231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.946822:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006da7a892 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531965.946823:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3b53 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [987136->991231] (req 987136->991231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.946826:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3b53 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [987136->991231] (req 987136->991231) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.946831:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3b53 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [987136->991231] (req 987136->991231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.946834:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3b53 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [987136->991231] (req 987136->991231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651531965.982734:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869252 is committed
00010000:00010000:0.0:1651531965.982771:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca3b3e lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [40960->45055] (req 40960->45055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531965.982776:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca3b3e lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [40960->45055] (req 40960->45055) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531965.982796:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000733c9403 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438147:x1731754467516736:12345-10.240.43.64@tcp:4:fio.0 Request processed in 72828us (72851us total) trans 21474869252 rc 0/0
00010000:00010000:1.0:1651531965.982800:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca3b3e lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [40960->45055] (req 40960->45055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531965.982800:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250064
00010000:00010000:1.0:1651531965.982805:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f765708a already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531965.982806:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca3b3e lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [40960->45055] (req 40960->45055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.982809:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca3b3e lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [40960->45055] (req 40960->45055) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.982814:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca3b3e lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [40960->45055] (req 40960->45055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531965.982817:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca3b3e lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [40960->45055] (req 40960->45055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531966.009141:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531966.009150:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467518208
00000100:00100000:1.0:1651531966.009158:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44537
00000100:00100000:1.0:1651531966.009160:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007a05c3e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438147:x1731754467518208:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531966.009164:0:206699:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531966.009167:0:206699:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3b5a lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445b49 expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531966.009175:0:206699:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3b5a lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445b49 expref: 10 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531966.009184:0:206699:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3b5a lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445b49 expref: 10 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531966.009187:0:206699:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006da7a892, rc 0)
00000100:00100000:1.0:1651531966.009203:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007a05c3e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438147:x1731754467518208:12345-10.240.43.64@tcp:101:fio.0 Request processed in 42us (62us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531966.009205:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44537
00000100:00100000:1.0:1651531966.009977:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531966.009984:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467518464
00000100:00100000:1.0:1651531966.009991:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44538
00000100:00100000:1.0:1651531966.009992:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000065be21ea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438146:x1731754467518464:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531966.009996:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531966.009999:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3b61 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445b57 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531966.010007:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3b61 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445b57 expref: 10 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531966.010011:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3b61 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445b57 expref: 10 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531966.010015:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008558d1b3, rc 0)
00000100:00100000:1.0:1651531966.010030:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000065be21ea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438146:x1731754467518464:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (54us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531966.010033:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44538
00000100:00100000:1.0:1651531966.010351:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531966.010374:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467518592
00000100:00100000:0.0:1651531966.010389:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250067
00000100:00100000:0.0:1651531966.010390:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002bf85ab5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438147:x1731754467518592:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531966.010399:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3b68 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.010403:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531966.010404:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531966.010405:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3b68 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [1044480->1048575] (req 1044480->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.010409:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3b68 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [1044480->1048575] (req 1044480->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.010422:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3b68 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [1044480->1048575] (req 1044480->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.010426:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3b68 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [1044480->1048575] (req 1044480->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531966.010442:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002bf85ab5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438147:x1731754467518592:12345-10.240.43.64@tcp:3:fio.0 Request processed in 51us (91us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531966.010445:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250067
00010000:00010000:0.0:1651531966.010451:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3b68 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [1044480->1048575] (req 1044480->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.010454:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c1022d42 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531966.010455:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3b68 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [1044480->1048575] (req 1044480->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.010458:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3b68 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [1044480->1048575] (req 1044480->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.010463:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3b68 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [1044480->1048575] (req 1044480->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.010465:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3b68 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [1044480->1048575] (req 1044480->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531966.010760:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531966.010772:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467518720
00000100:00100000:0.0:1651531966.010787:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250068
00000100:00100000:0.0:1651531966.010788:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c65d6bc4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438147:x1731754467518720:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531966.010795:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca3b6f lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.010800:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531966.010801:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531966.010802:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca3b6f lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [4096->8191] (req 4096->8191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.010806:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca3b6f lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [4096->8191] (req 4096->8191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651531966.070694:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869253 is committed
00002000:00010000:0.0:1651531966.070726:0:192754:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x34545:0x0] updating lvb mtime from disk: 1651531965 -> 1651531966
00002000:00010000:0.0:1651531966.070728:0:192754:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x34545:0x0] updating lvb ctime from disk: 1651531965 -> 1651531966
00010000:00010000:0.0:1651531966.070730:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca3b6f lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [4096->8191] (req 4096->8191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.070734:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca3b6f lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [4096->8191] (req 4096->8191) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531966.070756:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c65d6bc4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438147:x1731754467518720:12345-10.240.43.64@tcp:4:fio.0 Request processed in 59966us (59995us total) trans 21474869253 rc 0/0
00010000:00010000:1.0:1651531966.070757:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca3b6f lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [4096->8191] (req 4096->8191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531966.070759:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250068
00010000:00010000:1.0:1651531966.070762:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f5657138 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531966.070763:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca3b6f lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [4096->8191] (req 4096->8191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531966.070766:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca3b6f lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [4096->8191] (req 4096->8191) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531966.070772:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca3b6f lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [4096->8191] (req 4096->8191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531966.070774:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca3b6f lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [4096->8191] (req 4096->8191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531966.110430:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531966.110453:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467519616
00000100:00100000:0.0:1651531966.110469:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250069
00000100:00100000:0.0:1651531966.110471:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ecb6b3b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438149:x1731754467519616:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531966.110478:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3b76 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.110483:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531966.110483:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531966.110486:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3b76 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [561152->565247] (req 561152->565247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.110490:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3b76 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [561152->565247] (req 561152->565247) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531966.159650:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531966.159674:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467519872
00000100:00100000:1.0:1651531966.159699:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250070
00000100:00100000:1.0:1651531966.159701:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002d631b42 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754467519872:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531966.159709:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3b7d lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531966.159713:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531966.159714:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531966.159715:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3b7d lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [868352->872447] (req 868352->872447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531966.159724:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3b7d lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [868352->872447] (req 868352->872447) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651531966.159784:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869254 is committed
00010000:00010000:0.0:1651531966.159828:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3b76 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [561152->565247] (req 561152->565247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.159835:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3b76 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [561152->565247] (req 561152->565247) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531966.159855:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3b76 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [561152->565247] (req 561152->565247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531966.159859:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c1022d42 already unused, calling callback (0000000049fddea7)
00000100:00100000:0.0:1651531966.159863:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ecb6b3b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438149:x1731754467519616:12345-10.240.43.64@tcp:4:fio.0 Request processed in 49391us (49433us total) trans 21474869254 rc 0/0
00010000:00010000:1.0:1651531966.159864:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3b76 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [561152->565247] (req 561152->565247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531966.159867:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250069
00010000:00010000:1.0:1651531966.159868:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3b76 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [561152->565247] (req 561152->565247) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531966.159874:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3b76 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [561152->565247] (req 561152->565247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531966.159876:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3b76 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [561152->565247] (req 561152->565247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531966.160178:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531966.160186:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467520000
00000100:00100000:0.0:1651531966.160201:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250071
00000100:00100000:0.0:1651531966.160203:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000027d50205 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754467520000:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531966.160220:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca3b84 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.160237:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531966.160237:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531966.160238:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca3b84 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [61440->65535] (req 61440->65535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.160243:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca3b84 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [61440->65535] (req 61440->65535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531966.218544:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531966.218566:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467520128
00000100:00100000:1.0:1651531966.218579:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250072
00000100:00100000:1.0:1651531966.218581:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000086b59493 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754467520128:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531966.218589:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3b8b lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531966.218593:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531966.218595:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531966.218596:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3b8b lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [937984->942079] (req 937984->942079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531966.218600:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3b8b lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [937984->942079] (req 937984->942079) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651531966.218672:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869256 is committed
00010000:00010000:1.0:1651531966.218692:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3b7d lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [868352->872447] (req 868352->872447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531966.218696:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3b7d lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [868352->872447] (req 868352->872447) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531966.218716:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002d631b42 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467519872:12345-10.240.43.64@tcp:4:fio.0 Request processed in 59014us (59066us total) trans 21474869255 rc 0/0
00010000:00010000:0.0:1651531966.218724:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca3b84 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [61440->65535] (req 61440->65535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531966.218729:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250070
00010000:00010000:0.0:1651531966.218731:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca3b84 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [61440->65535] (req 61440->65535) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531966.218750:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3b7d lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [868352->872447] (req 868352->872447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531966.218754:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008558d1b3 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531966.218755:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3b7d lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [868352->872447] (req 868352->872447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531966.218755:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000027d50205 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754467520000:12345-10.240.43.64@tcp:4:fio.0 Request processed in 58550us (58577us total) trans 21474869256 rc 0/0
00010000:00010000:1.0:1651531966.218758:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3b7d lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [868352->872447] (req 868352->872447) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531966.218759:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250071
00010000:00010000:1.0:1651531966.218763:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3b7d lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [868352->872447] (req 868352->872447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531966.218769:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3b7d lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [868352->872447] (req 868352->872447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531966.218773:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca3b84 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [61440->65535] (req 61440->65535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531966.218776:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f5657138 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531966.218777:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca3b84 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [61440->65535] (req 61440->65535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531966.218779:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca3b84 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [61440->65535] (req 61440->65535) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531966.218783:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca3b84 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [61440->65535] (req 61440->65535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531966.218785:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca3b84 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [61440->65535] (req 61440->65535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531966.219128:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531966.219142:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531966.219154:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467520448
00000100:00100000:1.0:1651531966.219167:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467520512
00000100:00100000:1.0:1651531966.219172:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44539
00000100:00100000:1.0:1651531966.219173:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000094ff6232 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467520448:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531966.219177:0:206699:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651531966.219178:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44540
00010000:00010000:1.0:1651531966.219181:0:206699:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3b92 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445b6c expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531966.219181:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b5efe414 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467520512:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531966.219185:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531966.219190:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca3b99 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445b73 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.219198:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca3b99 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445b73 expref: 15 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531966.219201:0:206699:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3b92 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445b6c expref: 15 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531966.219202:0:166112:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca3b99 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445b73 expref: 15 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531966.219205:0:206699:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3b92 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445b6c expref: 15 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531966.219206:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f765708a, rc 0)
00010000:00010000:1.0:1651531966.219219:0:206699:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d44eb74d, rc 0)
00000100:00100000:0.0:1651531966.219241:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b5efe414 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467520512:12345-10.240.43.64@tcp:101:fio.0 Request processed in 60us (98us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531966.219242:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000094ff6232 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467520448:12345-10.240.43.64@tcp:101:fio.0 Request processed in 67us (115us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531966.219244:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44540
00000100:00100000:1.0:1651531966.219246:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44539
00000100:00100000:0.0:1651531966.220120:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531966.220129:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467520960
00000100:00100000:0.0:1651531966.220144:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250073
00000100:00100000:0.0:1651531966.220146:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e62b9827 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754467520960:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531966.220153:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca3ba0 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.220157:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531966.220158:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531966.220159:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca3ba0 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [479232->483327] (req 479232->483327) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.220163:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca3ba0 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [479232->483327] (req 479232->483327) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651531966.260903:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869258 is committed
00010000:00010000:1.0:1651531966.260924:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3b8b lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [937984->942079] (req 937984->942079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531966.260928:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3b8b lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [937984->942079] (req 937984->942079) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.260937:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca3ba0 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [479232->483327] (req 479232->483327) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.260942:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca3ba0 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [479232->483327] (req 479232->483327) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531966.260947:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000086b59493 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438148:x1731754467520128:12345-10.240.43.64@tcp:4:fio.0 Request processed in 42365us (42403us total) trans 21474869257 rc 0/0
00000100:00100000:1.0:1651531966.260950:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250072
00010000:00010000:1.0:1651531966.260965:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3b8b lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [937984->942079] (req 937984->942079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531966.260967:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e62b9827 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438147:x1731754467520960:12345-10.240.43.64@tcp:4:fio.0 Request processed in 40820us (40847us total) trans 21474869258 rc 0/0
00010000:00010000:1.0:1651531966.260968:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006da7a892 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531966.260969:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3b8b lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [937984->942079] (req 937984->942079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531966.260971:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250073
00010000:00010000:1.0:1651531966.260984:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3b8b lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [937984->942079] (req 937984->942079) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531966.260990:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3b8b lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [937984->942079] (req 937984->942079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531966.260993:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3b8b lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [937984->942079] (req 937984->942079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531966.260996:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca3ba0 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [479232->483327] (req 479232->483327) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531966.260999:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000820577fb already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531966.261000:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca3ba0 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [479232->483327] (req 479232->483327) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531966.261002:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca3ba0 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [479232->483327] (req 479232->483327) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531966.261013:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca3ba0 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [479232->483327] (req 479232->483327) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531966.261016:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca3ba0 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [479232->483327] (req 479232->483327) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531966.261340:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531966.261350:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531966.261360:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467521216
00000100:00100000:0.0:1651531966.261360:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531966.261370:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467521408
00000100:00100000:1.0:1651531966.261377:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44541
00000100:00100000:1.0:1651531966.261379:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085e7e36c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438148:x1731754467521216:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651531966.261388:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467521344
00000100:00100000:0.0:1651531966.261396:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250074
00000100:00100000:0.0:1651531966.261397:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b82e604e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438146:x1731754467521408:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531966.261398:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531966.261401:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3ba7 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445b81 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.261405:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca3bae lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531966.261409:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3ba7 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445b81 expref: 12 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531966.261409:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531966.261410:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531966.261411:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca3bae lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [933888->937983] (req 933888->937983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.261415:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca3bae lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [933888->937983] (req 933888->937983) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531966.261418:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3ba7 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445b81 expref: 12 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531966.261422:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d44eb74d, rc 0)
00000100:00100000:1.0:1651531966.261434:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085e7e36c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754467521216:12345-10.240.43.64@tcp:101:fio.0 Request processed in 54us (84us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531966.261437:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44541
00000100:00100000:1.0:1651531966.261446:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250075
00000100:00100000:1.0:1651531966.261448:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bea48126 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438146:x1731754467521344:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531966.261454:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3bb5 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531966.261458:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531966.261459:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531966.261460:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3bb5 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [925696->929791] (req 925696->929791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531966.261464:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3bb5 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [925696->929791] (req 925696->929791) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531966.261493:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3bb5 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [925696->929791] (req 925696->929791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531966.261497:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3bb5 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [925696->929791] (req 925696->929791) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531966.261509:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bea48126 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754467521344:12345-10.240.43.64@tcp:3:fio.0 Request processed in 60us (148us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531966.261511:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250075
00010000:00010000:1.0:1651531966.261528:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3bb5 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [925696->929791] (req 925696->929791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531966.261532:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008558d1b3 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531966.261533:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3bb5 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [925696->929791] (req 925696->929791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531966.261536:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3bb5 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [925696->929791] (req 925696->929791) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531966.261540:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3bb5 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [925696->929791] (req 925696->929791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531966.261558:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3bb5 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [925696->929791] (req 925696->929791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531966.262864:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531966.262873:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467522176
00000100:00100000:0.0:1651531966.262883:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250076
00000100:00100000:0.0:1651531966.262885:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f1f50889 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754467522176:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531966.262893:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3bbc lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.262897:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531966.262897:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531966.262898:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3bbc lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [724992->729087] (req 724992->729087) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.262903:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3bbc lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [724992->729087] (req 724992->729087) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.262916:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3bbc lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [724992->729087] (req 724992->729087) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.262919:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3bbc lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [724992->729087] (req 724992->729087) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531966.262933:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f1f50889 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754467522176:12345-10.240.43.64@tcp:3:fio.0 Request processed in 48us (70us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531966.262936:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250076
00010000:00010000:0.0:1651531966.262942:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3bbc lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [724992->729087] (req 724992->729087) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.262946:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000032ee36ee already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531966.262947:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3bbc lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [724992->729087] (req 724992->729087) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.262950:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3bbc lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [724992->729087] (req 724992->729087) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.262954:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3bbc lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [724992->729087] (req 724992->729087) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.262957:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3bbc lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [724992->729087] (req 724992->729087) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651531966.286259:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869259 is committed
00010000:00010000:0.0:1651531966.286296:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca3bae lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [933888->937983] (req 933888->937983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.286304:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca3bae lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [933888->937983] (req 933888->937983) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531966.286326:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b82e604e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438146:x1731754467521408:12345-10.240.43.64@tcp:4:fio.0 Request processed in 24927us (24986us total) trans 21474869259 rc 0/0
00010000:00010000:1.0:1651531966.286328:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca3bae lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [933888->937983] (req 933888->937983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531966.286329:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250074
00010000:00010000:1.0:1651531966.286333:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f765708a already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531966.286334:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca3bae lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [933888->937983] (req 933888->937983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531966.286338:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca3bae lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [933888->937983] (req 933888->937983) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531966.286343:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca3bae lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [933888->937983] (req 933888->937983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531966.286346:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca3bae lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [933888->937983] (req 933888->937983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531966.286850:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531966.286858:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467522688
00000100:00100000:0.0:1651531966.286868:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250077
00000100:00100000:0.0:1651531966.286870:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c1f549f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754467522688:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531966.286877:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3bc3 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.286881:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531966.286882:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531966.286883:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3bc3 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [679936->684031] (req 679936->684031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.286887:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3bc3 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [679936->684031] (req 679936->684031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.286898:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3bc3 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [679936->684031] (req 679936->684031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.286901:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3bc3 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [679936->684031] (req 679936->684031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531966.286924:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3bc3 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [679936->684031] (req 679936->684031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531966.286926:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c1f549f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754467522688:12345-10.240.43.64@tcp:3:fio.0 Request processed in 56us (77us total) trans 0 rc 4096/4096
00010000:00010000:1.0:1651531966.286928:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000032ee36ee already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531966.286929:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3bc3 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [679936->684031] (req 679936->684031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531966.286929:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250077
00010000:00010000:1.0:1651531966.286931:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3bc3 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [679936->684031] (req 679936->684031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531966.286936:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3bc3 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [679936->684031] (req 679936->684031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531966.286938:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3bc3 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [679936->684031] (req 679936->684031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531966.287239:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531966.287247:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467522816
00000100:00100000:0.0:1651531966.287259:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44542
00000100:00100000:0.0:1651531966.287261:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000efdaa0c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438149:x1731754467522816:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531966.287265:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531966.287269:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3bca lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445b8f expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.287277:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3bca lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445b8f expref: 10 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531966.287281:0:166111:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3bca lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445b8f expref: 10 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531966.287285:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002c5e01dd, rc 0)
00000100:00100000:0.0:1651531966.287294:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000efdaa0c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438149:x1731754467522816:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (56us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531966.287297:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44542
00000100:00100000:0.0:1651531966.311305:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531966.311314:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531966.311320:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467523328
00000100:00100000:0.0:1651531966.311334:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44543
00000100:00100000:0.0:1651531966.311337:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bedaf1f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438146:x1731754467523328:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531966.311340:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531966.311343:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3bd1 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445b9d expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.311351:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3bd1 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445b9d expref: 10 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531966.311355:0:166111:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3bd1 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445b9d expref: 10 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531966.311358:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002c5e01dd, rc 0)
00000100:00100000:1.0:1651531966.311361:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467523200
00000100:00100000:0.0:1651531966.311368:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bedaf1f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438146:x1731754467523328:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (54us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531966.311371:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44543
00000100:00100000:1.0:1651531966.311376:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250078
00000100:00100000:1.0:1651531966.311378:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029096870 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438148:x1731754467523200:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531966.311385:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3bd8 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531966.311390:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531966.311390:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531966.311391:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3bd8 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [159744->163839] (req 159744->163839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531966.311395:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3bd8 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [159744->163839] (req 159744->163839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531966.311419:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3bd8 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [159744->163839] (req 159744->163839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531966.311423:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3bd8 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [159744->163839] (req 159744->163839) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531966.311446:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029096870 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754467523200:12345-10.240.43.64@tcp:3:fio.0 Request processed in 67us (141us total) trans 0 rc 4096/4096
00010000:00010000:0.0:1651531966.311448:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3bd8 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [159744->163839] (req 159744->163839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531966.311449:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250078
00010000:00010000:0.0:1651531966.311452:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008558d1b3 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531966.311454:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3bd8 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [159744->163839] (req 159744->163839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.311457:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3bd8 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [159744->163839] (req 159744->163839) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.311462:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3bd8 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [159744->163839] (req 159744->163839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.311470:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca3bd8 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [159744->163839] (req 159744->163839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531966.312542:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531966.312562:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467523840
00000100:00100000:1.0:1651531966.312576:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250079
00000100:00100000:1.0:1651531966.312578:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003b40261e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438147:x1731754467523840:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531966.312587:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3bdf lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531966.312591:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531966.312591:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531966.312593:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3bdf lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [536576->540671] (req 536576->540671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531966.312597:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3bdf lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [536576->540671] (req 536576->540671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531966.348605:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531966.348613:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467523968
00000100:00100000:0.0:1651531966.348624:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250080
00000100:00100000:0.0:1651531966.348626:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dfff0362 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438149:x1731754467523968:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531966.348633:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3be6 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.348638:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531966.348638:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531966.348639:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3be6 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.348644:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3be6 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531966.348745:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531966.348759:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467524096
00000100:00100000:0.0:1651531966.348783:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250081
00000100:00100000:0.0:1651531966.348787:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000063869776 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754467524096:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531966.348813:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3bed lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.348818:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531966.348820:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531966.348821:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3bed lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [442368->446463] (req 442368->446463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.348825:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3bed lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [442368->446463] (req 442368->446463) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.348837:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3bed lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [442368->446463] (req 442368->446463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.348840:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3bed lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [442368->446463] (req 442368->446463) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531966.348860:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3bed lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [442368->446463] (req 442368->446463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531966.348864:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fb2f6575 already unused, calling callback (0000000049fddea7)
00000100:00100000:0.0:1651531966.348864:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000063869776 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754467524096:12345-10.240.43.64@tcp:3:fio.0 Request processed in 77us (120us total) trans 0 rc 4096/4096
00010000:00010000:1.0:1651531966.348866:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3bed lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [442368->446463] (req 442368->446463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531966.348867:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250081
00010000:00010000:1.0:1651531966.348869:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3bed lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [442368->446463] (req 442368->446463) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531966.348874:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3bed lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [442368->446463] (req 442368->446463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531966.348877:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3bed lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [442368->446463] (req 442368->446463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531966.349189:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531966.349198:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467524224
00000100:00100000:0.0:1651531966.349218:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44544
00000100:00100000:0.0:1651531966.349220:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009b569a7a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754467524224:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531966.349235:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531966.349239:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3bf4 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445bab expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.349247:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3bf4 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445bab expref: 16 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531966.349251:0:166111:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3bf4 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445bab expref: 16 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531966.349259:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000075a78972, rc 0)
00000100:00100000:0.0:1651531966.349270:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009b569a7a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754467524224:12345-10.240.43.64@tcp:101:fio.0 Request processed in 49us (81us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531966.349272:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44544
00000001:00080000:1.0:1651531966.386272:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869260 is committed
00010000:00010000:0.0:1651531966.386314:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3bdf lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [536576->540671] (req 536576->540671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.386320:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3bdf lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [536576->540671] (req 536576->540671) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531966.386348:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3bdf lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [536576->540671] (req 536576->540671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531966.386351:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003b40261e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754467523840:12345-10.240.43.64@tcp:4:fio.0 Request processed in 73772us (73809us total) trans 21474869260 rc 0/0
00010000:00010000:1.0:1651531966.386354:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d44eb74d already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531966.386355:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3bdf lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [536576->540671] (req 536576->540671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531966.386357:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250079
00010000:00010000:1.0:1651531966.386358:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3bdf lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [536576->540671] (req 536576->540671) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531966.386364:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3bdf lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [536576->540671] (req 536576->540671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531966.386367:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3bdf lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [536576->540671] (req 536576->540671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651531966.410845:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869261 is committed
00010000:00010000:0.0:1651531966.410881:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3be6 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.410885:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3be6 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531966.410901:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dfff0362 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438149:x1731754467523968:12345-10.240.43.64@tcp:4:fio.0 Request processed in 62274us (62297us total) trans 21474869261 rc 0/0
00000100:00100000:0.0:1651531966.410904:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250080
00010000:00010000:0.0:1651531966.410911:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3be6 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.410915:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002c5e01dd already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531966.410917:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3be6 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.410920:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3be6 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.410925:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3be6 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.410928:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3be6 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531966.411274:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531966.411282:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467525248
00000100:00100000:0.0:1651531966.411292:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250082
00000100:00100000:0.0:1651531966.411294:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000be87d738 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754467525248:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531966.411301:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3bfb lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.411305:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531966.411306:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531966.411307:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3bfb lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [311296->946175] (req 311296->946175) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.411311:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3bfb lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [311296->946175] (req 311296->946175) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.411493:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3bfb lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [311296->946175] (req 311296->946175) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.411501:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3bfb lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [311296->946175] (req 311296->946175) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531966.411516:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3bfb lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [311296->946175] (req 311296->946175) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531966.411518:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000be87d738 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754467525248:12345-10.240.43.64@tcp:3:fio.0 Request processed in 223us (244us total) trans 0 rc 8192/8192
00010000:00010000:1.0:1651531966.411520:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000075a78972 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531966.411521:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3bfb lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [311296->946175] (req 311296->946175) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531966.411521:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250082
00010000:00010000:1.0:1651531966.411524:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3bfb lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [311296->946175] (req 311296->946175) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531966.411529:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3bfb lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [311296->946175] (req 311296->946175) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531966.411531:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3bfb lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [311296->946175] (req 311296->946175) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531966.444839:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531966.444847:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467525632
00000100:00100000:0.0:1651531966.444860:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44545
00000100:00100000:0.0:1651531966.444875:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000052213cb9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438147:x1731754467525632:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531966.444880:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531966.444892:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3c02 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445bb9 expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.444901:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3c02 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445bb9 expref: 10 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531966.444906:0:166111:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3c02 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445bb9 expref: 10 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531966.444909:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002c5e01dd, rc 0)
00000100:00100000:0.0:1651531966.444920:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000052213cb9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438147:x1731754467525632:12345-10.240.43.64@tcp:101:fio.0 Request processed in 58us (82us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531966.444923:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44545
00000100:00100000:0.0:1651531966.444950:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531966.444974:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467525760
00000100:00100000:0.0:1651531966.444984:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250083
00000100:00100000:0.0:1651531966.444986:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002512e905 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754467525760:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531966.444992:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca3c09 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.444996:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531966.444997:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531966.444998:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca3c09 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [647168->651263] (req 647168->651263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.445002:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca3c09 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [647168->651263] (req 647168->651263) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531966.445640:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531966.445649:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467526016
00000100:00100000:0.0:1651531966.445659:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250084
00000100:00100000:0.0:1651531966.445661:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001304ce4c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754467526016:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531966.445669:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca3c10 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.445673:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531966.445674:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531966.445675:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca3c10 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [69632->73727] (req 69632->73727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.445679:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca3c10 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [69632->73727] (req 69632->73727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.445693:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca3c10 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [69632->73727] (req 69632->73727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.445697:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca3c10 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [69632->73727] (req 69632->73727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531966.445720:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001304ce4c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754467526016:12345-10.240.43.64@tcp:3:fio.0 Request processed in 59us (81us total) trans 0 rc 4096/4096
00010000:00010000:1.0:1651531966.445722:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca3c10 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [69632->73727] (req 69632->73727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531966.445723:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250084
00010000:00010000:1.0:1651531966.445726:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000080362f27 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531966.445727:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca3c10 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [69632->73727] (req 69632->73727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531966.445730:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca3c10 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [69632->73727] (req 69632->73727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531966.445736:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca3c10 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [69632->73727] (req 69632->73727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531966.445739:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca3c10 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [69632->73727] (req 69632->73727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651531966.483143:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869262 is committed
00010000:00010000:0.0:1651531966.483179:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca3c09 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [647168->651263] (req 647168->651263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.483184:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca3c09 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [647168->651263] (req 647168->651263) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531966.483200:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002512e905 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754467525760:12345-10.240.43.64@tcp:4:fio.0 Request processed in 38213us (38250us total) trans 21474869262 rc 0/0
00000100:00100000:0.0:1651531966.483203:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250083
00010000:00010000:0.0:1651531966.483221:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca3c09 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [647168->651263] (req 647168->651263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.483245:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e2ec18e1 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531966.483246:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca3c09 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [647168->651263] (req 647168->651263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.483249:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca3c09 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [647168->651263] (req 647168->651263) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.483259:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca3c09 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [647168->651263] (req 647168->651263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.483262:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca3c09 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [647168->651263] (req 647168->651263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531966.483563:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531966.483571:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467526272
00000100:00100000:0.0:1651531966.483580:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250085
00000100:00100000:0.0:1651531966.483582:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d710c5fd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438149:x1731754467526272:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531966.483589:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3c17 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.483593:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531966.483594:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531966.483595:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3c17 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [290816->294911] (req 290816->294911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.483599:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3c17 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [290816->294911] (req 290816->294911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.483610:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3c17 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [290816->294911] (req 290816->294911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.483613:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3c17 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [290816->294911] (req 290816->294911) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531966.483635:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d710c5fd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438149:x1731754467526272:12345-10.240.43.64@tcp:3:fio.0 Request processed in 52us (72us total) trans 0 rc 4096/4096
00010000:00010000:1.0:1651531966.483639:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3c17 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [290816->294911] (req 290816->294911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531966.483639:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250085
00010000:00010000:1.0:1651531966.483644:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002c5e01dd already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531966.483645:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3c17 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [290816->294911] (req 290816->294911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531966.483648:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3c17 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [290816->294911] (req 290816->294911) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531966.483653:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3c17 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [290816->294911] (req 290816->294911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531966.483665:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3c17 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [290816->294911] (req 290816->294911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531966.537566:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531966.537575:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467526976
00000100:00100000:0.0:1651531966.537584:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250086
00000100:00100000:0.0:1651531966.537586:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000374facb9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438149:x1731754467526976:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531966.537592:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca3c1e lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.537597:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531966.537597:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531966.537598:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca3c1e lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [684032->688127] (req 684032->688127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.537602:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca3c1e lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [684032->688127] (req 684032->688127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531966.538198:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531966.538249:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467527424
00000100:00100000:0.0:1651531966.538261:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44546
00000100:00100000:0.0:1651531966.538263:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bcdb3319 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754467527424:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531966.538266:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531966.538271:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca3c25 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445bc7 expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.538279:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca3c25 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445bc7 expref: 13 pid: 166111 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651531966.538281:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651531966.538283:0:166111:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca3c25 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445bc7 expref: 13 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531966.538295:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fab23815, rc 0)
00000100:00100000:0.0:1651531966.538315:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bcdb3319 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754467527424:12345-10.240.43.64@tcp:101:fio.0 Request processed in 51us (118us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531966.538318:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44546
00000100:00100000:0.0:1651531966.538326:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467527552
00000100:00100000:0.0:1651531966.538334:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250087
00000100:00100000:0.0:1651531966.538336:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bfdd313b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438149:x1731754467527552:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531966.538342:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca3c2c lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.538346:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531966.538346:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531966.538347:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca3c2c lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [950272->954367] (req 950272->954367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.538351:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca3c2c lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [950272->954367] (req 950272->954367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531966.539027:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531966.539036:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467527808
00000100:00100000:1.0:1651531966.539047:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250088
00000100:00100000:1.0:1651531966.539049:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001797bd5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754467527808:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531966.539057:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3c33 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531966.539061:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531966.539062:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531966.539063:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3c33 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [167936->172031] (req 167936->172031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531966.539067:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3c33 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [167936->172031] (req 167936->172031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531966.539081:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3c33 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [167936->172031] (req 167936->172031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531966.539084:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3c33 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [167936->172031] (req 167936->172031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531966.539099:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001797bd5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754467527808:12345-10.240.43.64@tcp:3:fio.0 Request processed in 49us (72us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531966.539111:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250088
00010000:00010000:1.0:1651531966.539119:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3c33 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [167936->172031] (req 167936->172031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531966.539123:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d44eb74d already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531966.539124:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3c33 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [167936->172031] (req 167936->172031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531966.539126:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3c33 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [167936->172031] (req 167936->172031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531966.539131:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3c33 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [167936->172031] (req 167936->172031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531966.539134:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3c33 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [167936->172031] (req 167936->172031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651531966.612571:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869264 is committed
00010000:00010000:0.0:1651531966.612607:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca3c2c lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [950272->954367] (req 950272->954367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.612612:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca3c2c lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [950272->954367] (req 950272->954367) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531966.612634:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bfdd313b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754467527552:12345-10.240.43.64@tcp:4:fio.0 Request processed in 74297us (74353us total) trans 21474869264 rc 0/0
00000100:00100000:0.0:1651531966.612640:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250087
00010000:00010000:0.0:1651531966.612648:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca3c2c lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [950272->954367] (req 950272->954367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.612652:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000014685f38 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531966.612653:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca3c2c lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [950272->954367] (req 950272->954367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.612656:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca3c2c lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [950272->954367] (req 950272->954367) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.612661:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca3c2c lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [950272->954367] (req 950272->954367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.612664:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca3c2c lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [950272->954367] (req 950272->954367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.612674:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca3c1e lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [684032->688127] (req 684032->688127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.612678:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca3c1e lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [684032->688127] (req 684032->688127) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531966.612689:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca3c1e lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [684032->688127] (req 684032->688127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531966.612693:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000374facb9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438149:x1731754467526976:12345-10.240.43.64@tcp:4:fio.0 Request processed in 75106us (75127us total) trans 21474869263 rc 0/0
00000100:00100000:0.0:1651531966.612696:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250086
00010000:00010000:1.0:1651531966.612698:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e2ec18e1 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531966.612699:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca3c1e lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [684032->688127] (req 684032->688127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531966.612703:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca3c1e lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [684032->688127] (req 684032->688127) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531966.612720:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca3c1e lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [684032->688127] (req 684032->688127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531966.612723:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca3c1e lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [684032->688127] (req 684032->688127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531966.613016:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531966.613035:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467528320
00000100:00100000:0.0:1651531966.613046:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250089
00000100:00100000:0.0:1651531966.613049:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ac545f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438147:x1731754467528320:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531966.613056:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca3c3a lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.613060:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531966.613061:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531966.613062:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca3c3a lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [73728->77823] (req 73728->77823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.613066:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca3c3a lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [73728->77823] (req 73728->77823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531966.613393:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531966.613403:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467528448
00000100:00100000:0.0:1651531966.613414:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44547
00000100:00100000:0.0:1651531966.613416:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002ef35a72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438149:x1731754467528448:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531966.613419:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531966.613424:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3c41 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445bd5 expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.613432:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3c41 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445bd5 expref: 13 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531966.613436:0:166111:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3c41 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445bd5 expref: 13 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531966.613440:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002c5e01dd, rc 0)
00000100:00100000:0.0:1651531966.613452:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002ef35a72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438149:x1731754467528448:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (60us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531966.613457:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44547
00000001:00080000:1.0:1651531966.687258:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869265 is committed
00010000:00010000:0.0:1651531966.687294:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca3c3a lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [73728->77823] (req 73728->77823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.687299:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca3c3a lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [73728->77823] (req 73728->77823) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531966.687321:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ac545f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438147:x1731754467528320:12345-10.240.43.64@tcp:4:fio.0 Request processed in 74270us (74305us total) trans 21474869265 rc 0/0
00010000:00010000:1.0:1651531966.687322:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca3c3a lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [73728->77823] (req 73728->77823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531966.687324:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250089
00010000:00010000:1.0:1651531966.687326:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fab23815 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531966.687327:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca3c3a lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [73728->77823] (req 73728->77823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531966.687331:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca3c3a lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [73728->77823] (req 73728->77823) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531966.687336:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca3c3a lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [73728->77823] (req 73728->77823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531966.687339:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca3c3a lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [73728->77823] (req 73728->77823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531966.688075:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531966.688100:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467529216
00000100:00100000:0.0:1651531966.688136:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250090
00000100:00100000:0.0:1651531966.688138:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f817afea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438147:x1731754467529216:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531966.688146:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3c48 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.688151:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531966.688151:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531966.688152:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3c48 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [118784->122879] (req 118784->122879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.688157:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3c48 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [118784->122879] (req 118784->122879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531966.688268:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651531966.688284:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951226688
00000100:00100000:0.0:1651531966.688316:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 464
00000100:00100000:0.0:1651531966.688320:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004d249e37 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951226688:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:0.0:1651531966.688329:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 350541248 pending 28672 free 81277214720 avail 77106331648
00000100:00100000:0.0:1651531966.688355:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004d249e37 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951226688:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 35us (87us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531966.688361:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 464
00000100:00100000:0.0:1651531966.688446:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531966.688460:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467529472
00000100:00100000:0.0:1651531966.688474:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250091
00000100:00100000:0.0:1651531966.688476:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ffcdece2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754467529472:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531966.688483:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca3c4f lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.688488:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531966.688488:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531966.688489:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca3c4f lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [401408->405503] (req 401408->405503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.688493:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca3c4f lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [401408->405503] (req 401408->405503) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651531966.801746:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869266 is committed
00010000:00010000:0.0:1651531966.801791:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3c48 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [118784->122879] (req 118784->122879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.801798:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3c48 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [118784->122879] (req 118784->122879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531966.801831:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3c48 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [118784->122879] (req 118784->122879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531966.801831:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f817afea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754467529216:12345-10.240.43.64@tcp:4:fio.0 Request processed in 113691us (113757us total) trans 21474869266 rc 0/0
00000100:00100000:0.0:1651531966.801837:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250090
00010000:00010000:1.0:1651531966.801843:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002c5e01dd already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531966.801845:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3c48 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [118784->122879] (req 118784->122879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531966.801848:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3c48 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [118784->122879] (req 118784->122879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531966.801855:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3c48 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [118784->122879] (req 118784->122879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531966.801858:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3c48 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [118784->122879] (req 118784->122879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531966.801894:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531966.801936:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467529600
00000100:00100000:0.0:1651531966.801950:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250092
00000100:00100000:0.0:1651531966.801952:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000df1eb0d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754467529600:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531966.801960:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca3c56 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.801964:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531966.801965:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531966.801966:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca3c56 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [548864->552959] (req 548864->552959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.801970:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca3c56 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [548864->552959] (req 548864->552959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.801982:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca3c56 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [548864->552959] (req 548864->552959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.801985:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca3c56 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [548864->552959] (req 548864->552959) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531966.802005:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca3c56 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [548864->552959] (req 548864->552959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531966.802006:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000df1eb0d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754467529600:12345-10.240.43.64@tcp:3:fio.0 Request processed in 53us (112us total) trans 0 rc 4096/4096
00010000:00010000:1.0:1651531966.802009:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000080362f27 already unused, calling callback (0000000049fddea7)
00000100:00100000:0.0:1651531966.802009:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250092
00010000:00010000:1.0:1651531966.802010:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca3c56 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [548864->552959] (req 548864->552959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531966.802013:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca3c56 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [548864->552959] (req 548864->552959) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531966.802019:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca3c56 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [548864->552959] (req 548864->552959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531966.802022:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca3c56 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [548864->552959] (req 548864->552959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531966.802194:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531966.802236:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467529728
00000100:00100000:0.0:1651531966.802249:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250093
00000100:00100000:0.0:1651531966.802251:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754467529728:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531966.802258:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3c5d lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.802265:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531966.802265:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531966.802266:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3c5d lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [954368->958463] (req 954368->958463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.802270:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3c5d lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [954368->958463] (req 954368->958463) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.802281:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3c5d lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [954368->958463] (req 954368->958463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.802284:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3c5d lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [954368->958463] (req 954368->958463) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531966.802299:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754467529728:12345-10.240.43.64@tcp:3:fio.0 Request processed in 48us (106us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531966.802302:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250093
00010000:00010000:0.0:1651531966.802309:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3c5d lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [954368->958463] (req 954368->958463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.802312:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000075a78972 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531966.802313:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3c5d lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [954368->958463] (req 954368->958463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.802346:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3c5d lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [954368->958463] (req 954368->958463) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.802352:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3c5d lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [954368->958463] (req 954368->958463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.802356:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3c5d lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [954368->958463] (req 954368->958463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531966.802370:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531966.802387:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467529856
00000100:00100000:0.0:1651531966.802400:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250094
00000100:00100000:0.0:1651531966.802402:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000054ed0749 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754467529856:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531966.802409:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3c64 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.802413:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531966.802413:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531966.802414:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3c64 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [684032->688127] (req 684032->688127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.802418:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3c64 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [684032->688127] (req 684032->688127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.802443:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3c64 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [684032->688127] (req 684032->688127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.802447:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3c64 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [684032->688127] (req 684032->688127) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531966.802458:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3c64 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [684032->688127] (req 684032->688127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531966.802462:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fb2f6575 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531966.802463:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3c64 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [684032->688127] (req 684032->688127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531966.802467:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000054ed0749 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754467529856:12345-10.240.43.64@tcp:3:fio.0 Request processed in 64us (97us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531966.802469:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250094
00010000:00010000:1.0:1651531966.802471:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3c64 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [684032->688127] (req 684032->688127) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531966.802476:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3c64 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [684032->688127] (req 684032->688127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531966.802479:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3c64 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [684032->688127] (req 684032->688127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651531966.827055:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869267 is committed
00010000:00010000:0.0:1651531966.827090:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca3c4f lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [401408->405503] (req 401408->405503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.827096:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca3c4f lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [401408->405503] (req 401408->405503) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531966.827118:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ffcdece2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754467529472:12345-10.240.43.64@tcp:4:fio.0 Request processed in 138641us (138673us total) trans 21474869267 rc 0/0
00010000:00010000:1.0:1651531966.827119:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca3c4f lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [401408->405503] (req 401408->405503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531966.827121:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250091
00010000:00010000:1.0:1651531966.827123:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000014685f38 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531966.827124:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca3c4f lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [401408->405503] (req 401408->405503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531966.827127:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca3c4f lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [401408->405503] (req 401408->405503) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531966.827134:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca3c4f lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [401408->405503] (req 401408->405503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531966.827137:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca3c4f lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [401408->405503] (req 401408->405503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531966.901478:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531966.901501:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467531072
00000100:00100000:0.0:1651531966.901514:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44548
00000100:00100000:0.0:1651531966.901515:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009acffcb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438147:x1731754467531072:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531966.901519:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531966.901523:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3c6b lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445be3 expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.901531:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3c6b lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445be3 expref: 10 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531966.901536:0:166111:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3c6b lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445be3 expref: 10 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531966.901539:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000075a78972, rc 0)
00000100:00100000:0.0:1651531966.901550:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009acffcb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438147:x1731754467531072:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (73us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531966.901553:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44548
00000100:00100000:1.0:1651531966.926696:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531966.926721:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467531520
00000100:00100000:0.0:1651531966.926733:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250095
00000100:00100000:0.0:1651531966.926736:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003ffbc5dc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754467531520:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531966.926743:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3c72 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.926747:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531966.926748:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531966.926749:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3c72 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [442368->446463] (req 442368->446463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.926753:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3c72 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [442368->446463] (req 442368->446463) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531966.977455:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531966.977464:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467531840
00000100:00100000:0.0:1651531966.977480:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250096
00000100:00100000:0.0:1651531966.977481:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000053497d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754467531840:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531966.977490:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3c79 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.977494:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531966.977495:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531966.977496:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3c79 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.977500:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3c79 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.977512:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3c79 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.977519:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3c79 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531966.977539:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000053497d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754467531840:12345-10.240.43.64@tcp:3:fio.0 Request processed in 57us (85us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531966.977542:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250096
00010000:00010000:0.0:1651531966.977549:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3c79 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.977553:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000032ee36ee already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531966.977554:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3c79 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.977557:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3c79 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.977562:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3c79 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.977564:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3c79 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651531966.988432:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869268 is committed
00010000:00010000:0.0:1651531966.988465:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3c72 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [442368->446463] (req 442368->446463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.988469:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3c72 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [442368->446463] (req 442368->446463) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531966.988492:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3c72 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [442368->446463] (req 442368->446463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531966.988494:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003ffbc5dc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754467531520:12345-10.240.43.64@tcp:4:fio.0 Request processed in 61757us (61799us total) trans 21474869268 rc 0/0
00010000:00010000:1.0:1651531966.988497:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000075a78972 already unused, calling callback (0000000049fddea7)
00000100:00100000:0.0:1651531966.988497:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250095
00010000:00010000:1.0:1651531966.988498:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3c72 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [442368->446463] (req 442368->446463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531966.988501:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3c72 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [442368->446463] (req 442368->446463) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531966.988507:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3c72 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [442368->446463] (req 442368->446463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531966.988510:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3c72 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [442368->446463] (req 442368->446463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531966.988823:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531966.988844:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467532224
00000100:00100000:0.0:1651531966.988856:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250097
00000100:00100000:0.0:1651531966.988858:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ffcc974c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438149:x1731754467532224:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531966.988865:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3c80 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.988869:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531966.988870:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531966.988871:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3c80 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [208896->212991] (req 208896->212991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.988875:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3c80 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [208896->212991] (req 208896->212991) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.988887:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3c80 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [208896->212991] (req 208896->212991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.988890:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3c80 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [208896->212991] (req 208896->212991) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531966.988909:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3c80 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [208896->212991] (req 208896->212991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531966.988911:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ffcc974c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438149:x1731754467532224:12345-10.240.43.64@tcp:3:fio.0 Request processed in 52us (89us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531966.988914:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250097
00010000:00010000:1.0:1651531966.988917:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000032ee36ee already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531966.988918:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3c80 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [208896->212991] (req 208896->212991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531966.988921:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3c80 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [208896->212991] (req 208896->212991) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531966.988926:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3c80 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [208896->212991] (req 208896->212991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531966.988929:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3c80 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [208896->212991] (req 208896->212991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531966.989258:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531966.989282:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467532352
00000100:00100000:0.0:1651531966.989296:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44549
00000100:00100000:0.0:1651531966.989298:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c43262d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754467532352:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531966.989302:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531966.989305:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca3c87 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445bf1 expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.989314:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca3c87 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445bf1 expref: 10 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531966.989318:0:166111:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca3c87 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445bf1 expref: 10 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531966.989321:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f765708a, rc 0)
00000100:00100000:0.0:1651531966.989341:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c43262d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754467532352:12345-10.240.43.64@tcp:101:fio.0 Request processed in 42us (84us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531966.989344:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44549
00000100:00100000:1.0:1651531966.989996:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531966.990014:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467532608
00000100:00100000:0.0:1651531966.990025:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250098
00000100:00100000:0.0:1651531966.990027:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d9e74b4c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438149:x1731754467532608:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531966.990034:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca3c8e lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.990038:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531966.990039:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531966.990040:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca3c8e lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [651264->655359] (req 651264->655359) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.990043:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca3c8e lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [651264->655359] (req 651264->655359) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.990056:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca3c8e lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [651264->655359] (req 651264->655359) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.990059:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca3c8e lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [651264->655359] (req 651264->655359) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531966.990074:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d9e74b4c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438149:x1731754467532608:12345-10.240.43.64@tcp:3:fio.0 Request processed in 46us (78us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531966.990076:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250098
00010000:00010000:0.0:1651531966.990082:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca3c8e lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [651264->655359] (req 651264->655359) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.990085:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000820577fb already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531966.990087:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca3c8e lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [651264->655359] (req 651264->655359) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.990089:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca3c8e lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [651264->655359] (req 651264->655359) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.990094:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca3c8e lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [651264->655359] (req 651264->655359) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531966.990097:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca3c8e lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [651264->655359] (req 651264->655359) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531967.002653:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531967.002676:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467532864
00000100:00100000:0.0:1651531967.002688:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250099
00000100:00100000:0.0:1651531967.002691:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003562cf4d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438147:x1731754467532864:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531967.002698:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca3c95 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.002702:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531967.002703:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531967.002704:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca3c95 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [397312->401407] (req 397312->401407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.002708:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca3c95 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [397312->401407] (req 397312->401407) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.002719:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca3c95 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [397312->401407] (req 397312->401407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.002722:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca3c95 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [397312->401407] (req 397312->401407) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531967.002743:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003562cf4d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438147:x1731754467532864:12345-10.240.43.64@tcp:3:fio.0 Request processed in 51us (91us total) trans 0 rc 4096/4096
00010000:00010000:1.0:1651531967.002746:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca3c95 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [397312->401407] (req 397312->401407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531967.002746:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250099
00010000:00010000:1.0:1651531967.002750:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000820577fb already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531967.002751:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca3c95 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [397312->401407] (req 397312->401407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531967.002754:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca3c95 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [397312->401407] (req 397312->401407) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531967.002759:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca3c95 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [397312->401407] (req 397312->401407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531967.002763:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca3c95 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [397312->401407] (req 397312->401407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531967.040195:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531967.040236:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467533248
00000100:00100000:1.0:1651531967.040237:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531967.040254:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44550
00000100:00100000:0.0:1651531967.040256:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003d9ef3c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438149:x1731754467533248:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651531967.040260:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467533376
00010000:00010000:0.0:1651531967.040260:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531967.040264:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca3c9c lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445bff expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531967.040276:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250100
00000100:00100000:1.0:1651531967.040278:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000059e5b3a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438146:x1731754467533376:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531967.040281:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca3c9c lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445bff expref: 11 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531967.040286:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3ca3 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.040286:0:166111:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca3c9c lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445bff expref: 11 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531967.040289:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f765708a, rc 0)
00010000:00010000:1.0:1651531967.040290:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531967.040291:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531967.040292:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3ca3 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [491520->495615] (req 491520->495615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531967.040296:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3ca3 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [491520->495615] (req 491520->495615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531967.040304:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003d9ef3c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754467533248:12345-10.240.43.64@tcp:101:fio.0 Request processed in 47us (109us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531967.040307:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44550
00000001:00080000:1.0:1651531967.115067:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869269 is committed
00002000:00010000:1.0:1651531967.115081:0:216323:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x34545:0x0] updating lvb mtime from disk: 1651531966 -> 1651531967
00002000:00010000:1.0:1651531967.115083:0:216323:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x34545:0x0] updating lvb ctime from disk: 1651531966 -> 1651531967
00010000:00010000:1.0:1651531967.115085:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3ca3 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [491520->495615] (req 491520->495615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531967.115089:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3ca3 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [491520->495615] (req 491520->495615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531967.115109:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000059e5b3a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438146:x1731754467533376:12345-10.240.43.64@tcp:4:fio.0 Request processed in 74831us (74872us total) trans 21474869269 rc 0/0
00000100:00100000:1.0:1651531967.115113:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250100
00010000:00010000:1.0:1651531967.115120:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3ca3 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [491520->495615] (req 491520->495615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531967.115123:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d44eb74d already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531967.115124:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3ca3 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [491520->495615] (req 491520->495615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531967.115127:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3ca3 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [491520->495615] (req 491520->495615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531967.115132:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3ca3 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [491520->495615] (req 491520->495615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531967.115135:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3ca3 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [491520->495615] (req 491520->495615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531967.115425:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531967.115433:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467533888
00000100:00100000:1.0:1651531967.115450:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250101
00000100:00100000:1.0:1651531967.115452:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c0b460ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438147:x1731754467533888:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531967.115460:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3caa lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531967.115464:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531967.115466:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531967.115467:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3caa lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [131072->135167] (req 131072->135167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531967.115471:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3caa lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [131072->135167] (req 131072->135167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531967.115483:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3caa lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [131072->135167] (req 131072->135167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531967.115486:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3caa lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [131072->135167] (req 131072->135167) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531967.115507:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c0b460ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438147:x1731754467533888:12345-10.240.43.64@tcp:3:fio.0 Request processed in 54us (82us total) trans 0 rc 4096/4096
00010000:00010000:0.0:1651531967.115508:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3caa lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [131072->135167] (req 131072->135167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531967.115509:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250101
00010000:00010000:0.0:1651531967.115513:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006da7a892 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531967.115514:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3caa lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [131072->135167] (req 131072->135167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.115518:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3caa lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [131072->135167] (req 131072->135167) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.115524:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3caa lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [131072->135167] (req 131072->135167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.115527:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca3caa lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [131072->135167] (req 131072->135167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531967.115830:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531967.115842:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467534016
00000100:00100000:0.0:1651531967.115854:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44551
00000100:00100000:0.0:1651531967.115855:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006e255cae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438146:x1731754467534016:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531967.115859:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531967.115863:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca3cb1 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445c0d expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.115871:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca3cb1 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445c0d expref: 10 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531967.115875:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca3cb1 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445c0d expref: 10 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531967.115879:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f765708a, rc 0)
00000100:00100000:0.0:1651531967.115896:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006e255cae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438146:x1731754467534016:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (66us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531967.115899:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44551
00000100:00100000:1.0:1651531967.116364:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531967.116379:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531967.116382:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467534336
00000100:00100000:1.0:1651531967.116387:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467534400
00000100:00100000:0.0:1651531967.116390:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44552
00000100:00100000:0.0:1651531967.116392:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000009c4c564 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438147:x1731754467534336:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531967.116395:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651531967.116400:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250102
00000100:00100000:1.0:1651531967.116402:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f7006631 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754467534400:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531967.116407:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca3cb8 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445c1b expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531967.116409:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca3cbf lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531967.116414:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531967.116414:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531967.116416:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca3cbf lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [655360->659455] (req 655360->659455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531967.116423:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca3cbf lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [655360->659455] (req 655360->659455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.116426:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca3cb8 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445c1b expref: 11 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531967.116430:0:166111:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca3cb8 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445c1b expref: 11 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531967.116435:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f5657138, rc 0)
00000100:00100000:0.0:1651531967.116448:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000009c4c564 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438147:x1731754467534336:12345-10.240.43.64@tcp:101:fio.0 Request processed in 55us (84us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531967.116451:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44552
00000100:00100000:0.0:1651531967.116918:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531967.116928:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467534592
00000100:00100000:1.0:1651531967.116935:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531967.116948:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467534528
00000100:00100000:1.0:1651531967.116958:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250103
00000100:00100000:1.0:1651531967.116960:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007d76765b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467534592:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651531967.116960:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250104
00000100:00100000:0.0:1651531967.116962:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c4ea889e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467534528:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531967.116969:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3cc6 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.116969:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3ccd lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531967.116973:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531967.116974:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531967.116975:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3cc6 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [1028096->1032191] (req 1028096->1032191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531967.116979:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3cc6 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [1028096->1032191] (req 1028096->1032191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.116980:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531967.116981:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531967.116982:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3ccd lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [348160->352255] (req 348160->352255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.116986:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3ccd lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [348160->352255] (req 348160->352255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531967.116991:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3cc6 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [1028096->1032191] (req 1028096->1032191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531967.116994:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3cc6 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [1028096->1032191] (req 1028096->1032191) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531967.117014:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007d76765b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467534592:12345-10.240.43.64@tcp:3:fio.0 Request processed in 53us (96us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531967.117017:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250103
00010000:00010000:1.0:1651531967.117026:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3cc6 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [1028096->1032191] (req 1028096->1032191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531967.117030:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a8889a80 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531967.117031:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3cc6 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [1028096->1032191] (req 1028096->1032191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531967.117034:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3cc6 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [1028096->1032191] (req 1028096->1032191) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531967.117039:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3cc6 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [1028096->1032191] (req 1028096->1032191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531967.117042:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3cc6 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [1028096->1032191] (req 1028096->1032191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531967.117353:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531967.117361:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467534784
00000100:00100000:1.0:1651531967.117371:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250105
00000100:00100000:1.0:1651531967.117372:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a925fbf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754467534784:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531967.117379:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3cd4 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531967.117383:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531967.117384:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531967.117385:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3cd4 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [991232->995327] (req 991232->995327) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531967.117389:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3cd4 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [991232->995327] (req 991232->995327) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531967.167536:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531967.167558:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467534912
00000100:00100000:1.0:1651531967.167570:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250106
00000100:00100000:1.0:1651531967.167572:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000942b56fd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754467534912:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531967.167579:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3cdb lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531967.167583:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531967.167584:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531967.167585:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3cdb lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531967.167589:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3cdb lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531967.167600:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3cdb lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531967.167603:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3cdb lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531967.167632:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000942b56fd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754467534912:12345-10.240.43.64@tcp:3:fio.0 Request processed in 59us (97us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531967.167636:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250106
00010000:00010000:1.0:1651531967.167642:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3cdb lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531967.167646:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a8889a80 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531967.167648:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3cdb lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531967.167651:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3cdb lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531967.167656:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3cdb lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531967.167659:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3cdb lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651531967.167699:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869270 is committed
00010000:00010000:1.0:1651531967.167747:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca3cbf lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [655360->659455] (req 655360->659455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531967.167751:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca3cbf lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [655360->659455] (req 655360->659455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531967.167764:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f7006631 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754467534400:12345-10.240.43.64@tcp:4:fio.0 Request processed in 51362us (51385us total) trans 21474869270 rc 0/0
00000100:00100000:1.0:1651531967.167767:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250102
00010000:00010000:0.0:1651531967.167772:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca3cbf lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [655360->659455] (req 655360->659455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.167779:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b4c8742a already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531967.167780:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca3cbf lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [655360->659455] (req 655360->659455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.167789:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca3cbf lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [655360->659455] (req 655360->659455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.167799:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca3cbf lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [655360->659455] (req 655360->659455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.167804:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca3cbf lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [655360->659455] (req 655360->659455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651531967.203279:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869272 is committed
00010000:00010000:0.0:1651531967.203315:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3cd4 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [991232->995327] (req 991232->995327) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.203320:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3cd4 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [991232->995327] (req 991232->995327) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531967.203340:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a925fbf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438147:x1731754467534784:12345-10.240.43.64@tcp:4:fio.0 Request processed in 85966us (85987us total) trans 21474869272 rc 0/0
00000100:00100000:0.0:1651531967.203343:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250105
00010000:00010000:1.0:1651531967.203344:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3cd4 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [991232->995327] (req 991232->995327) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531967.203348:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c2b76533 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531967.203349:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3cd4 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [991232->995327] (req 991232->995327) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531967.203356:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3cd4 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [991232->995327] (req 991232->995327) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.203356:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3ccd lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [348160->352255] (req 348160->352255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.203359:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3ccd lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [348160->352255] (req 348160->352255) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531967.203366:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3cd4 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [991232->995327] (req 991232->995327) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531967.203373:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3cd4 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [991232->995327] (req 991232->995327) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531967.203373:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c4ea889e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438146:x1731754467534528:12345-10.240.43.64@tcp:4:fio.0 Request processed in 86410us (86439us total) trans 21474869271 rc 0/0
00000100:00100000:0.0:1651531967.203376:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250104
00010000:00010000:1.0:1651531967.203377:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3ccd lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [348160->352255] (req 348160->352255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531967.203380:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c1022d42 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531967.203381:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3ccd lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [348160->352255] (req 348160->352255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531967.203384:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3ccd lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [348160->352255] (req 348160->352255) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531967.203387:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3ccd lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [348160->352255] (req 348160->352255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531967.203390:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3ccd lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [348160->352255] (req 348160->352255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531967.215295:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531967.215304:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467536000
00000100:00100000:0.0:1651531967.215314:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250107
00000100:00100000:0.0:1651531967.215316:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009c93d7f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754467536000:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531967.215323:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca3ce2 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.215328:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531967.215328:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531967.215329:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca3ce2 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [1019904->1023999] (req 1019904->1023999) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.215334:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca3ce2 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [1019904->1023999] (req 1019904->1023999) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651531967.256573:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869273 is committed
00010000:00010000:0.0:1651531967.256608:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca3ce2 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [1019904->1023999] (req 1019904->1023999) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.256612:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca3ce2 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [1019904->1023999] (req 1019904->1023999) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531967.256630:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009c93d7f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754467536000:12345-10.240.43.64@tcp:4:fio.0 Request processed in 41312us (41334us total) trans 21474869273 rc 0/0
00000100:00100000:0.0:1651531967.256633:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250107
00010000:00010000:0.0:1651531967.256640:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca3ce2 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [1019904->1023999] (req 1019904->1023999) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.256643:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f5657138 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531967.256644:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca3ce2 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [1019904->1023999] (req 1019904->1023999) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.256649:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca3ce2 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [1019904->1023999] (req 1019904->1023999) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.256654:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca3ce2 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [1019904->1023999] (req 1019904->1023999) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.256657:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca3ce2 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [1019904->1023999] (req 1019904->1023999) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531967.256953:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531967.256962:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467536192
00000100:00100000:0.0:1651531967.256970:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44553
00000100:00100000:0.0:1651531967.256971:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007f998d3c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438149:x1731754467536192:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531967.256975:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531967.256979:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca3ce9 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445c29 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.256987:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca3ce9 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445c29 expref: 10 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531967.256991:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca3ce9 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445c29 expref: 10 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531967.256995:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f765708a, rc 0)
00000100:00100000:0.0:1651531967.257004:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007f998d3c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438149:x1731754467536192:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (51us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531967.257010:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44553
00000100:00100000:0.0:1651531967.257466:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531967.257474:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531967.257481:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467536320
00000100:00100000:0.0:1651531967.257488:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44554
00000100:00100000:0.0:1651531967.257490:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ac499271 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438146:x1731754467536320:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531967.257493:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531967.257496:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3cf0 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445c37 expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.257504:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3cf0 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445c37 expref: 10 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531967.257508:0:166111:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3cf0 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445c37 expref: 10 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531967.257511:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c1022d42, rc 0)
00000100:00100000:0.0:1651531967.257520:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ac499271 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438146:x1731754467536320:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (55us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531967.257549:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44554
00000100:00100000:0.0:1651531967.257558:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467536576
00000100:00100000:0.0:1651531967.257566:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250108
00000100:00100000:0.0:1651531967.257568:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000082a985f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438146:x1731754467536576:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531967.257574:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca3cf7 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.257582:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531967.257583:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531967.257584:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca3cf7 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [819200->823295] (req 819200->823295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.257588:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca3cf7 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [819200->823295] (req 819200->823295) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.257600:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca3cf7 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [819200->823295] (req 819200->823295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.257603:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca3cf7 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [819200->823295] (req 819200->823295) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531967.257623:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000082a985f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438146:x1731754467536576:12345-10.240.43.64@tcp:3:fio.0 Request processed in 54us (148us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531967.257625:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250108
00010000:00010000:1.0:1651531967.257626:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca3cf7 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [819200->823295] (req 819200->823295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531967.257634:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000820577fb already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531967.257635:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca3cf7 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [819200->823295] (req 819200->823295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531967.257638:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca3cf7 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [819200->823295] (req 819200->823295) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531967.257641:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651531967.257643:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca3cf7 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [819200->823295] (req 819200->823295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531967.257646:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca3cf7 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [819200->823295] (req 819200->823295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531967.257678:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467536704
00000100:00100000:0.0:1651531967.257687:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250109
00000100:00100000:0.0:1651531967.257689:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005508963a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754467536704:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531967.257696:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3cfe lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.257700:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531967.257700:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531967.257701:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3cfe lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.257709:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3cfe lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.257736:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3cfe lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.257740:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3cfe lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531967.257759:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3cfe lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531967.257761:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005508963a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754467536704:12345-10.240.43.64@tcp:3:fio.0 Request processed in 71us (119us total) trans 0 rc 4096/4096
00010000:00010000:1.0:1651531967.257762:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000032ee36ee already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531967.257763:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3cfe lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531967.257764:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250109
00010000:00010000:1.0:1651531967.257766:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3cfe lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531967.257770:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3cfe lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531967.257773:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3cfe lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531967.258692:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531967.258701:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531967.258707:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467537600
00000100:00100000:0.0:1651531967.258714:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44555
00000100:00100000:0.0:1651531967.258716:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cb76f437 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438149:x1731754467537600:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531967.258719:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531967.258732:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3d05 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445c45 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.258741:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3d05 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445c45 expref: 10 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531967.258745:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3d05 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445c45 expref: 10 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531967.258752:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000075a78972, rc 0)
00000100:00100000:0.0:1651531967.258763:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cb76f437 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438149:x1731754467537600:12345-10.240.43.64@tcp:101:fio.0 Request processed in 47us (62us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531967.258765:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44555
00000100:00100000:0.0:1651531967.258773:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467537472
00000100:00100000:0.0:1651531967.258781:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250110
00000100:00100000:0.0:1651531967.258783:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000017b5519b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438147:x1731754467537472:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531967.258789:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca3d0c lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.258792:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531967.258793:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531967.258794:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca3d0c lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [638976->643071] (req 638976->643071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.258798:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca3d0c lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [638976->643071] (req 638976->643071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.258808:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca3d0c lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [638976->643071] (req 638976->643071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.258812:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca3d0c lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [638976->643071] (req 638976->643071) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531967.258825:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000017b5519b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438147:x1731754467537472:12345-10.240.43.64@tcp:3:fio.0 Request processed in 41us (133us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531967.258830:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250110
00010000:00010000:0.0:1651531967.258836:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca3d0c lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [638976->643071] (req 638976->643071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.258839:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000014685f38 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531967.258840:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca3d0c lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [638976->643071] (req 638976->643071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.258843:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca3d0c lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [638976->643071] (req 638976->643071) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.258847:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca3d0c lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [638976->643071] (req 638976->643071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.258850:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca3d0c lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [638976->643071] (req 638976->643071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531967.259138:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531967.259145:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467537856
00000100:00100000:0.0:1651531967.259153:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44556
00000100:00100000:0.0:1651531967.259154:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a7929b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438147:x1731754467537856:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531967.259158:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531967.259161:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3d13 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445c53 expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.259168:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3d13 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445c53 expref: 10 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531967.259176:0:166111:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3d13 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445c53 expref: 10 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531967.259179:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fb2f6575, rc 0)
00000100:00100000:0.0:1651531967.259189:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a7929b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438147:x1731754467537856:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (51us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531967.259191:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44556
00000100:00100000:0.0:1651531967.297658:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531967.297667:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531967.297675:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467538368
00000100:00100000:0.0:1651531967.297682:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44557
00000100:00100000:0.0:1651531967.297684:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000503404b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438146:x1731754467538368:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531967.297687:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531967.297691:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3d1a lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445c61 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.297699:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3d1a lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445c61 expref: 10 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531967.297703:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3d1a lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445c61 expref: 10 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531967.297706:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fb2f6575, rc 0)
00000100:00100000:0.0:1651531967.297715:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000503404b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438146:x1731754467538368:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (58us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531967.297720:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44557
00000100:00100000:0.0:1651531967.297728:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467538432
00000100:00100000:0.0:1651531967.297735:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250111
00000100:00100000:0.0:1651531967.297737:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d349b145 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754467538432:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531967.297742:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca3d21 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.297746:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531967.297747:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531967.297748:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca3d21 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [491520->495615] (req 491520->495615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.297752:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca3d21 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [491520->495615] (req 491520->495615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531967.298755:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531967.298763:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467539008
00000100:00100000:0.0:1651531967.298779:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250112
00000100:00100000:0.0:1651531967.298781:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000765f877 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754467539008:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531967.298788:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3d28 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.298792:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531967.298793:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531967.298794:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3d28 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [901120->905215] (req 901120->905215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.298798:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3d28 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [901120->905215] (req 901120->905215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651531967.337621:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869275 is committed
00010000:00010000:0.0:1651531967.337657:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca3d21 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [491520->495615] (req 491520->495615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.337662:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca3d21 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [491520->495615] (req 491520->495615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531967.337683:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d349b145 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438148:x1731754467538432:12345-10.240.43.64@tcp:4:fio.0 Request processed in 39946us (40016us total) trans 21474869274 rc 0/0
00010000:00010000:1.0:1651531967.337684:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca3d21 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [491520->495615] (req 491520->495615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531967.337687:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250111
00010000:00010000:1.0:1651531967.337689:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000014685f38 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531967.337690:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca3d21 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [491520->495615] (req 491520->495615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531967.337693:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca3d21 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [491520->495615] (req 491520->495615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531967.337699:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca3d21 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [491520->495615] (req 491520->495615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.337699:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3d28 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [901120->905215] (req 901120->905215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531967.337702:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca3d21 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [491520->495615] (req 491520->495615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.337703:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3d28 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [901120->905215] (req 901120->905215) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531967.337716:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000765f877 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438147:x1731754467539008:12345-10.240.43.64@tcp:4:fio.0 Request processed in 38935us (38962us total) trans 21474869275 rc 0/0
00000100:00100000:0.0:1651531967.337719:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250112
00010000:00010000:0.0:1651531967.337729:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3d28 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [901120->905215] (req 901120->905215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.337733:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000075a78972 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531967.337734:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3d28 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [901120->905215] (req 901120->905215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.337737:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3d28 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [901120->905215] (req 901120->905215) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.337752:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3d28 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [901120->905215] (req 901120->905215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.337755:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3d28 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [901120->905215] (req 901120->905215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531967.338025:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531967.338033:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467539328
00000100:00100000:0.0:1651531967.338043:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250113
00000100:00100000:0.0:1651531967.338044:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007a6934a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438146:x1731754467539328:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531967.338051:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3d2f lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.338055:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531967.338056:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531967.338057:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3d2f lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [122880->126975] (req 122880->126975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.338061:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3d2f lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [122880->126975] (req 122880->126975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531967.338424:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531967.338437:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467539648
00000100:00100000:0.0:1651531967.338447:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44558
00000100:00100000:0.0:1651531967.338449:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c683c211 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754467539648:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531967.338452:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531967.338456:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3d36 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445c6f expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.338477:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3d36 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445c6f expref: 13 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531967.338481:0:166111:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3d36 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445c6f expref: 13 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531967.338485:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c1022d42, rc 0)
00000100:00100000:0.0:1651531967.338497:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c683c211 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754467539648:12345-10.240.43.64@tcp:101:fio.0 Request processed in 48us (75us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531967.338500:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44558
00000100:00100000:1.0:1651531967.397703:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531967.397727:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467540160
00000100:00100000:0.0:1651531967.397738:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44559
00000100:00100000:0.0:1651531967.397739:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009e786cd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438149:x1731754467540160:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531967.397743:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531967.397747:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3d3d lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445c7d expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.397755:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3d3d lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445c7d expref: 13 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531967.397759:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3d3d lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445c7d expref: 13 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531967.397762:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c1022d42, rc 0)
00000100:00100000:0.0:1651531967.397773:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009e786cd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438149:x1731754467540160:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (71us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531967.397785:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44559
00000100:00100000:1.0:1651531967.398510:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531967.398527:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467540416
00000100:00100000:0.0:1651531967.398535:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44560
00000100:00100000:0.0:1651531967.398537:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008bb4a649 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754467540416:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531967.398540:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531967.398544:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3d44 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445c8b expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.398556:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3d44 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445c8b expref: 13 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531967.398560:0:166111:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3d44 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445c8b expref: 13 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531967.398564:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000075a78972, rc 0)
00000100:00100000:0.0:1651531967.398574:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008bb4a649 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754467540416:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (65us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531967.398576:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44560
00000001:00080000:1.0:1651531967.410739:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869276 is committed
00010000:00010000:0.0:1651531967.410774:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3d2f lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [122880->126975] (req 122880->126975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.410778:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3d2f lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [122880->126975] (req 122880->126975) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531967.410799:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007a6934a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438146:x1731754467539328:12345-10.240.43.64@tcp:4:fio.0 Request processed in 72754us (72775us total) trans 21474869276 rc 0/0
00000100:00100000:0.0:1651531967.410805:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250113
00010000:00010000:0.0:1651531967.410813:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3d2f lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [122880->126975] (req 122880->126975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.410816:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fb2f6575 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531967.410817:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3d2f lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [122880->126975] (req 122880->126975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.410820:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3d2f lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [122880->126975] (req 122880->126975) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.410826:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3d2f lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [122880->126975] (req 122880->126975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.410828:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3d2f lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [122880->126975] (req 122880->126975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531967.411515:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531967.411524:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467541056
00000100:00100000:0.0:1651531967.411531:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44561
00000100:00100000:0.0:1651531967.411533:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b2355651 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438146:x1731754467541056:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531967.411536:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531967.411540:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3d4b lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445c99 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.411547:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3d4b lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445c99 expref: 10 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531967.411555:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3d4b lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445c99 expref: 10 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531967.411559:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000075a78972, rc 0)
00000100:00100000:0.0:1651531967.411575:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b2355651 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438146:x1731754467541056:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (60us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531967.411577:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44561
00000100:00100000:0.0:1651531967.412298:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531967.412307:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467541312
00000100:00100000:0.0:1651531967.412316:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250114
00000100:00100000:0.0:1651531967.412318:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ac499271 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438147:x1731754467541312:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531967.412325:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3d52 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.412329:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531967.412330:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531967.412331:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3d52 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [712704->716799] (req 712704->716799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.412335:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3d52 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [712704->716799] (req 712704->716799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531967.435781:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531967.435790:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467541568
00000100:00100000:1.0:1651531967.435804:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44562
00000100:00100000:1.0:1651531967.435806:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cb694635 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754467541568:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531967.435810:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531967.435814:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3d59 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445ca7 expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531967.435824:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3d59 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445ca7 expref: 13 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531967.435829:0:166111:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3d59 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445ca7 expref: 13 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531967.435832:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c2b76533, rc 0)
00000100:00100000:1.0:1651531967.435847:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cb694635 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754467541568:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (67us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531967.435850:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44562
00000100:00100000:1.0:1651531967.436636:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531967.436659:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467541824
00000100:00100000:0.0:1651531967.436675:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250115
00000100:00100000:0.0:1651531967.436677:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b6b1b79d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438149:x1731754467541824:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531967.436687:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3d60 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.436691:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531967.436692:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531967.436693:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3d60 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [983040->987135] (req 983040->987135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.436697:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3d60 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [983040->987135] (req 983040->987135) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.436709:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3d60 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [983040->987135] (req 983040->987135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.436712:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3d60 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [983040->987135] (req 983040->987135) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531967.436730:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3d60 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [983040->987135] (req 983040->987135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531967.436733:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b6b1b79d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438149:x1731754467541824:12345-10.240.43.64@tcp:3:fio.0 Request processed in 56us (98us total) trans 0 rc 4096/4096
00010000:00010000:1.0:1651531967.436734:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000075a78972 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531967.436735:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3d60 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [983040->987135] (req 983040->987135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531967.436736:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250115
00010000:00010000:1.0:1651531967.436738:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3d60 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [983040->987135] (req 983040->987135) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531967.436744:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3d60 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [983040->987135] (req 983040->987135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531967.436747:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3d60 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [983040->987135] (req 983040->987135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531967.437046:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531967.437062:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467541952
00000100:00100000:0.0:1651531967.437076:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250116
00000100:00100000:0.0:1651531967.437078:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006a8dcc9d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438149:x1731754467541952:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531967.437085:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3d67 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.437089:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531967.437090:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531967.437092:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3d67 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [278528->282623] (req 278528->282623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.437096:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3d67 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [278528->282623] (req 278528->282623) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651531967.470909:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869277 is committed
00010000:00010000:0.0:1651531967.470949:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3d52 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [712704->716799] (req 712704->716799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.470956:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3d52 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [712704->716799] (req 712704->716799) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531967.470981:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ac499271 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754467541312:12345-10.240.43.64@tcp:4:fio.0 Request processed in 58661us (58682us total) trans 21474869277 rc 0/0
00000100:00100000:0.0:1651531967.470986:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250114
00010000:00010000:0.0:1651531967.470995:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3d52 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [712704->716799] (req 712704->716799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.471001:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c1022d42 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531967.471003:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3d52 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [712704->716799] (req 712704->716799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.471009:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3d52 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [712704->716799] (req 712704->716799) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.471018:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3d52 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [712704->716799] (req 712704->716799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.471023:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3d52 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [712704->716799] (req 712704->716799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531967.483504:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531967.483523:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467542208
00000100:00100000:0.0:1651531967.483541:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250117
00000100:00100000:0.0:1651531967.483542:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009e786cd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438149:x1731754467542208:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531967.483550:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3d6e lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.483554:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531967.483555:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531967.483556:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3d6e lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [446464->450559] (req 446464->450559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.483560:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3d6e lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [446464->450559] (req 446464->450559) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651531967.518652:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869278 is committed
00010000:00010000:0.0:1651531967.518689:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3d67 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [278528->282623] (req 278528->282623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.518696:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3d67 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [278528->282623] (req 278528->282623) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531967.518722:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006a8dcc9d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438149:x1731754467541952:12345-10.240.43.64@tcp:4:fio.0 Request processed in 81641us (81674us total) trans 21474869278 rc 0/0
00000100:00100000:0.0:1651531967.518726:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250116
00010000:00010000:0.0:1651531967.518737:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3d67 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [278528->282623] (req 278528->282623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.518743:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fb2f6575 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531967.518747:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3d67 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [278528->282623] (req 278528->282623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.518753:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3d67 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [278528->282623] (req 278528->282623) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.518762:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3d67 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [278528->282623] (req 278528->282623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.518768:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3d67 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [278528->282623] (req 278528->282623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531967.519089:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531967.519097:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467542336
00000100:00100000:1.0:1651531967.519110:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44563
00000100:00100000:1.0:1651531967.519112:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008bb4a649 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754467542336:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531967.519116:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531967.519120:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3d75 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445cb5 expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531967.519129:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3d75 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445cb5 expref: 13 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531967.519133:0:166111:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3d75 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445cb5 expref: 13 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531967.519137:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c2b76533, rc 0)
00000100:00100000:1.0:1651531967.519151:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008bb4a649 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754467542336:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (63us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531967.519154:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44563
00000100:00100000:1.0:1651531967.532545:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531967.532568:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467542720
00000100:00100000:0.0:1651531967.532593:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250118
00000100:00100000:0.0:1651531967.532596:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b9b10d48 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438149:x1731754467542720:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531967.532607:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3d7c lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.532615:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531967.532616:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531967.532617:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3d7c lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [831488->921599] (req 831488->921599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.532623:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3d7c lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [831488->921599] (req 831488->921599) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.532849:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3d7c lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [831488->921599] (req 831488->921599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.532854:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3d7c lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [831488->921599] (req 831488->921599) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531967.532870:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3d7c lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [831488->921599] (req 831488->921599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531967.532875:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b9b10d48 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438149:x1731754467542720:12345-10.240.43.64@tcp:3:fio.0 Request processed in 278us (331us total) trans 0 rc 8192/8192
00000100:00100000:0.0:1651531967.532879:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250118
00010000:00010000:1.0:1651531967.532885:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fb2f6575 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531967.532887:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3d7c lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [831488->921599] (req 831488->921599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531967.532890:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3d7c lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [831488->921599] (req 831488->921599) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531967.532896:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3d7c lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [831488->921599] (req 831488->921599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531967.532898:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3d7c lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [831488->921599] (req 831488->921599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531967.533179:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531967.533202:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467543040
00000100:00100000:0.0:1651531967.533239:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250119
00000100:00100000:0.0:1651531967.533241:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000315bf4eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754467543040:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531967.533248:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca3d83 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.533253:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531967.533253:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531967.533254:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca3d83 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [163840->167935] (req 163840->167935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.533258:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca3d83 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [163840->167935] (req 163840->167935) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.533270:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca3d83 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [163840->167935] (req 163840->167935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.533273:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca3d83 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [163840->167935] (req 163840->167935) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531967.533288:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000315bf4eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754467543040:12345-10.240.43.64@tcp:3:fio.0 Request processed in 47us (110us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531967.533291:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250119
00010000:00010000:0.0:1651531967.533297:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca3d83 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [163840->167935] (req 163840->167935) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.533302:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f765708a already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531967.533303:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca3d83 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [163840->167935] (req 163840->167935) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.533306:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca3d83 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [163840->167935] (req 163840->167935) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.533311:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca3d83 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [163840->167935] (req 163840->167935) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.533313:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca3d83 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [163840->167935] (req 163840->167935) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531967.533623:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531967.533640:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467543168
00000100:00100000:1.0:1651531967.533653:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44564
00000100:00100000:1.0:1651531967.533655:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a23bcd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438149:x1731754467543168:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531967.533659:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531967.533663:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3d8a lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445cc3 expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531967.533670:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3d8a lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445cc3 expref: 13 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531967.533675:0:166111:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3d8a lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445cc3 expref: 13 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531967.533687:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c2b76533, rc 0)
00000100:00100000:1.0:1651531967.533700:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a23bcd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438149:x1731754467543168:12345-10.240.43.64@tcp:101:fio.0 Request processed in 44us (77us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531967.533703:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44564
00000001:00080000:1.0:1651531967.543734:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869279 is committed
00010000:00010000:1.0:1651531967.543750:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3d6e lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [446464->450559] (req 446464->450559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531967.543754:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3d6e lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [446464->450559] (req 446464->450559) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531967.543774:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009e786cd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438149:x1731754467542208:12345-10.240.43.64@tcp:4:fio.0 Request processed in 60231us (60271us total) trans 21474869279 rc 0/0
00000100:00100000:1.0:1651531967.543778:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250117
00010000:00010000:0.0:1651531967.543782:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3d6e lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [446464->450559] (req 446464->450559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.543786:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c1022d42 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531967.543787:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3d6e lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [446464->450559] (req 446464->450559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.543791:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3d6e lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [446464->450559] (req 446464->450559) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.543796:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3d6e lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [446464->450559] (req 446464->450559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.543799:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3d6e lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [446464->450559] (req 446464->450559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531967.577104:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531967.577126:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467544000
00000100:00100000:1.0:1651531967.577141:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250120
00000100:00100000:1.0:1651531967.577143:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cb76f437 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754467544000:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531967.577151:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3d91 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531967.577155:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531967.577156:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531967.577157:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3d91 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531967.577161:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3d91 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531967.577183:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3d91 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531967.577186:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3d91 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531967.577202:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cb76f437 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754467544000:12345-10.240.43.64@tcp:3:fio.0 Request processed in 58us (98us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531967.577205:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250120
00010000:00010000:1.0:1651531967.577247:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3d91 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531967.577251:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c2b76533 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531967.577252:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3d91 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531967.577255:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3d91 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531967.577260:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3d91 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531967.577263:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3d91 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531967.649262:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531967.649274:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531967.649290:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467544576
00000100:00100000:1.0:1651531967.649293:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467544640
00000100:00100000:0.0:1651531967.649299:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44565
00000100:00100000:0.0:1651531967.649301:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a7929b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438146:x1731754467544576:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651531967.649306:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250121
00010000:00010000:0.0:1651531967.649310:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531967.649315:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3d98 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445cd1 expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531967.649316:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000503404b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754467544640:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531967.649323:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3d98 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445cd1 expref: 11 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531967.649324:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3d9f lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531967.649328:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531967.649328:0:166111:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3d98 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445cd1 expref: 11 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531967.649329:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531967.649330:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3d9f lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [65536->69631] (req 65536->69631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.649331:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c1022d42, rc 0)
00010000:00010000:1.0:1651531967.649334:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3d9f lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [65536->69631] (req 65536->69631) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531967.649341:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a7929b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438146:x1731754467544576:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (80us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531967.649344:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44565
00000100:00100000:0.0:1651531967.649478:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531967.649493:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467544768
00000100:00100000:0.0:1651531967.649510:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250122
00000100:00100000:0.0:1651531967.649512:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f148f36a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754467544768:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531967.649520:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca3da6 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.649528:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531967.649529:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531967.649531:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca3da6 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [466944->471039] (req 466944->471039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.649537:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca3da6 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [466944->471039] (req 466944->471039) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651531967.709043:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869280 is committed
00010000:00010000:0.0:1651531967.709084:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3d9f lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [65536->69631] (req 65536->69631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.709091:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3d9f lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [65536->69631] (req 65536->69631) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531967.709115:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000503404b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438149:x1731754467544640:12345-10.240.43.64@tcp:4:fio.0 Request processed in 59797us (59839us total) trans 21474869280 rc 0/0
00000100:00100000:0.0:1651531967.709121:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250121
00010000:00010000:0.0:1651531967.709132:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3d9f lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [65536->69631] (req 65536->69631) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.709136:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c2b76533 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531967.709137:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3d9f lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [65536->69631] (req 65536->69631) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.709141:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3d9f lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [65536->69631] (req 65536->69631) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.709150:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3d9f lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [65536->69631] (req 65536->69631) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.709157:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3d9f lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [65536->69631] (req 65536->69631) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531967.709470:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531967.709478:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467545408
00000100:00100000:0.0:1651531967.709496:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250123
00000100:00100000:0.0:1651531967.709498:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007dc97d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754467545408:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531967.709506:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3dad lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.709510:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531967.709511:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531967.709512:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3dad lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.709516:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3dad lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.709528:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3dad lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.709531:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3dad lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531967.709546:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007dc97d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754467545408:12345-10.240.43.64@tcp:3:fio.0 Request processed in 47us (77us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531967.709549:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250123
00010000:00010000:0.0:1651531967.709557:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3dad lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.709560:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c1022d42 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531967.709561:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3dad lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.709564:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3dad lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.709568:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3dad lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.709571:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3dad lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531967.709894:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531967.709903:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467545536
00000100:00100000:0.0:1651531967.709911:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44566
00000100:00100000:0.0:1651531967.709912:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009c5a362f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438149:x1731754467545536:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531967.709916:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531967.709919:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca3db4 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445cdf expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.709927:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca3db4 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445cdf expref: 13 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531967.709932:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca3db4 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445cdf expref: 13 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531967.709937:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f5657138, rc 0)
00000100:00100000:0.0:1651531967.709947:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009c5a362f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438149:x1731754467545536:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (53us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531967.709950:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44566
00000100:00100000:0.0:1651531967.710709:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531967.710717:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467545792
00000100:00100000:0.0:1651531967.710731:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250124
00000100:00100000:0.0:1651531967.710733:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d5703b86 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754467545792:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531967.710740:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca3dbb lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.710744:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531967.710745:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531967.710746:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca3dbb lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [528384->532479] (req 528384->532479) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.710750:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca3dbb lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [528384->532479] (req 528384->532479) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531967.746944:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531967.746953:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467545920
00000100:00100000:0.0:1651531967.746962:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44567
00000100:00100000:0.0:1651531967.746963:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b462545d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754467545920:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531967.746967:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531967.746971:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca3dc2 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445ced expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.746983:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca3dc2 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445ced expref: 16 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531967.746987:0:166111:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca3dc2 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445ced expref: 16 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531967.746991:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f5657138, rc 0)
00000100:00100000:0.0:1651531967.747001:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b462545d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754467545920:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (58us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531967.747004:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44567
00000001:00080000:1.0:1651531967.758616:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869281 is committed
00010000:00010000:0.0:1651531967.758654:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca3da6 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [466944->471039] (req 466944->471039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.758660:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca3da6 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [466944->471039] (req 466944->471039) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531967.758684:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f148f36a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754467544768:12345-10.240.43.64@tcp:4:fio.0 Request processed in 109170us (109206us total) trans 21474869281 rc 0/0
00000100:00100000:0.0:1651531967.758690:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250122
00010000:00010000:0.0:1651531967.758700:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca3da6 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [466944->471039] (req 466944->471039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.758706:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f765708a already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531967.758708:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca3da6 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [466944->471039] (req 466944->471039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.758720:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca3da6 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [466944->471039] (req 466944->471039) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.758729:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca3da6 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [466944->471039] (req 466944->471039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.758734:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca3da6 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [466944->471039] (req 466944->471039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531967.759097:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531967.759106:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467546304
00000100:00100000:0.0:1651531967.759121:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250125
00000100:00100000:0.0:1651531967.759123:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003b5b354a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438149:x1731754467546304:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531967.759130:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca3dc9 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.759135:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531967.759135:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531967.759136:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca3dc9 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [122880->126975] (req 122880->126975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.759140:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca3dc9 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [122880->126975] (req 122880->126975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651531967.806365:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869282 is committed
00010000:00010000:0.0:1651531967.806406:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca3dbb lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [528384->532479] (req 528384->532479) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.806413:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca3dbb lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [528384->532479] (req 528384->532479) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531967.806439:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d5703b86 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754467545792:12345-10.240.43.64@tcp:4:fio.0 Request processed in 95704us (95730us total) trans 21474869282 rc 0/0
00000100:00100000:0.0:1651531967.806444:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250124
00010000:00010000:0.0:1651531967.806456:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca3dbb lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [528384->532479] (req 528384->532479) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.806462:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000080362f27 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531967.806464:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca3dbb lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [528384->532479] (req 528384->532479) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.806470:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca3dbb lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [528384->532479] (req 528384->532479) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.806478:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca3dbb lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [528384->532479] (req 528384->532479) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.806484:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca3dbb lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [528384->532479] (req 528384->532479) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531967.843761:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531967.843769:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467546688
00000100:00100000:0.0:1651531967.843786:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250126
00000100:00100000:0.0:1651531967.843787:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004d72f458 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754467546688:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531967.843795:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca3dd0 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.843799:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531967.843801:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531967.843802:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca3dd0 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [1015808->1019903] (req 1015808->1019903) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.843806:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca3dd0 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [1015808->1019903] (req 1015808->1019903) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651531967.855453:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869283 is committed
00010000:00010000:0.0:1651531967.855486:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca3dc9 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [122880->126975] (req 122880->126975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.855490:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca3dc9 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [122880->126975] (req 122880->126975) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531967.855512:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003b5b354a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438149:x1731754467546304:12345-10.240.43.64@tcp:4:fio.0 Request processed in 96388us (96415us total) trans 21474869283 rc 0/0
00010000:00010000:1.0:1651531967.855514:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca3dc9 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [122880->126975] (req 122880->126975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531967.855515:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250125
00010000:00010000:1.0:1651531967.855520:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f5657138 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531967.855521:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca3dc9 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [122880->126975] (req 122880->126975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531967.855525:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca3dc9 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [122880->126975] (req 122880->126975) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531967.855531:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca3dc9 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [122880->126975] (req 122880->126975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531967.855554:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca3dc9 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [122880->126975] (req 122880->126975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531967.880442:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531967.880451:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467547072
00000100:00100000:0.0:1651531967.880468:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250127
00000100:00100000:0.0:1651531967.880469:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000091075bf7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754467547072:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531967.880478:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca3dd7 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.880482:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531967.880483:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531967.880484:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca3dd7 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [282624->286719] (req 282624->286719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.880488:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca3dd7 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [282624->286719] (req 282624->286719) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.880502:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca3dd7 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [282624->286719] (req 282624->286719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.880507:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca3dd7 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [282624->286719] (req 282624->286719) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531967.880532:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000091075bf7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754467547072:12345-10.240.43.64@tcp:3:fio.0 Request processed in 61us (89us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531967.880538:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250127
00010000:00010000:0.0:1651531967.880549:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca3dd7 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [282624->286719] (req 282624->286719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.880555:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f765708a already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531967.880556:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca3dd7 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [282624->286719] (req 282624->286719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.880559:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca3dd7 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [282624->286719] (req 282624->286719) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.880565:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca3dd7 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [282624->286719] (req 282624->286719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.880567:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca3dd7 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [282624->286719] (req 282624->286719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531967.880912:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531967.880921:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467547328
00000100:00100000:0.0:1651531967.880937:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250128
00000100:00100000:0.0:1651531967.880939:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007b76f7f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438149:x1731754467547328:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531967.880947:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3dde lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.880953:0:216321:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cfb802a0/0x3234de053ca2ca4 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [995328->999423] (req 995328->999423) gid 0 flags: 0x40000000020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44517f expref: 12 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.880956:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531967.880957:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531967.880957:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3dde lrc: 4/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [995328->999423] (req 995328->999423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.880965:0:216321:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cfb802a0/0x3234de053ca2ca4 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [995328->999423] (req 995328->999423) gid 0 flags: 0x50000000020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44517f expref: 12 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.880969:0:216321:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cfb802a0/0x3234de053ca2ca4 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [995328->999423] (req 995328->999423) gid 0 flags: 0x70000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44517f expref: 12 pid: 166113 timeout: 22776 lvb_type: 0
00000100:00100000:0.0:1651531967.880973:0:216321:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f7096c29 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997356160:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531967.880986:0:216321:0:(client.c:2492:ptlrpc_set_wait()) set 000000007ac4e30e going to sleep for 6 seconds
00000100:00100000:0.0:1651531967.881265:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531967.881272:0:166103:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467547392
00010000:00010000:0.0:1651531967.881278:0:166103:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cfb802a0/0x3234de053ca2ca4 lrc: 5/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [995328->999423] (req 995328->999423) gid 0 flags: 0x60000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44517f expref: 13 pid: 166113 timeout: 22776 lvb_type: 0
00000100:00100000:0.0:1651531967.881291:0:166103:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 214
00000100:00100000:0.0:1651531967.881293:0:166103:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000008e0501d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467547392:12345-10.240.43.64@tcp:103:ldlm_bl_03.0
00010000:00010000:0.0:1651531967.881299:0:166103:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531967.881302:0:166103:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cfb802a0/0x3234de053ca2ca4 lrc: 5/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [995328->999423] (req 995328->999423) gid 0 flags: 0x60000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44517f expref: 13 pid: 166113 timeout: 22776 lvb_type: 0
00010000:00010000:0.0:1651531967.881306:0:166103:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cfb802a0/0x3234de053ca2ca4 lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [995328->999423] (req 995328->999423) gid 0 flags: 0x50000400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44517f expref: 13 pid: 166113 timeout: 22776 lvb_type: 0
00010000:00010000:0.0:1651531967.881313:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531967.881314:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531967.881315:0:166103:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3dde lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [995328->999423] (req 995328->999423) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.881318:0:166103:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3dde lrc: 4/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [995328->999423] (req 995328->999423) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.881323:0:166103:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651531967.881333:0:166103:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000008e0501d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467547392:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 40us (69us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531967.881336:0:166103:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 214
00010000:00010000:0.0:1651531967.881346:0:216321:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cfb802a0/0x3234de053ca2ca4 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [995328->999423] (req 995328->999423) gid 0 flags: 0x44801400020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44517f expref: 12 pid: 166113 timeout: 22776 lvb_type: 0
00000100:00100000:0.0:1651531967.881350:0:216321:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f7096c29 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997356160:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651531967.881354:0:216321:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3dde lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [995328->999423] (req 995328->999423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.881358:0:216321:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3dde lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [995328->999423] (req 995328->999423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.881364:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3dde lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [995328->999423] (req 995328->999423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.881376:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3dde lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [995328->999423] (req 995328->999423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.881379:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3dde lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [995328->999423] (req 995328->999423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531967.881392:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007b76f7f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754467547328:12345-10.240.43.64@tcp:3:fio.0 Request processed in 452us (481us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531967.881395:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250128
00010000:00010000:0.0:1651531967.881402:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3dde lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [995328->999423] (req 995328->999423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.881405:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c1022d42 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531967.881406:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3dde lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [995328->999423] (req 995328->999423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.881409:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3dde lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [995328->999423] (req 995328->999423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.881413:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3dde lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [995328->999423] (req 995328->999423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.881416:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3dde lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [995328->999423] (req 995328->999423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531967.881712:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531967.881720:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467547520
00000100:00100000:0.0:1651531967.881737:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250129
00000100:00100000:0.0:1651531967.881739:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f7096c29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754467547520:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531967.881747:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3de5 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.881751:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531967.881751:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531967.881752:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3de5 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [73728->77823] (req 73728->77823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.881756:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3de5 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [73728->77823] (req 73728->77823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.881767:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3de5 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [73728->77823] (req 73728->77823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.881770:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3de5 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [73728->77823] (req 73728->77823) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531967.881790:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f7096c29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754467547520:12345-10.240.43.64@tcp:3:fio.0 Request processed in 51us (78us total) trans 0 rc 4096/4096
00010000:00010000:1.0:1651531967.881792:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3de5 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [73728->77823] (req 73728->77823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531967.881793:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250129
00010000:00010000:1.0:1651531967.881797:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002c5e01dd already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531967.881798:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3de5 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [73728->77823] (req 73728->77823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531967.881802:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3de5 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [73728->77823] (req 73728->77823) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531967.881807:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3de5 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [73728->77823] (req 73728->77823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531967.881810:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3de5 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [73728->77823] (req 73728->77823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531967.882092:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531967.882100:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467547648
00000100:00100000:0.0:1651531967.882107:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44568
00000100:00100000:0.0:1651531967.882118:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000f4bed26 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754467547648:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531967.882122:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531967.882126:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca3dec lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445cfb expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.882133:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca3dec lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445cfb expref: 12 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531967.882138:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca3dec lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445cfb expref: 12 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531967.882141:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fab23815, rc 0)
00000100:00100000:0.0:1651531967.882151:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000f4bed26 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754467547648:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (60us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531967.882154:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44568
00000001:00080000:1.0:1651531967.892355:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869284 is committed
00010000:00010000:0.0:1651531967.892391:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca3dd0 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [1015808->1019903] (req 1015808->1019903) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.892395:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca3dd0 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [1015808->1019903] (req 1015808->1019903) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531967.892420:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004d72f458 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467546688:12345-10.240.43.64@tcp:4:fio.0 Request processed in 48631us (48659us total) trans 21474869284 rc 0/0
00000100:00100000:0.0:1651531967.892423:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250126
00010000:00010000:0.0:1651531967.892430:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca3dd0 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [1015808->1019903] (req 1015808->1019903) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.892443:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000080362f27 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531967.892444:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca3dd0 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [1015808->1019903] (req 1015808->1019903) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.892447:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca3dd0 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [1015808->1019903] (req 1015808->1019903) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.892452:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca3dd0 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [1015808->1019903] (req 1015808->1019903) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.892455:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca3dd0 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [1015808->1019903] (req 1015808->1019903) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531967.904964:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531967.904972:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467548032
00000100:00100000:0.0:1651531967.904980:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44569
00000100:00100000:0.0:1651531967.904981:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bf4022bf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467548032:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531967.904985:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531967.904989:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca3df3 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445d09 expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.904996:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca3df3 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445d09 expref: 9 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531967.905000:0:166111:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca3df3 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445d09 expref: 9 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531967.905016:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000080362f27, rc 0)
00000100:00100000:0.0:1651531967.905027:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bf4022bf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467548032:12345-10.240.43.64@tcp:101:fio.0 Request processed in 45us (64us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531967.905029:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44569
00000100:00100000:0.0:1651531967.905748:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531967.905756:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467548288
00000100:00100000:0.0:1651531967.905765:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250130
00000100:00100000:0.0:1651531967.905767:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000052cf3c08 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467548288:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531967.905774:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca3dfa lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.905779:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531967.905779:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531967.905780:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca3dfa lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [966656->970751] (req 966656->970751) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.905784:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca3dfa lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [966656->970751] (req 966656->970751) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.905796:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca3dfa lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [966656->970751] (req 966656->970751) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.905799:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca3dfa lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [966656->970751] (req 966656->970751) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531967.905813:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000052cf3c08 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467548288:12345-10.240.43.64@tcp:3:fio.0 Request processed in 45us (65us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531967.905818:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250130
00010000:00010000:0.0:1651531967.905824:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca3dfa lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [966656->970751] (req 966656->970751) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.905828:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fab23815 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531967.905829:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca3dfa lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [966656->970751] (req 966656->970751) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.905832:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca3dfa lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [966656->970751] (req 966656->970751) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.905836:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca3dfa lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [966656->970751] (req 966656->970751) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.905839:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca3dfa lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [966656->970751] (req 966656->970751) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531967.928297:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531967.928305:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467548672
00000100:00100000:0.0:1651531967.928315:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250131
00000100:00100000:0.0:1651531967.928317:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000b1a9136 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467548672:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531967.928331:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca3e01 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.928336:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531967.928337:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531967.928338:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca3e01 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [495616->499711] (req 495616->499711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.928345:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca3e01 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [495616->499711] (req 495616->499711) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531967.928791:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531967.928799:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467548928
00000100:00100000:0.0:1651531967.928807:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44570
00000100:00100000:0.0:1651531967.928809:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aa58c961 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438146:x1731754467548928:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531967.928813:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531967.928817:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca3e08 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445d17 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.928825:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca3e08 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445d17 expref: 12 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531967.928829:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca3e08 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445d17 expref: 12 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531967.928832:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000080362f27, rc 0)
00000100:00100000:0.0:1651531967.928842:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aa58c961 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438146:x1731754467548928:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (52us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531967.928845:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44570
00000100:00100000:0.0:1651531967.929092:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531967.929100:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467549184
00000100:00100000:0.0:1651531967.929116:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250132
00000100:00100000:0.0:1651531967.929118:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000000615301 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438147:x1731754467549184:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531967.929128:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3e0f lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.929132:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531967.929133:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531967.929134:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3e0f lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [1032192->1036287] (req 1032192->1036287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.929138:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3e0f lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [1032192->1036287] (req 1032192->1036287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.929150:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3e0f lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [1032192->1036287] (req 1032192->1036287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.929153:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3e0f lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [1032192->1036287] (req 1032192->1036287) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531967.929172:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3e0f lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [1032192->1036287] (req 1032192->1036287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531967.929174:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000000615301 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438147:x1731754467549184:12345-10.240.43.64@tcp:3:fio.0 Request processed in 55us (82us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531967.929176:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250132
00010000:00010000:1.0:1651531967.929177:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c1022d42 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531967.929179:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3e0f lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [1032192->1036287] (req 1032192->1036287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531967.929182:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3e0f lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [1032192->1036287] (req 1032192->1036287) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531967.929198:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3e0f lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [1032192->1036287] (req 1032192->1036287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531967.929201:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3e0f lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [1032192->1036287] (req 1032192->1036287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531967.929480:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531967.929488:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467549312
00000100:00100000:0.0:1651531967.929495:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44571
00000100:00100000:0.0:1651531967.929497:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006c46ca95 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438147:x1731754467549312:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531967.929500:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531967.929504:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca3e16 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445d25 expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531967.929515:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca3e16 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445d25 expref: 12 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531967.929519:0:166111:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca3e16 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445d25 expref: 12 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531967.929523:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f765708a, rc 0)
00000100:00100000:0.0:1651531967.929532:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006c46ca95 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438147:x1731754467549312:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (52us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531967.929534:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44571
00000001:00080000:1.0:1651531968.000882:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869285 is committed
00010000:00010000:0.0:1651531968.000917:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca3e01 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [495616->499711] (req 495616->499711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.000921:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca3e01 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [495616->499711] (req 495616->499711) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531968.000938:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000b1a9136 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467548672:12345-10.240.43.64@tcp:4:fio.0 Request processed in 72620us (72642us total) trans 21474869285 rc 0/0
00000100:00100000:0.0:1651531968.000941:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250131
00010000:00010000:0.0:1651531968.000948:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca3e01 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [495616->499711] (req 495616->499711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.000951:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fab23815 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531968.000952:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca3e01 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [495616->499711] (req 495616->499711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.000959:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca3e01 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [495616->499711] (req 495616->499711) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.000964:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca3e01 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [495616->499711] (req 495616->499711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.000967:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca3e01 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [495616->499711] (req 495616->499711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531968.001304:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531968.001313:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467549824
00000100:00100000:0.0:1651531968.001323:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250133
00000100:00100000:0.0:1651531968.001325:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000065cbff98 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467549824:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531968.001332:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca3e1d lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.001336:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531968.001337:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531968.001338:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca3e1d lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [843776->847871] (req 843776->847871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.001341:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca3e1d lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [843776->847871] (req 843776->847871) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531968.002075:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531968.002083:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467549952
00000100:00100000:0.0:1651531968.002091:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44572
00000100:00100000:0.0:1651531968.002093:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a552d36e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438147:x1731754467549952:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531968.002098:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531968.002102:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca3e24 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445d33 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.002109:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca3e24 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445d33 expref: 12 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531968.002114:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca3e24 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445d33 expref: 12 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531968.002117:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000080362f27, rc 0)
00000100:00100000:0.0:1651531968.002127:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a552d36e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438147:x1731754467549952:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (53us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531968.002130:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44572
00000100:00100000:0.0:1651531968.002176:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531968.002183:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467550080
00000100:00100000:0.0:1651531968.002200:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250134
00000100:00100000:0.0:1651531968.002201:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009486b685 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754467550080:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531968.002208:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca3e2b lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.002221:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531968.002236:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531968.002238:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca3e2b lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [606208->610303] (req 606208->610303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.002242:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca3e2b lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [606208->610303] (req 606208->610303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.002256:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca3e2b lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [606208->610303] (req 606208->610303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.002259:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca3e2b lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [606208->610303] (req 606208->610303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531968.002275:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009486b685 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754467550080:12345-10.240.43.64@tcp:3:fio.0 Request processed in 73us (99us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531968.002278:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250134
00010000:00010000:0.0:1651531968.002284:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca3e2b lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [606208->610303] (req 606208->610303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.002287:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e2ec18e1 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531968.002288:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca3e2b lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [606208->610303] (req 606208->610303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.002291:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca3e2b lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [606208->610303] (req 606208->610303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.002296:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca3e2b lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [606208->610303] (req 606208->610303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.002298:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca3e2b lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [606208->610303] (req 606208->610303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531968.003273:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531968.003281:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467550592
00000100:00100000:0.0:1651531968.003290:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44573
00000100:00100000:0.0:1651531968.003291:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000c821e29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438146:x1731754467550592:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531968.003295:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531968.003298:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3e32 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445d41 expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.003306:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3e32 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445d41 expref: 12 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531968.003310:0:166111:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3e32 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445d41 expref: 12 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531968.003313:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c1022d42, rc 0)
00000100:00100000:0.0:1651531968.003323:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000c821e29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438146:x1731754467550592:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (50us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531968.003325:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44573
00000001:00080000:1.0:1651531968.026444:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869286 is committed
00002000:00010000:0.0:1651531968.026478:0:216321:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x34545:0x0] updating lvb mtime from disk: 1651531967 -> 1651531968
00002000:00010000:0.0:1651531968.026480:0:216321:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x34545:0x0] updating lvb ctime from disk: 1651531967 -> 1651531968
00010000:00010000:0.0:1651531968.026482:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca3e1d lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [843776->847871] (req 843776->847871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.026486:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca3e1d lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [843776->847871] (req 843776->847871) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531968.026507:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000065cbff98 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467549824:12345-10.240.43.64@tcp:4:fio.0 Request processed in 25181us (25203us total) trans 21474869286 rc 0/0
00010000:00010000:1.0:1651531968.026509:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca3e1d lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [843776->847871] (req 843776->847871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531968.026510:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250133
00010000:00010000:1.0:1651531968.026514:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f765708a already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531968.026515:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca3e1d lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [843776->847871] (req 843776->847871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.026518:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca3e1d lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [843776->847871] (req 843776->847871) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.026524:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca3e1d lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [843776->847871] (req 843776->847871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.026527:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca3e1d lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [843776->847871] (req 843776->847871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531968.026862:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531968.026871:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467551104
00000100:00100000:0.0:1651531968.026880:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250135
00000100:00100000:0.0:1651531968.026882:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000008174da5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467551104:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531968.026889:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3e39 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.026893:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531968.026894:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531968.026895:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3e39 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [983040->987135] (req 983040->987135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.026899:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3e39 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [983040->987135] (req 983040->987135) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.026911:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3e39 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [983040->987135] (req 983040->987135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.026914:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3e39 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [983040->987135] (req 983040->987135) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531968.026928:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000008174da5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467551104:12345-10.240.43.64@tcp:3:fio.0 Request processed in 46us (66us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531968.026931:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250135
00010000:00010000:0.0:1651531968.026937:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3e39 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [983040->987135] (req 983040->987135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.026940:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c1022d42 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531968.026942:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3e39 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [983040->987135] (req 983040->987135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.026947:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3e39 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [983040->987135] (req 983040->987135) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.026952:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3e39 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [983040->987135] (req 983040->987135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.026954:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3e39 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [983040->987135] (req 983040->987135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531968.027307:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531968.027315:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467551360
00000100:00100000:0.0:1651531968.027324:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250136
00000100:00100000:0.0:1651531968.027326:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007a05c3e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467551360:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531968.027333:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca3e40 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.027337:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531968.027337:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531968.027338:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca3e40 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [151552->155647] (req 151552->155647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.027342:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca3e40 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [151552->155647] (req 151552->155647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531968.027539:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531968.027548:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467551488
00000100:00100000:0.0:1651531968.027561:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250137
00000100:00100000:0.0:1651531968.027563:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b5efe414 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754467551488:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531968.027572:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca3e47 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.027576:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531968.027577:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531968.027578:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca3e47 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [303104->307199] (req 303104->307199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.027582:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca3e47 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [303104->307199] (req 303104->307199) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.027593:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca3e47 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [303104->307199] (req 303104->307199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.027597:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca3e47 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [303104->307199] (req 303104->307199) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531968.027611:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b5efe414 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754467551488:12345-10.240.43.64@tcp:3:fio.0 Request processed in 48us (73us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531968.027614:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250137
00010000:00010000:0.0:1651531968.027620:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca3e47 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [303104->307199] (req 303104->307199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.027624:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000080362f27 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531968.027625:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca3e47 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [303104->307199] (req 303104->307199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.027628:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca3e47 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [303104->307199] (req 303104->307199) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.027636:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca3e47 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [303104->307199] (req 303104->307199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.027639:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca3e47 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [303104->307199] (req 303104->307199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531968.062517:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531968.062526:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531968.062538:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467552000
00000100:00100000:1.0:1651531968.062547:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467552064
00000100:00100000:0.0:1651531968.062551:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250138
00000100:00100000:0.0:1651531968.062553:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000094ff6232 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754467552000:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531968.062561:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca3e4e lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.062565:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531968.062565:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:1.0:1651531968.062566:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250139
00010000:00010000:0.0:1651531968.062566:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca3e4e lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [466944->471039] (req 466944->471039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531968.062568:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085e7e36c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438149:x1731754467552064:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531968.062570:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca3e4e lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [466944->471039] (req 466944->471039) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.062588:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3e55 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.062593:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531968.062593:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531968.062594:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3e55 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.062599:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3e55 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.062613:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3e55 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.062617:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3e55 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531968.062638:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085e7e36c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754467552064:12345-10.240.43.64@tcp:3:fio.0 Request processed in 69us (112us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531968.062641:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250139
00010000:00010000:1.0:1651531968.062649:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3e55 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.062653:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a8889a80 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531968.062654:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3e55 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.062657:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3e55 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.062673:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3e55 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.062676:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3e55 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531968.062977:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531968.062986:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467552256
00000100:00100000:0.0:1651531968.062996:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250140
00000100:00100000:0.0:1651531968.062998:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000efdaa0c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754467552256:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531968.063005:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3e5c lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.063011:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531968.063011:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531968.063012:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3e5c lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [507904->511999] (req 507904->511999) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.063016:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3e5c lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [507904->511999] (req 507904->511999) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.063028:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3e5c lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [507904->511999] (req 507904->511999) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.063031:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3e5c lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [507904->511999] (req 507904->511999) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531968.063045:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000efdaa0c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754467552256:12345-10.240.43.64@tcp:3:fio.0 Request processed in 47us (69us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531968.063048:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250140
00010000:00010000:0.0:1651531968.063054:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3e5c lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [507904->511999] (req 507904->511999) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.063057:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c1022d42 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531968.063058:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3e5c lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [507904->511999] (req 507904->511999) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.063061:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3e5c lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [507904->511999] (req 507904->511999) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.063066:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3e5c lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [507904->511999] (req 507904->511999) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.063069:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3e5c lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [507904->511999] (req 507904->511999) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531968.063787:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531968.063795:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467552512
00000100:00100000:0.0:1651531968.063803:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44574
00000100:00100000:0.0:1651531968.063804:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dce6a2c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754467552512:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531968.063808:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531968.063811:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca3e63 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445d4f expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.063819:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca3e63 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445d4f expref: 15 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531968.063824:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca3e63 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445d4f expref: 15 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531968.063827:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fab23815, rc 0)
00000100:00100000:0.0:1651531968.063836:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dce6a2c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754467552512:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (50us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531968.063839:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44574
00000001:00080000:1.0:1651531968.097716:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869287 is committed
00010000:00010000:0.0:1651531968.097754:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca3e40 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [151552->155647] (req 151552->155647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.097760:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca3e40 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [151552->155647] (req 151552->155647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531968.097790:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007a05c3e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754467551360:12345-10.240.43.64@tcp:4:fio.0 Request processed in 70462us (70482us total) trans 21474869287 rc 0/0
00000100:00100000:0.0:1651531968.097795:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250136
00010000:00010000:0.0:1651531968.097804:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca3e40 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [151552->155647] (req 151552->155647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.097809:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e2ec18e1 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531968.097811:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca3e40 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [151552->155647] (req 151552->155647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.097817:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca3e40 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [151552->155647] (req 151552->155647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.097826:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca3e40 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [151552->155647] (req 151552->155647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.097831:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca3e40 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [151552->155647] (req 151552->155647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531968.098624:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531968.098632:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467553024
00000100:00100000:0.0:1651531968.098642:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250141
00000100:00100000:0.0:1651531968.098644:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000028779db6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754467553024:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531968.098651:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca3e6a lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.098655:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531968.098657:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531968.098658:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca3e6a lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [962560->966655] (req 962560->966655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.098662:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca3e6a lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [962560->966655] (req 962560->966655) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531968.110244:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531968.110253:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467553152
00000100:00100000:0.0:1651531968.110261:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44575
00000100:00100000:0.0:1651531968.110263:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009078ca7d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754467553152:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531968.110266:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531968.110270:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca3e71 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445d5d expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.110278:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca3e71 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445d5d expref: 15 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531968.110282:0:166111:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca3e71 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445d5d expref: 15 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531968.110286:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e2ec18e1, rc 0)
00000100:00100000:0.0:1651531968.110296:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009078ca7d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754467553152:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (52us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531968.110298:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44575
00000001:00080000:1.0:1651531968.146789:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869288 is committed
00010000:00010000:0.0:1651531968.146830:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca3e4e lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [466944->471039] (req 466944->471039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.146842:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca3e4e lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [466944->471039] (req 466944->471039) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.146870:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca3e4e lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [466944->471039] (req 466944->471039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.146875:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000080362f27 already unused, calling callback (0000000049fddea7)
00000100:00100000:0.0:1651531968.146875:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000094ff6232 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754467552000:12345-10.240.43.64@tcp:4:fio.0 Request processed in 84319us (84357us total) trans 21474869288 rc 0/0
00010000:00010000:1.0:1651531968.146876:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca3e4e lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [466944->471039] (req 466944->471039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.146879:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca3e4e lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [466944->471039] (req 466944->471039) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531968.146881:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250138
00010000:00010000:1.0:1651531968.146885:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca3e4e lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [466944->471039] (req 466944->471039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.146888:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca3e4e lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [466944->471039] (req 466944->471039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531968.147696:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531968.147704:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467553664
00000100:00100000:0.0:1651531968.147715:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250142
00000100:00100000:0.0:1651531968.147716:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000071f9ee43 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438146:x1731754467553664:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531968.147723:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca3e78 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.147728:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531968.147728:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531968.147729:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca3e78 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [573440->577535] (req 573440->577535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.147734:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca3e78 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [573440->577535] (req 573440->577535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651531968.194537:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869289 is committed
00010000:00010000:0.0:1651531968.194573:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca3e6a lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [962560->966655] (req 962560->966655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.194580:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca3e6a lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [962560->966655] (req 962560->966655) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531968.194611:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000028779db6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754467553024:12345-10.240.43.64@tcp:4:fio.0 Request processed in 95965us (95987us total) trans 21474869289 rc 0/0
00000100:00100000:0.0:1651531968.194615:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250141
00010000:00010000:0.0:1651531968.194626:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca3e6a lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [962560->966655] (req 962560->966655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.194633:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fab23815 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531968.194634:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca3e6a lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [962560->966655] (req 962560->966655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.194641:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca3e6a lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [962560->966655] (req 962560->966655) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.194649:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca3e6a lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [962560->966655] (req 962560->966655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.194655:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca3e6a lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [962560->966655] (req 962560->966655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651531968.243630:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869290 is committed
00010000:00010000:1.0:1651531968.243646:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca3e78 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [573440->577535] (req 573440->577535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.243662:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca3e78 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [573440->577535] (req 573440->577535) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531968.243686:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000071f9ee43 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467553664:12345-10.240.43.64@tcp:4:fio.0 Request processed in 95969us (95991us total) trans 21474869290 rc 0/0
00000100:00100000:1.0:1651531968.243690:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250142
00010000:00010000:0.0:1651531968.243696:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca3e78 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [573440->577535] (req 573440->577535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.243701:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e2ec18e1 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531968.243702:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca3e78 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [573440->577535] (req 573440->577535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.243705:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca3e78 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [573440->577535] (req 573440->577535) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.243713:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca3e78 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [573440->577535] (req 573440->577535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.243716:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca3e78 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [573440->577535] (req 573440->577535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531968.244023:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531968.244031:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467554176
00000100:00100000:0.0:1651531968.244039:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44576
00000100:00100000:0.0:1651531968.244041:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fb90eb28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467554176:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531968.244045:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531968.244048:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca3e7f lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445d6b expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.244056:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca3e7f lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445d6b expref: 9 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531968.244061:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca3e7f lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445d6b expref: 9 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531968.244064:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fab23815, rc 0)
00000100:00100000:0.0:1651531968.244082:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fb90eb28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467554176:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (59us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531968.244085:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44576
00000100:00100000:0.0:1651531968.244779:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531968.244801:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467554432
00000100:00100000:1.0:1651531968.244818:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250143
00000100:00100000:1.0:1651531968.244820:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000add44b2e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467554432:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531968.244828:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3e86 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.244833:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531968.244834:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531968.244835:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3e86 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.244839:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3e86 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.244851:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3e86 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.244854:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3e86 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531968.244870:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000add44b2e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467554432:12345-10.240.43.64@tcp:3:fio.0 Request processed in 49us (91us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531968.244882:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250143
00010000:00010000:1.0:1651531968.244890:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3e86 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.244893:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a8889a80 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531968.244894:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3e86 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.244897:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3e86 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.244902:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3e86 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.244905:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3e86 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531968.244980:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531968.245012:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467554688
00000100:00100000:1.0:1651531968.245026:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250144
00000100:00100000:1.0:1651531968.245028:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000670433b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467554688:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531968.245035:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3e8d lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.245039:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531968.245040:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531968.245041:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3e8d lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [24576->28671] (req 24576->28671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.245056:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3e8d lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [24576->28671] (req 24576->28671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.245068:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3e8d lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [24576->28671] (req 24576->28671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.245071:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3e8d lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [24576->28671] (req 24576->28671) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.245090:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3e8d lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [24576->28671] (req 24576->28671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531968.245092:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000670433b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467554688:12345-10.240.43.64@tcp:3:fio.0 Request processed in 63us (112us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531968.245095:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250144
00010000:00010000:0.0:1651531968.245095:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d44eb74d already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531968.245096:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3e8d lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [24576->28671] (req 24576->28671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.245099:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3e8d lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [24576->28671] (req 24576->28671) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.245104:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3e8d lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [24576->28671] (req 24576->28671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.245107:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3e8d lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [24576->28671] (req 24576->28671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531968.245460:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531968.245479:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531968.245489:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467554816
00000100:00100000:1.0:1651531968.245490:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467555008
00000100:00100000:0.0:1651531968.245507:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250145
00000100:00100000:1.0:1651531968.245509:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250146
00000100:00100000:0.0:1651531968.245509:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c62d1815 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754467554816:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651531968.245511:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a9fc5082 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438147:x1731754467555008:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531968.245516:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3e94 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.245519:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3e9b lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.245520:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531968.245521:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531968.245522:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3e94 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [126976->131071] (req 126976->131071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.245526:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3e94 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [126976->131071] (req 126976->131071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.245528:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531968.245528:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531968.245529:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3e9b lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [962560->966655] (req 962560->966655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.245533:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3e9b lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [962560->966655] (req 962560->966655) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651531968.315902:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869292 is committed
00010000:00010000:1.0:1651531968.315923:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3e9b lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [962560->966655] (req 962560->966655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.315927:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3e9b lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [962560->966655] (req 962560->966655) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.315944:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3e94 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [126976->131071] (req 126976->131071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531968.315948:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a9fc5082 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438147:x1731754467555008:12345-10.240.43.64@tcp:4:fio.0 Request processed in 70435us (70468us total) trans 21474869292 rc 0/0
00000100:00100000:1.0:1651531968.315951:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250146
00010000:00010000:0.0:1651531968.315953:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3e94 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [126976->131071] (req 126976->131071) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.315971:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3e9b lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [962560->966655] (req 962560->966655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531968.315973:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c62d1815 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467554816:12345-10.240.43.64@tcp:4:fio.0 Request processed in 70463us (70512us total) trans 21474869291 rc 0/0
00010000:00010000:1.0:1651531968.315974:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000968553c1 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531968.315975:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3e9b lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [962560->966655] (req 962560->966655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531968.315976:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250145
00010000:00010000:1.0:1651531968.315978:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3e9b lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [962560->966655] (req 962560->966655) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.315984:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3e9b lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [962560->966655] (req 962560->966655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.315987:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3e9b lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [962560->966655] (req 962560->966655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.315990:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3e94 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [126976->131071] (req 126976->131071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.315994:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c1022d42 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531968.315995:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3e94 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [126976->131071] (req 126976->131071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.315998:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3e94 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [126976->131071] (req 126976->131071) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.316001:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3e94 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [126976->131071] (req 126976->131071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.316004:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca3e94 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [126976->131071] (req 126976->131071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531968.316776:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531968.316801:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467555584
00000100:00100000:0.0:1651531968.316810:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44577
00000100:00100000:0.0:1651531968.316812:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000033723645 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467555584:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531968.316815:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531968.316819:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca3ea2 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445d79 expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.316827:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca3ea2 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445d79 expref: 9 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531968.316831:0:166111:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca3ea2 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445d79 expref: 9 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531968.316835:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fab23815, rc 0)
00000100:00100000:0.0:1651531968.316845:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000033723645 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467555584:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (69us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531968.316859:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44577
00000100:00100000:1.0:1651531968.317704:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531968.317722:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467555968
00000100:00100000:0.0:1651531968.317738:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250147
00000100:00100000:0.0:1651531968.317739:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005ec1cbc3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467555968:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531968.317747:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca3ea9 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.317751:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531968.317752:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531968.317753:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca3ea9 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [819200->823295] (req 819200->823295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.317757:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca3ea9 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [819200->823295] (req 819200->823295) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.317769:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca3ea9 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [819200->823295] (req 819200->823295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.317772:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca3ea9 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [819200->823295] (req 819200->823295) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531968.317788:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005ec1cbc3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467555968:12345-10.240.43.64@tcp:3:fio.0 Request processed in 48us (84us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531968.317791:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250147
00010000:00010000:0.0:1651531968.317797:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca3ea9 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [819200->823295] (req 819200->823295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.317800:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e2ec18e1 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531968.317811:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca3ea9 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [819200->823295] (req 819200->823295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.317814:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca3ea9 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [819200->823295] (req 819200->823295) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.317819:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca3ea9 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [819200->823295] (req 819200->823295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.317822:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca3ea9 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [819200->823295] (req 819200->823295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531968.318483:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531968.318500:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467556224
00000100:00100000:0.0:1651531968.318514:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250148
00000100:00100000:0.0:1651531968.318516:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002bdf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467556224:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531968.318524:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3eb0 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.318528:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531968.318529:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531968.318530:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3eb0 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [307200->311295] (req 307200->311295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.318534:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3eb0 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [307200->311295] (req 307200->311295) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.318545:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3eb0 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [307200->311295] (req 307200->311295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.318548:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3eb0 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [307200->311295] (req 307200->311295) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.318576:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3eb0 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [307200->311295] (req 307200->311295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531968.318577:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002bdf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467556224:12345-10.240.43.64@tcp:3:fio.0 Request processed in 60us (95us total) trans 0 rc 4096/4096
00010000:00010000:1.0:1651531968.318580:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002c5e01dd already unused, calling callback (0000000049fddea7)
00000100:00100000:0.0:1651531968.318580:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250148
00010000:00010000:1.0:1651531968.318581:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3eb0 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [307200->311295] (req 307200->311295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.318584:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3eb0 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [307200->311295] (req 307200->311295) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.318589:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3eb0 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [307200->311295] (req 307200->311295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.318593:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca3eb0 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [307200->311295] (req 307200->311295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531968.349734:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531968.349756:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467556608
00000100:00100000:0.0:1651531968.349771:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250149
00000100:00100000:0.0:1651531968.349772:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b5b5b4c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467556608:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531968.349780:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca3eb7 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.349784:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531968.349784:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531968.349785:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca3eb7 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.349789:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca3eb7 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.349801:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca3eb7 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.349804:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca3eb7 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.349824:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca3eb7 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531968.349824:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b5b5b4c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467556608:12345-10.240.43.64@tcp:3:fio.0 Request processed in 51us (90us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531968.349827:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250149
00010000:00010000:1.0:1651531968.349828:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e2ec18e1 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531968.349829:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca3eb7 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.349832:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca3eb7 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.349837:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca3eb7 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.349839:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca3eb7 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531968.374332:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531968.374357:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467556864
00000100:00100000:0.0:1651531968.374376:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250150
00000100:00100000:0.0:1651531968.374378:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000da31c48f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467556864:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531968.374385:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca3ebe lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.374389:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531968.374390:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531968.374391:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca3ebe lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [61440->65535] (req 61440->65535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.374395:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca3ebe lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [61440->65535] (req 61440->65535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531968.410449:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531968.410463:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531968.410470:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467557120
00000100:00100000:0.0:1651531968.410472:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467557248
00000100:00100000:1.0:1651531968.410486:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250151
00000100:00100000:1.0:1651531968.410493:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e4e3ecb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754467557120:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651531968.410494:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250152
00000100:00100000:0.0:1651531968.410496:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b67ad021 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438149:x1731754467557248:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531968.410501:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3ec5 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.410503:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca3ecc lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.410507:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531968.410508:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531968.410509:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca3ecc lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [454656->458751] (req 454656->458751) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.410513:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca3ecc lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [454656->458751] (req 454656->458751) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.410515:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531968.410516:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531968.410517:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3ec5 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.410521:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3ec5 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651531968.445585:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869293 is committed
00010000:00010000:0.0:1651531968.445624:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca3ebe lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [61440->65535] (req 61440->65535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.445631:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca3ebe lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [61440->65535] (req 61440->65535) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531968.445662:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000da31c48f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754467556864:12345-10.240.43.64@tcp:4:fio.0 Request processed in 71283us (71330us total) trans 21474869293 rc 0/0
00000100:00100000:0.0:1651531968.445666:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250150
00010000:00010000:0.0:1651531968.445678:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca3ebe lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [61440->65535] (req 61440->65535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.445685:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fab23815 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531968.445687:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca3ebe lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [61440->65535] (req 61440->65535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.445693:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca3ebe lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [61440->65535] (req 61440->65535) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.445702:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca3ebe lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [61440->65535] (req 61440->65535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.445708:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca3ebe lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [61440->65535] (req 61440->65535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531968.446447:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531968.446455:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467557504
00000100:00100000:0.0:1651531968.446473:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250153
00000100:00100000:0.0:1651531968.446475:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002d3e5ae4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754467557504:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531968.446482:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3ed3 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.446487:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531968.446487:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531968.446488:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3ed3 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [49152->53247] (req 49152->53247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.446492:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3ed3 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [49152->53247] (req 49152->53247) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.446504:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3ed3 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [49152->53247] (req 49152->53247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.446507:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3ed3 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [49152->53247] (req 49152->53247) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531968.446526:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002d3e5ae4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754467557504:12345-10.240.43.64@tcp:3:fio.0 Request processed in 50us (80us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531968.446529:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250153
00010000:00010000:1.0:1651531968.446530:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3ed3 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [49152->53247] (req 49152->53247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.446535:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fb2f6575 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531968.446536:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3ed3 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [49152->53247] (req 49152->53247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.446539:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3ed3 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [49152->53247] (req 49152->53247) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.446545:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3ed3 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [49152->53247] (req 49152->53247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.446548:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca3ed3 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [49152->53247] (req 49152->53247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531968.458082:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531968.458090:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467557760
00000100:00100000:0.0:1651531968.458105:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250154
00000100:00100000:0.0:1651531968.458107:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e9971da5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754467557760:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531968.458114:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca3eda lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.458122:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531968.458123:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531968.458124:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca3eda lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [503808->507903] (req 503808->507903) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.458128:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca3eda lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [503808->507903] (req 503808->507903) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651531968.482268:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869295 is committed
00010000:00010000:0.0:1651531968.482304:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca3ecc lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [454656->458751] (req 454656->458751) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.482310:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca3ecc lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [454656->458751] (req 454656->458751) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.482317:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3ec5 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.482340:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3ec5 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531968.482340:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b67ad021 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438149:x1731754467557248:12345-10.240.43.64@tcp:4:fio.0 Request processed in 71843us (71876us total) trans 21474869295 rc 0/0
00000100:00100000:0.0:1651531968.482345:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250152
00000100:00100000:1.0:1651531968.482359:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e4e3ecb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438146:x1731754467557120:12345-10.240.43.64@tcp:4:fio.0 Request processed in 71865us (71910us total) trans 21474869294 rc 0/0
00000100:00100000:1.0:1651531968.482363:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250151
00010000:00010000:0.0:1651531968.482365:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca3ecc lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [454656->458751] (req 454656->458751) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.482372:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3ec5 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.482372:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f5657138 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531968.482374:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca3ecc lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [454656->458751] (req 454656->458751) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.482375:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000968553c1 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531968.482376:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3ec5 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.482379:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3ec5 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.482379:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca3ecc lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [454656->458751] (req 454656->458751) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.482389:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca3ecc lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [454656->458751] (req 454656->458751) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.482399:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3ec5 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.482402:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3ec5 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [192512->196607] (req 192512->196607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.482406:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca3ecc lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [454656->458751] (req 454656->458751) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531968.482765:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531968.482774:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467558016
00000100:00100000:0.0:1651531968.482782:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44578
00000100:00100000:0.0:1651531968.482784:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dccc50c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754467558016:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531968.482787:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531968.482791:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3ee1 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445d87 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.482799:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3ee1 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445d87 expref: 12 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531968.482804:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3ee1 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445d87 expref: 12 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531968.482807:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000075a78972, rc 0)
00000100:00100000:0.0:1651531968.482817:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dccc50c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754467558016:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (52us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531968.482820:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44578
00000001:00080000:1.0:1651531968.531297:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869296 is committed
00010000:00010000:1.0:1651531968.531313:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca3eda lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [503808->507903] (req 503808->507903) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.531316:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca3eda lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [503808->507903] (req 503808->507903) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531968.531347:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e9971da5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467557760:12345-10.240.43.64@tcp:4:fio.0 Request processed in 73239us (73265us total) trans 21474869296 rc 0/0
00000100:00100000:1.0:1651531968.531350:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250154
00010000:00010000:0.0:1651531968.531390:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca3eda lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [503808->507903] (req 503808->507903) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.531394:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fab23815 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531968.531395:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca3eda lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [503808->507903] (req 503808->507903) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.531408:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca3eda lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [503808->507903] (req 503808->507903) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.531414:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca3eda lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [503808->507903] (req 503808->507903) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.531417:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca3eda lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [503808->507903] (req 503808->507903) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531968.543403:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531968.543426:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467559040
00000100:00100000:1.0:1651531968.543439:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250155
00000100:00100000:1.0:1651531968.543440:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000028779db6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467559040:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531968.543448:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3ee8 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.543452:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531968.543453:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531968.543454:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3ee8 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [143360->147455] (req 143360->147455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.543459:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3ee8 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [143360->147455] (req 143360->147455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.543470:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3ee8 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [143360->147455] (req 143360->147455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.543474:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3ee8 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [143360->147455] (req 143360->147455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531968.543494:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000028779db6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467559040:12345-10.240.43.64@tcp:3:fio.0 Request processed in 53us (92us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531968.543498:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250155
00010000:00010000:1.0:1651531968.543505:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3ee8 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [143360->147455] (req 143360->147455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.543517:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000968553c1 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531968.543518:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3ee8 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [143360->147455] (req 143360->147455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.543521:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3ee8 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [143360->147455] (req 143360->147455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.543526:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3ee8 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [143360->147455] (req 143360->147455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.543537:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3ee8 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [143360->147455] (req 143360->147455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531968.576299:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531968.576307:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467559360
00000100:00100000:0.0:1651531968.576315:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44579
00000100:00100000:0.0:1651531968.576317:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000071f9ee43 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467559360:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531968.576321:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531968.576325:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca3eef lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445d95 expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.576332:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca3eef lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445d95 expref: 9 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531968.576337:0:166111:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca3eef lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445d95 expref: 9 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531968.576340:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fab23815, rc 0)
00000100:00100000:0.0:1651531968.576350:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000071f9ee43 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467559360:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (52us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531968.576363:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44579
00000100:00100000:0.0:1651531968.577238:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531968.577248:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467559744
00000100:00100000:0.0:1651531968.577258:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250156
00000100:00100000:0.0:1651531968.577260:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000add44b2e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467559744:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531968.577267:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3ef6 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.577271:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531968.577272:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531968.577272:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3ef6 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [733184->737279] (req 733184->737279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.577277:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3ef6 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [733184->737279] (req 733184->737279) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531968.629047:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531968.629071:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467559936
00000100:00100000:1.0:1651531968.629094:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250157
00000100:00100000:1.0:1651531968.629097:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000670433b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438146:x1731754467559936:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531968.629104:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3efd lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.629109:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531968.629110:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531968.629111:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3efd lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [114688->118783] (req 114688->118783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.629115:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3efd lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [114688->118783] (req 114688->118783) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651531968.629188:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869297 is committed
00010000:00010000:0.0:1651531968.629249:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3ef6 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [733184->737279] (req 733184->737279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.629257:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3ef6 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [733184->737279] (req 733184->737279) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531968.629278:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000add44b2e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754467559744:12345-10.240.43.64@tcp:4:fio.0 Request processed in 52017us (52056us total) trans 21474869297 rc 0/0
00000100:00100000:0.0:1651531968.629281:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250156
00010000:00010000:0.0:1651531968.629289:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3ef6 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [733184->737279] (req 733184->737279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.629302:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000075a78972 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531968.629303:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3ef6 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [733184->737279] (req 733184->737279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.629307:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3ef6 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [733184->737279] (req 733184->737279) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.629312:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3ef6 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [733184->737279] (req 733184->737279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.629315:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3ef6 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [733184->737279] (req 733184->737279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651531968.670265:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869298 is committed
00010000:00010000:1.0:1651531968.670280:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3efd lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [114688->118783] (req 114688->118783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.670284:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3efd lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [114688->118783] (req 114688->118783) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531968.670306:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000670433b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467559936:12345-10.240.43.64@tcp:4:fio.0 Request processed in 41209us (41260us total) trans 21474869298 rc 0/0
00000100:00100000:1.0:1651531968.670310:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250157
00010000:00010000:0.0:1651531968.670312:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3efd lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [114688->118783] (req 114688->118783) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.670317:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000968553c1 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531968.670318:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3efd lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [114688->118783] (req 114688->118783) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.670321:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3efd lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [114688->118783] (req 114688->118783) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.670327:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3efd lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [114688->118783] (req 114688->118783) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.670330:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3efd lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [114688->118783] (req 114688->118783) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531968.671051:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531968.671076:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467560512
00000100:00100000:1.0:1651531968.671092:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250158
00000100:00100000:1.0:1651531968.671094:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002d3e5ae4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467560512:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531968.671109:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3f04 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.671113:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531968.671114:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531968.671115:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3f04 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [110592->114687] (req 110592->114687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.671119:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3f04 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [110592->114687] (req 110592->114687) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.671132:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3f04 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [110592->114687] (req 110592->114687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.671135:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3f04 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [110592->114687] (req 110592->114687) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531968.671161:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002d3e5ae4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467560512:12345-10.240.43.64@tcp:3:fio.0 Request processed in 66us (110us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531968.671164:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250158
00010000:00010000:1.0:1651531968.671171:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3f04 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [110592->114687] (req 110592->114687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.671174:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a8889a80 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531968.671175:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3f04 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [110592->114687] (req 110592->114687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.671178:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3f04 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [110592->114687] (req 110592->114687) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.671183:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3f04 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [110592->114687] (req 110592->114687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.671186:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3f04 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [110592->114687] (req 110592->114687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531968.671554:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531968.671572:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467560896
00000100:00100000:1.0:1651531968.671588:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250159
00000100:00100000:1.0:1651531968.671590:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b67ad021 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467560896:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531968.671597:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3f0b lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.671601:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531968.671610:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531968.671611:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3f0b lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.671615:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3f0b lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651531968.705964:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869299 is committed
00010000:00010000:1.0:1651531968.705979:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3f0b lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.705983:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3f0b lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531968.706005:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b67ad021 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467560896:12345-10.240.43.64@tcp:4:fio.0 Request processed in 34414us (34451us total) trans 21474869299 rc 0/0
00000100:00100000:1.0:1651531968.706008:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250159
00010000:00010000:0.0:1651531968.706011:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3f0b lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.706016:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e9b84540 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531968.706017:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3f0b lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.706020:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3f0b lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.706026:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3f0b lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.706028:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3f0b lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531968.706350:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531968.706358:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467561152
00000100:00100000:0.0:1651531968.706367:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44580
00000100:00100000:0.0:1651531968.706368:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e4e3ecb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467561152:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531968.706372:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531968.706376:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3f12 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445da3 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.706384:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3f12 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445da3 expref: 9 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531968.706400:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3f12 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445da3 expref: 9 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531968.706404:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000075a78972, rc 0)
00000100:00100000:0.0:1651531968.706420:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e4e3ecb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467561152:12345-10.240.43.64@tcp:101:fio.0 Request processed in 50us (70us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531968.706423:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44580
00000100:00100000:0.0:1651531968.719486:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531968.719500:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531968.719508:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467561600
00000100:00100000:1.0:1651531968.719509:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467561728
00000100:00100000:0.0:1651531968.719518:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250160
00000100:00100000:0.0:1651531968.719520:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029096870 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438149:x1731754467561600:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651531968.719521:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250161
00000100:00100000:1.0:1651531968.719523:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003b40261e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438147:x1731754467561728:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531968.719527:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3f19 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.719530:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3f20 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.719531:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531968.719532:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531968.719533:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3f19 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [512000->516095] (req 512000->516095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.719537:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3f19 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [512000->516095] (req 512000->516095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.719539:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531968.719539:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531968.719541:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3f20 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [61440->65535] (req 61440->65535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.719545:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3f20 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [61440->65535] (req 61440->65535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.719549:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3f19 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [512000->516095] (req 512000->516095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.719565:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3f19 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [512000->516095] (req 512000->516095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.719569:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3f20 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [61440->65535] (req 61440->65535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.719572:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3f20 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [61440->65535] (req 61440->65535) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531968.719583:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029096870 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438149:x1731754467561600:12345-10.240.43.64@tcp:3:fio.0 Request processed in 63us (97us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531968.719586:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250160
00000100:00100000:1.0:1651531968.719593:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003b40261e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467561728:12345-10.240.43.64@tcp:3:fio.0 Request processed in 69us (93us total) trans 0 rc 4096/4096
00010000:00010000:0.0:1651531968.719594:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3f19 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [512000->516095] (req 512000->516095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531968.719596:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250161
00010000:00010000:0.0:1651531968.719597:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000075a78972 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531968.719598:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3f19 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [512000->516095] (req 512000->516095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.719601:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3f19 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [512000->516095] (req 512000->516095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.719604:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3f20 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [61440->65535] (req 61440->65535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.719606:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3f19 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [512000->516095] (req 512000->516095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.719608:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a8889a80 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531968.719609:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3f20 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [61440->65535] (req 61440->65535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.719609:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3f19 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [512000->516095] (req 512000->516095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.719612:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3f20 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [61440->65535] (req 61440->65535) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.719617:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3f20 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [61440->65535] (req 61440->65535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.719619:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3f20 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [61440->65535] (req 61440->65535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531968.719980:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531968.719988:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467562048
00000100:00100000:0.0:1651531968.720003:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250162
00000100:00100000:0.0:1651531968.720005:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dfff0362 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467562048:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531968.720012:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca3f27 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.720025:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531968.720025:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531968.720026:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca3f27 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [860160->864255] (req 860160->864255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.720030:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca3f27 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [860160->864255] (req 860160->864255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.720042:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca3f27 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [860160->864255] (req 860160->864255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.720046:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca3f27 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [860160->864255] (req 860160->864255) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531968.720061:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dfff0362 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467562048:12345-10.240.43.64@tcp:3:fio.0 Request processed in 55us (81us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531968.720063:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250162
00010000:00010000:0.0:1651531968.720070:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca3f27 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [860160->864255] (req 860160->864255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.720073:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fab23815 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531968.720074:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca3f27 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [860160->864255] (req 860160->864255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.720077:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca3f27 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [860160->864255] (req 860160->864255) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.720081:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca3f27 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [860160->864255] (req 860160->864255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.720085:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca3f27 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [860160->864255] (req 860160->864255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531968.759398:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531968.759408:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531968.759415:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467562688
00000100:00100000:0.0:1651531968.759423:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44581
00000100:00100000:0.0:1651531968.759424:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002bf85ab5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467562688:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531968.759428:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531968.759432:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca3f2e lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445db1 expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.759440:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca3f2e lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445db1 expref: 9 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531968.759444:0:166111:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca3f2e lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445db1 expref: 9 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531968.759447:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fab23815, rc 0)
00000100:00100000:0.0:1651531968.759457:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002bf85ab5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467562688:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (48us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531968.759459:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44581
00000100:00100000:0.0:1651531968.759466:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467562432
00000100:00100000:0.0:1651531968.759480:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250163
00000100:00100000:0.0:1651531968.759482:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bedaf1f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467562432:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531968.759491:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3f35 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.759494:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531968.759495:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531968.759496:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3f35 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [417792->421887] (req 417792->421887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.759500:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3f35 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [417792->421887] (req 417792->421887) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.759511:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3f35 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [417792->421887] (req 417792->421887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.759515:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3f35 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [417792->421887] (req 417792->421887) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531968.759529:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bedaf1f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467562432:12345-10.240.43.64@tcp:3:fio.0 Request processed in 46us (132us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531968.759532:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250163
00010000:00010000:0.0:1651531968.759537:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3f35 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [417792->421887] (req 417792->421887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.759541:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000075a78972 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531968.759542:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3f35 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [417792->421887] (req 417792->421887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.759545:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3f35 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [417792->421887] (req 417792->421887) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.759552:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3f35 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [417792->421887] (req 417792->421887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.759555:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3f35 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [417792->421887] (req 417792->421887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531968.759875:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531968.759893:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467562816
00000100:00100000:0.0:1651531968.759908:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250164
00000100:00100000:0.0:1651531968.759910:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002bdf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467562816:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531968.759917:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca3f3c lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.759921:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531968.759921:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531968.759922:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca3f3c lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [782336->786431] (req 782336->786431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.759926:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca3f3c lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [782336->786431] (req 782336->786431) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.759962:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca3f3c lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [782336->786431] (req 782336->786431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.759966:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca3f3c lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [782336->786431] (req 782336->786431) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531968.759982:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002bdf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467562816:12345-10.240.43.64@tcp:3:fio.0 Request processed in 72us (108us total) trans 0 rc 4096/4096
00010000:00010000:1.0:1651531968.759986:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca3f3c lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [782336->786431] (req 782336->786431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531968.759997:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250164
00010000:00010000:1.0:1651531968.759999:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f5657138 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531968.760000:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca3f3c lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [782336->786431] (req 782336->786431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.760003:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca3f3c lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [782336->786431] (req 782336->786431) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.760009:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca3f3c lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [782336->786431] (req 782336->786431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.760011:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca3f3c lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [782336->786431] (req 782336->786431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531968.760014:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531968.760038:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467562944
00000100:00100000:0.0:1651531968.760050:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250165
00000100:00100000:0.0:1651531968.760052:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c65d6bc4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467562944:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531968.760059:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca3f43 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.760062:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531968.760063:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531968.760064:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca3f43 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [442368->446463] (req 442368->446463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.760068:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca3f43 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [442368->446463] (req 442368->446463) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.760078:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca3f43 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [442368->446463] (req 442368->446463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.760081:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca3f43 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [442368->446463] (req 442368->446463) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531968.760112:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c65d6bc4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467562944:12345-10.240.43.64@tcp:3:fio.0 Request processed in 59us (98us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531968.760115:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250165
00010000:00010000:0.0:1651531968.760122:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca3f43 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [442368->446463] (req 442368->446463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.760137:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000014685f38 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531968.760138:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca3f43 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [442368->446463] (req 442368->446463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.760142:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca3f43 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [442368->446463] (req 442368->446463) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.760146:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca3f43 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [442368->446463] (req 442368->446463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.760149:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca3f43 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [442368->446463] (req 442368->446463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531968.760579:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531968.760587:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467563328
00000100:00100000:0.0:1651531968.760603:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250166
00000100:00100000:0.0:1651531968.760605:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ecb6b3b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467563328:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531968.760612:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3f4a lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.760617:0:192755:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca2e2c lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [8192->16383] (req 8192->12287) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445481 expref: 8 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.760620:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531968.760621:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531968.760621:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3f4a lrc: 4/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [8192->12287] (req 8192->12287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.760632:0:192755:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca2e2c lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [8192->16383] (req 8192->12287) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445481 expref: 8 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.760636:0:192755:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca2e2c lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [8192->16383] (req 8192->12287) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445481 expref: 8 pid: 166112 timeout: 22777 lvb_type: 0
00000100:00100000:0.0:1651531968.760640:0:192755:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f47fde78 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0001_UUID:192755:1731745997356224:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531968.760657:0:192755:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cd8a7e69 going to sleep for 6 seconds
00000100:00100000:0.0:1651531968.760877:0:192755:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f47fde78 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0001_UUID:192755:1731745997356224:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651531968.760882:0:192755:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3f4a lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [8192->12287] (req 8192->12287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531968.760982:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531968.761000:0:166103:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467563584
00010000:00010000:0.0:1651531968.761007:0:166103:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca2e2c lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [8192->16383] (req 8192->12287) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445481 expref: 9 pid: 166112 timeout: 22777 lvb_type: 0
00000100:00100000:0.0:1651531968.761020:0:166103:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 215
00000100:00100000:0.0:1651531968.761021:0:166103:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b5b5b4c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754467563584:12345-10.240.43.64@tcp:103:ldlm_bl_04.0
00010000:00010000:0.0:1651531968.761024:0:166103:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531968.761029:0:166103:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca2e2c lrc: 4/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [8192->16383] (req 8192->12287) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445481 expref: 9 pid: 166112 timeout: 22777 lvb_type: 0
00010000:00010000:0.0:1651531968.761032:0:166103:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca2e2c lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [8192->16383] (req 8192->12287) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445481 expref: 9 pid: 166112 timeout: 22777 lvb_type: 0
00010000:00010000:0.0:1651531968.761041:0:166103:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca2e2c lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [8192->16383] (req 8192->12287) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445481 expref: 9 pid: 166112 timeout: 22777 lvb_type: 0
00010000:00010000:0.0:1651531968.761045:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531968.761045:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531968.761046:0:166103:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3f4a lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [8192->12287] (req 8192->12287) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.761049:0:166103:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3f4a lrc: 4/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [8192->12287] (req 8192->12287) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.761057:0:166103:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651531968.761065:0:166103:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b5b5b4c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467563584:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 43us (84us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531968.761068:0:166103:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 215
00010000:00010000:0.0:1651531968.761075:0:192755:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3f4a lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [8192->12287] (req 8192->12287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.761078:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3f4a lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [8192->12287] (req 8192->12287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.761089:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3f4a lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [8192->12287] (req 8192->12287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.761092:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3f4a lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [8192->12287] (req 8192->12287) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531968.761109:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ecb6b3b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438148:x1731754467563328:12345-10.240.43.64@tcp:3:fio.0 Request processed in 504us (530us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531968.761113:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250166
00010000:00010000:0.0:1651531968.761119:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3f4a lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [8192->12287] (req 8192->12287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.761122:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000032ee36ee already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531968.761123:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3f4a lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [8192->12287] (req 8192->12287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.761126:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3f4a lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [8192->12287] (req 8192->12287) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.761130:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3f4a lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [8192->12287] (req 8192->12287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.761133:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3f4a lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [8192->12287] (req 8192->12287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531968.802138:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531968.802146:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467564160
00000100:00100000:0.0:1651531968.802154:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44582
00000100:00100000:0.0:1651531968.802156:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f47fde78 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438148:x1731754467564160:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531968.802159:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531968.802163:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3f51 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445dbf expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.802168:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531968.802169:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531968.802170:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3f51 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445dbf expref: 8 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531968.802176:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3f51 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445dbf expref: 8 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531968.802180:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000032ee36ee, rc 0)
00000100:00100000:0.0:1651531968.802195:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f47fde78 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467564160:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (58us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531968.802198:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44582
00000100:00100000:0.0:1651531968.843266:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531968.843274:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467564544
00000100:00100000:0.0:1651531968.843290:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250167
00000100:00100000:0.0:1651531968.843291:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000065be21ea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467564544:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531968.843299:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca3f58 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.843302:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531968.843303:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531968.843304:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca3f58 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [856064->860159] (req 856064->860159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.843308:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca3f58 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [856064->860159] (req 856064->860159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.843319:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca3f58 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [856064->860159] (req 856064->860159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.843322:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca3f58 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [856064->860159] (req 856064->860159) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531968.843352:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000065be21ea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467564544:12345-10.240.43.64@tcp:3:fio.0 Request processed in 60us (86us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531968.843355:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250167
00010000:00010000:0.0:1651531968.843362:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca3f58 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [856064->860159] (req 856064->860159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.843366:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000775318ab already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531968.843367:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca3f58 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [856064->860159] (req 856064->860159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.843370:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca3f58 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [856064->860159] (req 856064->860159) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.843374:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca3f58 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [856064->860159] (req 856064->860159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.843377:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca3f58 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [856064->860159] (req 856064->860159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531968.843469:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531968.843478:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467564800
00000100:00100000:0.0:1651531968.843493:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250168
00000100:00100000:0.0:1651531968.843495:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bcdb3319 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467564800:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531968.843502:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca3f5f lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.843507:0:192755:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3f51 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445dbf expref: 8 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531968.843518:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531968.843519:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531968.843519:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca3f5f lrc: 4/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [225280->229375] (req 225280->229375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.843528:0:192755:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3f51 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445dbf expref: 8 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531968.843532:0:192755:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3f51 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445dbf expref: 8 pid: 166113 timeout: 22777 lvb_type: 1
00000100:00100000:0.0:1651531968.843536:0:192755:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000063869776 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0001_UUID:192755:1731745997356288:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531968.843551:0:192755:0:(client.c:2492:ptlrpc_set_wait()) set 00000000cd8a7e69 going to sleep for 6 seconds
00000100:00100000:0.0:1651531968.843723:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531968.843746:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467564928
00000100:00100000:1.0:1651531968.843758:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250169
00000100:00100000:1.0:1651531968.843760:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000be87d738 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754467564928:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531968.843767:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3f66 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.843772:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531968.843772:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531968.843774:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3f66 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [970752->974847] (req 970752->974847) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.843778:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3f66 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [970752->974847] (req 970752->974847) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.843794:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3f66 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [970752->974847] (req 970752->974847) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.843797:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3f66 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [970752->974847] (req 970752->974847) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.843817:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3f66 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [970752->974847] (req 970752->974847) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531968.843818:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000be87d738 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754467564928:12345-10.240.43.64@tcp:3:fio.0 Request processed in 58us (96us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531968.843821:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250169
00010000:00010000:0.0:1651531968.843821:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a8889a80 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531968.843822:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3f66 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [970752->974847] (req 970752->974847) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.843825:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3f66 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [970752->974847] (req 970752->974847) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.843831:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3f66 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [970752->974847] (req 970752->974847) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.843845:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca3f66 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [970752->974847] (req 970752->974847) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531968.843986:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531968.843994:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531968.844004:0:166103:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467564992
00000100:00100000:1.0:1651531968.844008:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467565120
00010000:00010000:0.0:1651531968.844009:0:166103:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3f51 lrc: 5/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445dbf expref: 9 pid: 166113 timeout: 22777 lvb_type: 1
00000100:00100000:0.0:1651531968.844020:0:166103:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 216
00000100:00100000:0.0:1651531968.844022:0:166103:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001304ce4c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754467564992:12345-10.240.43.64@tcp:103:ldlm_bl_02.0
00000100:00100000:1.0:1651531968.844025:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250170
00010000:00010000:0.0:1651531968.844025:0:166103:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00000100:00100000:1.0:1651531968.844027:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002512e905 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438146:x1731754467565120:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531968.844028:0:166103:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3f51 lrc: 5/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445dbf expref: 10 pid: 166113 timeout: 22777 lvb_type: 1
00010000:00010000:0.0:1651531968.844033:0:166103:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3f51 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445dbf expref: 10 pid: 166113 timeout: 22777 lvb_type: 1
00010000:00010000:1.0:1651531968.844034:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3f6d lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.844039:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531968.844040:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531968.844041:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3f6d lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [339968->344063] (req 339968->344063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.844045:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3f6d lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [339968->344063] (req 339968->344063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.844045:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531968.844046:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531968.844047:0:166103:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca3f5f lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [225280->229375] (req 225280->229375) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.844050:0:166103:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca3f5f lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [225280->229375] (req 225280->229375) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.844055:0:166103:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1651531968.844056:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3f6d lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [339968->344063] (req 339968->344063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.844059:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3f6d lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [339968->344063] (req 339968->344063) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531968.844075:0:166103:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001304ce4c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754467564992:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 53us (89us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531968.844078:0:166103:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 216
00000100:00100000:1.0:1651531968.844085:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002512e905 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438146:x1731754467565120:12345-10.240.43.64@tcp:3:fio.0 Request processed in 58us (91us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531968.844088:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250170
00010000:00010000:1.0:1651531968.844096:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3f6d lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [339968->344063] (req 339968->344063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.844096:0:192755:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3f51 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445dbf expref: 8 pid: 166113 timeout: 22777 lvb_type: 1
00010000:00010000:1.0:1651531968.844100:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001e36c601 already unused, calling callback (0000000049fddea7)
00000100:00100000:0.0:1651531968.844100:0:192755:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000063869776 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0001_UUID:192755:1731745997356288:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651531968.844101:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3f6d lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [339968->344063] (req 339968->344063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.844104:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3f6d lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [339968->344063] (req 339968->344063) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.844104:0:192755:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca3f5f lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [225280->229375] (req 225280->229375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.844109:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3f6d lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [339968->344063] (req 339968->344063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.844109:0:192755:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca3f5f lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [225280->229375] (req 225280->229375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.844112:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3f6d lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [339968->344063] (req 339968->344063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.844112:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca3f5f lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [225280->229375] (req 225280->229375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531968.844179:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531968.844219:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467565248
00000100:00100000:1.0:1651531968.844243:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250171
00000100:00100000:1.0:1651531968.844244:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000da31c48f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754467565248:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531968.844251:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3f74 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.844256:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531968.844257:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531968.844258:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3f74 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.844262:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3f74 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651531968.884527:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869301 is committed
00010000:00010000:1.0:1651531968.884549:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3f74 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.884553:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3f74 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.884569:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca3f5f lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [225280->229375] (req 225280->229375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531968.884573:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000da31c48f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467565248:12345-10.240.43.64@tcp:4:fio.0 Request processed in 40328us (40394us total) trans 21474869301 rc 0/0
00000100:00100000:1.0:1651531968.884576:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250171
00010000:00010000:0.0:1651531968.884578:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca3f5f lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [225280->229375] (req 225280->229375) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.884589:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3f74 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.884593:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e9b84540 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531968.884594:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3f74 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531968.884594:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bcdb3319 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438147:x1731754467564800:12345-10.240.43.64@tcp:4:fio.0 Request processed in 41098us (41137us total) trans 21474869300 rc 0/0
00010000:00010000:1.0:1651531968.884597:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3f74 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531968.884597:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250168
00010000:00010000:1.0:1651531968.884602:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3f74 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.884605:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca3f5f lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [225280->229375] (req 225280->229375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.884609:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3f74 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.884622:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000014685f38 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531968.884623:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca3f5f lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [225280->229375] (req 225280->229375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.884626:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca3f5f lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [225280->229375] (req 225280->229375) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.884631:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca3f5f lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [225280->229375] (req 225280->229375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.884634:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca3f5f lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [225280->229375] (req 225280->229375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531968.885194:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531968.885209:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531968.885236:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467565760
00000100:00100000:1.0:1651531968.885239:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467565696
00000100:00100000:0.0:1651531968.885251:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250172
00000100:00100000:0.0:1651531968.885258:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000137fd3d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467565760:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651531968.885260:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250173
00000100:00100000:1.0:1651531968.885262:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003a5ac9b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467565696:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531968.885266:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3f7b lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.885270:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3f82 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.885270:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531968.885271:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531968.885272:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3f7b lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [593920->598015] (req 593920->598015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.885276:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531968.885276:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3f7b lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [593920->598015] (req 593920->598015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.885277:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531968.885278:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3f82 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [4096->8191] (req 4096->8191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.885282:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3f82 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [4096->8191] (req 4096->8191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.885294:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3f82 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [4096->8191] (req 4096->8191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.885297:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3f82 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [4096->8191] (req 4096->8191) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531968.885312:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003a5ac9b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467565696:12345-10.240.43.64@tcp:3:fio.0 Request processed in 49us (103us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531968.885315:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250173
00010000:00010000:1.0:1651531968.885332:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3f82 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [4096->8191] (req 4096->8191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.885335:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001e36c601 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531968.885336:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3f82 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [4096->8191] (req 4096->8191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.885339:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3f82 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [4096->8191] (req 4096->8191) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.885344:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3f82 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [4096->8191] (req 4096->8191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.885347:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3f82 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [4096->8191] (req 4096->8191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531968.885627:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531968.885645:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467566080
00000100:00100000:0.0:1651531968.885665:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44583
00000100:00100000:0.0:1651531968.885667:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f05c0b82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438148:x1731754467566080:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531968.885671:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531968.885674:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca3f89 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445dcd expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.885682:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca3f89 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445dcd expref: 11 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531968.885687:0:166111:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca3f89 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445dcd expref: 11 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531968.885690:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000775318ab, rc 0)
00000100:00100000:0.0:1651531968.885702:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f05c0b82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438148:x1731754467566080:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (75us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531968.885704:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44583
00000100:00100000:1.0:1651531968.886510:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531968.886518:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467566464
00000100:00100000:1.0:1651531968.886533:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250174
00000100:00100000:1.0:1651531968.886535:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000880cd1d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754467566464:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531968.886543:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3f90 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.886547:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531968.886547:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531968.886548:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3f90 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [159744->163839] (req 159744->163839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.886552:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3f90 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [159744->163839] (req 159744->163839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.886572:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3f90 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [159744->163839] (req 159744->163839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.886575:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3f90 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [159744->163839] (req 159744->163839) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531968.886595:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000880cd1d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754467566464:12345-10.240.43.64@tcp:3:fio.0 Request processed in 59us (85us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531968.886598:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250174
00010000:00010000:1.0:1651531968.886604:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3f90 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [159744->163839] (req 159744->163839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.886608:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000968553c1 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531968.886609:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3f90 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [159744->163839] (req 159744->163839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.886612:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3f90 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [159744->163839] (req 159744->163839) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.886616:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3f90 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [159744->163839] (req 159744->163839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.886619:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3f90 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [159744->163839] (req 159744->163839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531968.886948:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531968.886956:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467566592
00000100:00100000:1.0:1651531968.886980:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250175
00000100:00100000:1.0:1651531968.886982:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b338475a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438148:x1731754467566592:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531968.886989:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3f97 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.886993:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531968.886993:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531968.886994:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3f97 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [958464->962559] (req 958464->962559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.886998:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3f97 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [958464->962559] (req 958464->962559) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.887008:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3f97 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [958464->962559] (req 958464->962559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.887011:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3f97 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [958464->962559] (req 958464->962559) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531968.887031:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b338475a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438148:x1731754467566592:12345-10.240.43.64@tcp:3:fio.0 Request processed in 48us (83us total) trans 0 rc 4096/4096
00010000:00010000:0.0:1651531968.887033:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3f97 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [958464->962559] (req 958464->962559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531968.887034:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250175
00010000:00010000:0.0:1651531968.887038:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d44eb74d already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531968.887039:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3f97 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [958464->962559] (req 958464->962559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.887042:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3f97 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [958464->962559] (req 958464->962559) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.887048:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3f97 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [958464->962559] (req 958464->962559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.887060:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca3f97 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [958464->962559] (req 958464->962559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531968.887375:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531968.887383:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467566720
00000100:00100000:1.0:1651531968.887395:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250176
00000100:00100000:1.0:1651531968.887396:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006c903446 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754467566720:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531968.887403:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3f9e lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.887418:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531968.887419:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531968.887419:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3f9e lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [425984->430079] (req 425984->430079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.887423:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3f9e lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [425984->430079] (req 425984->430079) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.887434:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3f9e lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [425984->430079] (req 425984->430079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.887437:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3f9e lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [425984->430079] (req 425984->430079) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531968.887454:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006c903446 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754467566720:12345-10.240.43.64@tcp:3:fio.0 Request processed in 57us (79us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531968.887457:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250176
00010000:00010000:1.0:1651531968.887464:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3f9e lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [425984->430079] (req 425984->430079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.887467:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c2b76533 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531968.887468:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3f9e lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [425984->430079] (req 425984->430079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.887471:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3f9e lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [425984->430079] (req 425984->430079) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.887483:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3f9e lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [425984->430079] (req 425984->430079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.887494:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3f9e lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [425984->430079] (req 425984->430079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531968.887790:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531968.887808:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467566848
00000100:00100000:0.0:1651531968.887818:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44584
00000100:00100000:0.0:1651531968.887820:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001eda4376 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438148:x1731754467566848:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531968.887823:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531968.887827:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3fa5 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445ddb expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.887834:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3fa5 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445ddb expref: 11 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531968.887838:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3fa5 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445ddb expref: 11 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531968.887842:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000075a78972, rc 0)
00000100:00100000:0.0:1651531968.887852:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001eda4376 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438148:x1731754467566848:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (62us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531968.887855:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44584
00000100:00100000:1.0:1651531968.888552:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531968.888560:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467567104
00000100:00100000:1.0:1651531968.888574:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250177
00000100:00100000:1.0:1651531968.888576:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e15376c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754467567104:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531968.888583:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3fac lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.888587:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531968.888588:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531968.888589:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3fac lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.888592:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3fac lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.888603:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3fac lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.888606:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3fac lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531968.888625:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e15376c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754467567104:12345-10.240.43.64@tcp:3:fio.0 Request processed in 48us (73us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531968.888637:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250177
00010000:00010000:1.0:1651531968.888644:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3fac lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.888647:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e9b84540 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531968.888648:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3fac lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.888659:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3fac lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.888664:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3fac lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.888667:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3fac lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651531968.955842:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869302 is committed
00010000:00010000:0.0:1651531968.955873:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3f7b lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [593920->598015] (req 593920->598015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.955877:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3f7b lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [593920->598015] (req 593920->598015) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531968.955915:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000137fd3d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438148:x1731754467565760:12345-10.240.43.64@tcp:4:fio.0 Request processed in 70660us (70720us total) trans 21474869302 rc 0/0
00000100:00100000:0.0:1651531968.955918:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250172
00010000:00010000:0.0:1651531968.955926:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3f7b lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [593920->598015] (req 593920->598015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.955930:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000032ee36ee already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531968.955931:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3f7b lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [593920->598015] (req 593920->598015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.955934:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3f7b lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [593920->598015] (req 593920->598015) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.955939:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3f7b lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [593920->598015] (req 593920->598015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.955942:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca3f7b lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [593920->598015] (req 593920->598015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531968.956279:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531968.956288:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467567488
00000100:00100000:0.0:1651531968.956306:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250178
00000100:00100000:0.0:1651531968.956308:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000063869776 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438146:x1731754467567488:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531968.956315:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3fb3 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.956319:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531968.956329:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531968.956330:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3fb3 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [122880->126975] (req 122880->126975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.956335:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3fb3 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [122880->126975] (req 122880->126975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.956347:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3fb3 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [122880->126975] (req 122880->126975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.956351:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3fb3 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [122880->126975] (req 122880->126975) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531968.956370:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000063869776 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438146:x1731754467567488:12345-10.240.43.64@tcp:3:fio.0 Request processed in 61us (91us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531968.956373:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250178
00010000:00010000:1.0:1651531968.956374:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3fb3 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [122880->126975] (req 122880->126975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.956380:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000075a78972 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531968.956382:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3fb3 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [122880->126975] (req 122880->126975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.956386:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3fb3 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [122880->126975] (req 122880->126975) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.956404:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3fb3 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [122880->126975] (req 122880->126975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.956407:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca3fb3 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [122880->126975] (req 122880->126975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531968.957136:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531968.957145:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467567872
00000100:00100000:0.0:1651531968.957160:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250179
00000100:00100000:0.0:1651531968.957161:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d710c5fd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438149:x1731754467567872:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531968.957168:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca3fba lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.957172:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531968.957173:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531968.957174:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca3fba lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [622592->626687] (req 622592->626687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531968.957178:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca3fba lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [622592->626687] (req 622592->626687) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531968.957559:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531968.957569:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467568128
00000100:00100000:1.0:1651531968.957586:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250180
00000100:00100000:1.0:1651531968.957589:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c4db449c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438148:x1731754467568128:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531968.957597:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3fc1 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.957601:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531968.957602:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531968.957603:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3fc1 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [126976->131071] (req 126976->131071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.957608:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3fc1 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [126976->131071] (req 126976->131071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.957621:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3fc1 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [126976->131071] (req 126976->131071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.957624:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3fc1 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [126976->131071] (req 126976->131071) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531968.957646:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c4db449c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438148:x1731754467568128:12345-10.240.43.64@tcp:3:fio.0 Request processed in 56us (88us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531968.957657:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250180
00010000:00010000:1.0:1651531968.957665:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3fc1 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [126976->131071] (req 126976->131071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.957669:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e9b84540 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531968.957670:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3fc1 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [126976->131071] (req 126976->131071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.957673:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3fc1 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [126976->131071] (req 126976->131071) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.957687:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3fc1 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [126976->131071] (req 126976->131071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531968.957690:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3fc1 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [126976->131071] (req 126976->131071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531969.014120:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531969.014130:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467568384
00000100:00100000:1.0:1651531969.014146:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250181
00000100:00100000:1.0:1651531969.014149:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000530f55ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438147:x1731754467568384:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531969.014157:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3fc8 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.014161:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531969.014162:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531969.014163:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3fc8 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [884736->888831] (req 884736->888831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.014178:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3fc8 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [884736->888831] (req 884736->888831) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651531969.024793:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869303 is committed
00002000:00010000:0.0:1651531969.024826:0:192755:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x34545:0x0] updating lvb mtime from disk: 1651531968 -> 1651531969
00002000:00010000:0.0:1651531969.024828:0:192755:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x34545:0x0] updating lvb ctime from disk: 1651531968 -> 1651531969
00010000:00010000:0.0:1651531969.024830:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca3fba lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [622592->626687] (req 622592->626687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.024834:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca3fba lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [622592->626687] (req 622592->626687) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531969.024852:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d710c5fd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754467567872:12345-10.240.43.64@tcp:4:fio.0 Request processed in 67689us (67716us total) trans 21474869303 rc 0/0
00000100:00100000:0.0:1651531969.024855:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250179
00010000:00010000:0.0:1651531969.024862:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca3fba lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [622592->626687] (req 622592->626687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.024866:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000775318ab already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531969.024867:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca3fba lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [622592->626687] (req 622592->626687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.024870:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca3fba lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [622592->626687] (req 622592->626687) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.024875:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca3fba lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [622592->626687] (req 622592->626687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.024878:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca3fba lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [622592->626687] (req 622592->626687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531969.050361:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531969.050370:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467568704
00000100:00100000:0.0:1651531969.050384:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250182
00000100:00100000:0.0:1651531969.050385:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b6b1b79d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438148:x1731754467568704:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651531969.050388:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651531969.050394:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca3fcf lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531969.050397:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467568640
00010000:00010000:0.0:1651531969.050398:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531969.050399:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531969.050400:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca3fcf lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [8192->12287] (req 8192->12287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.050404:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca3fcf lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [8192->12287] (req 8192->12287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531969.050408:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250183
00000100:00100000:1.0:1651531969.050410:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006a8dcc9d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754467568640:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531969.050416:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca3fcf lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [8192->12287] (req 8192->12287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.050418:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3fd6 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.050419:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca3fcf lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [8192->12287] (req 8192->12287) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.050423:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531969.050424:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531969.050425:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3fd6 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [737280->741375] (req 737280->741375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.050436:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3fd6 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [737280->741375] (req 737280->741375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531969.050440:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b6b1b79d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754467568704:12345-10.240.43.64@tcp:3:fio.0 Request processed in 54us (80us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531969.050443:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250182
00010000:00010000:0.0:1651531969.050478:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca3fcf lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [8192->12287] (req 8192->12287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.050482:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000775318ab already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531969.050493:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca3fcf lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [8192->12287] (req 8192->12287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.050498:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca3fcf lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [8192->12287] (req 8192->12287) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.050507:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca3fcf lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [8192->12287] (req 8192->12287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.050511:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca3fcf lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [8192->12287] (req 8192->12287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651531969.085524:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869304 is committed
00010000:00010000:1.0:1651531969.085566:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3fc8 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [884736->888831] (req 884736->888831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.085571:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3fc8 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [884736->888831] (req 884736->888831) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531969.085593:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000530f55ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438147:x1731754467568384:12345-10.240.43.64@tcp:4:fio.0 Request processed in 71443us (71474us total) trans 21474869304 rc 0/0
00000100:00100000:1.0:1651531969.085605:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250181
00010000:00010000:1.0:1651531969.085614:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3fc8 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [884736->888831] (req 884736->888831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.085617:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e9b84540 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531969.085618:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3fc8 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [884736->888831] (req 884736->888831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.085635:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3fc8 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [884736->888831] (req 884736->888831) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.085641:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3fc8 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [884736->888831] (req 884736->888831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.085644:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3fc8 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [884736->888831] (req 884736->888831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531969.085966:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531969.085976:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467569024
00000100:00100000:1.0:1651531969.085986:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250184
00000100:00100000:1.0:1651531969.085988:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009e786cd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438146:x1731754467569024:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531969.085995:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3fdd lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.085999:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531969.086000:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531969.086001:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3fdd lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [835584->839679] (req 835584->839679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.086016:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3fdd lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [835584->839679] (req 835584->839679) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531969.097996:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531969.098021:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467569152
00000100:00100000:1.0:1651531969.098038:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250185
00000100:00100000:1.0:1651531969.098040:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000374facb9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467569152:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531969.098047:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3fe4 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.098052:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531969.098052:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531969.098053:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3fe4 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [401408->405503] (req 401408->405503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.098057:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3fe4 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [401408->405503] (req 401408->405503) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.098070:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3fe4 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [401408->405503] (req 401408->405503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.098073:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3fe4 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [401408->405503] (req 401408->405503) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.098091:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3fe4 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [401408->405503] (req 401408->405503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531969.098095:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000374facb9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467569152:12345-10.240.43.64@tcp:3:fio.0 Request processed in 54us (100us total) trans 0 rc 4096/4096
00010000:00010000:0.0:1651531969.098096:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e9b84540 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531969.098097:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3fe4 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [401408->405503] (req 401408->405503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531969.098098:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250185
00010000:00010000:0.0:1651531969.098101:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3fe4 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [401408->405503] (req 401408->405503) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.098106:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3fe4 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [401408->405503] (req 401408->405503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.098109:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca3fe4 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [401408->405503] (req 401408->405503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651531969.134585:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869305 is committed
00010000:00010000:1.0:1651531969.134638:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3fd6 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [737280->741375] (req 737280->741375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.134642:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3fd6 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [737280->741375] (req 737280->741375) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531969.134662:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006a8dcc9d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438148:x1731754467568640:12345-10.240.43.64@tcp:4:fio.0 Request processed in 84251us (84275us total) trans 21474869305 rc 0/0
00000100:00100000:1.0:1651531969.134666:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250183
00010000:00010000:0.0:1651531969.134676:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3fd6 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [737280->741375] (req 737280->741375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.134696:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c2b76533 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531969.134698:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3fd6 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [737280->741375] (req 737280->741375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.134704:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3fd6 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [737280->741375] (req 737280->741375) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.134714:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3fd6 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [737280->741375] (req 737280->741375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.134718:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca3fd6 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [737280->741375] (req 737280->741375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531969.147071:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531969.147080:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467569536
00000100:00100000:1.0:1651531969.147090:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250186
00000100:00100000:1.0:1651531969.147092:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000082a985f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438146:x1731754467569536:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531969.147100:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3feb lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.147104:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531969.147105:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531969.147106:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3feb lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [77824->81919] (req 77824->81919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.147110:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3feb lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [77824->81919] (req 77824->81919) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.147123:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3feb lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [77824->81919] (req 77824->81919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.147126:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3feb lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [77824->81919] (req 77824->81919) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531969.147154:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000082a985f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438146:x1731754467569536:12345-10.240.43.64@tcp:3:fio.0 Request processed in 61us (83us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531969.147157:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250186
00010000:00010000:1.0:1651531969.147164:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3feb lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [77824->81919] (req 77824->81919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.147167:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001e36c601 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531969.147168:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3feb lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [77824->81919] (req 77824->81919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.147171:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3feb lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [77824->81919] (req 77824->81919) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.147176:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3feb lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [77824->81919] (req 77824->81919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.147178:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3feb lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [77824->81919] (req 77824->81919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651531969.182370:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869306 is committed
00010000:00010000:1.0:1651531969.182385:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3fdd lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [835584->839679] (req 835584->839679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.182389:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3fdd lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [835584->839679] (req 835584->839679) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531969.182411:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009e786cd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438146:x1731754467569024:12345-10.240.43.64@tcp:4:fio.0 Request processed in 96422us (96445us total) trans 21474869306 rc 0/0
00010000:00010000:0.0:1651531969.182416:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3fdd lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [835584->839679] (req 835584->839679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.182421:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000968553c1 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531969.182422:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3fdd lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [835584->839679] (req 835584->839679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531969.182423:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250184
00010000:00010000:0.0:1651531969.182425:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3fdd lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [835584->839679] (req 835584->839679) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.182431:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3fdd lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [835584->839679] (req 835584->839679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.182434:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca3fdd lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [835584->839679] (req 835584->839679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531969.182741:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531969.182750:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467569792
00000100:00100000:1.0:1651531969.182760:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250187
00000100:00100000:1.0:1651531969.182762:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005508963a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438147:x1731754467569792:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531969.182769:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3ff2 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.182773:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531969.182774:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531969.182775:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3ff2 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [499712->503807] (req 499712->503807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.182779:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3ff2 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [499712->503807] (req 499712->503807) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531969.183631:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531969.183640:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467569920
00000100:00100000:1.0:1651531969.183650:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250188
00000100:00100000:1.0:1651531969.183652:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000017b5519b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438148:x1731754467569920:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531969.183659:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca3ff9 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.183663:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531969.183663:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531969.183664:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca3ff9 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [520192->827391] (req 520192->827391) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.183679:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca3ff9 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [520192->827391] (req 520192->827391) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.183908:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca3ff9 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [520192->827391] (req 520192->827391) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.183912:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca3ff9 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [520192->827391] (req 520192->827391) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.183931:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca3ff9 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [520192->827391] (req 520192->827391) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531969.183932:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000017b5519b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438148:x1731754467569920:12345-10.240.43.64@tcp:3:fio.0 Request processed in 280us (302us total) trans 0 rc 8192/8192
00000100:00100000:1.0:1651531969.183935:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250188
00010000:00010000:0.0:1651531969.183936:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b4c8742a already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531969.183937:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca3ff9 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [520192->827391] (req 520192->827391) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.183940:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca3ff9 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [520192->827391] (req 520192->827391) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.183946:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca3ff9 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [520192->827391] (req 520192->827391) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.183949:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca3ff9 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [520192->827391] (req 520192->827391) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651531969.207885:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869307 is committed
00010000:00010000:1.0:1651531969.207899:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3ff2 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [499712->503807] (req 499712->503807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.207903:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3ff2 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [499712->503807] (req 499712->503807) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531969.207918:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005508963a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438147:x1731754467569792:12345-10.240.43.64@tcp:4:fio.0 Request processed in 25155us (25178us total) trans 21474869307 rc 0/0
00000100:00100000:1.0:1651531969.207921:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250187
00010000:00010000:1.0:1651531969.207928:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3ff2 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [499712->503807] (req 499712->503807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.207931:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001e36c601 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531969.207932:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3ff2 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [499712->503807] (req 499712->503807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.207945:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3ff2 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [499712->503807] (req 499712->503807) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.207950:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3ff2 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [499712->503807] (req 499712->503807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.207953:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca3ff2 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [499712->503807] (req 499712->503807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531969.256926:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531969.256935:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467570880
00000100:00100000:1.0:1651531969.256945:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250189
00000100:00100000:1.0:1651531969.256947:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d349b145 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438148:x1731754467570880:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531969.256963:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4000 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.256967:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531969.256967:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531969.256968:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4000 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [200704->204799] (req 200704->204799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.256972:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4000 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [200704->204799] (req 200704->204799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.256985:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4000 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [200704->204799] (req 200704->204799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.256988:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4000 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [200704->204799] (req 200704->204799) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531969.257015:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d349b145 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438148:x1731754467570880:12345-10.240.43.64@tcp:3:fio.0 Request processed in 66us (89us total) trans 0 rc 4096/4096
00010000:00010000:0.0:1651531969.257017:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4000 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [200704->204799] (req 200704->204799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531969.257018:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250189
00010000:00010000:0.0:1651531969.257022:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001e36c601 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531969.257023:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4000 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [200704->204799] (req 200704->204799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.257027:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4000 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [200704->204799] (req 200704->204799) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.257032:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4000 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [200704->204799] (req 200704->204799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.257044:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4000 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [200704->204799] (req 200704->204799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531969.296855:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531969.296876:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467571392
00000100:00100000:1.0:1651531969.296887:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250190
00000100:00100000:1.0:1651531969.296889:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000765f877 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438146:x1731754467571392:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531969.296896:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4007 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.296900:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531969.296900:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531969.296901:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4007 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [462848->466943] (req 462848->466943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.296905:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4007 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [462848->466943] (req 462848->466943) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531969.296974:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531969.297009:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467571520
00000100:00100000:0.0:1651531969.297027:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44585
00000100:00100000:0.0:1651531969.297030:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007a6934a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754467571520:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531969.297036:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531969.297042:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca400e lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445de9 expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.297055:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca400e lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445de9 expref: 11 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531969.297060:0:166111:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca400e lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445de9 expref: 11 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531969.297064:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000775318ab, rc 0)
00000100:00100000:0.0:1651531969.297082:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007a6934a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754467571520:12345-10.240.43.64@tcp:101:fio.0 Request processed in 52us (108us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531969.297085:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44585
00000100:00100000:1.0:1651531969.298009:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531969.298017:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467571968
00000100:00100000:1.0:1651531969.298027:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250191
00000100:00100000:1.0:1651531969.298029:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ac499271 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438148:x1731754467571968:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531969.298037:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4015 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.298046:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531969.298046:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531969.298047:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4015 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [499712->503807] (req 499712->503807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.298051:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4015 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [499712->503807] (req 499712->503807) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.298062:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4015 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [499712->503807] (req 499712->503807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.298065:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4015 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [499712->503807] (req 499712->503807) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.298086:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4015 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [499712->503807] (req 499712->503807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531969.298087:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ac499271 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438148:x1731754467571968:12345-10.240.43.64@tcp:3:fio.0 Request processed in 57us (79us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531969.298090:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250191
00010000:00010000:0.0:1651531969.298090:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008558d1b3 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531969.298091:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4015 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [499712->503807] (req 499712->503807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.298104:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4015 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [499712->503807] (req 499712->503807) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.298110:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4015 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [499712->503807] (req 499712->503807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.298113:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4015 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [499712->503807] (req 499712->503807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531969.334319:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531969.334332:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531969.334340:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467572352
00000100:00100000:0.0:1651531969.334343:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467572288
00000100:00100000:1.0:1651531969.334350:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250192
00000100:00100000:1.0:1651531969.334352:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000503404b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438147:x1731754467572352:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651531969.334354:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44586
00000100:00100000:0.0:1651531969.334356:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cb76f437 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754467572288:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531969.334360:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca401c lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.334360:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531969.334364:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531969.334364:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531969.334364:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca4023 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445df7 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.334374:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca401c lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [622592->626687] (req 622592->626687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.334378:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca401c lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [622592->626687] (req 622592->626687) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.334381:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca4023 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445df7 expref: 12 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531969.334385:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca4023 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445df7 expref: 12 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531969.334389:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000775318ab, rc 0)
00010000:00010000:1.0:1651531969.334391:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca401c lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [622592->626687] (req 622592->626687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.334394:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca401c lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [622592->626687] (req 622592->626687) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531969.334403:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cb76f437 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754467572288:12345-10.240.43.64@tcp:101:fio.0 Request processed in 47us (85us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531969.334406:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44586
00000100:00100000:1.0:1651531969.334415:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000503404b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438147:x1731754467572352:12345-10.240.43.64@tcp:3:fio.0 Request processed in 62us (83us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531969.334418:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250192
00010000:00010000:1.0:1651531969.334425:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca401c lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [622592->626687] (req 622592->626687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.334429:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008558d1b3 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531969.334430:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca401c lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [622592->626687] (req 622592->626687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.334433:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca401c lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [622592->626687] (req 622592->626687) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.334437:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca401c lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [622592->626687] (req 622592->626687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.334440:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca401c lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [622592->626687] (req 622592->626687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531969.334716:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531969.334724:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467572544
00000100:00100000:1.0:1651531969.334733:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250193
00000100:00100000:1.0:1651531969.334735:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007dc97d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438146:x1731754467572544:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531969.334741:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca402a lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.334745:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531969.334746:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531969.334747:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca402a lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [200704->204799] (req 200704->204799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.334751:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca402a lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [200704->204799] (req 200704->204799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.334761:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca402a lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [200704->204799] (req 200704->204799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.334764:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca402a lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [200704->204799] (req 200704->204799) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531969.334786:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007dc97d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438146:x1731754467572544:12345-10.240.43.64@tcp:3:fio.0 Request processed in 51us (70us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531969.334789:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250193
00010000:00010000:0.0:1651531969.334789:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca402a lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [200704->204799] (req 200704->204799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.334793:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001e36c601 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531969.334794:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca402a lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [200704->204799] (req 200704->204799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.334798:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca402a lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [200704->204799] (req 200704->204799) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.334803:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca402a lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [200704->204799] (req 200704->204799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.334806:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca402a lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [200704->204799] (req 200704->204799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531969.335134:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531969.335141:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467572864
00000100:00100000:1.0:1651531969.335150:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250194
00000100:00100000:1.0:1651531969.335161:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f148f36a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438147:x1731754467572864:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531969.335168:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4031 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.335172:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531969.335172:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531969.335173:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4031 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [118784->122879] (req 118784->122879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.335177:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4031 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [118784->122879] (req 118784->122879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.335187:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4031 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [118784->122879] (req 118784->122879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.335190:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4031 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [118784->122879] (req 118784->122879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.335203:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4031 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [118784->122879] (req 118784->122879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531969.335209:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f148f36a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438147:x1731754467572864:12345-10.240.43.64@tcp:3:fio.0 Request processed in 47us (75us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531969.335220:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250194
00010000:00010000:0.0:1651531969.335221:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b4c8742a already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531969.335234:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4031 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [118784->122879] (req 118784->122879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.335238:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4031 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [118784->122879] (req 118784->122879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.335243:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4031 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [118784->122879] (req 118784->122879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.335245:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4031 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [118784->122879] (req 118784->122879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531969.335573:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531969.335582:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467572992
00000100:00100000:1.0:1651531969.335590:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250195
00000100:00100000:1.0:1651531969.335592:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d5703b86 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438146:x1731754467572992:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531969.335599:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4038 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.335613:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531969.335613:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531969.335614:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4038 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [176128->180223] (req 176128->180223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.335618:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4038 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [176128->180223] (req 176128->180223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651531969.369438:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869308 is committed
00010000:00010000:1.0:1651531969.369486:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4007 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [462848->466943] (req 462848->466943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.369492:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4007 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [462848->466943] (req 462848->466943) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531969.369516:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000765f877 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438146:x1731754467571392:12345-10.240.43.64@tcp:4:fio.0 Request processed in 72625us (72661us total) trans 21474869308 rc 0/0
00000100:00100000:1.0:1651531969.369520:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250190
00010000:00010000:1.0:1651531969.369528:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4007 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [462848->466943] (req 462848->466943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.369532:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006da7a892 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531969.369533:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4007 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [462848->466943] (req 462848->466943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.369536:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4007 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [462848->466943] (req 462848->466943) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.369567:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4007 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [462848->466943] (req 462848->466943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.369578:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4007 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [462848->466943] (req 462848->466943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531969.370334:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531969.370344:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467573248
00000100:00100000:1.0:1651531969.370356:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250196
00000100:00100000:1.0:1651531969.370358:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438146:x1731754467573248:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531969.370365:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca403f lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.370370:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531969.370370:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531969.370371:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca403f lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [786432->790527] (req 786432->790527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.370376:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca403f lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [786432->790527] (req 786432->790527) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531969.381939:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531969.381961:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467573376
00000100:00100000:1.0:1651531969.381978:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250197
00000100:00100000:1.0:1651531969.381980:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009b569a7a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754467573376:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531969.381988:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4046 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.382004:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531969.382005:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531969.382006:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4046 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [385024->389119] (req 385024->389119) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.382010:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4046 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [385024->389119] (req 385024->389119) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651531969.417189:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869309 is committed
00010000:00010000:0.0:1651531969.417246:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4038 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [176128->180223] (req 176128->180223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.417251:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4038 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [176128->180223] (req 176128->180223) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531969.417285:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d5703b86 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467572992:12345-10.240.43.64@tcp:4:fio.0 Request processed in 81691us (81711us total) trans 21474869309 rc 0/0
00000100:00100000:0.0:1651531969.417291:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250195
00010000:00010000:0.0:1651531969.417302:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4038 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [176128->180223] (req 176128->180223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.417307:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000968553c1 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531969.417309:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4038 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [176128->180223] (req 176128->180223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.417314:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4038 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [176128->180223] (req 176128->180223) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.417324:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4038 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [176128->180223] (req 176128->180223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.417330:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4038 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [176128->180223] (req 176128->180223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531969.417574:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531969.417594:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467573504
00000100:00100000:0.0:1651531969.417606:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250198
00000100:00100000:0.0:1651531969.417608:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000052213cb9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467573504:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531969.417616:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca404d lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.417620:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531969.417621:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531969.417622:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca404d lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [196608->200703] (req 196608->200703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.417626:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca404d lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [196608->200703] (req 196608->200703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.417638:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca404d lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [196608->200703] (req 196608->200703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.417641:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca404d lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [196608->200703] (req 196608->200703) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531969.417663:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000052213cb9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467573504:12345-10.240.43.64@tcp:3:fio.0 Request processed in 55us (89us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531969.417666:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250198
00010000:00010000:0.0:1651531969.417674:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca404d lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [196608->200703] (req 196608->200703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.417677:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000775318ab already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531969.417679:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca404d lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [196608->200703] (req 196608->200703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.417693:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca404d lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [196608->200703] (req 196608->200703) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.417698:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca404d lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [196608->200703] (req 196608->200703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.417701:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca404d lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [196608->200703] (req 196608->200703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531969.417990:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531969.417998:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467573632
00000100:00100000:0.0:1651531969.418006:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44587
00000100:00100000:0.0:1651531969.418007:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002ef35a72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467573632:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531969.418011:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531969.418015:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4054 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445e05 expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.418023:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4054 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445e05 expref: 14 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531969.418027:0:166111:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4054 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445e05 expref: 14 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531969.418031:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000032ee36ee, rc 0)
00000100:00100000:0.0:1651531969.418046:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002ef35a72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467573632:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (57us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531969.418058:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44587
00000100:00100000:0.0:1651531969.430503:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531969.430535:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467574016
00000100:00100000:1.0:1651531969.430554:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250199
00000100:00100000:1.0:1651531969.430556:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000df1eb0d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467574016:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531969.430566:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca405b lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.430571:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531969.430572:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531969.430573:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca405b lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [131072->135167] (req 131072->135167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.430577:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca405b lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [131072->135167] (req 131072->135167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.430612:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca405b lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [131072->135167] (req 131072->135167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.430616:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca405b lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [131072->135167] (req 131072->135167) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531969.430647:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000df1eb0d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467574016:12345-10.240.43.64@tcp:3:fio.0 Request processed in 89us (144us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531969.430650:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250199
00010000:00010000:1.0:1651531969.430658:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca405b lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [131072->135167] (req 131072->135167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.430661:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c2b76533 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531969.430662:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca405b lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [131072->135167] (req 131072->135167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.430665:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca405b lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [131072->135167] (req 131072->135167) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.430670:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca405b lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [131072->135167] (req 131072->135167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.430673:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca405b lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [131072->135167] (req 131072->135167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531969.431033:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531969.431044:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467574144
00000100:00100000:1.0:1651531969.431059:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250200
00000100:00100000:1.0:1651531969.431061:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ffcdece2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754467574144:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531969.431068:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca4062 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.431072:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531969.431081:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531969.431082:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca4062 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [24576->28671] (req 24576->28671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.431087:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca4062 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [24576->28671] (req 24576->28671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651531969.455154:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869311 is committed
00010000:00010000:1.0:1651531969.455198:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4046 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [385024->389119] (req 385024->389119) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.455203:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4046 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [385024->389119] (req 385024->389119) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.455234:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4046 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [385024->389119] (req 385024->389119) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.455239:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006da7a892 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531969.455241:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4046 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [385024->389119] (req 385024->389119) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531969.455244:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009b569a7a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754467573376:12345-10.240.43.64@tcp:4:fio.0 Request processed in 73262us (73305us total) trans 21474869311 rc 0/0
00010000:00010000:0.0:1651531969.455244:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4046 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [385024->389119] (req 385024->389119) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531969.455247:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250197
00010000:00010000:0.0:1651531969.455250:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4046 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [385024->389119] (req 385024->389119) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.455253:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4046 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [385024->389119] (req 385024->389119) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.455271:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca403f lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [786432->790527] (req 786432->790527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.455275:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca403f lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [786432->790527] (req 786432->790527) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531969.455290:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438146:x1731754467573248:12345-10.240.43.64@tcp:4:fio.0 Request processed in 84932us (84956us total) trans 21474869310 rc 0/0
00000100:00100000:0.0:1651531969.455294:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250196
00010000:00010000:0.0:1651531969.455302:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca403f lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [786432->790527] (req 786432->790527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.455306:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008558d1b3 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531969.455307:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca403f lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [786432->790527] (req 786432->790527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.455309:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca403f lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [786432->790527] (req 786432->790527) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.455314:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca403f lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [786432->790527] (req 786432->790527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.455316:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca403f lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [786432->790527] (req 786432->790527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531969.456818:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531969.456827:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467574784
00000100:00100000:0.0:1651531969.456844:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250201
00000100:00100000:0.0:1651531969.456846:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000053497d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754467574784:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531969.456854:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4069 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.456858:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531969.456859:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531969.456860:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4069 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [892928->897023] (req 892928->897023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.456864:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4069 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [892928->897023] (req 892928->897023) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.456878:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4069 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [892928->897023] (req 892928->897023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.456881:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4069 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [892928->897023] (req 892928->897023) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531969.456900:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000053497d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754467574784:12345-10.240.43.64@tcp:3:fio.0 Request processed in 53us (82us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531969.456903:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250201
00010000:00010000:1.0:1651531969.456904:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4069 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [892928->897023] (req 892928->897023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.456908:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000032ee36ee already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531969.456910:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4069 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [892928->897023] (req 892928->897023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.456913:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4069 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [892928->897023] (req 892928->897023) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.456919:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4069 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [892928->897023] (req 892928->897023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.456933:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4069 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [892928->897023] (req 892928->897023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651531969.502883:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869312 is committed
00010000:00010000:0.0:1651531969.502915:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca4062 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [24576->28671] (req 24576->28671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.502919:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca4062 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [24576->28671] (req 24576->28671) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531969.502934:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ffcdece2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438148:x1731754467574144:12345-10.240.43.64@tcp:4:fio.0 Request processed in 71872us (71902us total) trans 21474869312 rc 0/0
00000100:00100000:0.0:1651531969.502937:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250200
00010000:00010000:0.0:1651531969.502944:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca4062 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [24576->28671] (req 24576->28671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.502947:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e9b84540 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531969.502948:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca4062 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [24576->28671] (req 24576->28671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.502951:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca4062 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [24576->28671] (req 24576->28671) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.502960:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca4062 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [24576->28671] (req 24576->28671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.502963:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca4062 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [24576->28671] (req 24576->28671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531969.503650:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531969.503659:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467575296
00000100:00100000:0.0:1651531969.503669:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250202
00000100:00100000:0.0:1651531969.503671:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007d76765b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438149:x1731754467575296:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531969.503678:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca4070 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.503682:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531969.503683:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531969.503684:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca4070 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [684032->688127] (req 684032->688127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.503688:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca4070 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [684032->688127] (req 684032->688127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531969.516886:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531969.516895:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467575552
00000100:00100000:0.0:1651531969.516903:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44588
00000100:00100000:0.0:1651531969.516905:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000942b56fd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438146:x1731754467575552:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531969.516909:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531969.516912:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca4077 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445e13 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.516932:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca4077 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445e13 expref: 11 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531969.516936:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca4077 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445e13 expref: 11 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531969.516940:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000014685f38, rc 0)
00000100:00100000:0.0:1651531969.516950:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000942b56fd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438146:x1731754467575552:12345-10.240.43.64@tcp:101:fio.0 Request processed in 45us (65us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531969.516953:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44588
00000100:00100000:0.0:1651531969.517680:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531969.517689:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467575808
00000100:00100000:0.0:1651531969.517704:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250203
00000100:00100000:0.0:1651531969.517706:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009c93d7f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438147:x1731754467575808:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531969.517713:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca407e lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.517717:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531969.517718:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531969.517719:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca407e lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [675840->679935] (req 675840->679935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.517723:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca407e lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [675840->679935] (req 675840->679935) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651531969.528178:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869313 is committed
00010000:00010000:0.0:1651531969.528208:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca4070 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [684032->688127] (req 684032->688127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.528238:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca4070 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [684032->688127] (req 684032->688127) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531969.528255:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007d76765b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754467575296:12345-10.240.43.64@tcp:4:fio.0 Request processed in 24583us (24605us total) trans 21474869313 rc 0/0
00000100:00100000:0.0:1651531969.528258:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250202
00010000:00010000:0.0:1651531969.528266:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca4070 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [684032->688127] (req 684032->688127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.528269:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000775318ab already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531969.528270:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca4070 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [684032->688127] (req 684032->688127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.528273:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca4070 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [684032->688127] (req 684032->688127) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.528278:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca4070 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [684032->688127] (req 684032->688127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.528281:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca4070 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [684032->688127] (req 684032->688127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531969.528612:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531969.528620:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467575936
00000100:00100000:0.0:1651531969.528638:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250204
00000100:00100000:0.0:1651531969.528639:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007f998d3c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438148:x1731754467575936:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531969.528656:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca4085 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.528661:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531969.528661:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531969.528663:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca4085 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [970752->974847] (req 970752->974847) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.528667:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca4085 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [970752->974847] (req 970752->974847) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.528678:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca4085 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [970752->974847] (req 970752->974847) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.528682:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca4085 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [970752->974847] (req 970752->974847) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531969.528702:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007f998d3c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438148:x1731754467575936:12345-10.240.43.64@tcp:3:fio.0 Request processed in 62us (91us total) trans 0 rc 4096/4096
00010000:00010000:1.0:1651531969.528704:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca4085 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [970752->974847] (req 970752->974847) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531969.528705:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250204
00010000:00010000:1.0:1651531969.528708:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000014685f38 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531969.528709:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca4085 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [970752->974847] (req 970752->974847) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.528713:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca4085 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [970752->974847] (req 970752->974847) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.528719:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca4085 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [970752->974847] (req 970752->974847) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.528721:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca4085 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [970752->974847] (req 970752->974847) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531969.529060:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531969.529068:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467576064
00000100:00100000:0.0:1651531969.529083:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250205
00000100:00100000:0.0:1651531969.529084:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003562cf4d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754467576064:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531969.529091:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca408c lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.529096:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531969.529104:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531969.529105:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca408c lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [385024->389119] (req 385024->389119) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.529109:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca408c lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [385024->389119] (req 385024->389119) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531969.588593:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531969.588603:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467576320
00000100:00100000:0.0:1651531969.588611:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44589
00000100:00100000:0.0:1651531969.588613:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000059e5b3a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754467576320:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531969.588616:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531969.588620:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca4093 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445e21 expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.588629:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca4093 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445e21 expref: 14 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531969.588633:0:166111:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca4093 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445e21 expref: 14 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531969.588637:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000775318ab, rc 0)
00000001:00080000:1.0:1651531969.588646:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869315 is committed
00000100:00100000:0.0:1651531969.588647:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000059e5b3a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754467576320:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (55us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531969.588650:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44589
00010000:00010000:0.0:1651531969.588672:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca408c lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [385024->389119] (req 385024->389119) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.588688:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca408c lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [385024->389119] (req 385024->389119) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.588693:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca407e lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [675840->679935] (req 675840->679935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.588697:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca407e lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [675840->679935] (req 675840->679935) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531969.588701:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003562cf4d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467576064:12345-10.240.43.64@tcp:4:fio.0 Request processed in 59616us (59642us total) trans 21474869315 rc 0/0
00000100:00100000:0.0:1651531969.588704:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250205
00010000:00010000:0.0:1651531969.588711:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca408c lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [385024->389119] (req 385024->389119) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.588714:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000820577fb already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531969.588721:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca408c lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [385024->389119] (req 385024->389119) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.588725:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca408c lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [385024->389119] (req 385024->389119) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531969.588728:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009c93d7f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438147:x1731754467575808:12345-10.240.43.64@tcp:4:fio.0 Request processed in 71021us (71047us total) trans 21474869314 rc 0/0
00010000:00010000:0.0:1651531969.588730:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca408c lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [385024->389119] (req 385024->389119) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531969.588731:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250203
00010000:00010000:0.0:1651531969.588732:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca408c lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [385024->389119] (req 385024->389119) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.588736:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca407e lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [675840->679935] (req 675840->679935) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.588739:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fab23815 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531969.588739:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca407e lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [675840->679935] (req 675840->679935) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.588750:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca407e lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [675840->679935] (req 675840->679935) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.588754:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca407e lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [675840->679935] (req 675840->679935) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.588757:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca407e lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [675840->679935] (req 675840->679935) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531969.589059:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531969.589067:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467576576
00000100:00100000:0.0:1651531969.589081:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44590
00000100:00100000:0.0:1651531969.589083:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c0b460ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438146:x1731754467576576:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531969.589086:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531969.589090:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca409a lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445e2f expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.589095:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531969.589096:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531969.589098:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca409a lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445e2f expref: 8 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531969.589102:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca409a lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445e2f expref: 8 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531969.589106:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000014685f38, rc 0)
00000100:00100000:0.0:1651531969.589120:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c0b460ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467576576:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (62us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531969.589131:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44590
00000100:00100000:0.0:1651531969.590122:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531969.590144:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467577088
00000100:00100000:1.0:1651531969.590161:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250206
00000100:00100000:1.0:1651531969.590163:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f7006631 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467577088:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531969.590171:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca40a1 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.590175:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531969.590175:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531969.590177:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca40a1 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [888832->892927] (req 888832->892927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.590181:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca40a1 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [888832->892927] (req 888832->892927) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.590193:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca40a1 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [888832->892927] (req 888832->892927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.590196:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca40a1 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [888832->892927] (req 888832->892927) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531969.590221:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f7006631 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467577088:12345-10.240.43.64@tcp:3:fio.0 Request processed in 57us (99us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531969.590238:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250206
00010000:00010000:1.0:1651531969.590246:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca40a1 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [888832->892927] (req 888832->892927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.590258:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c2b76533 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531969.590259:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca40a1 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [888832->892927] (req 888832->892927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.590263:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca40a1 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [888832->892927] (req 888832->892927) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.590268:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca40a1 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [888832->892927] (req 888832->892927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.590270:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca40a1 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [888832->892927] (req 888832->892927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531969.614320:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531969.614348:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467577728
00000100:00100000:1.0:1651531969.614366:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250207
00000100:00100000:1.0:1651531969.614368:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a925fbf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467577728:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531969.614376:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca40a8 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.614382:0:216323:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca409a lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445e2f expref: 8 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531969.614385:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531969.614386:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531969.614387:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca40a8 lrc: 4/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [405504->409599] (req 405504->409599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.614406:0:216323:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca409a lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445e2f expref: 8 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531969.614410:0:216323:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca409a lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445e2f expref: 8 pid: 166111 timeout: 22778 lvb_type: 1
00000100:00100000:1.0:1651531969.614415:0:216323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000054ed0749 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_010:lustre-OST0001_UUID:216323:1731745997356352:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531969.614429:0:216323:0:(client.c:2492:ptlrpc_set_wait()) set 0000000073aaa033 going to sleep for 6 seconds
00000100:00100000:0.0:1651531969.614691:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531969.614702:0:166102:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467577792
00010000:00010000:1.0:1651531969.614709:0:166102:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca409a lrc: 5/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445e2f expref: 9 pid: 166111 timeout: 22778 lvb_type: 1
00000100:00100000:1.0:1651531969.614722:0:166102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 217
00000100:00100000:1.0:1651531969.614724:0:166102:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c4ea889e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438146:x1731754467577792:12345-10.240.43.64@tcp:103:ldlm_bl_01.0
00010000:00010000:1.0:1651531969.614727:0:166102:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1651531969.614731:0:166102:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca409a lrc: 5/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445e2f expref: 9 pid: 166111 timeout: 22778 lvb_type: 1
00010000:00010000:1.0:1651531969.614735:0:166102:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca409a lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445e2f expref: 9 pid: 166111 timeout: 22778 lvb_type: 1
00010000:00010000:1.0:1651531969.614742:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531969.614742:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531969.614743:0:166102:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca40a8 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [405504->409599] (req 405504->409599) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.614758:0:166102:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca40a8 lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [405504->409599] (req 405504->409599) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.614763:0:166102:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1651531969.614774:0:166102:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c4ea889e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438146:x1731754467577792:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 50us (83us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531969.614777:0:166102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 217
00010000:00010000:1.0:1651531969.614789:0:216323:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca409a lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445e2f expref: 8 pid: 166111 timeout: 22778 lvb_type: 1
00000100:00100000:1.0:1651531969.614793:0:216323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000054ed0749 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_010:lustre-OST0001_UUID:216323:1731745997356352:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651531969.614797:0:216323:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca40a8 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [405504->409599] (req 405504->409599) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.614800:0:216323:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca40a8 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [405504->409599] (req 405504->409599) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.614803:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca40a8 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [405504->409599] (req 405504->409599) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531969.649416:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531969.649425:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467578112
00000100:00100000:0.0:1651531969.649438:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250208
00000100:00100000:0.0:1651531969.649440:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003d9ef3c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438146:x1731754467578112:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531969.649448:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca40af lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.649452:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531969.649453:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531969.649454:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca40af lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [450560->454655] (req 450560->454655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.649458:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca40af lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [450560->454655] (req 450560->454655) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651531969.660476:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869316 is committed
00010000:00010000:1.0:1651531969.660490:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca40a8 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [405504->409599] (req 405504->409599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.660494:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca40a8 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [405504->409599] (req 405504->409599) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531969.660527:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a925fbf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438146:x1731754467577728:12345-10.240.43.64@tcp:4:fio.0 Request processed in 46158us (46208us total) trans 21474869316 rc 0/0
00010000:00010000:0.0:1651531969.660529:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca40a8 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [405504->409599] (req 405504->409599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531969.660530:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250207
00010000:00010000:0.0:1651531969.660534:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c2b76533 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531969.660535:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca40a8 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [405504->409599] (req 405504->409599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.660538:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca40a8 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [405504->409599] (req 405504->409599) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.660555:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca40a8 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [405504->409599] (req 405504->409599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.660558:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca40a8 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [405504->409599] (req 405504->409599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651531969.717827:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869317 is committed
00010000:00010000:0.0:1651531969.717860:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca40af lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [450560->454655] (req 450560->454655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.717864:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca40af lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [450560->454655] (req 450560->454655) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531969.717882:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003d9ef3c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438146:x1731754467578112:12345-10.240.43.64@tcp:4:fio.0 Request processed in 68440us (68466us total) trans 21474869317 rc 0/0
00000100:00100000:0.0:1651531969.717885:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250208
00010000:00010000:0.0:1651531969.717892:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca40af lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [450560->454655] (req 450560->454655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.717895:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fab23815 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531969.717896:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca40af lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [450560->454655] (req 450560->454655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.717899:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca40af lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [450560->454655] (req 450560->454655) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.717904:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca40af lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [450560->454655] (req 450560->454655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.717918:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca40af lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [450560->454655] (req 450560->454655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531969.718873:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531969.718894:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467578496
00000100:00100000:0.0:1651531969.718906:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44591
00000100:00100000:0.0:1651531969.718908:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000054ed0749 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438146:x1731754467578496:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531969.718912:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651531969.718913:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651531969.718915:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca40b6 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445e3d expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.718928:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531969.718929:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:1.0:1651531969.718931:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467578752
00010000:00010000:0.0:1651531969.718931:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca40b6 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445e3d expref: 8 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531969.718935:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca40b6 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445e3d expref: 9 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531969.718940:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000820577fb, rc 0)
00000100:00100000:1.0:1651531969.718943:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250209
00000100:00100000:1.0:1651531969.718945:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003ffbc5dc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438146:x1731754467578752:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651531969.718954:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000054ed0749 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438146:x1731754467578496:12345-10.240.43.64@tcp:101:fio.0 Request processed in 45us (81us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531969.718957:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44591
00010000:00010000:1.0:1651531969.718959:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca40bd lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.718964:0:216321:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca40b6 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445e3d expref: 8 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531969.718967:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531969.718968:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531969.718969:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca40bd lrc: 4/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [294912->299007] (req 294912->299007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.718976:0:216321:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca40b6 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445e3d expref: 8 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531969.718980:0:216321:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca40b6 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445e3d expref: 8 pid: 166111 timeout: 22778 lvb_type: 1
00000100:00100000:1.0:1651531969.718990:0:216321:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ffcc974c pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997356416:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531969.719000:0:216321:0:(client.c:2492:ptlrpc_set_wait()) set 0000000073aaa033 going to sleep for 6 seconds
00000100:00100000:1.0:1651531969.719429:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531969.719437:0:166102:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467578816
00010000:00010000:1.0:1651531969.719443:0:166102:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca40b6 lrc: 5/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445e3d expref: 9 pid: 166111 timeout: 22778 lvb_type: 1
00000100:00100000:1.0:1651531969.719457:0:166102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 218
00000100:00100000:1.0:1651531969.719458:0:166102:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000151c8460 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438147:x1731754467578816:12345-10.240.43.64@tcp:103:ldlm_bl_03.0
00010000:00010000:1.0:1651531969.719462:0:166102:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1651531969.719466:0:166102:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca40b6 lrc: 5/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445e3d expref: 9 pid: 166111 timeout: 22778 lvb_type: 1
00010000:00010000:1.0:1651531969.719470:0:166102:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca40b6 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445e3d expref: 9 pid: 166111 timeout: 22778 lvb_type: 1
00010000:00010000:1.0:1651531969.719476:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531969.719477:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531969.719478:0:166102:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca40bd lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [294912->299007] (req 294912->299007) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.719481:0:166102:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca40bd lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [294912->299007] (req 294912->299007) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.719486:0:166102:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1651531969.719496:0:166102:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000151c8460 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438147:x1731754467578816:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 37us (67us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531969.719500:0:166102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 218
00010000:00010000:1.0:1651531969.719555:0:216321:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca40b6 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445e3d expref: 8 pid: 166111 timeout: 22778 lvb_type: 1
00000100:00100000:1.0:1651531969.719560:0:216321:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ffcc974c pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997356416:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651531969.719564:0:216321:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca40bd lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [294912->299007] (req 294912->299007) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.719567:0:216321:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca40bd lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [294912->299007] (req 294912->299007) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.719570:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca40bd lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [294912->299007] (req 294912->299007) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531969.719849:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531969.719867:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467579072
00000100:00100000:0.0:1651531969.719878:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44592
00000100:00100000:0.0:1651531969.719880:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ffcc974c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438147:x1731754467579072:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531969.719883:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531969.719895:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca40c4 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445e4b expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.719903:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca40c4 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445e4b expref: 11 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531969.719907:0:166111:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca40c4 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445e4b expref: 11 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531969.719911:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000775318ab, rc 0)
00000100:00100000:0.0:1651531969.719925:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ffcc974c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438147:x1731754467579072:12345-10.240.43.64@tcp:101:fio.0 Request processed in 45us (77us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531969.719928:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44592
00000001:00080000:1.0:1651531969.754024:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869318 is committed
00010000:00010000:1.0:1651531969.754038:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca40bd lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [294912->299007] (req 294912->299007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.754042:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca40bd lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [294912->299007] (req 294912->299007) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531969.754058:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003ffbc5dc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438146:x1731754467578752:12345-10.240.43.64@tcp:4:fio.0 Request processed in 35112us (35145us total) trans 21474869318 rc 0/0
00000100:00100000:1.0:1651531969.754061:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250209
00010000:00010000:1.0:1651531969.754068:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca40bd lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [294912->299007] (req 294912->299007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.754075:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d44eb74d already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531969.754076:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca40bd lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [294912->299007] (req 294912->299007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.754079:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca40bd lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [294912->299007] (req 294912->299007) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.754084:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca40bd lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [294912->299007] (req 294912->299007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.754087:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca40bd lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [294912->299007] (req 294912->299007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531969.754421:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531969.754444:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467579456
00000100:00100000:0.0:1651531969.754455:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44593
00000100:00100000:0.0:1651531969.754457:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d9e74b4c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438147:x1731754467579456:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531969.754461:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531969.754464:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca40cb lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445e59 expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.754470:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531969.754471:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531969.754472:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca40cb lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445e59 expref: 8 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531969.754477:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca40cb lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445e59 expref: 8 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531969.754485:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000775318ab, rc 0)
00000100:00100000:0.0:1651531969.754500:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d9e74b4c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467579456:12345-10.240.43.64@tcp:101:fio.0 Request processed in 43us (80us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531969.754503:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44593
00000100:00100000:1.0:1651531969.755297:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531969.755306:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467579712
00000100:00100000:1.0:1651531969.755322:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250210
00000100:00100000:1.0:1651531969.755324:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000567318ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467579712:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531969.755331:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca40d2 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.755336:0:216321:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca40cb lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445e59 expref: 8 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531969.755340:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531969.755340:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531969.755341:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca40d2 lrc: 4/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [937984->942079] (req 937984->942079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.755358:0:216321:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca40cb lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445e59 expref: 8 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531969.755362:0:216321:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca40cb lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445e59 expref: 8 pid: 166111 timeout: 22778 lvb_type: 1
00000100:00100000:1.0:1651531969.755366:0:216321:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009acffcb8 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997356480:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531969.755379:0:216321:0:(client.c:2492:ptlrpc_set_wait()) set 0000000073aaa033 going to sleep for 6 seconds
00000100:00100000:1.0:1651531969.755596:0:216321:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009acffcb8 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997356480:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651531969.755600:0:216321:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca40d2 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [937984->942079] (req 937984->942079) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531969.755693:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531969.755711:0:166102:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467579776
00010000:00010000:1.0:1651531969.755717:0:166102:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca40cb lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445e59 expref: 9 pid: 166111 timeout: 22778 lvb_type: 1
00000100:00100000:1.0:1651531969.755728:0:166102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 219
00000100:00100000:1.0:1651531969.755730:0:166102:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009acffcb8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754467579776:12345-10.240.43.64@tcp:103:ldlm_bl_04.0
00010000:00010000:1.0:1651531969.755733:0:166102:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1651531969.755737:0:166102:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca40cb lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445e59 expref: 9 pid: 166111 timeout: 22778 lvb_type: 1
00010000:00010000:1.0:1651531969.755741:0:166102:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca40cb lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445e59 expref: 9 pid: 166111 timeout: 22778 lvb_type: 1
00010000:00010000:1.0:1651531969.755755:0:166102:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca40cb lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445e59 expref: 9 pid: 166111 timeout: 22778 lvb_type: 1
00010000:00010000:1.0:1651531969.755760:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531969.755760:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531969.755761:0:166102:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca40d2 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [937984->942079] (req 937984->942079) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.755764:0:166102:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca40d2 lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [937984->942079] (req 937984->942079) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.755771:0:166102:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1651531969.755781:0:166102:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009acffcb8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467579776:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 50us (88us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531969.755783:0:166102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 219
00010000:00010000:1.0:1651531969.755819:0:216321:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca40d2 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [937984->942079] (req 937984->942079) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.755823:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca40d2 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [937984->942079] (req 937984->942079) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531969.779128:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531969.779141:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531969.779151:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467579968
00000100:00100000:0.0:1651531969.779162:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44594
00000100:00100000:0.0:1651531969.779164:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c43262d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438148:x1731754467579968:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531969.779167:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531969.779171:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca40d9 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445e67 expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531969.779173:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467580160
00010000:00010000:0.0:1651531969.779179:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca40d9 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445e67 expref: 12 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531969.779183:0:166111:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca40d9 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445e67 expref: 12 pid: 166111 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651531969.779184:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250211
00000100:00100000:1.0:1651531969.779186:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b5b5b4c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754467580160:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531969.779187:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fab23815, rc 0)
00010000:00010000:1.0:1651531969.779193:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca40e0 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531969.779199:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c43262d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754467579968:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (72us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531969.779202:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44594
00010000:00010000:1.0:1651531969.779221:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531969.779231:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531969.779233:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca40e0 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [307200->311295] (req 307200->311295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.779241:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca40e0 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [307200->311295] (req 307200->311295) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.779256:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca40e0 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [307200->311295] (req 307200->311295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.779259:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca40e0 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [307200->311295] (req 307200->311295) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.779277:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca40e0 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [307200->311295] (req 307200->311295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.779281:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d44eb74d already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531969.779283:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca40e0 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [307200->311295] (req 307200->311295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531969.779286:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b5b5b4c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438146:x1731754467580160:12345-10.240.43.64@tcp:3:fio.0 Request processed in 99us (144us total) trans 0 rc 4096/4096
00010000:00010000:0.0:1651531969.779287:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca40e0 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [307200->311295] (req 307200->311295) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531969.779289:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250211
00010000:00010000:0.0:1651531969.779292:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca40e0 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [307200->311295] (req 307200->311295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.779295:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca40e0 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [307200->311295] (req 307200->311295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531969.780207:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531969.780237:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467580800
00000100:00100000:1.0:1651531969.780252:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250212
00000100:00100000:1.0:1651531969.780254:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006e255cae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438146:x1731754467580800:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531969.780262:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca40e7 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.780266:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531969.780267:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531969.780268:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca40e7 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [688128->692223] (req 688128->692223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.780283:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca40e7 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [688128->692223] (req 688128->692223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.780294:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca40e7 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [688128->692223] (req 688128->692223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.780297:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca40e7 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [688128->692223] (req 688128->692223) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.780315:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca40e7 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [688128->692223] (req 688128->692223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531969.780317:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006e255cae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438146:x1731754467580800:12345-10.240.43.64@tcp:3:fio.0 Request processed in 62us (111us total) trans 0 rc 4096/4096
00010000:00010000:0.0:1651531969.780319:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c2b76533 already unused, calling callback (0000000049fddea7)
00000100:00100000:1.0:1651531969.780320:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250212
00010000:00010000:0.0:1651531969.780320:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca40e7 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [688128->692223] (req 688128->692223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.780323:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca40e7 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [688128->692223] (req 688128->692223) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.780329:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca40e7 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [688128->692223] (req 688128->692223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.780331:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca40e7 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [688128->692223] (req 688128->692223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531969.780632:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531969.780650:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467581056
00000100:00100000:1.0:1651531969.780664:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250213
00000100:00100000:1.0:1651531969.780665:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000009c4c564 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438147:x1731754467581056:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531969.780672:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca40ee lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.780676:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531969.780677:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531969.780678:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca40ee lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [602112->606207] (req 602112->606207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.780682:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca40ee lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [602112->606207] (req 602112->606207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.780692:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca40ee lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [602112->606207] (req 602112->606207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.780704:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca40ee lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [602112->606207] (req 602112->606207) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531969.780719:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000009c4c564 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438147:x1731754467581056:12345-10.240.43.64@tcp:3:fio.0 Request processed in 53us (88us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531969.780722:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250213
00010000:00010000:1.0:1651531969.780728:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca40ee lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [602112->606207] (req 602112->606207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.780732:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e9b84540 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531969.780733:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca40ee lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [602112->606207] (req 602112->606207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.780736:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca40ee lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [602112->606207] (req 602112->606207) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.780740:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca40ee lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [602112->606207] (req 602112->606207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.780743:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca40ee lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [602112->606207] (req 602112->606207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531969.781008:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531969.781027:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467581184
00000100:00100000:1.0:1651531969.781040:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250214
00000100:00100000:1.0:1651531969.781041:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c683c211 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438146:x1731754467581184:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531969.781048:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca40f5 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.781060:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531969.781061:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531969.781062:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca40f5 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [544768->548863] (req 544768->548863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.781066:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca40f5 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [544768->548863] (req 544768->548863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.781077:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca40f5 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [544768->548863] (req 544768->548863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.781080:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca40f5 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [544768->548863] (req 544768->548863) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.781090:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca40f5 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [544768->548863] (req 544768->548863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.781094:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008558d1b3 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531969.781095:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca40f5 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [544768->548863] (req 544768->548863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531969.781097:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c683c211 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438146:x1731754467581184:12345-10.240.43.64@tcp:3:fio.0 Request processed in 55us (90us total) trans 0 rc 4096/4096
00010000:00010000:0.0:1651531969.781098:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca40f5 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [544768->548863] (req 544768->548863) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531969.781100:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250214
00010000:00010000:0.0:1651531969.781103:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca40f5 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [544768->548863] (req 544768->548863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.781106:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca40f5 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [544768->548863] (req 544768->548863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651531969.803042:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869319 is committed
00010000:00010000:1.0:1651531969.803055:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca40d2 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [937984->942079] (req 937984->942079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.803059:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca40d2 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [937984->942079] (req 937984->942079) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531969.803079:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000567318ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438146:x1731754467579712:12345-10.240.43.64@tcp:4:fio.0 Request processed in 47754us (47782us total) trans 21474869319 rc 0/0
00000100:00100000:1.0:1651531969.803082:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250210
00010000:00010000:1.0:1651531969.803089:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca40d2 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [937984->942079] (req 937984->942079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.803100:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a8889a80 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531969.803102:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca40d2 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [937984->942079] (req 937984->942079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.803105:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca40d2 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [937984->942079] (req 937984->942079) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.803110:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca40d2 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [937984->942079] (req 937984->942079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.803112:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca40d2 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [937984->942079] (req 937984->942079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531969.803415:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531969.803425:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467581440
00000100:00100000:1.0:1651531969.803434:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250215
00000100:00100000:1.0:1651531969.803436:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001304ce4c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438147:x1731754467581440:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531969.803442:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca40fc lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.803446:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531969.803447:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531969.803448:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca40fc lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [229376->233471] (req 229376->233471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.803452:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca40fc lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [229376->233471] (req 229376->233471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651531969.863702:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869320 is committed
00010000:00010000:1.0:1651531969.863717:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca40fc lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [229376->233471] (req 229376->233471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.863720:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca40fc lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [229376->233471] (req 229376->233471) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531969.863740:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001304ce4c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438147:x1731754467581440:12345-10.240.43.64@tcp:4:fio.0 Request processed in 60304us (60325us total) trans 21474869320 rc 0/0
00000100:00100000:1.0:1651531969.863744:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250215
00010000:00010000:0.0:1651531969.863745:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca40fc lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [229376->233471] (req 229376->233471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.863750:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e9b84540 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531969.863751:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca40fc lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [229376->233471] (req 229376->233471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.863754:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca40fc lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [229376->233471] (req 229376->233471) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.863759:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca40fc lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [229376->233471] (req 229376->233471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.863766:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca40fc lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [229376->233471] (req 229376->233471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531969.864065:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531969.864083:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467581696
00000100:00100000:0.0:1651531969.864097:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44595
00000100:00100000:0.0:1651531969.864099:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000033696ffa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438146:x1731754467581696:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531969.864102:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531969.864113:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca4103 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445e75 expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.864119:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531969.864120:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531969.864122:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca4103 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445e75 expref: 8 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531969.864126:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca4103 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445e75 expref: 8 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531969.864130:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fab23815, rc 0)
00000100:00100000:0.0:1651531969.864146:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000033696ffa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467581696:12345-10.240.43.64@tcp:101:fio.0 Request processed in 46us (82us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531969.864149:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44595
00000100:00100000:1.0:1651531969.864897:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531969.864905:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467581952
00000100:00100000:1.0:1651531969.864915:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250216
00000100:00100000:1.0:1651531969.864917:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a20162bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467581952:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531969.864925:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca410a lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.864929:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531969.864930:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531969.864931:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca410a lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [360448->364543] (req 360448->364543) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.864935:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca410a lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [360448->364543] (req 360448->364543) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.864946:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca410a lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [360448->364543] (req 360448->364543) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.864960:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca410a lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [360448->364543] (req 360448->364543) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.864979:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca410a lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [360448->364543] (req 360448->364543) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531969.864980:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a20162bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467581952:12345-10.240.43.64@tcp:3:fio.0 Request processed in 62us (84us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531969.864983:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250216
00010000:00010000:0.0:1651531969.864983:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a8889a80 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531969.864986:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca410a lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [360448->364543] (req 360448->364543) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.864989:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca410a lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [360448->364543] (req 360448->364543) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.864994:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca410a lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [360448->364543] (req 360448->364543) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.864997:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca410a lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [360448->364543] (req 360448->364543) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531969.865309:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531969.865318:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467582080
00000100:00100000:1.0:1651531969.865327:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250217
00000100:00100000:1.0:1651531969.865329:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008b42dfe9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467582080:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531969.865335:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4111 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.865340:0:216323:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca4103 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445e75 expref: 8 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531969.865344:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531969.865344:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531969.865345:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4111 lrc: 4/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [827392->831487] (req 827392->831487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.865352:0:216323:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca4103 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445e75 expref: 8 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531969.865356:0:216323:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca4103 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445e75 expref: 8 pid: 166111 timeout: 22778 lvb_type: 1
00000100:00100000:1.0:1651531969.865372:0:216323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b97e3b28 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_010:lustre-OST0001_UUID:216323:1731745997356544:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531969.865384:0:216323:0:(client.c:2492:ptlrpc_set_wait()) set 0000000073aaa033 going to sleep for 6 seconds
00000100:00100000:1.0:1651531969.865654:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531969.865661:0:166102:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467582144
00010000:00010000:1.0:1651531969.865667:0:166102:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca4103 lrc: 5/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445e75 expref: 9 pid: 166111 timeout: 22778 lvb_type: 1
00000100:00100000:1.0:1651531969.865679:0:166102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 220
00000100:00100000:1.0:1651531969.865681:0:166102:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000099b6616a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438147:x1731754467582144:12345-10.240.43.64@tcp:103:ldlm_bl_05.0
00010000:00010000:1.0:1651531969.865684:0:166102:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1651531969.865688:0:166102:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca4103 lrc: 5/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445e75 expref: 9 pid: 166111 timeout: 22778 lvb_type: 1
00010000:00010000:1.0:1651531969.865692:0:166102:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca4103 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445e75 expref: 9 pid: 166111 timeout: 22778 lvb_type: 1
00010000:00010000:1.0:1651531969.865699:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531969.865700:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531969.865700:0:166102:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4111 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [827392->831487] (req 827392->831487) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.865704:0:166102:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4111 lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [827392->831487] (req 827392->831487) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.865709:0:166102:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1651531969.865718:0:166102:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000099b6616a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438147:x1731754467582144:12345-10.240.43.64@tcp:103:ldlm_bl_05.0 Request processed in 36us (64us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531969.865730:0:166102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 220
00010000:00010000:1.0:1651531969.865741:0:216323:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca4103 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445e75 expref: 8 pid: 166111 timeout: 22778 lvb_type: 1
00000100:00100000:1.0:1651531969.865746:0:216323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b97e3b28 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_010:lustre-OST0001_UUID:216323:1731745997356544:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651531969.865749:0:216323:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4111 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [827392->831487] (req 827392->831487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.865753:0:216323:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4111 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [827392->831487] (req 827392->831487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.865755:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4111 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [827392->831487] (req 827392->831487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531969.875894:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531969.875902:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467582272
00000100:00100000:1.0:1651531969.875931:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250218
00000100:00100000:1.0:1651531969.875932:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b97e3b28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438147:x1731754467582272:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531969.875940:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4118 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.875944:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531969.875945:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531969.875946:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4118 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [253952->258047] (req 253952->258047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.875950:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4118 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [253952->258047] (req 253952->258047) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531969.875966:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651531969.875971:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4118 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [253952->258047] (req 253952->258047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.875974:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4118 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [253952->258047] (req 253952->258047) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531969.875975:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467582400
00000100:00100000:0.0:1651531969.875985:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250219
00000100:00100000:0.0:1651531969.875987:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c4ea889e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438146:x1731754467582400:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651531969.875989:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b97e3b28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438147:x1731754467582272:12345-10.240.43.64@tcp:3:fio.0 Request processed in 56us (96us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531969.875992:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250218
00010000:00010000:0.0:1651531969.875994:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca411f lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.875999:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4118 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [253952->258047] (req 253952->258047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.875999:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531969.875999:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531969.876000:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca411f lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [692224->696319] (req 692224->696319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.876004:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000968553c1 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531969.876004:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca411f lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [692224->696319] (req 692224->696319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.876005:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4118 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [253952->258047] (req 253952->258047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.876008:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4118 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [253952->258047] (req 253952->258047) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.876013:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4118 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [253952->258047] (req 253952->258047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.876016:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4118 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [253952->258047] (req 253952->258047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651531969.947153:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869322 is committed
00010000:00010000:1.0:1651531969.947173:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4111 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [827392->831487] (req 827392->831487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.947179:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4111 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [827392->831487] (req 827392->831487) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.947184:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca411f lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [692224->696319] (req 692224->696319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531969.947199:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008b42dfe9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467582080:12345-10.240.43.64@tcp:4:fio.0 Request processed in 81869us (81890us total) trans 21474869321 rc 0/0
00000100:00100000:1.0:1651531969.947202:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250217
00010000:00010000:0.0:1651531969.947220:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca411f lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [692224->696319] (req 692224->696319) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.947235:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4111 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [827392->831487] (req 827392->831487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.947239:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006da7a892 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531969.947240:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4111 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [827392->831487] (req 827392->831487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.947243:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4111 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [827392->831487] (req 827392->831487) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531969.947247:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c4ea889e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438146:x1731754467582400:12345-10.240.43.64@tcp:4:fio.0 Request processed in 71259us (71281us total) trans 21474869322 rc 0/0
00010000:00010000:1.0:1651531969.947248:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4111 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [827392->831487] (req 827392->831487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531969.947250:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250219
00010000:00010000:1.0:1651531969.947251:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4111 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [827392->831487] (req 827392->831487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.947254:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca411f lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [692224->696319] (req 692224->696319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.947257:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000032ee36ee already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531969.947258:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca411f lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [692224->696319] (req 692224->696319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.947262:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca411f lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [692224->696319] (req 692224->696319) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.947266:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca411f lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [692224->696319] (req 692224->696319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.947268:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca411f lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [692224->696319] (req 692224->696319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531969.947686:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531969.947708:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467583040
00000100:00100000:0.0:1651531969.947724:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250220
00000100:00100000:0.0:1651531969.947726:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000329eeeee pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438146:x1731754467583040:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531969.947734:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca4126 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.947738:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531969.947738:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531969.947740:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca4126 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [126976->131071] (req 126976->131071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.947744:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca4126 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [126976->131071] (req 126976->131071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.947755:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca4126 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [126976->131071] (req 126976->131071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.947759:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca4126 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [126976->131071] (req 126976->131071) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.947776:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca4126 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [126976->131071] (req 126976->131071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531969.947779:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000329eeeee pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438146:x1731754467583040:12345-10.240.43.64@tcp:3:fio.0 Request processed in 52us (93us total) trans 0 rc 4096/4096
00010000:00010000:1.0:1651531969.947780:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000075a78972 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531969.947780:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca4126 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [126976->131071] (req 126976->131071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.947783:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca4126 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [126976->131071] (req 126976->131071) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531969.947783:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250220
00010000:00010000:1.0:1651531969.947788:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca4126 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [126976->131071] (req 126976->131071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.947791:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca4126 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [126976->131071] (req 126976->131071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531969.948090:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531969.948105:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467583168
00000100:00100000:0.0:1651531969.948119:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250221
00000100:00100000:0.0:1651531969.948121:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f3a0807 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438147:x1731754467583168:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531969.948128:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca412d lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.948132:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531969.948133:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531969.948134:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca412d lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [135168->139263] (req 135168->139263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.948138:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca412d lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [135168->139263] (req 135168->139263) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.948150:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca412d lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [135168->139263] (req 135168->139263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.948153:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca412d lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [135168->139263] (req 135168->139263) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531969.948168:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f3a0807 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438147:x1731754467583168:12345-10.240.43.64@tcp:3:fio.0 Request processed in 46us (78us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531969.948170:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250221
00010000:00010000:0.0:1651531969.948177:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca412d lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [135168->139263] (req 135168->139263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.948180:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f5657138 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531969.948183:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca412d lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [135168->139263] (req 135168->139263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.948186:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca412d lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [135168->139263] (req 135168->139263) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.948190:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca412d lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [135168->139263] (req 135168->139263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.948193:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca412d lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [135168->139263] (req 135168->139263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531969.948364:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531969.948375:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467583296
00000100:00100000:0.0:1651531969.948388:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250222
00000100:00100000:0.0:1651531969.948390:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a899ddab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438147:x1731754467583296:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531969.948397:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca4134 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.948401:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531969.948401:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531969.948402:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca4134 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [405504->409599] (req 405504->409599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.948406:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca4134 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [405504->409599] (req 405504->409599) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.948417:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca4134 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [405504->409599] (req 405504->409599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.948420:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca4134 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [405504->409599] (req 405504->409599) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.948431:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca4134 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [405504->409599] (req 405504->409599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.948435:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fb2f6575 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531969.948436:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca4134 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [405504->409599] (req 405504->409599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531969.948438:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a899ddab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438147:x1731754467583296:12345-10.240.43.64@tcp:3:fio.0 Request processed in 48us (75us total) trans 0 rc 4096/4096
00010000:00010000:1.0:1651531969.948439:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca4134 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [405504->409599] (req 405504->409599) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531969.948441:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250222
00010000:00010000:1.0:1651531969.948443:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca4134 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [405504->409599] (req 405504->409599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.948446:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca4134 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [405504->409599] (req 405504->409599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531969.948522:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531969.948545:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467583424
00000100:00100000:0.0:1651531969.948558:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250223
00000100:00100000:0.0:1651531969.948560:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b10bc064 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438147:x1731754467583424:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531969.948569:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca413b lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.948573:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531969.948573:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531969.948574:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca413b lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [86016->90111] (req 86016->90111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.948578:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca413b lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [86016->90111] (req 86016->90111) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.948589:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca413b lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [86016->90111] (req 86016->90111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.948592:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca413b lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [86016->90111] (req 86016->90111) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.948602:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca413b lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [86016->90111] (req 86016->90111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.948605:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e2ec18e1 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531969.948606:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca413b lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [86016->90111] (req 86016->90111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.948609:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca413b lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [86016->90111] (req 86016->90111) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531969.948609:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b10bc064 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438147:x1731754467583424:12345-10.240.43.64@tcp:3:fio.0 Request processed in 49us (87us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531969.948612:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250223
00010000:00010000:1.0:1651531969.948613:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca413b lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [86016->90111] (req 86016->90111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531969.948620:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca413b lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [86016->90111] (req 86016->90111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531969.972654:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531969.972678:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467583808
00000100:00100000:0.0:1651531969.972695:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250224
00000100:00100000:0.0:1651531969.972697:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000427633c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438148:x1731754467583808:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531969.972704:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4142 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.972708:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531969.972709:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531969.972710:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4142 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [495616->499711] (req 495616->499711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531969.972714:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4142 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [495616->499711] (req 495616->499711) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651531970.032365:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869323 is committed
00010000:00010000:0.0:1651531970.032395:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4142 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [495616->499711] (req 495616->499711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.032400:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4142 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [495616->499711] (req 495616->499711) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531970.032417:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000427633c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438148:x1731754467583808:12345-10.240.43.64@tcp:4:fio.0 Request processed in 59719us (59763us total) trans 21474869323 rc 0/0
00000100:00100000:0.0:1651531970.032420:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250224
00010000:00010000:0.0:1651531970.032427:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4142 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [495616->499711] (req 495616->499711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.032430:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f5657138 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531970.032431:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4142 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [495616->499711] (req 495616->499711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.032448:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4142 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [495616->499711] (req 495616->499711) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.032453:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4142 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [495616->499711] (req 495616->499711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.032456:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4142 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [495616->499711] (req 495616->499711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531970.033262:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531970.033280:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467584512
00000100:00100000:0.0:1651531970.033297:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250225
00000100:00100000:0.0:1651531970.033298:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d76314b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438148:x1731754467584512:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531970.033306:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca4149 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.033310:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531970.033310:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531970.033311:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca4149 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [811008->815103] (req 811008->815103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.033315:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca4149 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [811008->815103] (req 811008->815103) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.033327:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca4149 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [811008->815103] (req 811008->815103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.033331:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca4149 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [811008->815103] (req 811008->815103) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531970.033363:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d76314b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438148:x1731754467584512:12345-10.240.43.64@tcp:3:fio.0 Request processed in 63us (101us total) trans 0 rc 4096/4096
00010000:00010000:1.0:1651531970.033364:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca4149 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [811008->815103] (req 811008->815103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531970.033366:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250225
00010000:00010000:1.0:1651531970.033368:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002c5e01dd already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531970.033369:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca4149 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [811008->815103] (req 811008->815103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531970.033372:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca4149 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [811008->815103] (req 811008->815103) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531970.033378:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca4149 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [811008->815103] (req 811008->815103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531970.033380:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca4149 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [811008->815103] (req 811008->815103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531970.046265:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531970.046287:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467584768
00000100:00100000:0.0:1651531970.046300:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44596
00000100:00100000:0.0:1651531970.046302:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002ae2aeac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438147:x1731754467584768:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531970.046305:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531970.046309:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4150 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445e83 expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.046315:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531970.046316:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531970.046318:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4150 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445e83 expref: 8 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531970.046322:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4150 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445e83 expref: 8 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531970.046326:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f5657138, rc 0)
00000100:00100000:0.0:1651531970.046337:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002ae2aeac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467584768:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (73us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531970.046340:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44596
00000100:00100000:1.0:1651531970.069620:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531970.069642:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467585152
00000100:00100000:0.0:1651531970.069657:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250226
00000100:00100000:0.0:1651531970.069659:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001797bd5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467585152:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531970.069676:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4157 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.069680:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531970.069681:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531970.069682:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4157 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [81920->774143] (req 81920->774143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.069686:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4157 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [81920->774143] (req 81920->774143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.069915:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4157 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [81920->774143] (req 81920->774143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.069919:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4157 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [81920->774143] (req 81920->774143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531970.069933:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4157 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [81920->774143] (req 81920->774143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531970.069937:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c1022d42 already unused, calling callback (0000000049fddea7)
00000100:00100000:0.0:1651531970.069937:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001797bd5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467585152:12345-10.240.43.64@tcp:3:fio.0 Request processed in 277us (317us total) trans 0 rc 8192/8192
00010000:00010000:1.0:1651531970.069939:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4157 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [81920->774143] (req 81920->774143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531970.069940:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250226
00010000:00010000:1.0:1651531970.069943:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4157 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [81920->774143] (req 81920->774143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531970.069947:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4157 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [81920->774143] (req 81920->774143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531970.069950:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4157 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [81920->774143] (req 81920->774143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531970.070294:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531970.070316:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467585408
00000100:00100000:0.0:1651531970.070330:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250227
00000100:00100000:0.0:1651531970.070332:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bfdd313b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467585408:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531970.070339:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca415e lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.070343:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531970.070344:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531970.070345:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca415e lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [946176->950271] (req 946176->950271) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.070358:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca415e lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [946176->950271] (req 946176->950271) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.070369:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca415e lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [946176->950271] (req 946176->950271) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.070372:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca415e lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [946176->950271] (req 946176->950271) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531970.070387:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bfdd313b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467585408:12345-10.240.43.64@tcp:3:fio.0 Request processed in 55us (94us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531970.070390:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250227
00010000:00010000:0.0:1651531970.070397:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca415e lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [946176->950271] (req 946176->950271) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.070400:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000080362f27 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531970.070401:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca415e lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [946176->950271] (req 946176->950271) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.070404:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca415e lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [946176->950271] (req 946176->950271) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.070409:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca415e lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [946176->950271] (req 946176->950271) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.070412:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca415e lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [946176->950271] (req 946176->950271) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531970.070743:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531970.070754:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467585600
00000100:00100000:0.0:1651531970.070769:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250228
00000100:00100000:0.0:1651531970.070771:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ac545f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467585600:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531970.070778:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca4165 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.070782:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531970.070782:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531970.070783:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca4165 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [184320->188415] (req 184320->188415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.070787:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca4165 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [184320->188415] (req 184320->188415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.070798:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca4165 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [184320->188415] (req 184320->188415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.070801:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca4165 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [184320->188415] (req 184320->188415) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531970.070818:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca4165 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [184320->188415] (req 184320->188415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531970.070820:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ac545f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467585600:12345-10.240.43.64@tcp:3:fio.0 Request processed in 49us (77us total) trans 0 rc 4096/4096
00010000:00010000:1.0:1651531970.070822:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f765708a already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531970.070823:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca4165 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [184320->188415] (req 184320->188415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531970.070823:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250228
00010000:00010000:1.0:1651531970.070826:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca4165 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [184320->188415] (req 184320->188415) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531970.070831:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca4165 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [184320->188415] (req 184320->188415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531970.070834:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca4165 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [184320->188415] (req 184320->188415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531970.070946:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531970.070957:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467585728
00000100:00100000:0.0:1651531970.070970:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250229
00000100:00100000:0.0:1651531970.070972:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f817afea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467585728:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531970.070987:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca416c lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.070992:0:192753:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4150 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445e83 expref: 8 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531970.070996:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531970.070996:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531970.070997:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca416c lrc: 4/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [696320->700415] (req 696320->700415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.071005:0:192753:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4150 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445e83 expref: 8 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531970.071009:0:192753:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4150 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445e83 expref: 8 pid: 166111 timeout: 22778 lvb_type: 1
00000100:00100000:0.0:1651531970.071013:0:192753:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cc11a3b9 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:192753:1731745997356608:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531970.071026:0:192753:0:(client.c:2492:ptlrpc_set_wait()) set 0000000060d3a5ac going to sleep for 6 seconds
00000100:00100000:1.0:1651531970.071319:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531970.071322:0:192753:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cc11a3b9 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:192753:1731745997356608:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651531970.071326:0:192753:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca416c lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [696320->700415] (req 696320->700415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531970.071327:0:166102:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467585920
00010000:00010000:1.0:1651531970.071333:0:166102:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4150 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445e83 expref: 9 pid: 166111 timeout: 22778 lvb_type: 1
00000100:00100000:1.0:1651531970.071344:0:166102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 221
00000100:00100000:1.0:1651531970.071345:0:166102:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003b5b354a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438147:x1731754467585920:12345-10.240.43.64@tcp:103:ldlm_bl_01.0
00010000:00010000:1.0:1651531970.071349:0:166102:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1651531970.071353:0:166102:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4150 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445e83 expref: 9 pid: 166111 timeout: 22778 lvb_type: 1
00010000:00010000:1.0:1651531970.071357:0:166102:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4150 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445e83 expref: 9 pid: 166111 timeout: 22778 lvb_type: 1
00010000:00010000:1.0:1651531970.071364:0:166102:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4150 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445e83 expref: 9 pid: 166111 timeout: 22778 lvb_type: 1
00010000:00010000:1.0:1651531970.071368:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531970.071368:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531970.071369:0:166102:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca416c lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [696320->700415] (req 696320->700415) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531970.071372:0:166102:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca416c lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [696320->700415] (req 696320->700415) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531970.071381:0:166102:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1651531970.071383:0:192753:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca416c lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [696320->700415] (req 696320->700415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.071386:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca416c lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [696320->700415] (req 696320->700415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531970.071393:0:166102:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003b5b354a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467585920:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 47us (74us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531970.071396:0:166102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 221
00000001:00080000:1.0:1651531970.105208:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869324 is committed
00002000:00010000:0.0:1651531970.105255:0:192753:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x34545:0x0] updating lvb mtime from disk: 1651531969 -> 1651531970
00002000:00010000:0.0:1651531970.105257:0:192753:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x34545:0x0] updating lvb ctime from disk: 1651531969 -> 1651531970
00010000:00010000:0.0:1651531970.105260:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca416c lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [696320->700415] (req 696320->700415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.105264:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca416c lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [696320->700415] (req 696320->700415) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531970.105285:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f817afea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438146:x1731754467585728:12345-10.240.43.64@tcp:4:fio.0 Request processed in 34312us (34339us total) trans 21474869324 rc 0/0
00010000:00010000:1.0:1651531970.105288:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca416c lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [696320->700415] (req 696320->700415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531970.105288:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250229
00010000:00010000:1.0:1651531970.105292:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002c5e01dd already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531970.105293:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca416c lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [696320->700415] (req 696320->700415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531970.105296:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca416c lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [696320->700415] (req 696320->700415) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531970.105301:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca416c lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [696320->700415] (req 696320->700415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531970.105304:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca416c lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [696320->700415] (req 696320->700415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531970.106055:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531970.106064:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467586176
00000100:00100000:0.0:1651531970.106080:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250230
00000100:00100000:0.0:1651531970.106082:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cc11a3b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438146:x1731754467586176:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531970.106092:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4173 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.106096:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531970.106097:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531970.106098:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4173 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [409600->413695] (req 409600->413695) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.106102:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4173 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [409600->413695] (req 409600->413695) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.106113:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4173 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [409600->413695] (req 409600->413695) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.106125:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4173 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [409600->413695] (req 409600->413695) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531970.106140:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cc11a3b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438146:x1731754467586176:12345-10.240.43.64@tcp:3:fio.0 Request processed in 57us (85us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531970.106143:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250230
00010000:00010000:0.0:1651531970.106150:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4173 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [409600->413695] (req 409600->413695) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.106153:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000080362f27 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531970.106154:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4173 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [409600->413695] (req 409600->413695) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.106157:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4173 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [409600->413695] (req 409600->413695) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.106162:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4173 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [409600->413695] (req 409600->413695) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.106164:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4173 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [409600->413695] (req 409600->413695) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531970.106497:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531970.106505:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467586304
00000100:00100000:0.0:1651531970.106518:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44597
00000100:00100000:0.0:1651531970.106520:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000021f31110 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438147:x1731754467586304:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531970.106523:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531970.106536:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca417a lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445e91 expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.106542:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531970.106542:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531970.106544:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca417a lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445e91 expref: 8 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531970.106549:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca417a lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445e91 expref: 8 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531970.106553:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e2ec18e1, rc 0)
00000100:00100000:0.0:1651531970.106563:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000021f31110 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467586304:12345-10.240.43.64@tcp:101:fio.0 Request processed in 43us (66us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531970.106566:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44597
00000100:00100000:0.0:1651531970.127010:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531970.127019:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467587008
00000100:00100000:0.0:1651531970.127035:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250231
00000100:00100000:0.0:1651531970.127037:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000053de45f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467587008:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531970.127044:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4181 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.127048:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531970.127049:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531970.127050:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4181 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [651264->655359] (req 651264->655359) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.127054:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4181 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [651264->655359] (req 651264->655359) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.127078:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4181 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [651264->655359] (req 651264->655359) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.127081:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4181 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [651264->655359] (req 651264->655359) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531970.127102:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4181 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [651264->655359] (req 651264->655359) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531970.127102:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000053de45f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467587008:12345-10.240.43.64@tcp:3:fio.0 Request processed in 65us (93us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531970.127105:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250231
00010000:00010000:1.0:1651531970.127106:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000080362f27 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531970.127107:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4181 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [651264->655359] (req 651264->655359) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531970.127110:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4181 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [651264->655359] (req 651264->655359) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531970.127119:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4181 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [651264->655359] (req 651264->655359) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531970.127122:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4181 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [651264->655359] (req 651264->655359) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531970.127783:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531970.127790:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467587328
00000100:00100000:0.0:1651531970.127805:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250232
00000100:00100000:0.0:1651531970.127807:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000089660739 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467587328:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531970.127814:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca4188 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.127818:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531970.127818:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531970.127820:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca4188 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [262144->266239] (req 262144->266239) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.127823:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca4188 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [262144->266239] (req 262144->266239) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.127834:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca4188 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [262144->266239] (req 262144->266239) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.127850:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca4188 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [262144->266239] (req 262144->266239) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531970.127867:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca4188 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [262144->266239] (req 262144->266239) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531970.127870:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000089660739 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467587328:12345-10.240.43.64@tcp:3:fio.0 Request processed in 62us (88us total) trans 0 rc 4096/4096
00010000:00010000:1.0:1651531970.127871:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fb2f6575 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531970.127872:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca4188 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [262144->266239] (req 262144->266239) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531970.127873:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250232
00010000:00010000:1.0:1651531970.127875:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca4188 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [262144->266239] (req 262144->266239) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531970.127880:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca4188 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [262144->266239] (req 262144->266239) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531970.127882:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca4188 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [262144->266239] (req 262144->266239) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531970.151405:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531970.151414:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467587584
00000100:00100000:0.0:1651531970.151429:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250233
00000100:00100000:0.0:1651531970.151430:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000e33e11e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467587584:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531970.151437:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca418f lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.151442:0:192753:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca417a lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445e91 expref: 8 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531970.151445:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531970.151446:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531970.151447:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca418f lrc: 4/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [643072->647167] (req 643072->647167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.151454:0:192753:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca417a lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445e91 expref: 8 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531970.151458:0:192753:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca417a lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445e91 expref: 8 pid: 166111 timeout: 22778 lvb_type: 1
00000100:00100000:0.0:1651531970.151473:0:192753:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003158b8a7 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:192753:1731745997356672:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531970.151486:0:192753:0:(client.c:2492:ptlrpc_set_wait()) set 0000000060d3a5ac going to sleep for 6 seconds
00000100:00100000:0.0:1651531970.151683:0:192753:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003158b8a7 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:192753:1731745997356672:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651531970.151688:0:192753:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca418f lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [643072->647167] (req 643072->647167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531970.151781:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531970.151800:0:166102:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467587648
00010000:00010000:1.0:1651531970.151807:0:166102:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca417a lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445e91 expref: 9 pid: 166111 timeout: 22778 lvb_type: 1
00000100:00100000:1.0:1651531970.151817:0:166102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 222
00000100:00100000:1.0:1651531970.151819:0:166102:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003158b8a7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438149:x1731754467587648:12345-10.240.43.64@tcp:103:ldlm_bl_06.0
00010000:00010000:1.0:1651531970.151831:0:166102:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1651531970.151835:0:166102:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca417a lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445e91 expref: 9 pid: 166111 timeout: 22778 lvb_type: 1
00010000:00010000:1.0:1651531970.151839:0:166102:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca417a lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445e91 expref: 9 pid: 166111 timeout: 22778 lvb_type: 1
00010000:00010000:1.0:1651531970.151845:0:166102:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca417a lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445e91 expref: 9 pid: 166111 timeout: 22778 lvb_type: 1
00010000:00010000:1.0:1651531970.151849:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531970.151849:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531970.151850:0:166102:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca418f lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [643072->647167] (req 643072->647167) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531970.151853:0:166102:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca418f lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [643072->647167] (req 643072->647167) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531970.151865:0:166102:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1651531970.151875:0:166102:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003158b8a7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467587648:12345-10.240.43.64@tcp:103:ldlm_bl_06.0 Request processed in 55us (94us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531970.151877:0:166102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 222
00010000:00010000:0.0:1651531970.151878:0:192753:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca418f lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [643072->647167] (req 643072->647167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.151882:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca418f lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [643072->647167] (req 643072->647167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651531970.199195:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869325 is committed
00010000:00010000:0.0:1651531970.199245:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca418f lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [643072->647167] (req 643072->647167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.199249:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca418f lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [643072->647167] (req 643072->647167) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531970.199265:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000e33e11e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438146:x1731754467587584:12345-10.240.43.64@tcp:4:fio.0 Request processed in 47834us (47861us total) trans 21474869325 rc 0/0
00000100:00100000:0.0:1651531970.199268:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250233
00010000:00010000:0.0:1651531970.199276:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca418f lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [643072->647167] (req 643072->647167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.199280:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000075a78972 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531970.199282:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca418f lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [643072->647167] (req 643072->647167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.199285:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca418f lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [643072->647167] (req 643072->647167) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.199290:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca418f lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [643072->647167] (req 643072->647167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.199293:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca418f lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [643072->647167] (req 643072->647167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531970.199315:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531970.199342:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467587968
00000100:00100000:0.0:1651531970.199353:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44598
00000100:00100000:0.0:1651531970.199355:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000000615301 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438146:x1731754467587968:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531970.199359:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531970.199363:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4196 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445e9f expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.199368:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531970.199369:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531970.199371:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4196 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445e9f expref: 8 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531970.199376:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4196 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445e9f expref: 8 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531970.199379:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000032ee36ee, rc 0)
00000100:00100000:0.0:1651531970.199391:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000000615301 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467587968:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (76us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531970.199394:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44598
00000100:00100000:1.0:1651531970.199724:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531970.199742:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467588160
00000100:00100000:0.0:1651531970.199758:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250234
00000100:00100000:0.0:1651531970.199759:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000091075bf7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467588160:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531970.199767:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca419d lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.199771:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531970.199771:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531970.199773:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca419d lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [765952->770047] (req 765952->770047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.199777:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca419d lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [765952->770047] (req 765952->770047) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.199789:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca419d lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [765952->770047] (req 765952->770047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.199792:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca419d lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [765952->770047] (req 765952->770047) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531970.199812:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000091075bf7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467588160:12345-10.240.43.64@tcp:3:fio.0 Request processed in 51us (88us total) trans 0 rc 4096/4096
00010000:00010000:1.0:1651531970.199814:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca419d lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [765952->770047] (req 765952->770047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531970.199815:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250234
00010000:00010000:1.0:1651531970.199818:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fab23815 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531970.199827:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca419d lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [765952->770047] (req 765952->770047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531970.199831:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca419d lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [765952->770047] (req 765952->770047) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531970.199836:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca419d lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [765952->770047] (req 765952->770047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531970.199839:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca419d lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [765952->770047] (req 765952->770047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531970.200897:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531970.200915:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467588800
00000100:00100000:0.0:1651531970.200932:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250235
00000100:00100000:0.0:1651531970.200934:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004d72f458 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467588800:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531970.200944:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca41a4 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.200948:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531970.200949:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531970.200950:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca41a4 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [1015808->1019903] (req 1015808->1019903) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.200954:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca41a4 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [1015808->1019903] (req 1015808->1019903) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.200965:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca41a4 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [1015808->1019903] (req 1015808->1019903) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.200968:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca41a4 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [1015808->1019903] (req 1015808->1019903) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531970.200985:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca41a4 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [1015808->1019903] (req 1015808->1019903) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531970.200988:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004d72f458 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467588800:12345-10.240.43.64@tcp:3:fio.0 Request processed in 54us (92us total) trans 0 rc 4096/4096
00010000:00010000:1.0:1651531970.200989:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000775318ab already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531970.200990:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca41a4 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [1015808->1019903] (req 1015808->1019903) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531970.200991:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250235
00010000:00010000:1.0:1651531970.200993:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca41a4 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [1015808->1019903] (req 1015808->1019903) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531970.200998:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca41a4 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [1015808->1019903] (req 1015808->1019903) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531970.201001:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca41a4 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [1015808->1019903] (req 1015808->1019903) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531970.202336:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531970.202365:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467589312
00000100:00100000:0.0:1651531970.202380:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250236
00000100:00100000:0.0:1651531970.202381:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000008e0501d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467589312:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531970.202389:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca41ab lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.202392:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531970.202393:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531970.202395:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca41ab lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [995328->999423] (req 995328->999423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.202399:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca41ab lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [995328->999423] (req 995328->999423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.202410:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca41ab lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [995328->999423] (req 995328->999423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.202413:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca41ab lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [995328->999423] (req 995328->999423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531970.202428:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000008e0501d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467589312:12345-10.240.43.64@tcp:3:fio.0 Request processed in 46us (93us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531970.202430:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250236
00010000:00010000:0.0:1651531970.202437:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca41ab lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [995328->999423] (req 995328->999423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.202440:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000075a78972 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531970.202441:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca41ab lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [995328->999423] (req 995328->999423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.202444:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca41ab lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [995328->999423] (req 995328->999423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.202449:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca41ab lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [995328->999423] (req 995328->999423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.202451:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca41ab lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [995328->999423] (req 995328->999423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531970.248730:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531970.248754:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467589824
00000100:00100000:0.0:1651531970.248770:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250237
00000100:00100000:0.0:1651531970.248771:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001e61ed2d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467589824:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531970.248779:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca41b2 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.248784:0:192753:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4196 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445e9f expref: 8 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531970.248787:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531970.248788:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531970.248788:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca41b2 lrc: 4/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [331776->335871] (req 331776->335871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.248796:0:192753:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4196 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445e9f expref: 8 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531970.248800:0:192753:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4196 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445e9f expref: 8 pid: 166111 timeout: 22778 lvb_type: 1
00000100:00100000:0.0:1651531970.248804:0:192753:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e2c70225 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:192753:1731745997356736:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531970.248817:0:192753:0:(client.c:2492:ptlrpc_set_wait()) set 0000000060d3a5ac going to sleep for 6 seconds
00000100:00100000:1.0:1651531970.248926:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531970.248936:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467590016
00000100:00100000:0.0:1651531970.248942:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531970.248956:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467589952
00000100:00100000:0.0:1651531970.248957:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250238
00000100:00100000:0.0:1651531970.248960:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f99d9ea1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438147:x1731754467590016:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651531970.248966:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250239
00000100:00100000:1.0:1651531970.248968:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004d810c74 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438147:x1731754467589952:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531970.248976:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca41b9 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531970.248981:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531970.248982:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531970.248982:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca41b9 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [430080->434175] (req 430080->434175) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.248982:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca41c0 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531970.248986:0:216323:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca41b9 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [430080->434175] (req 430080->434175) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.248986:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531970.248987:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531970.248988:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca41c0 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [737280->741375] (req 737280->741375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.248992:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca41c0 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [737280->741375] (req 737280->741375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.249004:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca41c0 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [737280->741375] (req 737280->741375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.249007:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca41c0 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [737280->741375] (req 737280->741375) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531970.249022:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca41c0 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [737280->741375] (req 737280->741375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531970.249026:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f99d9ea1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438147:x1731754467590016:12345-10.240.43.64@tcp:3:fio.0 Request processed in 66us (100us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531970.249029:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250238
00010000:00010000:1.0:1651531970.249030:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000820577fb already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531970.249031:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca41c0 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [737280->741375] (req 737280->741375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531970.249034:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca41c0 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [737280->741375] (req 737280->741375) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531970.249039:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca41c0 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [737280->741375] (req 737280->741375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531970.249053:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca41c0 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [737280->741375] (req 737280->741375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531970.249098:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531970.249108:0:166102:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467590144
00000100:00100000:0.0:1651531970.249110:0:192753:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e2c70225 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:192753:1731745997356736:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651531970.249115:0:166102:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4196 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445e9f expref: 10 pid: 166111 timeout: 22778 lvb_type: 1
00010000:00010000:0.0:1651531970.249115:0:192753:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca41b2 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [331776->335871] (req 331776->335871) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531970.249126:0:166102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 223
00000100:00100000:1.0:1651531970.249128:0:166102:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000af037a35 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438146:x1731754467590144:12345-10.240.43.64@tcp:103:ldlm_bl_03.0
00010000:00010000:1.0:1651531970.249131:0:166102:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1651531970.249135:0:166102:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4196 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445e9f expref: 10 pid: 166111 timeout: 22778 lvb_type: 1
00010000:00010000:1.0:1651531970.249140:0:166102:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4196 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445e9f expref: 10 pid: 166111 timeout: 22778 lvb_type: 1
00010000:00010000:1.0:1651531970.249146:0:166102:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4196 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445e9f expref: 10 pid: 166111 timeout: 22778 lvb_type: 1
00010000:00010000:1.0:1651531970.249150:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531970.249150:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531970.249151:0:166102:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca41b2 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [331776->335871] (req 331776->335871) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531970.249154:0:166102:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca41b2 lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [331776->335871] (req 331776->335871) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531970.249169:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531970.249169:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531970.249170:0:166102:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca41b9 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [430080->434175] (req 430080->434175) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531970.249173:0:166102:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca41b9 lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [430080->434175] (req 430080->434175) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531970.249184:0:166102:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1651531970.249190:0:192753:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca41b2 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [331776->335871] (req 331776->335871) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531970.249194:0:166102:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000af037a35 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438146:x1731754467590144:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 65us (96us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531970.249197:0:166102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 223
00010000:00010000:1.0:1651531970.249204:0:216323:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca41b9 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [430080->434175] (req 430080->434175) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.249204:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca41b2 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [331776->335871] (req 331776->335871) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531970.249207:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca41b9 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [430080->434175] (req 430080->434175) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651531970.289901:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869327 is committed
00010000:00010000:1.0:1651531970.289921:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca41b9 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [430080->434175] (req 430080->434175) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531970.289925:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca41b9 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [430080->434175] (req 430080->434175) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.289930:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca41b2 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [331776->335871] (req 331776->335871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.289934:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca41b2 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [331776->335871] (req 331776->335871) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531970.289944:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004d810c74 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467589952:12345-10.240.43.64@tcp:4:fio.0 Request processed in 40975us (41002us total) trans 21474869326 rc 0/0
00000100:00100000:1.0:1651531970.289948:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250239
00000100:00100000:0.0:1651531970.289955:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001e61ed2d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467589824:12345-10.240.43.64@tcp:4:fio.0 Request processed in 41183us (41226us total) trans 21474869327 rc 0/0
00000100:00100000:0.0:1651531970.289958:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250237
00010000:00010000:1.0:1651531970.289964:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca41b9 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [430080->434175] (req 430080->434175) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.289966:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca41b2 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [331776->335871] (req 331776->335871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531970.289967:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006da7a892 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531970.289969:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca41b9 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [430080->434175] (req 430080->434175) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.289970:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000075a78972 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531970.289971:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca41b9 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [430080->434175] (req 430080->434175) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.289971:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca41b2 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [331776->335871] (req 331776->335871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.289974:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca41b2 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [331776->335871] (req 331776->335871) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531970.289976:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca41b9 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [430080->434175] (req 430080->434175) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531970.289979:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca41b9 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [430080->434175] (req 430080->434175) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.289979:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca41b2 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [331776->335871] (req 331776->335871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.289982:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca41b2 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [331776->335871] (req 331776->335871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531970.290350:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531970.290368:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467590656
00000100:00100000:0.0:1651531970.290384:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250240
00000100:00100000:0.0:1651531970.290386:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000043b0f16d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438149:x1731754467590656:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531970.290394:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca41c7 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.290398:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531970.290398:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531970.290399:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca41c7 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [77824->81919] (req 77824->81919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.290403:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca41c7 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [77824->81919] (req 77824->81919) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.290414:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca41c7 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [77824->81919] (req 77824->81919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.290417:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca41c7 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [77824->81919] (req 77824->81919) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531970.290435:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca41c7 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [77824->81919] (req 77824->81919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531970.290438:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000043b0f16d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438149:x1731754467590656:12345-10.240.43.64@tcp:3:fio.0 Request processed in 51us (88us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531970.290441:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250240
00010000:00010000:1.0:1651531970.290444:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000014685f38 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531970.290445:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca41c7 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [77824->81919] (req 77824->81919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531970.290448:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca41c7 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [77824->81919] (req 77824->81919) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531970.290453:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca41c7 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [77824->81919] (req 77824->81919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531970.290467:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca41c7 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [77824->81919] (req 77824->81919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531970.290657:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531970.290668:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467590912
00000100:00100000:0.0:1651531970.290678:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44599
00000100:00100000:0.0:1651531970.290680:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004237e3f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438146:x1731754467590912:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531970.290683:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531970.290696:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca41ce lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445ead expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.290701:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531970.290702:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531970.290704:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca41ce lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445ead expref: 8 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531970.290709:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca41ce lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445ead expref: 8 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531970.290713:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000032ee36ee, rc 0)
00000100:00100000:0.0:1651531970.290725:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004237e3f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467590912:12345-10.240.43.64@tcp:101:fio.0 Request processed in 45us (69us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531970.290728:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44599
00000100:00100000:1.0:1651531970.290886:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531970.290897:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531970.290897:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467591104
00000100:00100000:0.0:1651531970.290907:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467591168
00000100:00100000:0.0:1651531970.290913:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44600
00000100:00100000:0.0:1651531970.290914:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007b76f7f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438147:x1731754467591104:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651531970.290915:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44601
00000100:00100000:1.0:1651531970.290917:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f7096c29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754467591168:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531970.290917:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531970.290921:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531970.290921:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca41d5 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445ec9 expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531970.290925:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca41dc lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445ec2 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.290926:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531970.290926:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531970.290928:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca41d5 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445ec9 expref: 10 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531970.290933:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531970.290933:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531970.290936:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca41dc lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445ec2 expref: 11 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531970.290940:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca41dc lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445ec2 expref: 11 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531970.290940:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca41d5 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445ec9 expref: 11 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531970.290944:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000968553c1, rc 0)
00010000:00010000:0.0:1651531970.290952:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000820577fb, rc 0)
00000100:00100000:1.0:1651531970.290954:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f7096c29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754467591168:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (57us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531970.290957:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44601
00000100:00100000:0.0:1651531970.290961:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007b76f7f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438147:x1731754467591104:12345-10.240.43.64@tcp:101:fio.0 Request processed in 46us (75us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531970.290963:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44600
00000100:00100000:1.0:1651531970.337778:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531970.337800:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467592256
00000100:00100000:0.0:1651531970.337815:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250241
00000100:00100000:0.0:1651531970.337816:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000052cf3c08 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754467592256:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531970.337826:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca41e3 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.337830:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531970.337830:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531970.337831:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca41e3 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [450560->454655] (req 450560->454655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.337835:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca41e3 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [450560->454655] (req 450560->454655) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.337846:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca41e3 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [450560->454655] (req 450560->454655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.337850:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca41e3 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [450560->454655] (req 450560->454655) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531970.337868:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000052cf3c08 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754467592256:12345-10.240.43.64@tcp:3:fio.0 Request processed in 51us (91us total) trans 0 rc 4096/4096
00010000:00010000:1.0:1651531970.337872:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca41e3 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [450560->454655] (req 450560->454655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531970.337879:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000075a78972 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531970.337880:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca41e3 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [450560->454655] (req 450560->454655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531970.337880:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250241
00010000:00010000:1.0:1651531970.337883:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca41e3 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [450560->454655] (req 450560->454655) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531970.337888:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca41e3 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [450560->454655] (req 450560->454655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531970.337891:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca41e3 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [450560->454655] (req 450560->454655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531970.387295:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531970.387319:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467593408
00000100:00100000:0.0:1651531970.387335:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250242
00000100:00100000:0.0:1651531970.387336:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000b1a9136 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438147:x1731754467593408:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531970.387344:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca41ea lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.387349:0:192753:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca41ce lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445ead expref: 10 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531970.387352:0:192753:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca41d5 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445ec9 expref: 10 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531970.387355:0:192753:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca41dc lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445ec2 expref: 10 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531970.387358:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531970.387358:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531970.387359:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca41ea lrc: 6/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [40960->45055] (req 40960->45055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.387366:0:192753:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca41dc lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445ec2 expref: 10 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531970.387370:0:192753:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca41dc lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445ec2 expref: 10 pid: 166113 timeout: 22779 lvb_type: 1
00000100:00100000:0.0:1651531970.387387:0:192753:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e2c70225 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:192753:1731745997356800:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651531970.387408:0:192753:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca41d5 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445ec9 expref: 10 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531970.387412:0:192753:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca41d5 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445ec9 expref: 10 pid: 166111 timeout: 22779 lvb_type: 1
00000100:00100000:0.0:1651531970.387416:0:192753:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b0d90290 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:192753:1731745997356864:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651531970.387423:0:192753:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca41ce lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445ead expref: 10 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531970.387426:0:192753:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca41ce lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445ead expref: 10 pid: 166111 timeout: 22779 lvb_type: 1
00000100:00100000:0.0:1651531970.387430:0:192753:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f690960f pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:192753:1731745997356928:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531970.387435:0:192753:0:(client.c:2492:ptlrpc_set_wait()) set 000000002355ae1a going to sleep for 6 seconds
00000100:00100000:1.0:1651531970.387795:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531970.387802:0:192753:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e2c70225 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:192753:1731745997356800:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531970.387810:0:192753:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b0d90290 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:192753:1731745997356864:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531970.387813:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531970.387813:0:192753:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f690960f pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:192753:1731745997356928:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651531970.387823:0:192753:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca41ea lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [40960->45055] (req 40960->45055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531970.387827:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531970.387836:0:166103:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467593536
00000100:00100000:1.0:1651531970.387837:0:166102:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467593472
00010000:00010000:0.0:1651531970.387841:0:166103:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca41d5 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445ec9 expref: 12 pid: 166111 timeout: 22779 lvb_type: 1
00010000:00010000:1.0:1651531970.387844:0:166102:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca41dc lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445ec2 expref: 12 pid: 166113 timeout: 22779 lvb_type: 1
00000100:00100000:0.0:1651531970.387853:0:166103:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467593600
00010000:00010000:0.0:1651531970.387856:0:166103:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca41ce lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445ead expref: 13 pid: 166111 timeout: 22779 lvb_type: 1
00000100:00100000:1.0:1651531970.387860:0:166102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 224
00000100:00100000:1.0:1651531970.387862:0:166102:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005dd15341 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467593536:12345-10.240.43.64@tcp:103:ldlm_bl_05.0
00000100:00100000:0.0:1651531970.387863:0:166103:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 225
00010000:00010000:1.0:1651531970.387865:0:166102:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00000100:00100000:0.0:1651531970.387865:0:166103:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000091b66ece pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467593472:12345-10.240.43.64@tcp:103:ldlm_bl_02.0
00010000:00010000:0.0:1651531970.387868:0:166103:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1651531970.387870:0:166102:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca41d5 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445ec9 expref: 13 pid: 166111 timeout: 22779 lvb_type: 1
00010000:00010000:0.0:1651531970.387873:0:166103:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca41dc lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445ec2 expref: 13 pid: 166113 timeout: 22779 lvb_type: 1
00010000:00010000:0.0:1651531970.387876:0:166103:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca41dc lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445ec2 expref: 13 pid: 166113 timeout: 22779 lvb_type: 1
00010000:00010000:1.0:1651531970.387883:0:166102:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca41d5 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445ec9 expref: 13 pid: 166111 timeout: 22779 lvb_type: 1
00010000:00010000:0.0:1651531970.387890:0:166103:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca41dc lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445ec2 expref: 13 pid: 166113 timeout: 22779 lvb_type: 1
00010000:00010000:1.0:1651531970.387893:0:166102:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca41d5 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445ec9 expref: 13 pid: 166111 timeout: 22779 lvb_type: 1
00010000:00010000:0.0:1651531970.387895:0:166103:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1651531970.387897:0:166102:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651531970.387905:0:166103:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000091b66ece pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754467593472:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 39us (93us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531970.387906:0:166102:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005dd15341 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438147:x1731754467593536:12345-10.240.43.64@tcp:103:ldlm_bl_05.0 Request processed in 44us (111us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531970.387908:0:166103:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 225
00000100:00100000:1.0:1651531970.387910:0:166102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 224
00000100:00100000:0.0:1651531970.387914:0:166103:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 226
00000100:00100000:0.0:1651531970.387925:0:166103:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007a05c3e3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438149:x1731754467593600:12345-10.240.43.64@tcp:103:ldlm_bl_02.0
00010000:00010000:0.0:1651531970.387928:0:166103:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531970.387932:0:166103:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca41ce lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445ead expref: 9 pid: 166111 timeout: 22779 lvb_type: 1
00010000:00010000:0.0:1651531970.387936:0:166103:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca41ce lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445ead expref: 9 pid: 166111 timeout: 22779 lvb_type: 1
00010000:00010000:0.0:1651531970.387941:0:166103:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca41ce lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445ead expref: 9 pid: 166111 timeout: 22779 lvb_type: 1
00010000:00010000:0.0:1651531970.387945:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531970.387945:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531970.387946:0:166103:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca41ea lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [40960->45055] (req 40960->45055) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.387950:0:166103:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca41ea lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [40960->45055] (req 40960->45055) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.387957:0:166103:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651531970.387963:0:166103:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007a05c3e3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467593600:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 37us (136us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531970.387966:0:166103:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 226
00010000:00010000:0.0:1651531970.387972:0:192753:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca41ea lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [40960->45055] (req 40960->45055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.387976:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca41ea lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [40960->45055] (req 40960->45055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531970.438691:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531970.438702:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467593728
00000100:00100000:1.0:1651531970.438720:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250243
00000100:00100000:1.0:1651531970.438723:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005dd15341 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754467593728:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531970.438731:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca41f1 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531970.438737:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531970.438738:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531970.438739:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca41f1 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [835584->839679] (req 835584->839679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531970.438743:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca41f1 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [835584->839679] (req 835584->839679) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651531970.449765:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869328 is committed
00010000:00010000:0.0:1651531970.449796:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca41ea lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [40960->45055] (req 40960->45055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.449801:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca41ea lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [40960->45055] (req 40960->45055) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531970.449817:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000b1a9136 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438147:x1731754467593408:12345-10.240.43.64@tcp:4:fio.0 Request processed in 62480us (62523us total) trans 21474869328 rc 0/0
00000100:00100000:0.0:1651531970.449820:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250242
00010000:00010000:0.0:1651531970.449827:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca41ea lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [40960->45055] (req 40960->45055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.449831:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000775318ab already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531970.449832:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca41ea lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [40960->45055] (req 40960->45055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.449835:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca41ea lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [40960->45055] (req 40960->45055) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.449840:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca41ea lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [40960->45055] (req 40960->45055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.449842:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca41ea lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [40960->45055] (req 40960->45055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531970.450585:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531970.450604:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467593984
00000100:00100000:0.0:1651531970.450616:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250244
00000100:00100000:0.0:1651531970.450627:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009acffcb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438147:x1731754467593984:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531970.450634:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca41f8 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.450639:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531970.450639:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531970.450640:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca41f8 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [319488->323583] (req 319488->323583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.450644:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca41f8 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [319488->323583] (req 319488->323583) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531970.464580:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531970.464590:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467594368
00000100:00100000:0.0:1651531970.464606:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250245
00000100:00100000:0.0:1651531970.464608:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f690960f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467594368:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531970.464615:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca41ff lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.464619:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531970.464620:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531970.464621:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca41ff lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [974848->978943] (req 974848->978943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.464625:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca41ff lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [974848->978943] (req 974848->978943) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651531970.500915:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869330 is committed
00010000:00010000:0.0:1651531970.500944:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca41f8 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [319488->323583] (req 319488->323583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.500959:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca41f8 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [319488->323583] (req 319488->323583) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531970.500964:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca41f1 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [835584->839679] (req 835584->839679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531970.500979:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009acffcb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438147:x1731754467593984:12345-10.240.43.64@tcp:4:fio.0 Request processed in 50352us (50394us total) trans 21474869330 rc 0/0
00000100:00100000:0.0:1651531970.500982:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250244
00010000:00010000:1.0:1651531970.500986:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca41f1 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [835584->839679] (req 835584->839679) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.500997:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca41f8 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [319488->323583] (req 319488->323583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.501000:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000032ee36ee already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531970.501002:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca41f8 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [319488->323583] (req 319488->323583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.501005:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca41f8 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [319488->323583] (req 319488->323583) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531970.501008:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005dd15341 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754467593728:12345-10.240.43.64@tcp:4:fio.0 Request processed in 62285us (62318us total) trans 21474869329 rc 0/0
00010000:00010000:0.0:1651531970.501009:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca41f8 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [319488->323583] (req 319488->323583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.501012:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca41f8 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [319488->323583] (req 319488->323583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.501016:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca41f1 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [835584->839679] (req 835584->839679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.501019:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006da7a892 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531970.501019:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca41f1 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [835584->839679] (req 835584->839679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531970.501028:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250243
00010000:00010000:0.0:1651531970.501031:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca41f1 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [835584->839679] (req 835584->839679) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.501034:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca41f1 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [835584->839679] (req 835584->839679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.501037:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca41f1 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [835584->839679] (req 835584->839679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531970.501392:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531970.501400:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467594624
00000100:00100000:0.0:1651531970.501408:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44602
00000100:00100000:0.0:1651531970.501410:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b0d90290 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438146:x1731754467594624:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531970.501414:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531970.501426:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca4206 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445ed7 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.501434:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca4206 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445ed7 expref: 11 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531970.501439:0:166112:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca4206 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445ed7 expref: 11 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531970.501442:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fab23815, rc 0)
00000100:00100000:0.0:1651531970.501452:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b0d90290 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438146:x1731754467594624:12345-10.240.43.64@tcp:101:fio.0 Request processed in 42us (61us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531970.501464:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44602
00000100:00100000:0.0:1651531970.538176:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531970.538184:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467595200
00000100:00100000:0.0:1651531970.538192:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44603
00000100:00100000:0.0:1651531970.538194:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e2c70225 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438148:x1731754467595200:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531970.538197:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531970.538201:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca420d lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445ee5 expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.538208:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca420d lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445ee5 expref: 11 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531970.538241:0:166111:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca420d lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445ee5 expref: 11 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531970.538245:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fab23815, rc 0)
00000100:00100000:0.0:1651531970.538256:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e2c70225 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438148:x1731754467595200:12345-10.240.43.64@tcp:101:fio.0 Request processed in 62us (81us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531970.538259:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44603
00000100:00100000:0.0:1651531970.539014:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531970.539038:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467595456
00000100:00100000:1.0:1651531970.539055:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250246
00000100:00100000:1.0:1651531970.539057:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f0234546 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754467595456:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531970.539068:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4214 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531970.539073:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531970.539073:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531970.539074:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4214 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [507904->511999] (req 507904->511999) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531970.539079:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4214 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [507904->511999] (req 507904->511999) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531970.539092:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4214 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [507904->511999] (req 507904->511999) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531970.539095:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4214 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [507904->511999] (req 507904->511999) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.539122:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4214 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [507904->511999] (req 507904->511999) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531970.539126:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f0234546 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754467595456:12345-10.240.43.64@tcp:3:fio.0 Request processed in 68us (112us total) trans 0 rc 4096/4096
00010000:00010000:0.0:1651531970.539126:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b4c8742a already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531970.539127:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4214 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [507904->511999] (req 507904->511999) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531970.539129:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250246
00010000:00010000:0.0:1651531970.539142:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4214 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [507904->511999] (req 507904->511999) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.539148:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4214 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [507904->511999] (req 507904->511999) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.539150:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4214 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [507904->511999] (req 507904->511999) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531970.539488:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531970.539510:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467595584
00000100:00100000:1.0:1651531970.539523:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250247
00000100:00100000:1.0:1651531970.539524:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085951ded pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438148:x1731754467595584:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531970.539531:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca421b lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531970.539536:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531970.539536:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531970.539537:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca421b lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [139264->143359] (req 139264->143359) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531970.539541:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca421b lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [139264->143359] (req 139264->143359) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651531970.551580:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869331 is committed
00010000:00010000:0.0:1651531970.551606:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca41ff lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [974848->978943] (req 974848->978943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.551611:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca41ff lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [974848->978943] (req 974848->978943) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531970.551631:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f690960f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438147:x1731754467594368:12345-10.240.43.64@tcp:4:fio.0 Request processed in 87023us (87051us total) trans 21474869331 rc 0/0
00010000:00010000:1.0:1651531970.551635:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca41ff lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [974848->978943] (req 974848->978943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531970.551635:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250245
00010000:00010000:1.0:1651531970.551639:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000775318ab already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531970.551640:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca41ff lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [974848->978943] (req 974848->978943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531970.551643:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca41ff lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [974848->978943] (req 974848->978943) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531970.551661:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca41ff lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [974848->978943] (req 974848->978943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531970.551663:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca41ff lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [974848->978943] (req 974848->978943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531970.552319:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531970.552327:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467595840
00000100:00100000:0.0:1651531970.552337:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250248
00000100:00100000:0.0:1651531970.552339:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a6e5c9ad pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438146:x1731754467595840:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531970.552347:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca4222 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.552351:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531970.552360:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531970.552362:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca4222 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [917504->921599] (req 917504->921599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.552366:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca4222 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [917504->921599] (req 917504->921599) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.552378:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca4222 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [917504->921599] (req 917504->921599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.552381:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca4222 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [917504->921599] (req 917504->921599) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531970.552396:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a6e5c9ad pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438146:x1731754467595840:12345-10.240.43.64@tcp:3:fio.0 Request processed in 56us (77us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531970.552399:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250248
00010000:00010000:0.0:1651531970.552405:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca4222 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [917504->921599] (req 917504->921599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.552408:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fab23815 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531970.552409:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca4222 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [917504->921599] (req 917504->921599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.552412:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca4222 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [917504->921599] (req 917504->921599) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.552417:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca4222 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [917504->921599] (req 917504->921599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.552419:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca4222 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [917504->921599] (req 917504->921599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531970.577367:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531970.577377:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531970.577389:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467596160
00000100:00100000:0.0:1651531970.577395:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467596224
00000100:00100000:0.0:1651531970.577402:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44604
00000100:00100000:0.0:1651531970.577404:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d5b4a165 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438146:x1731754467596160:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651531970.577408:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44605
00010000:00010000:0.0:1651531970.577408:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651531970.577411:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009486b685 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754467596224:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531970.577412:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca4229 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445efa expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531970.577415:0:206699:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531970.577420:0:206699:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4230 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445f01 expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.577420:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca4229 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445efa expref: 12 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531970.577424:0:166111:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca4229 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445efa expref: 13 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531970.577428:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fab23815, rc 0)
00010000:00010000:1.0:1651531970.577429:0:206699:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4230 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445f01 expref: 12 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531970.577434:0:206699:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4230 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445f01 expref: 12 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531970.577437:0:206699:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b4c8742a, rc 0)
00000100:00100000:0.0:1651531970.577438:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d5b4a165 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438146:x1731754467596160:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (71us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531970.577440:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44604
00000100:00100000:1.0:1651531970.577447:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009486b685 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438148:x1731754467596224:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (70us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531970.577450:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44605
00000100:00100000:0.0:1651531970.578370:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531970.578379:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531970.578391:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467596608
00000100:00100000:1.0:1651531970.578396:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467596672
00000100:00100000:0.0:1651531970.578402:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250249
00000100:00100000:0.0:1651531970.578403:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000065cbff98 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754467596608:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651531970.578405:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44606
00000100:00100000:1.0:1651531970.578406:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000008174da5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438147:x1731754467596672:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531970.578419:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4237 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531970.578421:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531970.578424:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca423e lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445f0f expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.578424:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531970.578424:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531970.578425:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4237 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [655360->659455] (req 655360->659455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.578429:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4237 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [655360->659455] (req 655360->659455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531970.578437:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca423e lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445f0f expref: 12 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531970.578442:0:166112:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca423e lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445f0f expref: 12 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531970.578445:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006da7a892, rc 0)
00000100:00100000:1.0:1651531970.578458:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000008174da5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438147:x1731754467596672:12345-10.240.43.64@tcp:101:fio.0 Request processed in 51us (79us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531970.578461:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44606
00000001:00080000:1.0:1651531970.613764:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869332 is committed
00010000:00010000:0.0:1651531970.613798:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca421b lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [139264->143359] (req 139264->143359) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.613803:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca421b lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [139264->143359] (req 139264->143359) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531970.613819:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085951ded pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438148:x1731754467595584:12345-10.240.43.64@tcp:4:fio.0 Request processed in 74294us (74332us total) trans 21474869332 rc 0/0
00000100:00100000:0.0:1651531970.613822:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250247
00010000:00010000:0.0:1651531970.613829:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca421b lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [139264->143359] (req 139264->143359) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.613832:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001e36c601 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531970.613833:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca421b lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [139264->143359] (req 139264->143359) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.613836:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca421b lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [139264->143359] (req 139264->143359) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.613854:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca421b lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [139264->143359] (req 139264->143359) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.613857:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca421b lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [139264->143359] (req 139264->143359) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531970.626619:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531970.626642:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467597312
00000100:00100000:0.0:1651531970.626658:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250250
00000100:00100000:0.0:1651531970.626659:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000099b6616a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438146:x1731754467597312:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531970.626667:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca4245 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.626671:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531970.626672:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531970.626673:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca4245 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [458752->462847] (req 458752->462847) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.626677:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca4245 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [458752->462847] (req 458752->462847) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.626688:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca4245 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [458752->462847] (req 458752->462847) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.626691:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca4245 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [458752->462847] (req 458752->462847) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531970.626711:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000099b6616a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438146:x1731754467597312:12345-10.240.43.64@tcp:3:fio.0 Request processed in 51us (93us total) trans 0 rc 4096/4096
00010000:00010000:1.0:1651531970.626713:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca4245 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [458752->462847] (req 458752->462847) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531970.626718:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fab23815 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531970.626719:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca4245 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [458752->462847] (req 458752->462847) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531970.626722:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca4245 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [458752->462847] (req 458752->462847) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531970.626724:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250250
00010000:00010000:1.0:1651531970.626728:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca4245 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [458752->462847] (req 458752->462847) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531970.626740:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca4245 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [458752->462847] (req 458752->462847) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651531970.664409:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869333 is committed
00010000:00010000:0.0:1651531970.664438:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4237 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [655360->659455] (req 655360->659455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.664443:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4237 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [655360->659455] (req 655360->659455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531970.664470:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000065cbff98 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438149:x1731754467596608:12345-10.240.43.64@tcp:4:fio.0 Request processed in 86065us (86100us total) trans 21474869333 rc 0/0
00000100:00100000:0.0:1651531970.664473:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250249
00010000:00010000:0.0:1651531970.664480:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4237 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [655360->659455] (req 655360->659455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.664484:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000032ee36ee already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531970.664485:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4237 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [655360->659455] (req 655360->659455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.664488:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4237 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [655360->659455] (req 655360->659455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.664493:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4237 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [655360->659455] (req 655360->659455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.664496:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4237 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [655360->659455] (req 655360->659455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531970.665525:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531970.665533:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467597760
00000100:00100000:0.0:1651531970.665553:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250251
00000100:00100000:0.0:1651531970.665555:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000af037a35 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438147:x1731754467597760:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531970.665562:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca424c lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.665566:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531970.665567:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531970.665568:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca424c lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [716800->720895] (req 716800->720895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.665572:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca424c lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [716800->720895] (req 716800->720895) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.665583:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca424c lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [716800->720895] (req 716800->720895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.665586:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca424c lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [716800->720895] (req 716800->720895) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531970.665607:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000af037a35 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438147:x1731754467597760:12345-10.240.43.64@tcp:3:fio.0 Request processed in 51us (82us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531970.665609:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250251
00010000:00010000:0.0:1651531970.665617:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca424c lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [716800->720895] (req 716800->720895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.665620:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e2ec18e1 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531970.665621:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca424c lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [716800->720895] (req 716800->720895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.665635:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca424c lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [716800->720895] (req 716800->720895) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.665640:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca424c lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [716800->720895] (req 716800->720895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.665642:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca424c lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [716800->720895] (req 716800->720895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531970.690627:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531970.690649:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467598144
00000100:00100000:1.0:1651531970.690666:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250252
00000100:00100000:1.0:1651531970.690667:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003b5b354a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438146:x1731754467598144:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531970.690675:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4253 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531970.690680:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531970.690680:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531970.690681:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4253 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [688128->692223] (req 688128->692223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531970.690685:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4253 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [688128->692223] (req 688128->692223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531970.690699:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4253 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [688128->692223] (req 688128->692223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531970.690702:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4253 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [688128->692223] (req 688128->692223) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531970.690718:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003b5b354a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438146:x1731754467598144:12345-10.240.43.64@tcp:3:fio.0 Request processed in 50us (91us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531970.690721:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250252
00010000:00010000:1.0:1651531970.690738:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4253 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [688128->692223] (req 688128->692223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531970.690742:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006da7a892 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531970.690743:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4253 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [688128->692223] (req 688128->692223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531970.690746:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4253 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [688128->692223] (req 688128->692223) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531970.690750:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4253 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [688128->692223] (req 688128->692223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531970.690753:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4253 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [688128->692223] (req 688128->692223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531970.691084:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531970.691102:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467598336
00000100:00100000:1.0:1651531970.691111:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44607
00000100:00100000:1.0:1651531970.691113:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b9b10d48 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438147:x1731754467598336:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531970.691117:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531970.691120:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca425a lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445f1d expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531970.691125:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531970.691126:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531970.691128:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca425a lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445f1d expref: 8 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531970.691133:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca425a lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445f1d expref: 8 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531970.691147:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b4c8742a, rc 0)
00000100:00100000:1.0:1651531970.691158:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b9b10d48 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467598336:12345-10.240.43.64@tcp:101:fio.0 Request processed in 44us (74us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531970.691161:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44607
00000100:00100000:0.0:1651531970.715109:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531970.715138:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467599104
00000100:00100000:1.0:1651531970.715154:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250253
00000100:00100000:1.0:1651531970.715156:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000315bf4eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467599104:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531970.715163:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4261 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531970.715167:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531970.715168:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531970.715169:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4261 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [20480->24575] (req 20480->24575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531970.715173:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4261 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [20480->24575] (req 20480->24575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531970.715185:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4261 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [20480->24575] (req 20480->24575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531970.715188:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4261 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [20480->24575] (req 20480->24575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.715205:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4261 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [20480->24575] (req 20480->24575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531970.715208:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000315bf4eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467599104:12345-10.240.43.64@tcp:3:fio.0 Request processed in 51us (100us total) trans 0 rc 4096/4096
00010000:00010000:0.0:1651531970.715210:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006da7a892 already unused, calling callback (0000000049fddea7)
00000100:00100000:1.0:1651531970.715221:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250253
00010000:00010000:0.0:1651531970.715221:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4261 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [20480->24575] (req 20480->24575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.715235:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4261 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [20480->24575] (req 20480->24575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.715241:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4261 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [20480->24575] (req 20480->24575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.715244:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4261 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [20480->24575] (req 20480->24575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531970.739980:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531970.740002:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467599488
00000100:00100000:1.0:1651531970.740016:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250254
00000100:00100000:1.0:1651531970.740018:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a9fc5082 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467599488:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531970.740026:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4268 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531970.740030:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531970.740030:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531970.740031:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4268 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [1040384->1044479] (req 1040384->1044479) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531970.740035:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4268 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [1040384->1044479] (req 1040384->1044479) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531970.740046:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4268 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [1040384->1044479] (req 1040384->1044479) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531970.740050:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4268 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [1040384->1044479] (req 1040384->1044479) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531970.740069:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a9fc5082 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467599488:12345-10.240.43.64@tcp:3:fio.0 Request processed in 50us (90us total) trans 0 rc 4096/4096
00010000:00010000:0.0:1651531970.740071:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4268 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [1040384->1044479] (req 1040384->1044479) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531970.740072:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250254
00010000:00010000:0.0:1651531970.740075:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000968553c1 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531970.740076:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4268 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [1040384->1044479] (req 1040384->1044479) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.740080:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4268 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [1040384->1044479] (req 1040384->1044479) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.740085:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4268 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [1040384->1044479] (req 1040384->1044479) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.740088:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4268 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [1040384->1044479] (req 1040384->1044479) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531970.740404:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531970.740426:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467599616
00000100:00100000:1.0:1651531970.740438:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250255
00000100:00100000:1.0:1651531970.740440:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c62d1815 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467599616:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531970.740447:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca426f lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531970.740463:0:216323:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca425a lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445f1d expref: 8 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531970.740466:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531970.740467:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531970.740468:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca426f lrc: 4/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [995328->999423] (req 995328->999423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531970.740492:0:216323:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca425a lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445f1d expref: 8 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531970.740496:0:216323:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca425a lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445f1d expref: 8 pid: 166113 timeout: 22779 lvb_type: 1
00000100:00100000:1.0:1651531970.740501:0:216323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000be4b467 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_010:lustre-OST0001_UUID:216323:1731745997356992:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531970.740514:0:216323:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fc7d2635 going to sleep for 6 seconds
00000100:00100000:1.0:1651531970.740725:0:216323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000be4b467 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_010:lustre-OST0001_UUID:216323:1731745997356992:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651531970.740730:0:216323:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca426f lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [995328->999423] (req 995328->999423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531970.740799:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531970.740818:0:166103:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467599680
00010000:00010000:0.0:1651531970.740825:0:166103:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca425a lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445f1d expref: 9 pid: 166113 timeout: 22779 lvb_type: 1
00000100:00100000:0.0:1651531970.740837:0:166103:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 227
00000100:00100000:0.0:1651531970.740839:0:166103:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000be4b467 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754467599680:12345-10.240.43.64@tcp:103:ldlm_bl_06.0
00010000:00010000:0.0:1651531970.740842:0:166103:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531970.740846:0:166103:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca425a lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445f1d expref: 9 pid: 166113 timeout: 22779 lvb_type: 1
00010000:00010000:0.0:1651531970.740860:0:166103:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca425a lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445f1d expref: 9 pid: 166113 timeout: 22779 lvb_type: 1
00010000:00010000:0.0:1651531970.740866:0:166103:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca425a lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445f1d expref: 9 pid: 166113 timeout: 22779 lvb_type: 1
00010000:00010000:0.0:1651531970.740871:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531970.740871:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531970.740872:0:166103:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca426f lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [995328->999423] (req 995328->999423) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.740876:0:166103:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca426f lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [995328->999423] (req 995328->999423) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.740884:0:166103:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1651531970.740890:0:216323:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca426f lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [995328->999423] (req 995328->999423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531970.740894:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca426f lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [995328->999423] (req 995328->999423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531970.740896:0:166103:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000be4b467 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467599680:12345-10.240.43.64@tcp:103:ldlm_bl_06.0 Request processed in 56us (97us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531970.740899:0:166103:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 227
00000100:00100000:1.0:1651531970.778637:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531970.778657:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467599872
00000100:00100000:0.0:1651531970.778673:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250256
00000100:00100000:0.0:1651531970.778674:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009c946e88 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754467599872:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531970.778684:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4276 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.778689:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531970.778689:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531970.778690:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4276 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [868352->872447] (req 868352->872447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.778703:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4276 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [868352->872447] (req 868352->872447) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531970.778707:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531970.778715:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467599808
00010000:00010000:0.0:1651531970.778715:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4276 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [868352->872447] (req 868352->872447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.778719:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4276 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [868352->872447] (req 868352->872447) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531970.778731:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250257
00000100:00100000:1.0:1651531970.778733:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f18d8e18 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754467599808:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651531970.778739:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009c946e88 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754467599872:12345-10.240.43.64@tcp:3:fio.0 Request processed in 63us (102us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531970.778742:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250256
00010000:00010000:1.0:1651531970.778746:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca427d lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531970.778750:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531970.778751:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531970.778752:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca427d lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [700416->704511] (req 700416->704511) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.778755:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4276 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [868352->872447] (req 868352->872447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531970.778756:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca427d lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [700416->704511] (req 700416->704511) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.778758:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e2ec18e1 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531970.778759:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4276 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [868352->872447] (req 868352->872447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.778762:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4276 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [868352->872447] (req 868352->872447) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.778767:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4276 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [868352->872447] (req 868352->872447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.778770:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4276 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [868352->872447] (req 868352->872447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651531970.815057:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869334 is committed
00010000:00010000:1.0:1651531970.815099:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca426f lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [995328->999423] (req 995328->999423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531970.815104:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca426f lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [995328->999423] (req 995328->999423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.815130:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca426f lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [995328->999423] (req 995328->999423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531970.815135:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c62d1815 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438147:x1731754467599616:12345-10.240.43.64@tcp:4:fio.0 Request processed in 74694us (74730us total) trans 21474869334 rc 0/0
00010000:00010000:0.0:1651531970.815135:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a8889a80 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531970.815136:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca426f lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [995328->999423] (req 995328->999423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.815139:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca426f lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [995328->999423] (req 995328->999423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531970.815140:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250255
00010000:00010000:0.0:1651531970.815144:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca426f lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [995328->999423] (req 995328->999423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.815147:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca426f lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [995328->999423] (req 995328->999423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531970.815486:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531970.815502:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467600192
00000100:00100000:1.0:1651531970.815517:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250258
00000100:00100000:1.0:1651531970.815519:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d0a08679 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438147:x1731754467600192:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531970.815527:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4284 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531970.815531:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531970.815532:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531970.815533:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4284 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [401408->405503] (req 401408->405503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531970.815537:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4284 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [401408->405503] (req 401408->405503) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531970.827931:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531970.827940:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467600320
00000100:00100000:0.0:1651531970.827950:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250259
00000100:00100000:0.0:1651531970.827952:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005ec1cbc3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467600320:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531970.827960:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca428b lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.827964:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531970.827964:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531970.827966:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca428b lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.827980:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca428b lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651531970.865699:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869335 is committed
00010000:00010000:0.0:1651531970.865735:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca427d lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [700416->704511] (req 700416->704511) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.865739:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca427d lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [700416->704511] (req 700416->704511) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531970.865760:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f18d8e18 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754467599808:12345-10.240.43.64@tcp:4:fio.0 Request processed in 87026us (87054us total) trans 21474869335 rc 0/0
00000100:00100000:0.0:1651531970.865764:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250257
00010000:00010000:0.0:1651531970.865771:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca427d lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [700416->704511] (req 700416->704511) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.865775:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e9b84540 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531970.865776:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca427d lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [700416->704511] (req 700416->704511) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.865779:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca427d lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [700416->704511] (req 700416->704511) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.865784:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca427d lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [700416->704511] (req 700416->704511) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.865786:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca427d lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [700416->704511] (req 700416->704511) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531970.866095:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531970.866119:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467600448
00000100:00100000:1.0:1651531970.866128:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44608
00000100:00100000:1.0:1651531970.866130:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d87e5801 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467600448:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531970.866134:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531970.866138:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4292 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445f2b expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531970.866146:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4292 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445f2b expref: 14 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531970.866151:0:166112:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4292 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445f2b expref: 14 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531970.866166:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c2b76533, rc 0)
00000100:00100000:1.0:1651531970.866178:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d87e5801 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467600448:12345-10.240.43.64@tcp:101:fio.0 Request processed in 47us (84us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531970.866181:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44608
00000100:00100000:0.0:1651531970.866971:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531970.866979:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467600704
00000100:00100000:0.0:1651531970.866989:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250260
00000100:00100000:0.0:1651531970.866990:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a23bcd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467600704:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531970.866998:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4299 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.867002:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531970.867002:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531970.867003:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4299 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [618496->622591] (req 618496->622591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.867007:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4299 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [618496->622591] (req 618496->622591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.867019:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4299 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [618496->622591] (req 618496->622591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.867022:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4299 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [618496->622591] (req 618496->622591) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531970.867044:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a23bcd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467600704:12345-10.240.43.64@tcp:3:fio.0 Request processed in 53us (74us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531970.867047:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250260
00010000:00010000:0.0:1651531970.867054:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4299 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [618496->622591] (req 618496->622591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.867069:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000032ee36ee already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531970.867070:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4299 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [618496->622591] (req 618496->622591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.867073:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4299 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [618496->622591] (req 618496->622591) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.867078:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4299 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [618496->622591] (req 618496->622591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.867080:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4299 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [618496->622591] (req 618496->622591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531970.867341:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531970.867352:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467600832
00000100:00100000:1.0:1651531970.867366:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250261
00000100:00100000:1.0:1651531970.867368:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000033723645 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467600832:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531970.867379:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca42a0 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531970.867383:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531970.867384:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531970.867385:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca42a0 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [421888->425983] (req 421888->425983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531970.867389:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca42a0 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [421888->425983] (req 421888->425983) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531970.867402:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca42a0 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [421888->425983] (req 421888->425983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531970.867405:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca42a0 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [421888->425983] (req 421888->425983) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.867415:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca42a0 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [421888->425983] (req 421888->425983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.867419:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d44eb74d already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531970.867420:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca42a0 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [421888->425983] (req 421888->425983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531970.867423:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000033723645 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467600832:12345-10.240.43.64@tcp:3:fio.0 Request processed in 55us (82us total) trans 0 rc 4096/4096
00010000:00010000:0.0:1651531970.867423:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca42a0 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [421888->425983] (req 421888->425983) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.867428:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca42a0 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [421888->425983] (req 421888->425983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.867431:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca42a0 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [421888->425983] (req 421888->425983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531970.867436:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250261
00000100:00100000:0.0:1651531970.867736:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531970.867753:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467600960
00000100:00100000:1.0:1651531970.867766:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250262
00000100:00100000:1.0:1651531970.867767:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b9b10d48 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467600960:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531970.867774:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca42a7 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531970.867778:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531970.867779:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531970.867780:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca42a7 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [45056->49151] (req 45056->49151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531970.867784:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca42a7 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [45056->49151] (req 45056->49151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531970.878599:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531970.878623:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467601088
00000100:00100000:0.0:1651531970.878638:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250263
00000100:00100000:0.0:1651531970.878640:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000205abf78 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754467601088:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531970.878647:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca42ae lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.878651:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531970.878651:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531970.878652:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca42ae lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [81920->86015] (req 81920->86015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.878656:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca42ae lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [81920->86015] (req 81920->86015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651531970.891611:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869337 is committed
00010000:00010000:0.0:1651531970.891641:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca428b lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.891645:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca428b lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531970.891662:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005ec1cbc3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754467600320:12345-10.240.43.64@tcp:4:fio.0 Request processed in 63708us (63731us total) trans 21474869337 rc 0/0
00000100:00100000:0.0:1651531970.891665:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250259
00010000:00010000:0.0:1651531970.891671:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca428b lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.891687:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e2ec18e1 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531970.891688:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca428b lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.891691:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca428b lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.891696:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca428b lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.891698:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca428b lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.891710:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4284 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [401408->405503] (req 401408->405503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.891713:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4284 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [401408->405503] (req 401408->405503) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531970.891725:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d0a08679 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438147:x1731754467600192:12345-10.240.43.64@tcp:4:fio.0 Request processed in 76205us (76240us total) trans 21474869336 rc 0/0
00000100:00100000:0.0:1651531970.891727:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250258
00010000:00010000:0.0:1651531970.891733:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4284 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [401408->405503] (req 401408->405503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.891737:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008558d1b3 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531970.891737:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4284 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [401408->405503] (req 401408->405503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.891749:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4284 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [401408->405503] (req 401408->405503) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.891753:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4284 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [401408->405503] (req 401408->405503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.891756:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4284 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [401408->405503] (req 401408->405503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531970.892099:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531970.892118:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467601344
00000100:00100000:0.0:1651531970.892130:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250264
00000100:00100000:0.0:1651531970.892131:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004f05a5e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467601344:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531970.892138:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca42b5 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.892142:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531970.892143:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531970.892144:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca42b5 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [978944->983039] (req 978944->983039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.892148:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca42b5 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [978944->983039] (req 978944->983039) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531970.892410:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531970.892417:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467601472
00000100:00100000:0.0:1651531970.892434:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250265
00000100:00100000:0.0:1651531970.892436:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aa58c961 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754467601472:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531970.892453:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca42bc lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.892457:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531970.892458:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531970.892459:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca42bc lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [212992->217087] (req 212992->217087) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.892463:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca42bc lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [212992->217087] (req 212992->217087) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.892474:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca42bc lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [212992->217087] (req 212992->217087) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.892477:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca42bc lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [212992->217087] (req 212992->217087) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531970.892497:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aa58c961 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754467601472:12345-10.240.43.64@tcp:3:fio.0 Request processed in 60us (88us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531970.892500:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250265
00010000:00010000:0.0:1651531970.892508:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca42bc lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [212992->217087] (req 212992->217087) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.892511:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000080362f27 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531970.892512:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca42bc lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [212992->217087] (req 212992->217087) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.892515:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca42bc lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [212992->217087] (req 212992->217087) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.892531:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca42bc lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [212992->217087] (req 212992->217087) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.892533:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca42bc lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [212992->217087] (req 212992->217087) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531970.941251:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531970.941260:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467601728
00000100:00100000:0.0:1651531970.941277:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250266
00000100:00100000:0.0:1651531970.941278:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006c46ca95 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754467601728:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531970.941286:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca42c3 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.941291:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531970.941292:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531970.941293:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca42c3 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [462848->466943] (req 462848->466943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.941297:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca42c3 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [462848->466943] (req 462848->466943) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.941309:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca42c3 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [462848->466943] (req 462848->466943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.941312:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca42c3 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [462848->466943] (req 462848->466943) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531970.941332:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006c46ca95 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438149:x1731754467601728:12345-10.240.43.64@tcp:3:fio.0 Request processed in 53us (82us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531970.941344:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250266
00010000:00010000:0.0:1651531970.941352:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca42c3 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [462848->466943] (req 462848->466943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.941355:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000080362f27 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531970.941356:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca42c3 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [462848->466943] (req 462848->466943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.941359:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca42c3 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [462848->466943] (req 462848->466943) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.941363:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca42c3 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [462848->466943] (req 462848->466943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.941366:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca42c3 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [462848->466943] (req 462848->466943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531970.941378:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869339 is committed
00010000:00010000:1.0:1651531970.941410:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca42a7 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [45056->49151] (req 45056->49151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531970.941414:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca42a7 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [45056->49151] (req 45056->49151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531970.941436:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b9b10d48 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438146:x1731754467600960:12345-10.240.43.64@tcp:4:fio.0 Request processed in 73667us (73700us total) trans 21474869338 rc 0/0
00010000:00010000:0.0:1651531970.941438:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca42ae lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [81920->86015] (req 81920->86015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531970.941439:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250262
00010000:00010000:0.0:1651531970.941442:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca42ae lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [81920->86015] (req 81920->86015) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531970.941451:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca42a7 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [45056->49151] (req 45056->49151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531970.941458:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a8889a80 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531970.941459:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca42a7 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [45056->49151] (req 45056->49151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531970.941462:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca42a7 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [45056->49151] (req 45056->49151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531970.941470:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000205abf78 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438148:x1731754467601088:12345-10.240.43.64@tcp:4:fio.0 Request processed in 62830us (62871us total) trans 21474869339 rc 0/0
00010000:00010000:1.0:1651531970.941478:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca42a7 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [45056->49151] (req 45056->49151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531970.941481:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca42a7 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [45056->49151] (req 45056->49151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531970.941485:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca42ae lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [81920->86015] (req 81920->86015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531970.941486:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250263
00010000:00010000:1.0:1651531970.941487:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000032ee36ee already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531970.941488:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca42ae lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [81920->86015] (req 81920->86015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531970.941491:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca42ae lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [81920->86015] (req 81920->86015) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531970.941494:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca42ae lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [81920->86015] (req 81920->86015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531970.941497:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca42ae lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [81920->86015] (req 81920->86015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531970.941853:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531970.941872:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467601856
00000100:00100000:0.0:1651531970.941896:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250267
00000100:00100000:0.0:1651531970.941898:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002dee0a2a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438148:x1731754467601856:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531970.941908:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca42ca lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.941912:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531970.941912:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531970.941913:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca42ca lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [352256->356351] (req 352256->356351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.941917:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca42ca lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [352256->356351] (req 352256->356351) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.941930:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca42ca lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [352256->356351] (req 352256->356351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.941933:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca42ca lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [352256->356351] (req 352256->356351) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531970.941948:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002dee0a2a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438148:x1731754467601856:12345-10.240.43.64@tcp:3:fio.0 Request processed in 50us (96us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531970.941951:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250267
00010000:00010000:0.0:1651531970.941958:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca42ca lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [352256->356351] (req 352256->356351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.941961:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e2ec18e1 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531970.941962:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca42ca lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [352256->356351] (req 352256->356351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.941968:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca42ca lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [352256->356351] (req 352256->356351) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.941973:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca42ca lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [352256->356351] (req 352256->356351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.941975:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca42ca lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [352256->356351] (req 352256->356351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531970.942693:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531970.942712:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467602304
00000100:00100000:0.0:1651531970.942727:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250268
00000100:00100000:0.0:1651531970.942729:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000042dc8e7d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438148:x1731754467602304:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531970.942736:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca42d1 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.942740:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531970.942741:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531970.942742:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca42d1 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [434176->438271] (req 434176->438271) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.942745:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca42d1 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [434176->438271] (req 434176->438271) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531970.991507:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869340 is committed
00010000:00010000:0.0:1651531970.991550:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca42b5 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [978944->983039] (req 978944->983039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.991554:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca42b5 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [978944->983039] (req 978944->983039) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531970.991572:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004f05a5e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438146:x1731754467601344:12345-10.240.43.64@tcp:4:fio.0 Request processed in 99439us (99473us total) trans 21474869340 rc 0/0
00000100:00100000:0.0:1651531970.991575:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250264
00010000:00010000:0.0:1651531970.991582:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca42b5 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [978944->983039] (req 978944->983039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.991585:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fb2f6575 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531970.991586:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca42b5 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [978944->983039] (req 978944->983039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.991589:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca42b5 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [978944->983039] (req 978944->983039) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.991594:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca42b5 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [978944->983039] (req 978944->983039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531970.991597:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca42b5 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [978944->983039] (req 978944->983039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531971.004770:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531971.004792:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467602688
00000100:00100000:0.0:1651531971.004807:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250269
00000100:00100000:0.0:1651531971.004809:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000074ceacc7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438148:x1731754467602688:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531971.004816:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca42d8 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.004820:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531971.004831:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531971.004833:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca42d8 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [458752->462847] (req 458752->462847) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.004837:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca42d8 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [458752->462847] (req 458752->462847) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531971.016881:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869341 is committed
00002000:00010000:0.0:1651531971.016894:0:216321:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x34545:0x0] updating lvb mtime from disk: 1651531970 -> 1651531971
00002000:00010000:0.0:1651531971.016895:0:216321:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x34545:0x0] updating lvb ctime from disk: 1651531970 -> 1651531971
00010000:00010000:0.0:1651531971.016898:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca42d1 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [434176->438271] (req 434176->438271) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.016901:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca42d1 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [434176->438271] (req 434176->438271) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531971.016923:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000042dc8e7d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438148:x1731754467602304:12345-10.240.43.64@tcp:4:fio.0 Request processed in 74193us (74229us total) trans 21474869341 rc 0/0
00010000:00010000:1.0:1651531971.016924:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca42d1 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [434176->438271] (req 434176->438271) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531971.016926:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250268
00010000:00010000:1.0:1651531971.016929:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002c5e01dd already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531971.016930:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca42d1 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [434176->438271] (req 434176->438271) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.016933:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca42d1 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [434176->438271] (req 434176->438271) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.016939:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca42d1 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [434176->438271] (req 434176->438271) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.016941:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca42d1 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [434176->438271] (req 434176->438271) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531971.054237:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869342 is committed
00010000:00010000:0.0:1651531971.054251:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca42d8 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [458752->462847] (req 458752->462847) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.054255:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca42d8 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [458752->462847] (req 458752->462847) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531971.054277:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000074ceacc7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438148:x1731754467602688:12345-10.240.43.64@tcp:4:fio.0 Request processed in 49466us (49507us total) trans 21474869342 rc 0/0
00000100:00100000:0.0:1651531971.054280:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250269
00010000:00010000:0.0:1651531971.054296:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca42d8 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [458752->462847] (req 458752->462847) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.054300:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fb2f6575 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531971.054301:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca42d8 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [458752->462847] (req 458752->462847) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.054304:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca42d8 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [458752->462847] (req 458752->462847) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.054309:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca42d8 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [458752->462847] (req 458752->462847) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.054311:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca42d8 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [458752->462847] (req 458752->462847) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531971.054586:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531971.054594:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467602944
00000100:00100000:0.0:1651531971.054604:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250270
00000100:00100000:0.0:1651531971.054606:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000021f31110 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438149:x1731754467602944:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531971.054613:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca42df lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.054617:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531971.054617:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531971.054618:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca42df lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [548864->552959] (req 548864->552959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.054622:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca42df lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [548864->552959] (req 548864->552959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.054646:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca42df lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [548864->552959] (req 548864->552959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.054649:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca42df lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [548864->552959] (req 548864->552959) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531971.054670:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000021f31110 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438149:x1731754467602944:12345-10.240.43.64@tcp:3:fio.0 Request processed in 63us (84us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531971.054673:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250270
00010000:00010000:0.0:1651531971.054680:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca42df lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [548864->552959] (req 548864->552959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.054683:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e2ec18e1 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531971.054684:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca42df lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [548864->552959] (req 548864->552959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.054687:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca42df lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [548864->552959] (req 548864->552959) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.054691:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca42df lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [548864->552959] (req 548864->552959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.054694:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca42df lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [548864->552959] (req 548864->552959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531971.055014:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531971.055023:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467603072
00000100:00100000:0.0:1651531971.055033:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250271
00000100:00100000:0.0:1651531971.055035:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000000615301 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438149:x1731754467603072:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531971.055042:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca42e6 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.055046:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531971.055046:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531971.055047:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca42e6 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [434176->438271] (req 434176->438271) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.055051:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca42e6 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [434176->438271] (req 434176->438271) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531971.067978:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531971.067988:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467603264
00000100:00100000:1.0:1651531971.067997:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44609
00000100:00100000:1.0:1651531971.067999:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b2fdb973 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438147:x1731754467603264:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531971.068003:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531971.068007:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca42ed lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445f39 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.068027:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca42ed lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445f39 expref: 11 pid: 166113 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651531971.068027:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651531971.068032:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca42ed lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445f39 expref: 11 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531971.068035:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a8889a80, rc 0)
00000100:00100000:0.0:1651531971.068036:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467603392
00000100:00100000:0.0:1651531971.068050:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250272
00000100:00100000:0.0:1651531971.068051:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003158b8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754467603392:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651531971.068053:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b2fdb973 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438147:x1731754467603264:12345-10.240.43.64@tcp:101:fio.0 Request processed in 53us (75us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531971.068055:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44609
00010000:00010000:0.0:1651531971.068059:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca42f4 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.068063:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531971.068064:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531971.068065:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca42f4 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [573440->577535] (req 573440->577535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.068069:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca42f4 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [573440->577535] (req 573440->577535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.068080:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca42f4 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [573440->577535] (req 573440->577535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.068084:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca42f4 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [573440->577535] (req 573440->577535) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.068103:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca42f4 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [573440->577535] (req 573440->577535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531971.068103:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003158b8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438148:x1731754467603392:12345-10.240.43.64@tcp:3:fio.0 Request processed in 50us (77us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531971.068105:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250272
00010000:00010000:1.0:1651531971.068107:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e2ec18e1 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531971.068108:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca42f4 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [573440->577535] (req 573440->577535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.068111:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca42f4 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [573440->577535] (req 573440->577535) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.068117:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca42f4 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [573440->577535] (req 573440->577535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.068120:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca42f4 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [573440->577535] (req 573440->577535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531971.068548:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531971.068566:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467603712
00000100:00100000:1.0:1651531971.068573:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44610
00000100:00100000:1.0:1651531971.068575:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000deba47dc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754467603712:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531971.068578:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531971.068582:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca42fb lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445f47 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.068589:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca42fb lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445f47 expref: 11 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531971.068593:0:166112:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca42fb lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445f47 expref: 11 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531971.068597:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c2b76533, rc 0)
00000100:00100000:1.0:1651531971.068611:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000deba47dc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754467603712:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (64us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531971.068614:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44610
00000100:00100000:1.0:1651531971.069052:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531971.069066:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531971.069074:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467603904
00000100:00100000:0.0:1651531971.069074:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467603968
00000100:00100000:1.0:1651531971.069086:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250273
00000100:00100000:1.0:1651531971.069094:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d3ac27c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438146:x1731754467603904:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651531971.069096:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250274
00000100:00100000:0.0:1651531971.069097:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c550f111 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438146:x1731754467603968:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531971.069109:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4302 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.069109:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca4309 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.069113:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531971.069114:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531971.069115:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca4309 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [1036288->1040383] (req 1036288->1040383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.069119:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca4309 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [1036288->1040383] (req 1036288->1040383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.069120:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531971.069120:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531971.069127:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4302 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [65536->69631] (req 65536->69631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.069131:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4302 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [65536->69631] (req 65536->69631) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.069131:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca4309 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [1036288->1040383] (req 1036288->1040383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.069134:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca4309 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [1036288->1040383] (req 1036288->1040383) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.069144:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4302 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [65536->69631] (req 65536->69631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.069147:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4302 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [65536->69631] (req 65536->69631) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531971.069149:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c550f111 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438146:x1731754467603968:12345-10.240.43.64@tcp:3:fio.0 Request processed in 51us (83us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531971.069153:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250274
00000100:00100000:1.0:1651531971.069163:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d3ac27c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438146:x1731754467603904:12345-10.240.43.64@tcp:3:fio.0 Request processed in 74us (111us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531971.069166:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250273
00010000:00010000:0.0:1651531971.069166:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca4309 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [1036288->1040383] (req 1036288->1040383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.069169:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fb2f6575 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531971.069171:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca4309 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [1036288->1040383] (req 1036288->1040383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.069173:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca4309 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [1036288->1040383] (req 1036288->1040383) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.069178:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca4309 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [1036288->1040383] (req 1036288->1040383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.069181:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca4309 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [1036288->1040383] (req 1036288->1040383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.069185:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4302 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [65536->69631] (req 65536->69631) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.069187:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b4c8742a already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531971.069188:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4302 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [65536->69631] (req 65536->69631) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.069191:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4302 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [65536->69631] (req 65536->69631) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.069194:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4302 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [65536->69631] (req 65536->69631) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.069197:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4302 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [65536->69631] (req 65536->69631) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531971.069554:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531971.069562:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467604288
00000100:00100000:1.0:1651531971.069570:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44611
00000100:00100000:1.0:1651531971.069571:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e72632c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438147:x1731754467604288:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531971.069575:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531971.069578:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4310 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445f55 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.069586:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4310 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445f55 expref: 11 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531971.069590:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4310 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445f55 expref: 11 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531971.069606:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000968553c1, rc 0)
00000100:00100000:1.0:1651531971.069617:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e72632c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438147:x1731754467604288:12345-10.240.43.64@tcp:101:fio.0 Request processed in 45us (64us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531971.069620:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44611
00000100:00100000:1.0:1651531971.070718:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531971.070727:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467604672
00000100:00100000:1.0:1651531971.070736:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250275
00000100:00100000:1.0:1651531971.070738:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cb694635 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438147:x1731754467604672:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531971.070744:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4317 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.070748:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531971.070749:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531971.070750:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4317 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [73728->77823] (req 73728->77823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.070754:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4317 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [73728->77823] (req 73728->77823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531971.104901:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869343 is committed
00010000:00010000:1.0:1651531971.104938:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca42e6 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [434176->438271] (req 434176->438271) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.104942:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca42e6 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [434176->438271] (req 434176->438271) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531971.104959:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000000615301 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754467603072:12345-10.240.43.64@tcp:4:fio.0 Request processed in 49923us (49945us total) trans 21474869343 rc 0/0
00000100:00100000:1.0:1651531971.104965:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250271
00010000:00010000:1.0:1651531971.104972:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca42e6 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [434176->438271] (req 434176->438271) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.104975:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000080362f27 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531971.104976:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca42e6 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [434176->438271] (req 434176->438271) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.104979:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca42e6 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [434176->438271] (req 434176->438271) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.104984:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca42e6 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [434176->438271] (req 434176->438271) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.104987:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca42e6 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [434176->438271] (req 434176->438271) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531971.143490:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531971.143499:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467604992
00000100:00100000:1.0:1651531971.143510:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250276
00000100:00100000:1.0:1651531971.143512:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008bb4a649 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438148:x1731754467604992:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531971.143520:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca431e lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.143524:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531971.143525:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531971.143526:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca431e lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [905216->909311] (req 905216->909311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.143533:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca431e lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [905216->909311] (req 905216->909311) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.143545:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca431e lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [905216->909311] (req 905216->909311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.143548:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca431e lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [905216->909311] (req 905216->909311) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531971.143569:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008bb4a649 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438148:x1731754467604992:12345-10.240.43.64@tcp:3:fio.0 Request processed in 57us (80us total) trans 0 rc 4096/4096
00010000:00010000:0.0:1651531971.143571:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca431e lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [905216->909311] (req 905216->909311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531971.143572:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250276
00010000:00010000:0.0:1651531971.143576:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000968553c1 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531971.143578:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca431e lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [905216->909311] (req 905216->909311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.143581:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca431e lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [905216->909311] (req 905216->909311) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.143587:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca431e lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [905216->909311] (req 905216->909311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.143589:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca431e lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [905216->909311] (req 905216->909311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531971.155509:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869344 is committed
00010000:00010000:1.0:1651531971.155541:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4317 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [73728->77823] (req 73728->77823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.155545:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4317 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [73728->77823] (req 73728->77823) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531971.155566:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cb694635 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438147:x1731754467604672:12345-10.240.43.64@tcp:4:fio.0 Request processed in 84827us (84848us total) trans 21474869344 rc 0/0
00010000:00010000:0.0:1651531971.155567:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4317 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [73728->77823] (req 73728->77823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531971.155569:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250275
00010000:00010000:0.0:1651531971.155571:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006da7a892 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531971.155572:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4317 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [73728->77823] (req 73728->77823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.155579:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4317 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [73728->77823] (req 73728->77823) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.155584:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4317 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [73728->77823] (req 73728->77823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.155587:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4317 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [73728->77823] (req 73728->77823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531971.155908:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531971.155917:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467605312
00000100:00100000:1.0:1651531971.155927:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250277
00000100:00100000:1.0:1651531971.155929:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002e949b2e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438146:x1731754467605312:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531971.155936:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4325 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.155941:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531971.155942:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531971.155942:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4325 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [1024000->1028095] (req 1024000->1028095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.155947:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4325 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [1024000->1028095] (req 1024000->1028095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531971.168446:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531971.168455:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467605440
00000100:00100000:1.0:1651531971.168465:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250278
00000100:00100000:1.0:1651531971.168467:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b462545d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754467605440:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531971.168474:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca432c lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.168478:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531971.168479:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531971.168480:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca432c lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [749568->753663] (req 749568->753663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.168483:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca432c lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [749568->753663] (req 749568->753663) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531971.181561:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869345 is committed
00010000:00010000:1.0:1651531971.181590:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4325 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [1024000->1028095] (req 1024000->1028095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.181595:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4325 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [1024000->1028095] (req 1024000->1028095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531971.181615:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002e949b2e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438146:x1731754467605312:12345-10.240.43.64@tcp:4:fio.0 Request processed in 25685us (25707us total) trans 21474869345 rc 0/0
00000100:00100000:1.0:1651531971.181618:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250277
00010000:00010000:1.0:1651531971.181699:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4325 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [1024000->1028095] (req 1024000->1028095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.181703:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c2b76533 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531971.181704:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4325 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [1024000->1028095] (req 1024000->1028095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.181707:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4325 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [1024000->1028095] (req 1024000->1028095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.181712:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4325 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [1024000->1028095] (req 1024000->1028095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.181715:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4325 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [1024000->1028095] (req 1024000->1028095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531971.182044:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531971.182052:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467605568
00000100:00100000:1.0:1651531971.182059:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44612
00000100:00100000:1.0:1651531971.182061:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001797bd5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438147:x1731754467605568:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531971.182064:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531971.182068:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4333 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445f63 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.182079:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4333 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445f63 expref: 11 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531971.182084:0:166112:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4333 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445f63 expref: 11 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531971.182087:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001e36c601, rc 0)
00000100:00100000:1.0:1651531971.182096:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001797bd5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438147:x1731754467605568:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (53us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531971.182099:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44612
00000100:00100000:1.0:1651531971.182441:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531971.182449:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467605696
00000100:00100000:1.0:1651531971.182458:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250279
00000100:00100000:1.0:1651531971.182460:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bfdd313b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438146:x1731754467605696:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531971.182467:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca433a lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.182471:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531971.182472:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531971.182473:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca433a lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [1011712->1015807] (req 1011712->1015807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.182477:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca433a lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [1011712->1015807] (req 1011712->1015807) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.182488:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca433a lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [1011712->1015807] (req 1011712->1015807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.182492:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca433a lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [1011712->1015807] (req 1011712->1015807) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531971.182514:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bfdd313b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438146:x1731754467605696:12345-10.240.43.64@tcp:3:fio.0 Request processed in 53us (74us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531971.182517:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250279
00010000:00010000:0.0:1651531971.182517:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca433a lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [1011712->1015807] (req 1011712->1015807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.182521:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006da7a892 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531971.182522:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca433a lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [1011712->1015807] (req 1011712->1015807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.182526:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca433a lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [1011712->1015807] (req 1011712->1015807) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.182531:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca433a lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [1011712->1015807] (req 1011712->1015807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.182534:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca433a lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [1011712->1015807] (req 1011712->1015807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531971.206654:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531971.206673:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467605952
00000100:00100000:1.0:1651531971.206682:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44613
00000100:00100000:1.0:1651531971.206684:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ac545f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754467605952:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531971.206687:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531971.206691:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4341 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445f71 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.206699:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4341 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445f71 expref: 11 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531971.206703:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4341 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445f71 expref: 11 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531971.206707:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001e36c601, rc 0)
00000100:00100000:1.0:1651531971.206717:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ac545f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754467605952:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (63us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531971.206719:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44613
00000100:00100000:1.0:1651531971.207287:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531971.207296:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467606336
00000100:00100000:1.0:1651531971.207306:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250280
00000100:00100000:1.0:1651531971.207308:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f817afea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438148:x1731754467606336:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531971.207314:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4348 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.207319:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531971.207319:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531971.207320:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4348 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [774144->778239] (req 774144->778239) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.207324:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4348 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [774144->778239] (req 774144->778239) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.207336:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4348 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [774144->778239] (req 774144->778239) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.207340:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4348 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [774144->778239] (req 774144->778239) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531971.207362:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f817afea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438148:x1731754467606336:12345-10.240.43.64@tcp:3:fio.0 Request processed in 53us (75us total) trans 0 rc 4096/4096
00010000:00010000:0.0:1651531971.207364:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4348 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [774144->778239] (req 774144->778239) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531971.207365:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250280
00010000:00010000:0.0:1651531971.207372:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c2b76533 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531971.207373:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4348 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [774144->778239] (req 774144->778239) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.207376:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4348 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [774144->778239] (req 774144->778239) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.207381:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4348 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [774144->778239] (req 774144->778239) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.207384:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4348 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [774144->778239] (req 774144->778239) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531971.207708:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531971.207715:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467606592
00000100:00100000:1.0:1651531971.207724:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250281
00000100:00100000:1.0:1651531971.207726:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000091075bf7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754467606592:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531971.207732:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca434f lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.207737:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531971.207738:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531971.207739:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca434f lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [479232->483327] (req 479232->483327) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.207743:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca434f lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [479232->483327] (req 479232->483327) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531971.242991:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869346 is committed
00010000:00010000:1.0:1651531971.243022:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca432c lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [749568->753663] (req 749568->753663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.243027:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca432c lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [749568->753663] (req 749568->753663) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531971.243043:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b462545d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754467605440:12345-10.240.43.64@tcp:4:fio.0 Request processed in 74575us (74597us total) trans 21474869346 rc 0/0
00000100:00100000:1.0:1651531971.243046:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250278
00010000:00010000:1.0:1651531971.243053:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca432c lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [749568->753663] (req 749568->753663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.243056:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a8889a80 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531971.243057:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca432c lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [749568->753663] (req 749568->753663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.243060:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca432c lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [749568->753663] (req 749568->753663) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.243065:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca432c lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [749568->753663] (req 749568->753663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.243088:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca432c lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [749568->753663] (req 749568->753663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531971.243417:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531971.243425:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467606848
00000100:00100000:1.0:1651531971.243435:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250282
00000100:00100000:1.0:1651531971.243437:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004d72f458 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438148:x1731754467606848:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531971.243444:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4356 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.243448:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531971.243448:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531971.243449:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4356 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.243453:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4356 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.243464:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4356 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.243468:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4356 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531971.243489:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004d72f458 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438148:x1731754467606848:12345-10.240.43.64@tcp:3:fio.0 Request processed in 51us (72us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531971.243491:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250282
00010000:00010000:0.0:1651531971.243492:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4356 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.243496:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001e36c601 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531971.243497:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4356 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.243500:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4356 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.243505:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4356 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.243508:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4356 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531971.257177:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531971.257185:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467607360
00000100:00100000:1.0:1651531971.257194:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250283
00000100:00100000:1.0:1651531971.257196:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003b5b354a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438147:x1731754467607360:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531971.257202:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca435d lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.257206:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531971.257207:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531971.257208:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca435d lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.257240:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca435d lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531971.293641:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869347 is committed
00010000:00010000:1.0:1651531971.293670:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca434f lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [479232->483327] (req 479232->483327) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.293675:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca434f lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [479232->483327] (req 479232->483327) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.293690:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca434f lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [479232->483327] (req 479232->483327) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.293694:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000968553c1 already unused, calling callback (0000000049fddea7)
00000100:00100000:1.0:1651531971.293696:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000091075bf7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754467606592:12345-10.240.43.64@tcp:4:fio.0 Request processed in 85968us (85988us total) trans 21474869347 rc 0/0
00010000:00010000:0.0:1651531971.293696:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca434f lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [479232->483327] (req 479232->483327) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.293699:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca434f lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [479232->483327] (req 479232->483327) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531971.293701:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250281
00010000:00010000:0.0:1651531971.293704:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca434f lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [479232->483327] (req 479232->483327) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.293707:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca434f lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [479232->483327] (req 479232->483327) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531971.307047:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531971.307063:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467607872
00000100:00100000:1.0:1651531971.307071:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44614
00000100:00100000:1.0:1651531971.307072:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029096870 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438148:x1731754467607872:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531971.307078:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531971.307082:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4364 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445f7f expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.307089:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4364 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445f7f expref: 11 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531971.307093:0:166112:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4364 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445f7f expref: 11 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531971.307097:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b4c8742a, rc 0)
00000100:00100000:1.0:1651531971.307106:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029096870 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438148:x1731754467607872:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (60us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531971.307109:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44614
00000100:00100000:1.0:1651531971.307830:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531971.307838:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467608128
00000100:00100000:1.0:1651531971.307853:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250284
00000100:00100000:1.0:1651531971.307855:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003b40261e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754467608128:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531971.307861:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca436b lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.307865:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531971.307866:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531971.307867:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca436b lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [774144->778239] (req 774144->778239) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.307871:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca436b lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [774144->778239] (req 774144->778239) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531971.319522:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869348 is committed
00010000:00010000:0.0:1651531971.319538:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca435d lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.319541:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca435d lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531971.319563:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003b5b354a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438147:x1731754467607360:12345-10.240.43.64@tcp:4:fio.0 Request processed in 62366us (62386us total) trans 21474869348 rc 0/0
00010000:00010000:1.0:1651531971.319565:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca435d lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531971.319567:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250283
00010000:00010000:1.0:1651531971.319569:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a8889a80 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531971.319570:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca435d lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.319573:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca435d lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.319579:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca435d lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.319582:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca435d lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531971.320313:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531971.320321:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467608384
00000100:00100000:1.0:1651531971.320329:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44615
00000100:00100000:1.0:1651531971.320330:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dfff0362 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438147:x1731754467608384:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531971.320334:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531971.320337:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4372 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445f8d expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.320345:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4372 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445f8d expref: 11 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531971.320353:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4372 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445f8d expref: 11 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531971.320356:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b4c8742a, rc 0)
00000100:00100000:1.0:1651531971.320372:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dfff0362 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438147:x1731754467608384:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (60us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531971.320375:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44615
00000100:00100000:1.0:1651531971.321043:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531971.321065:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467608640
00000100:00100000:0.0:1651531971.321078:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250285
00000100:00100000:0.0:1651531971.321080:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bedaf1f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438146:x1731754467608640:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531971.321088:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca4379 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.321092:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531971.321093:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531971.321094:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca4379 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [389120->393215] (req 389120->393215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.321098:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca4379 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [389120->393215] (req 389120->393215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.321110:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca4379 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [389120->393215] (req 389120->393215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.321113:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca4379 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [389120->393215] (req 389120->393215) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531971.321128:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bedaf1f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438146:x1731754467608640:12345-10.240.43.64@tcp:3:fio.0 Request processed in 48us (86us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531971.321131:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250285
00010000:00010000:0.0:1651531971.321138:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca4379 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [389120->393215] (req 389120->393215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.321141:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fb2f6575 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531971.321142:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca4379 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [389120->393215] (req 389120->393215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.321149:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca4379 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [389120->393215] (req 389120->393215) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.321153:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca4379 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [389120->393215] (req 389120->393215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.321156:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca4379 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [389120->393215] (req 389120->393215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531971.369522:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531971.369547:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467609024
00000100:00100000:0.0:1651531971.369561:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250286
00000100:00100000:0.0:1651531971.369563:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005dd15341 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754467609024:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531971.369571:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca4380 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.369576:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531971.369577:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531971.369578:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca4380 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [1024000->1028095] (req 1024000->1028095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.369582:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca4380 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [1024000->1028095] (req 1024000->1028095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531971.389965:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869349 is committed
00010000:00010000:1.0:1651531971.389996:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca436b lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [774144->778239] (req 774144->778239) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.390000:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca436b lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [774144->778239] (req 774144->778239) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531971.390019:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003b40261e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754467608128:12345-10.240.43.64@tcp:4:fio.0 Request processed in 82163us (82188us total) trans 21474869349 rc 0/0
00000100:00100000:1.0:1651531971.390024:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250284
00010000:00010000:0.0:1651531971.390027:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca436b lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [774144->778239] (req 774144->778239) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.390032:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008558d1b3 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531971.390034:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca436b lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [774144->778239] (req 774144->778239) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.390037:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca436b lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [774144->778239] (req 774144->778239) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.390042:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca436b lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [774144->778239] (req 774144->778239) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.390045:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca436b lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [774144->778239] (req 774144->778239) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531971.440615:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869350 is committed
00010000:00010000:0.0:1651531971.440630:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca4380 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [1024000->1028095] (req 1024000->1028095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.440634:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca4380 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [1024000->1028095] (req 1024000->1028095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531971.440656:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005dd15341 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438149:x1731754467609024:12345-10.240.43.64@tcp:4:fio.0 Request processed in 71092us (71134us total) trans 21474869350 rc 0/0
00000100:00100000:0.0:1651531971.440659:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250286
00010000:00010000:1.0:1651531971.440660:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca4380 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [1024000->1028095] (req 1024000->1028095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.440665:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fb2f6575 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531971.440666:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca4380 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [1024000->1028095] (req 1024000->1028095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.440669:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca4380 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [1024000->1028095] (req 1024000->1028095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.440676:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca4380 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [1024000->1028095] (req 1024000->1028095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.440679:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca4380 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [1024000->1028095] (req 1024000->1028095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531971.441029:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531971.441052:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467609536
00000100:00100000:0.0:1651531971.441068:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250287
00000100:00100000:0.0:1651531971.441070:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000be87d738 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438148:x1731754467609536:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531971.441077:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4387 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.441082:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531971.441084:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531971.441085:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4387 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [696320->700415] (req 696320->700415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.441089:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4387 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [696320->700415] (req 696320->700415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.441100:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4387 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [696320->700415] (req 696320->700415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.441104:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4387 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [696320->700415] (req 696320->700415) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531971.441119:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000be87d738 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438148:x1731754467609536:12345-10.240.43.64@tcp:3:fio.0 Request processed in 48us (91us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531971.441122:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250287
00010000:00010000:0.0:1651531971.441128:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4387 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [696320->700415] (req 696320->700415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.441132:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f5657138 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531971.441133:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4387 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [696320->700415] (req 696320->700415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.441136:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4387 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [696320->700415] (req 696320->700415) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.441140:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4387 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [696320->700415] (req 696320->700415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.441143:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4387 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [696320->700415] (req 696320->700415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531971.441884:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531971.441902:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467609792
00000100:00100000:0.0:1651531971.441918:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250288
00000100:00100000:0.0:1651531971.441919:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002512e905 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438149:x1731754467609792:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531971.441926:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca438e lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.441931:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531971.441931:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531971.441932:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca438e lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [860160->864255] (req 860160->864255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.441936:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca438e lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [860160->864255] (req 860160->864255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531971.564910:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869351 is committed
00010000:00010000:0.0:1651531971.564924:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca438e lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [860160->864255] (req 860160->864255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.564928:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca438e lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [860160->864255] (req 860160->864255) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531971.564944:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002512e905 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438149:x1731754467609792:12345-10.240.43.64@tcp:4:fio.0 Request processed in 123024us (123060us total) trans 21474869351 rc 0/0
00000100:00100000:0.0:1651531971.564947:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250288
00010000:00010000:0.0:1651531971.564954:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca438e lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [860160->864255] (req 860160->864255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.564962:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f765708a already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531971.564963:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca438e lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [860160->864255] (req 860160->864255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.564966:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca438e lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [860160->864255] (req 860160->864255) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.564971:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca438e lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [860160->864255] (req 860160->864255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.564974:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca438e lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [860160->864255] (req 860160->864255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531971.616498:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531971.616516:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467610816
00000100:00100000:1.0:1651531971.616525:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44616
00000100:00100000:1.0:1651531971.616527:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000063869776 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438147:x1731754467610816:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531971.616531:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531971.616535:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4395 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445f9b expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.616540:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531971.616541:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531971.616543:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4395 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445f9b expref: 8 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531971.616547:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4395 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445f9b expref: 8 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531971.616551:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b4c8742a, rc 0)
00000100:00100000:1.0:1651531971.616567:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000063869776 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467610816:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (70us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531971.616573:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44616
00000100:00100000:1.0:1651531971.667155:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531971.667178:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467611584
00000100:00100000:0.0:1651531971.667194:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250289
00000100:00100000:0.0:1651531971.667196:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d710c5fd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467611584:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531971.667204:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca439c lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.667208:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531971.667209:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531971.667210:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca439c lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [331776->335871] (req 331776->335871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.667235:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca439c lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [331776->335871] (req 331776->335871) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.667248:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca439c lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [331776->335871] (req 331776->335871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.667253:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca439c lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [331776->335871] (req 331776->335871) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531971.667275:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d710c5fd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467611584:12345-10.240.43.64@tcp:3:fio.0 Request processed in 78us (120us total) trans 0 rc 4096/4096
00010000:00010000:1.0:1651531971.667278:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca439c lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [331776->335871] (req 331776->335871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531971.667278:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250289
00010000:00010000:1.0:1651531971.667282:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f765708a already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531971.667283:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca439c lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [331776->335871] (req 331776->335871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.667286:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca439c lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [331776->335871] (req 331776->335871) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.667291:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca439c lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [331776->335871] (req 331776->335871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.667294:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca439c lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [331776->335871] (req 331776->335871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531971.667999:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531971.668026:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467611840
00000100:00100000:0.0:1651531971.668043:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250290
00000100:00100000:0.0:1651531971.668045:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000374facb9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467611840:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531971.668052:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca43a3 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.668057:0:192754:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4395 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445f9b expref: 8 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531971.668061:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531971.668061:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531971.668062:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca43a3 lrc: 4/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [614400->618495] (req 614400->618495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.668070:0:192754:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4395 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445f9b expref: 8 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531971.668074:0:192754:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4395 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445f9b expref: 8 pid: 166112 timeout: 22780 lvb_type: 1
00000100:00100000:0.0:1651531971.668082:0:192754:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cc11a3b9 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_005:lustre-OST0001_UUID:192754:1731745997357056:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531971.668096:0:192754:0:(client.c:2492:ptlrpc_set_wait()) set 000000000b5c3114 going to sleep for 6 seconds
00000100:00100000:1.0:1651531971.668382:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531971.668384:0:192754:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cc11a3b9 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_005:lustre-OST0001_UUID:192754:1731745997357056:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651531971.668395:0:192754:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca43a3 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [614400->618495] (req 614400->618495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531971.668403:0:166103:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467611904
00010000:00010000:0.0:1651531971.668408:0:166103:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4395 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445f9b expref: 9 pid: 166112 timeout: 22780 lvb_type: 1
00000100:00100000:0.0:1651531971.668420:0:166103:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 228
00000100:00100000:0.0:1651531971.668421:0:166103:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000052213cb9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438147:x1731754467611904:12345-10.240.43.64@tcp:103:ldlm_bl_05.0
00010000:00010000:0.0:1651531971.668425:0:166103:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531971.668429:0:166103:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4395 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445f9b expref: 9 pid: 166112 timeout: 22780 lvb_type: 1
00010000:00010000:0.0:1651531971.668433:0:166103:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4395 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445f9b expref: 9 pid: 166112 timeout: 22780 lvb_type: 1
00010000:00010000:0.0:1651531971.668439:0:166103:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4395 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445f9b expref: 9 pid: 166112 timeout: 22780 lvb_type: 1
00010000:00010000:0.0:1651531971.668443:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531971.668444:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531971.668446:0:166103:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca43a3 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [614400->618495] (req 614400->618495) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.668449:0:166103:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca43a3 lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [614400->618495] (req 614400->618495) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.668456:0:166103:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651531971.668465:0:166103:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000052213cb9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467611904:12345-10.240.43.64@tcp:103:ldlm_bl_05.0 Request processed in 43us (84us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531971.668468:0:166103:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 228
00010000:00010000:0.0:1651531971.668475:0:192754:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca43a3 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [614400->618495] (req 614400->618495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.668478:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca43a3 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [614400->618495] (req 614400->618495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531971.717769:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531971.717777:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467612096
00000100:00100000:1.0:1651531971.717785:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44617
00000100:00100000:1.0:1651531971.717787:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009b569a7a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438147:x1731754467612096:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531971.717791:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531971.717795:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca43aa lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445fa9 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.717806:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca43aa lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445fa9 expref: 11 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531971.717810:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca43aa lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445fa9 expref: 11 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531971.717813:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a8889a80, rc 0)
00000100:00100000:1.0:1651531971.717829:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009b569a7a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438147:x1731754467612096:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (61us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531971.717832:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44617
00000001:00080000:0.0:1651531971.717877:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869352 is committed
00010000:00010000:0.0:1651531971.717891:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca43a3 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [614400->618495] (req 614400->618495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.717895:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca43a3 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [614400->618495] (req 614400->618495) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531971.717916:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000374facb9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438146:x1731754467611840:12345-10.240.43.64@tcp:4:fio.0 Request processed in 49870us (49917us total) trans 21474869352 rc 0/0
00000100:00100000:0.0:1651531971.717919:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250290
00010000:00010000:0.0:1651531971.717926:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca43a3 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [614400->618495] (req 614400->618495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.717949:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f5657138 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531971.717950:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca43a3 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [614400->618495] (req 614400->618495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.717954:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca43a3 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [614400->618495] (req 614400->618495) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.717959:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca43a3 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [614400->618495] (req 614400->618495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.717961:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca43a3 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [614400->618495] (req 614400->618495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531971.759880:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531971.759889:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467613248
00000100:00100000:0.0:1651531971.759905:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250291
00000100:00100000:0.0:1651531971.759907:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cc11a3b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438149:x1731754467613248:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531971.759915:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca43b1 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.759919:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531971.759920:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531971.759921:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca43b1 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [90112->94207] (req 90112->94207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.759925:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca43b1 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [90112->94207] (req 90112->94207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.759941:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca43b1 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [90112->94207] (req 90112->94207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.759944:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca43b1 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [90112->94207] (req 90112->94207) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531971.759965:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cc11a3b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438149:x1731754467613248:12345-10.240.43.64@tcp:3:fio.0 Request processed in 57us (85us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531971.759968:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250291
00010000:00010000:0.0:1651531971.759975:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca43b1 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [90112->94207] (req 90112->94207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.759979:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f5657138 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531971.759980:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca43b1 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [90112->94207] (req 90112->94207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.759982:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca43b1 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [90112->94207] (req 90112->94207) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.759987:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca43b1 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [90112->94207] (req 90112->94207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.759990:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca43b1 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [90112->94207] (req 90112->94207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531971.760291:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531971.760299:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467613632
00000100:00100000:0.0:1651531971.760315:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250292
00000100:00100000:0.0:1651531971.760317:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000053de45f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438148:x1731754467613632:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531971.760324:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca43b8 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.760328:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531971.760329:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531971.760330:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca43b8 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [98304->102399] (req 98304->102399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.760334:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca43b8 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [98304->102399] (req 98304->102399) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531971.796709:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869353 is committed
00010000:00010000:0.0:1651531971.796723:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca43b8 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [98304->102399] (req 98304->102399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.796726:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca43b8 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [98304->102399] (req 98304->102399) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531971.796746:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000053de45f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438148:x1731754467613632:12345-10.240.43.64@tcp:4:fio.0 Request processed in 36428us (36455us total) trans 21474869353 rc 0/0
00000100:00100000:0.0:1651531971.796749:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250292
00010000:00010000:1.0:1651531971.796750:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca43b8 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [98304->102399] (req 98304->102399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.796755:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c1022d42 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531971.796756:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca43b8 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [98304->102399] (req 98304->102399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.796759:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca43b8 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [98304->102399] (req 98304->102399) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.796765:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca43b8 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [98304->102399] (req 98304->102399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.796768:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca43b8 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [98304->102399] (req 98304->102399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531971.808128:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651531971.808136:0:182071:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951226816
00000100:00100000:0.0:1651531971.808145:0:182071:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 465
00000100:00100000:0.0:1651531971.808146:0:182071:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000089660739 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951226816:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:0.0:1651531971.808152:0:182071:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 350512576 pending 0 free 81277214720 avail 77105758208
00000100:00100000:0.0:1651531971.808164:0:182071:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000089660739 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951226816:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 17us (37us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531971.808166:0:182071:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 465
00000100:00100000:0.0:1651531971.809172:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531971.809181:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531971.809193:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531971.809203:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467613952
00000100:00100000:1.0:1651531971.809233:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467614016
00000100:00100000:0.0:1651531971.809236:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250293
00000100:00100000:0.0:1651531971.809238:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000e33e11e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467613952:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651531971.809246:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467614144
00010000:00010000:0.0:1651531971.809246:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca43bf lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.809250:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:1.0:1651531971.809255:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44618
00000100:00100000:1.0:1651531971.809257:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aa58c961 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754467614016:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531971.809257:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531971.809258:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca43bf lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [872448->876543] (req 872448->876543) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.809262:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531971.809262:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca43bf lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [872448->876543] (req 872448->876543) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.809266:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca43c6 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445fb7 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.809274:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531971.809274:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531971.809277:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca43c6 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445fb7 expref: 10 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531971.809281:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca43bf lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [872448->876543] (req 872448->876543) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.809285:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca43bf lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [872448->876543] (req 872448->876543) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.809289:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca43c6 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445fb7 expref: 10 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531971.809293:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a8889a80, rc 0)
00000100:00100000:0.0:1651531971.809300:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000e33e11e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438147:x1731754467613952:12345-10.240.43.64@tcp:3:fio.0 Request processed in 61us (128us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531971.809303:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250293
00000100:00100000:1.0:1651531971.809308:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aa58c961 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438148:x1731754467614016:12345-10.240.43.64@tcp:101:fio.0 Request processed in 50us (127us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531971.809312:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44618
00010000:00010000:0.0:1651531971.809316:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca43bf lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [872448->876543] (req 872448->876543) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531971.809317:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44619
00000100:00100000:1.0:1651531971.809319:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006c46ca95 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467614144:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531971.809319:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f5657138 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531971.809320:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca43bf lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [872448->876543] (req 872448->876543) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.809322:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531971.809324:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca43cd lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445fc5 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.809324:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca43bf lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [872448->876543] (req 872448->876543) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.809328:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca43bf lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [872448->876543] (req 872448->876543) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.809329:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531971.809330:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531971.809331:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca43bf lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [872448->876543] (req 872448->876543) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.809332:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca43cd lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445fc5 expref: 9 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531971.809338:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca43cd lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445fc5 expref: 9 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531971.809341:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d44eb74d, rc 0)
00000100:00100000:1.0:1651531971.809348:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006c46ca95 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438147:x1731754467614144:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (155us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531971.809350:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44619
00000100:00100000:0.0:1651531971.810862:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531971.810887:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467614976
00000100:00100000:1.0:1651531971.810903:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250294
00000100:00100000:1.0:1651531971.810905:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000021f31110 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438147:x1731754467614976:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531971.810913:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca43d4 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.810917:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531971.810918:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531971.810919:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca43d4 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [245760->249855] (req 245760->249855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.810923:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca43d4 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [245760->249855] (req 245760->249855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.810936:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca43d4 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [245760->249855] (req 245760->249855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.810939:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca43d4 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [245760->249855] (req 245760->249855) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.810961:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca43d4 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [245760->249855] (req 245760->249855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531971.810965:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000021f31110 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438147:x1731754467614976:12345-10.240.43.64@tcp:3:fio.0 Request processed in 59us (103us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531971.810968:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250294
00010000:00010000:0.0:1651531971.810970:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e9b84540 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531971.810971:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca43d4 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [245760->249855] (req 245760->249855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.810974:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca43d4 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [245760->249855] (req 245760->249855) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.810979:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca43d4 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [245760->249855] (req 245760->249855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.810986:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca43d4 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [245760->249855] (req 245760->249855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531971.851194:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531971.851232:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467615744
00000100:00100000:1.0:1651531971.851249:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250295
00000100:00100000:1.0:1651531971.851251:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003158b8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438149:x1731754467615744:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531971.851259:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca43db lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.851266:0:192755:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca43c6 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445fb7 expref: 9 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531971.851270:0:192755:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca43cd lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445fc5 expref: 9 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531971.851273:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531971.851273:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531971.851274:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca43db lrc: 5/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [372736->602111] (req 372736->602111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.851282:0:192755:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca43cd lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445fc5 expref: 9 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531971.851286:0:192755:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca43cd lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445fc5 expref: 9 pid: 166112 timeout: 22780 lvb_type: 1
00000100:00100000:1.0:1651531971.851294:0:192755:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001304ce4c pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0001_UUID:192755:1731745997357120:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651531971.851311:0:192755:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca43c6 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445fb7 expref: 9 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531971.851314:0:192755:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca43c6 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445fb7 expref: 9 pid: 166112 timeout: 22780 lvb_type: 1
00000100:00100000:1.0:1651531971.851318:0:192755:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002ef35a72 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0001_UUID:192755:1731745997357184:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531971.851323:0:192755:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ec524534 going to sleep for 6 seconds
00000100:00100000:0.0:1651531971.851755:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531971.851763:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531971.851769:0:169267:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467615936
00000100:00100000:0.0:1651531971.851769:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531971.851779:0:166103:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467615872
00010000:00010000:1.0:1651531971.851782:0:169267:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca43c6 lrc: 5/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445fb7 expref: 11 pid: 166112 timeout: 22780 lvb_type: 1
00010000:00010000:0.0:1651531971.851786:0:166103:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca43cd lrc: 5/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445fc5 expref: 11 pid: 166112 timeout: 22780 lvb_type: 1
00000100:00100000:1.0:1651531971.851791:0:169267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 229
00000100:00100000:1.0:1651531971.851793:0:169267:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000000615301 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754467615936:12345-10.240.43.64@tcp:103:ldlm_bl_02.0
00000100:00100000:0.0:1651531971.851799:0:166103:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 230
00000100:00100000:0.0:1651531971.851800:0:166103:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000df1eb0d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754467615872:12345-10.240.43.64@tcp:103:ldlm_bl_02.0
00010000:00010000:1.0:1651531971.851801:0:169267:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531971.851804:0:166103:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1651531971.851806:0:169267:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca43c6 lrc: 5/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445fb7 expref: 11 pid: 166112 timeout: 22780 lvb_type: 1
00010000:00010000:0.0:1651531971.851808:0:166103:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca43cd lrc: 5/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445fc5 expref: 11 pid: 166112 timeout: 22780 lvb_type: 1
00010000:00010000:1.0:1651531971.851810:0:169267:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca43c6 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445fb7 expref: 11 pid: 166112 timeout: 22780 lvb_type: 1
00010000:00010000:0.0:1651531971.851814:0:166103:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca43cd lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445fc5 expref: 11 pid: 166112 timeout: 22780 lvb_type: 1
00010000:00010000:1.0:1651531971.851826:0:169267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531971.851827:0:169267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531971.851829:0:169267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca43db lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [372736->602111] (req 372736->602111) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.851833:0:169267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca43db lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [372736->602111] (req 372736->602111) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.851837:0:166103:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1651531971.851838:0:169267:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651531971.851848:0:166103:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000df1eb0d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754467615872:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 47us (85us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531971.851851:0:166103:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 230
00000100:00100000:1.0:1651531971.851853:0:169267:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000000615301 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754467615936:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 60us (99us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531971.851857:0:169267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 229
00000100:00100000:0.0:1651531971.851865:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467616064
00000100:00100000:0.0:1651531971.851874:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44620
00000100:00100000:0.0:1651531971.851877:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000053497d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438146:x1731754467616064:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531971.851880:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531971.851883:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca43e2 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445fd3 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.851891:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca43e2 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445fd3 expref: 11 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531971.851895:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca43e2 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445fd3 expref: 11 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531971.851899:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f5657138, rc 0)
00000100:00100000:0.0:1651531971.851908:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000053497d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438146:x1731754467616064:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (139us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531971.851911:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44620
00010000:00010000:1.0:1651531971.851913:0:192755:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca43cd lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445fc5 expref: 9 pid: 166112 timeout: 22780 lvb_type: 1
00000100:00100000:1.0:1651531971.851918:0:192755:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001304ce4c pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0001_UUID:192755:1731745997357120:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651531971.851921:0:192755:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca43c6 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445fb7 expref: 8 pid: 166112 timeout: 22780 lvb_type: 1
00000100:00100000:1.0:1651531971.851925:0:192755:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002ef35a72 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0001_UUID:192755:1731745997357184:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651531971.851929:0:192755:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca43db lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [372736->602111] (req 372736->602111) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.851932:0:192755:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca43db lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [372736->602111] (req 372736->602111) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.851935:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca43db lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [372736->602111] (req 372736->602111) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531971.893108:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869354 is committed
00010000:00010000:1.0:1651531971.893141:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca43db lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [372736->602111] (req 372736->602111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.893147:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca43db lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [372736->602111] (req 372736->602111) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.893166:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca43db lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [372736->602111] (req 372736->602111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531971.893170:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003158b8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438149:x1731754467615744:12345-10.240.43.64@tcp:4:fio.0 Request processed in 41918us (41977us total) trans 21474869354 rc 0/0
00010000:00010000:0.0:1651531971.893171:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e9b84540 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531971.893172:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca43db lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [372736->602111] (req 372736->602111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531971.893174:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250295
00010000:00010000:0.0:1651531971.893175:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca43db lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [372736->602111] (req 372736->602111) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.893181:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca43db lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [372736->602111] (req 372736->602111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.893185:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca43db lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [372736->602111] (req 372736->602111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531971.893737:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531971.893746:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467616768
00000100:00100000:0.0:1651531971.893760:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44621
00000100:00100000:0.0:1651531971.893761:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ffcdece2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438146:x1731754467616768:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531971.893765:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531971.893769:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca43e9 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445fe1 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.893775:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531971.893775:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531971.893777:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca43e9 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445fe1 expref: 8 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531971.893782:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca43e9 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445fe1 expref: 8 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531971.893786:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f5657138, rc 0)
00000100:00100000:0.0:1651531971.893800:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ffcdece2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467616768:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (64us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531971.893803:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44621
00000100:00100000:0.0:1651531971.937549:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531971.937582:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467617792
00000100:00100000:1.0:1651531971.937600:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250296
00000100:00100000:1.0:1651531971.937602:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007d76765b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467617792:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531971.937611:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca43f0 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.937615:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531971.937616:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531971.937617:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca43f0 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [258048->262143] (req 258048->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.937621:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca43f0 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [258048->262143] (req 258048->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.937634:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca43f0 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [258048->262143] (req 258048->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.937637:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca43f0 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [258048->262143] (req 258048->262143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531971.937659:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007d76765b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467617792:12345-10.240.43.64@tcp:3:fio.0 Request processed in 56us (110us total) trans 0 rc 4096/4096
00010000:00010000:0.0:1651531971.937659:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca43f0 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [258048->262143] (req 258048->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531971.937663:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250296
00010000:00010000:0.0:1651531971.937668:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a8889a80 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531971.937669:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca43f0 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [258048->262143] (req 258048->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.937672:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca43f0 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [258048->262143] (req 258048->262143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.937677:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca43f0 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [258048->262143] (req 258048->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.937680:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca43f0 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [258048->262143] (req 258048->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531971.937926:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531971.937937:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467617920
00000100:00100000:1.0:1651531971.937950:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250297
00000100:00100000:1.0:1651531971.937952:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007f998d3c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467617920:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531971.937959:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca43f7 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.937963:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531971.937964:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531971.937965:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca43f7 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [471040->475135] (req 471040->475135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.937969:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca43f7 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [471040->475135] (req 471040->475135) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.937981:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca43f7 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [471040->475135] (req 471040->475135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.937984:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca43f7 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [471040->475135] (req 471040->475135) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531971.937999:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007f998d3c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467617920:12345-10.240.43.64@tcp:3:fio.0 Request processed in 46us (73us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531971.938001:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250297
00010000:00010000:1.0:1651531971.938008:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca43f7 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [471040->475135] (req 471040->475135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.938011:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d44eb74d already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531971.938014:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca43f7 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [471040->475135] (req 471040->475135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.938017:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca43f7 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [471040->475135] (req 471040->475135) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.938021:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca43f7 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [471040->475135] (req 471040->475135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.938024:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca43f7 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [471040->475135] (req 471040->475135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531971.938090:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531971.938121:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467618048
00000100:00100000:1.0:1651531971.938135:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250298
00000100:00100000:1.0:1651531971.938137:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009c93d7f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467618048:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531971.938144:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca43fe lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.938147:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531971.938148:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531971.938149:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca43fe lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [532480->536575] (req 532480->536575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.938153:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca43fe lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [532480->536575] (req 532480->536575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.938164:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca43fe lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [532480->536575] (req 532480->536575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.938167:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca43fe lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [532480->536575] (req 532480->536575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.938179:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca43fe lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [532480->536575] (req 532480->536575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.938183:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b4c8742a already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531971.938184:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca43fe lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [532480->536575] (req 532480->536575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531971.938186:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009c93d7f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467618048:12345-10.240.43.64@tcp:3:fio.0 Request processed in 49us (96us total) trans 0 rc 4096/4096
00010000:00010000:0.0:1651531971.938187:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca43fe lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [532480->536575] (req 532480->536575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531971.938189:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250298
00010000:00010000:0.0:1651531971.938192:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca43fe lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [532480->536575] (req 532480->536575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.938199:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca43fe lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [532480->536575] (req 532480->536575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531971.938292:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531971.938304:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467618176
00000100:00100000:1.0:1651531971.938317:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250299
00000100:00100000:1.0:1651531971.938319:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000942b56fd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467618176:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531971.938334:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4405 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.938338:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531971.938338:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531971.938340:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4405 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.938343:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4405 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.938355:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4405 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.938358:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4405 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.938368:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4405 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.938372:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008558d1b3 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531971.938373:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4405 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531971.938376:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000942b56fd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467618176:12345-10.240.43.64@tcp:3:fio.0 Request processed in 56us (84us total) trans 0 rc 4096/4096
00010000:00010000:0.0:1651531971.938376:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4405 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531971.938379:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250299
00010000:00010000:0.0:1651531971.938381:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4405 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.938384:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4405 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531971.938913:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531971.938930:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467618560
00000100:00100000:1.0:1651531971.938946:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250300
00000100:00100000:1.0:1651531971.938948:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003562cf4d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467618560:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531971.938955:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca440c lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.938960:0:192755:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009f4458d9/0x3234de053ca2d7d lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [966656->974847] (req 966656->970751) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4452f2 expref: 8 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.938963:0:192755:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca43e9 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445fe1 expref: 8 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531971.938966:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531971.938967:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531971.938967:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca440c lrc: 5/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [966656->970751] (req 966656->970751) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.938975:0:192755:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca43e9 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445fe1 expref: 8 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531971.938979:0:192755:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca43e9 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445fe1 expref: 8 pid: 166113 timeout: 22780 lvb_type: 1
00000100:00100000:1.0:1651531971.938983:0:192755:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002ef35a72 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0001_UUID:192755:1731745997357248:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651531971.938998:0:192755:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009f4458d9/0x3234de053ca2d7d lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [966656->974847] (req 966656->970751) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4452f2 expref: 8 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.939001:0:192755:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009f4458d9/0x3234de053ca2d7d lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [966656->974847] (req 966656->970751) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4452f2 expref: 8 pid: 166112 timeout: 22780 lvb_type: 0
00000100:00100000:1.0:1651531971.939009:0:192755:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001304ce4c pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0001_UUID:192755:1731745997357312:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531971.939014:0:192755:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ec524534 going to sleep for 6 seconds
00000100:00100000:1.0:1651531971.939283:0:192755:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002ef35a72 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0001_UUID:192755:1731745997357248:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531971.939287:0:192755:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001304ce4c pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0001_UUID:192755:1731745997357312:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651531971.939291:0:192755:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca440c lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [966656->970751] (req 966656->970751) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531971.939359:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531971.939380:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531971.939392:0:166102:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467618624
00010000:00010000:1.0:1651531971.939398:0:166102:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca43e9 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445fe1 expref: 9 pid: 166113 timeout: 22780 lvb_type: 1
00000100:00100000:0.0:1651531971.939398:0:166104:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467618688
00010000:00010000:0.0:1651531971.939405:0:166104:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009f4458d9/0x3234de053ca2d7d lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [966656->974847] (req 966656->970751) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4452f2 expref: 10 pid: 166112 timeout: 22780 lvb_type: 0
00000100:00100000:1.0:1651531971.939406:0:166102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 231
00000100:00100000:1.0:1651531971.939408:0:166102:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001304ce4c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754467618624:12345-10.240.43.64@tcp:103:ldlm_bl_04.0
00010000:00010000:1.0:1651531971.939412:0:166102:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00000100:00100000:0.0:1651531971.939414:0:166104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 232
00010000:00010000:1.0:1651531971.939416:0:166102:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca43e9 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445fe1 expref: 10 pid: 166113 timeout: 22780 lvb_type: 1
00000100:00100000:0.0:1651531971.939416:0:166104:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000008711775 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438147:x1731754467618688:12345-10.240.43.64@tcp:103:ldlm_bl_03.0
00010000:00010000:1.0:1651531971.939420:0:166102:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca43e9 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445fe1 expref: 10 pid: 166113 timeout: 22780 lvb_type: 1
00010000:00010000:0.0:1651531971.939422:0:166104:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1651531971.939426:0:166102:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca43e9 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db445fe1 expref: 10 pid: 166113 timeout: 22780 lvb_type: 1
00010000:00010000:0.0:1651531971.939427:0:166104:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009f4458d9/0x3234de053ca2d7d lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [966656->974847] (req 966656->970751) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4452f2 expref: 10 pid: 166112 timeout: 22780 lvb_type: 0
00010000:00010000:0.0:1651531971.939431:0:166104:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009f4458d9/0x3234de053ca2d7d lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [966656->974847] (req 966656->970751) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4452f2 expref: 10 pid: 166112 timeout: 22780 lvb_type: 0
00010000:00010000:1.0:1651531971.939435:0:166102:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1651531971.939438:0:166104:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009f4458d9/0x3234de053ca2d7d lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [966656->974847] (req 966656->970751) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4452f2 expref: 9 pid: 166112 timeout: 22780 lvb_type: 0
00010000:00010000:0.0:1651531971.939442:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531971.939443:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531971.939444:0:166104:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca440c lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [966656->970751] (req 966656->970751) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531971.939447:0:166102:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001304ce4c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467618624:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 38us (89us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531971.939450:0:166102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 231
00010000:00010000:0.0:1651531971.939454:0:166104:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca440c lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [966656->970751] (req 966656->970751) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.939464:0:166104:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1651531971.939472:0:192755:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca440c lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [966656->970751] (req 966656->970751) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531971.939473:0:166104:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000008711775 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438147:x1731754467618688:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 56us (94us total) trans 0 rc 0/0
00010000:00010000:1.0:1651531971.939476:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca440c lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [966656->970751] (req 966656->970751) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531971.939476:0:166104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 232
00000001:00080000:0.0:1651531971.973709:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869355 is committed
00010000:00010000:1.0:1651531971.973736:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca440c lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [966656->970751] (req 966656->970751) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.973741:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca440c lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [966656->970751] (req 966656->970751) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531971.973757:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003562cf4d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438148:x1731754467618560:12345-10.240.43.64@tcp:4:fio.0 Request processed in 34808us (34844us total) trans 21474869355 rc 0/0
00000100:00100000:1.0:1651531971.973760:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250300
00010000:00010000:1.0:1651531971.973767:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca440c lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [966656->970751] (req 966656->970751) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.973771:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000968553c1 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531971.973772:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca440c lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [966656->970751] (req 966656->970751) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.973775:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca440c lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [966656->970751] (req 966656->970751) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.973781:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca440c lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [966656->970751] (req 966656->970751) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.973784:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca440c lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [966656->970751] (req 966656->970751) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531971.987554:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531971.987570:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467619200
00000100:00100000:1.0:1651531971.987572:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531971.987584:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531971.987591:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467619072
00000100:00100000:0.0:1651531971.987601:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250301
00000100:00100000:0.0:1651531971.987603:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f7006631 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438147:x1731754467619200:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:1.0:1651531971.987606:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250302
00000100:00100000:1.0:1651531971.987609:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002ef35a72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438148:x1731754467619072:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531971.987614:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4413 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.987618:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca441a lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.987619:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531971.987619:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531971.987620:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4413 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [626688->630783] (req 626688->630783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531971.987625:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4413 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [626688->630783] (req 626688->630783) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.987626:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531971.987627:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531971.987628:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca441a lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [516096->520191] (req 516096->520191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.987632:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca441a lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [516096->520191] (req 516096->520191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.987645:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca441a lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [516096->520191] (req 516096->520191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.987648:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca441a lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [516096->520191] (req 516096->520191) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531971.987666:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002ef35a72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438148:x1731754467619072:12345-10.240.43.64@tcp:3:fio.0 Request processed in 57us (95us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531971.987671:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250302
00010000:00010000:1.0:1651531971.987683:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca441a lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [516096->520191] (req 516096->520191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.987687:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000968553c1 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531971.987688:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca441a lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [516096->520191] (req 516096->520191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.987691:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca441a lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [516096->520191] (req 516096->520191) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.987695:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca441a lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [516096->520191] (req 516096->520191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.987698:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca441a lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [516096->520191] (req 516096->520191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531971.987704:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467619008
00000100:00100000:1.0:1651531971.987712:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44622
00000100:00100000:1.0:1651531971.987713:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000052213cb9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438147:x1731754467619008:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531971.987717:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531971.987719:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca4421 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445fef expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.987727:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca4421 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445fef expref: 10 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531971.987735:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca4421 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445fef expref: 10 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531971.987738:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d44eb74d, rc 0)
00000100:00100000:1.0:1651531971.987777:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000052213cb9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438147:x1731754467619008:12345-10.240.43.64@tcp:101:fio.0 Request processed in 62us (192us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531971.987780:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44622
00000100:00100000:0.0:1651531971.988057:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531971.988075:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467619456
00000100:00100000:1.0:1651531971.988086:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250303
00000100:00100000:1.0:1651531971.988088:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a925fbf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438149:x1731754467619456:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531971.988094:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4428 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.988098:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531971.988099:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531971.988100:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4428 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [806912->811007] (req 806912->811007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.988103:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4428 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [806912->811007] (req 806912->811007) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531971.988427:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531971.988435:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467619584
00000100:00100000:1.0:1651531971.988445:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250304
00000100:00100000:1.0:1651531971.988447:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001304ce4c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754467619584:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531971.988455:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca442f lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.988459:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531971.988460:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531971.988461:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca442f lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [786432->790527] (req 786432->790527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531971.988465:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca442f lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [786432->790527] (req 786432->790527) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531972.037630:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869356 is committed
00010000:00010000:1.0:1651531972.037665:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4413 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [626688->630783] (req 626688->630783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.037669:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4413 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [626688->630783] (req 626688->630783) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.037681:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4413 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [626688->630783] (req 626688->630783) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531972.037688:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f7006631 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754467619200:12345-10.240.43.64@tcp:4:fio.0 Request processed in 50084us (50134us total) trans 21474869356 rc 0/0
00000100:00100000:1.0:1651531972.037691:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250301
00010000:00010000:0.0:1651531972.037691:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f5657138 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531972.037692:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4413 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [626688->630783] (req 626688->630783) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.037696:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4413 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [626688->630783] (req 626688->630783) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.037701:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4413 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [626688->630783] (req 626688->630783) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.037704:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4413 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [626688->630783] (req 626688->630783) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531972.038015:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531972.038023:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467619712
00000100:00100000:1.0:1651531972.038033:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250305
00000100:00100000:1.0:1651531972.038035:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754467619712:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531972.038042:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca4436 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.038046:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531972.038048:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531972.038049:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca4436 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [782336->786431] (req 782336->786431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.038053:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca4436 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [782336->786431] (req 782336->786431) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531972.049486:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531972.049494:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467619840
00000100:00100000:1.0:1651531972.049506:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44623
00000100:00100000:1.0:1651531972.049508:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003ffbc5dc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754467619840:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531972.049512:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531972.049516:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca443d lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db445ffd expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.049524:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca443d lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445ffd expref: 16 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531972.049528:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca443d lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db445ffd expref: 16 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531972.049532:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000968553c1, rc 0)
00000100:00100000:1.0:1651531972.049542:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003ffbc5dc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754467619840:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (57us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531972.049544:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44623
00000100:00100000:1.0:1651531972.050334:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531972.050342:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467620096
00000100:00100000:1.0:1651531972.050357:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250306
00000100:00100000:1.0:1651531972.050360:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000567318ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754467620096:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531972.050367:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4444 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.050371:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531972.050372:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531972.050373:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4444 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [376832->380927] (req 376832->380927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.050377:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4444 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [376832->380927] (req 376832->380927) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531972.063018:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869358 is committed
00002000:00010000:1.0:1651531972.063045:0:192753:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x34545:0x0] updating lvb mtime from disk: 1651531971 -> 1651531972
00002000:00010000:1.0:1651531972.063047:0:192753:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x34545:0x0] updating lvb ctime from disk: 1651531971 -> 1651531972
00010000:00010000:1.0:1651531972.063050:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca442f lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [786432->790527] (req 786432->790527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.063053:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca442f lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [786432->790527] (req 786432->790527) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531972.063069:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001304ce4c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754467619584:12345-10.240.43.64@tcp:4:fio.0 Request processed in 74622us (74642us total) trans 21474869358 rc 0/0
00000100:00100000:1.0:1651531972.063072:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250304
00010000:00010000:1.0:1651531972.063079:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca442f lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [786432->790527] (req 786432->790527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.063083:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c2b76533 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531972.063084:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca442f lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [786432->790527] (req 786432->790527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.063088:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca442f lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [786432->790527] (req 786432->790527) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.063093:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca442f lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [786432->790527] (req 786432->790527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.063096:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca442f lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [786432->790527] (req 786432->790527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.063106:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4428 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [806912->811007] (req 806912->811007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.063109:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4428 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [806912->811007] (req 806912->811007) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531972.063120:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a925fbf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438149:x1731754467619456:12345-10.240.43.64@tcp:4:fio.0 Request processed in 75031us (75063us total) trans 21474869357 rc 0/0
00000100:00100000:1.0:1651531972.063122:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250303
00010000:00010000:1.0:1651531972.063127:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4428 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [806912->811007] (req 806912->811007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.063130:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001e36c601 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531972.063131:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4428 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [806912->811007] (req 806912->811007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.063134:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4428 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [806912->811007] (req 806912->811007) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.063142:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4428 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [806912->811007] (req 806912->811007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.063144:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4428 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [806912->811007] (req 806912->811007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531972.064018:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531972.064026:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467620480
00000100:00100000:1.0:1651531972.064036:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250307
00000100:00100000:1.0:1651531972.064038:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009acffcb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754467620480:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531972.064044:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca444b lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.064048:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531972.064049:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531972.064050:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca444b lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [778240->782335] (req 778240->782335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.064054:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca444b lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [778240->782335] (req 778240->782335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531972.064390:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531972.064398:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467620672
00000100:00100000:1.0:1651531972.064413:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250308
00000100:00100000:1.0:1651531972.064415:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000054ed0749 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754467620672:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531972.064422:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4452 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.064430:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531972.064430:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531972.064431:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4452 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [786432->790527] (req 786432->790527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.064435:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4452 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [786432->790527] (req 786432->790527) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.064446:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4452 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [786432->790527] (req 786432->790527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.064449:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4452 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [786432->790527] (req 786432->790527) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531972.064468:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000054ed0749 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754467620672:12345-10.240.43.64@tcp:3:fio.0 Request processed in 53us (78us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531972.064471:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250308
00010000:00010000:0.0:1651531972.064471:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4452 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [786432->790527] (req 786432->790527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.064475:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008558d1b3 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531972.064476:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4452 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [786432->790527] (req 786432->790527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.064479:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4452 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [786432->790527] (req 786432->790527) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.064485:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4452 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [786432->790527] (req 786432->790527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.064488:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4452 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [786432->790527] (req 786432->790527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531972.095809:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869360 is committed
00010000:00010000:1.0:1651531972.095838:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca4436 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [782336->786431] (req 782336->786431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.095842:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca4436 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [782336->786431] (req 782336->786431) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531972.095858:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438146:x1731754467619712:12345-10.240.43.64@tcp:4:fio.0 Request processed in 57822us (57844us total) trans 21474869359 rc 0/0
00010000:00010000:0.0:1651531972.095859:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4444 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [376832->380927] (req 376832->380927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531972.095861:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250305
00010000:00010000:0.0:1651531972.095863:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4444 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [376832->380927] (req 376832->380927) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.095868:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca4436 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [782336->786431] (req 782336->786431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.095879:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d44eb74d already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531972.095880:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca4436 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [782336->786431] (req 782336->786431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.095883:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca4436 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [782336->786431] (req 782336->786431) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531972.095883:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000567318ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438149:x1731754467620096:12345-10.240.43.64@tcp:4:fio.0 Request processed in 45522us (45550us total) trans 21474869360 rc 0/0
00000100:00100000:0.0:1651531972.095887:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250306
00010000:00010000:1.0:1651531972.095888:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca4436 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [782336->786431] (req 782336->786431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.095891:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca4436 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [782336->786431] (req 782336->786431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.095907:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4444 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [376832->380927] (req 376832->380927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.095909:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006da7a892 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531972.095910:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4444 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [376832->380927] (req 376832->380927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.095913:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4444 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [376832->380927] (req 376832->380927) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.095917:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4444 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [376832->380927] (req 376832->380927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.095919:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4444 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [376832->380927] (req 376832->380927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531972.096342:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531972.096350:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467621248
00000100:00100000:1.0:1651531972.096364:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44624
00000100:00100000:1.0:1651531972.096366:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ffcc974c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754467621248:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531972.096369:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531972.096373:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4459 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44600b expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.096381:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4459 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44600b expref: 10 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531972.096385:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4459 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44600b expref: 10 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531972.096389:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001e36c601, rc 0)
00000100:00100000:1.0:1651531972.096399:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ffcc974c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754467621248:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (58us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531972.096401:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44624
00000100:00100000:1.0:1651531972.096586:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531972.096602:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467621376
00000100:00100000:0.0:1651531972.096616:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250309
00000100:00100000:0.0:1651531972.096618:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d9e74b4c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754467621376:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531972.096625:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4460 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.096629:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531972.096630:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531972.096631:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4460 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [868352->872447] (req 868352->872447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.096635:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4460 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [868352->872447] (req 868352->872447) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531972.096914:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531972.096921:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467621568
00000100:00100000:1.0:1651531972.096931:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250310
00000100:00100000:1.0:1651531972.096932:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c43262d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438149:x1731754467621568:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531972.096939:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4467 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.096958:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531972.096959:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531972.096960:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4467 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [1036288->1040383] (req 1036288->1040383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.096964:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4467 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [1036288->1040383] (req 1036288->1040383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.096976:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4467 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [1036288->1040383] (req 1036288->1040383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.096979:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4467 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [1036288->1040383] (req 1036288->1040383) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531972.096999:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c43262d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438149:x1731754467621568:12345-10.240.43.64@tcp:3:fio.0 Request processed in 66us (85us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531972.097002:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250310
00010000:00010000:0.0:1651531972.097004:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4467 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [1036288->1040383] (req 1036288->1040383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.097008:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c2b76533 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531972.097009:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4467 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [1036288->1040383] (req 1036288->1040383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.097013:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4467 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [1036288->1040383] (req 1036288->1040383) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.097018:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4467 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [1036288->1040383] (req 1036288->1040383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.097021:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4467 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [1036288->1040383] (req 1036288->1040383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531972.145967:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869361 is committed
00010000:00010000:0.0:1651531972.146013:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca444b lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [778240->782335] (req 778240->782335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.146017:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca444b lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [778240->782335] (req 778240->782335) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531972.146038:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009acffcb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438147:x1731754467620480:12345-10.240.43.64@tcp:4:fio.0 Request processed in 82000us (82020us total) trans 21474869361 rc 0/0
00000100:00100000:0.0:1651531972.146042:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250307
00010000:00010000:1.0:1651531972.146043:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca444b lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [778240->782335] (req 778240->782335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.146048:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000968553c1 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531972.146049:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca444b lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [778240->782335] (req 778240->782335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.146061:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca444b lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [778240->782335] (req 778240->782335) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.146067:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca444b lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [778240->782335] (req 778240->782335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.146079:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca444b lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [778240->782335] (req 778240->782335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531972.146380:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531972.146404:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467621824
00000100:00100000:0.0:1651531972.146418:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250311
00000100:00100000:0.0:1651531972.146420:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a20162bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438146:x1731754467621824:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531972.146427:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca446e lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.146431:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531972.146432:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531972.146433:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca446e lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [77824->81919] (req 77824->81919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.146437:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca446e lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [77824->81919] (req 77824->81919) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531972.196633:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869362 is committed
00010000:00010000:0.0:1651531972.196677:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4460 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [868352->872447] (req 868352->872447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.196685:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4460 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [868352->872447] (req 868352->872447) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531972.196707:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d9e74b4c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754467621376:12345-10.240.43.64@tcp:4:fio.0 Request processed in 100089us (100121us total) trans 21474869362 rc 0/0
00010000:00010000:1.0:1651531972.196711:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4460 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [868352->872447] (req 868352->872447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531972.196711:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250309
00010000:00010000:1.0:1651531972.196715:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f5657138 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531972.196716:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4460 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [868352->872447] (req 868352->872447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.196720:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4460 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [868352->872447] (req 868352->872447) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.196734:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4460 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [868352->872447] (req 868352->872447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.196737:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4460 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [868352->872447] (req 868352->872447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531972.197044:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531972.197064:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467622080
00000100:00100000:0.0:1651531972.197081:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250312
00000100:00100000:0.0:1651531972.197083:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b97e3b28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438149:x1731754467622080:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531972.197090:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca4475 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.197094:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531972.197095:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531972.197096:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca4475 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [565248->569343] (req 565248->569343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.197100:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca4475 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [565248->569343] (req 565248->569343) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.197113:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca4475 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [565248->569343] (req 565248->569343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.197117:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca4475 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [565248->569343] (req 565248->569343) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531972.197132:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b97e3b28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438149:x1731754467622080:12345-10.240.43.64@tcp:3:fio.0 Request processed in 49us (88us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531972.197136:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250312
00010000:00010000:0.0:1651531972.197143:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca4475 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [565248->569343] (req 565248->569343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.197146:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f765708a already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531972.197147:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca4475 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [565248->569343] (req 565248->569343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.197150:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca4475 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [565248->569343] (req 565248->569343) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.197155:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca4475 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [565248->569343] (req 565248->569343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.197157:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca4475 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [565248->569343] (req 565248->569343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531972.197915:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531972.197933:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467622336
00000100:00100000:0.0:1651531972.197949:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250313
00000100:00100000:0.0:1651531972.197951:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008b42dfe9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438149:x1731754467622336:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531972.197958:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca447c lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.197962:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531972.197963:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531972.197964:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca447c lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [65536->69631] (req 65536->69631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.197971:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca447c lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [65536->69631] (req 65536->69631) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531972.208497:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531972.208519:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467622464
00000100:00100000:1.0:1651531972.208533:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44625
00000100:00100000:1.0:1651531972.208535:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003d9ef3c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438149:x1731754467622464:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531972.208539:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531972.208543:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4483 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446019 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.208560:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4483 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446019 expref: 13 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531972.208565:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4483 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446019 expref: 13 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531972.208568:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000968553c1, rc 0)
00000100:00100000:1.0:1651531972.208580:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003d9ef3c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438149:x1731754467622464:12345-10.240.43.64@tcp:101:fio.0 Request processed in 45us (84us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531972.208583:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44625
00000001:00080000:0.0:1651531972.247284:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869363 is committed
00010000:00010000:0.0:1651531972.247328:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca446e lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [77824->81919] (req 77824->81919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.247332:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca446e lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [77824->81919] (req 77824->81919) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531972.247353:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a20162bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438146:x1731754467621824:12345-10.240.43.64@tcp:4:fio.0 Request processed in 100933us (100974us total) trans 21474869363 rc 0/0
00010000:00010000:1.0:1651531972.247355:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca446e lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [77824->81919] (req 77824->81919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531972.247356:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250311
00010000:00010000:1.0:1651531972.247360:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c1022d42 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531972.247361:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca446e lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [77824->81919] (req 77824->81919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.247364:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca446e lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [77824->81919] (req 77824->81919) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.247378:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca446e lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [77824->81919] (req 77824->81919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.247381:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca446e lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [77824->81919] (req 77824->81919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531972.259151:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531972.259183:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467622976
00000100:00100000:0.0:1651531972.259198:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250314
00000100:00100000:0.0:1651531972.259200:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000329eeeee pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438147:x1731754467622976:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531972.259208:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca448a lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.259221:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531972.259231:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531972.259233:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca448a lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [860160->864255] (req 860160->864255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.259237:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca448a lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [860160->864255] (req 860160->864255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531972.297925:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869364 is committed
00010000:00010000:0.0:1651531972.297968:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca447c lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [65536->69631] (req 65536->69631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.297972:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca447c lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [65536->69631] (req 65536->69631) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531972.297994:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008b42dfe9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438149:x1731754467622336:12345-10.240.43.64@tcp:4:fio.0 Request processed in 100042us (100079us total) trans 21474869364 rc 0/0
00010000:00010000:1.0:1651531972.297995:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca447c lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [65536->69631] (req 65536->69631) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531972.297997:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250313
00010000:00010000:1.0:1651531972.298000:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fb2f6575 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531972.298001:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca447c lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [65536->69631] (req 65536->69631) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.298004:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca447c lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [65536->69631] (req 65536->69631) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.298017:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca447c lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [65536->69631] (req 65536->69631) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.298020:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca447c lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [65536->69631] (req 65536->69631) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531972.309781:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531972.309804:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467623296
00000100:00100000:0.0:1651531972.309819:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250315
00000100:00100000:0.0:1651531972.309821:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f3a0807 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438146:x1731754467623296:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531972.309829:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4491 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.309833:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531972.309833:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531972.309834:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4491 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [389120->393215] (req 389120->393215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.309839:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4491 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [389120->393215] (req 389120->393215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.309851:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4491 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [389120->393215] (req 389120->393215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.309858:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4491 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [389120->393215] (req 389120->393215) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531972.309874:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f3a0807 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438146:x1731754467623296:12345-10.240.43.64@tcp:3:fio.0 Request processed in 52us (94us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531972.309877:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250315
00010000:00010000:0.0:1651531972.309883:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4491 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [389120->393215] (req 389120->393215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.309887:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000080362f27 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531972.309888:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4491 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [389120->393215] (req 389120->393215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.309890:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4491 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [389120->393215] (req 389120->393215) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.309895:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4491 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [389120->393215] (req 389120->393215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.309898:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4491 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [389120->393215] (req 389120->393215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531972.310209:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531972.310239:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467623488
00000100:00100000:1.0:1651531972.310251:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44626
00000100:00100000:1.0:1651531972.310253:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a899ddab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438147:x1731754467623488:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531972.310256:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531972.310260:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4498 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446027 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.310268:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4498 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446027 expref: 10 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531972.310272:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4498 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446027 expref: 10 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531972.310277:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000968553c1, rc 0)
00000100:00100000:1.0:1651531972.310299:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a899ddab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438147:x1731754467623488:12345-10.240.43.64@tcp:101:fio.0 Request processed in 46us (91us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531972.310302:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44626
00000100:00100000:1.0:1651531972.310617:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531972.310635:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467623616
00000100:00100000:0.0:1651531972.310652:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250316
00000100:00100000:0.0:1651531972.310654:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b10bc064 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438146:x1731754467623616:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531972.310661:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca449f lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.310667:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531972.310667:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531972.310668:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca449f lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [1044480->1048575] (req 1044480->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.310672:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca449f lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [1044480->1048575] (req 1044480->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.310684:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca449f lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [1044480->1048575] (req 1044480->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.310687:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca449f lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [1044480->1048575] (req 1044480->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.310704:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca449f lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [1044480->1048575] (req 1044480->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531972.310707:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b10bc064 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438146:x1731754467623616:12345-10.240.43.64@tcp:3:fio.0 Request processed in 53us (91us total) trans 0 rc 4096/4096
00010000:00010000:1.0:1651531972.310708:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e2ec18e1 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531972.310709:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca449f lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [1044480->1048575] (req 1044480->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531972.310710:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250316
00010000:00010000:1.0:1651531972.310712:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca449f lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [1044480->1048575] (req 1044480->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.310718:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca449f lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [1044480->1048575] (req 1044480->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.310720:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca449f lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [1044480->1048575] (req 1044480->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531972.310984:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531972.310996:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467623744
00000100:00100000:0.0:1651531972.311010:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250317
00000100:00100000:0.0:1651531972.311012:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000427633c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438146:x1731754467623744:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531972.311020:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca44a6 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.311023:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531972.311024:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531972.311025:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca44a6 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [917504->921599] (req 917504->921599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.311033:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca44a6 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [917504->921599] (req 917504->921599) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.311043:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca44a6 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [917504->921599] (req 917504->921599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.311046:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca44a6 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [917504->921599] (req 917504->921599) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.311063:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca44a6 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [917504->921599] (req 917504->921599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531972.311066:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000427633c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438146:x1731754467623744:12345-10.240.43.64@tcp:3:fio.0 Request processed in 53us (82us total) trans 0 rc 4096/4096
00010000:00010000:1.0:1651531972.311067:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002c5e01dd already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531972.311068:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca44a6 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [917504->921599] (req 917504->921599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531972.311069:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250317
00010000:00010000:1.0:1651531972.311072:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca44a6 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [917504->921599] (req 917504->921599) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.311077:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca44a6 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [917504->921599] (req 917504->921599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.311080:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca44a6 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [917504->921599] (req 917504->921599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531972.321938:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869365 is committed
00010000:00010000:0.0:1651531972.321952:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca448a lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [860160->864255] (req 860160->864255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.321955:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca448a lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [860160->864255] (req 860160->864255) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531972.321975:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000329eeeee pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438147:x1731754467622976:12345-10.240.43.64@tcp:4:fio.0 Request processed in 62774us (62824us total) trans 21474869365 rc 0/0
00000100:00100000:0.0:1651531972.321978:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250314
00010000:00010000:0.0:1651531972.321985:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca448a lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [860160->864255] (req 860160->864255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.321988:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f765708a already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531972.321989:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca448a lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [860160->864255] (req 860160->864255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.321994:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca448a lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [860160->864255] (req 860160->864255) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.321999:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca448a lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [860160->864255] (req 860160->864255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.322001:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca448a lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [860160->864255] (req 860160->864255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531972.322294:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531972.322302:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467624000
00000100:00100000:0.0:1651531972.322312:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250318
00000100:00100000:0.0:1651531972.322314:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006e255cae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438146:x1731754467624000:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531972.322320:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca44ad lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.322325:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531972.322325:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531972.322326:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca44ad lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [630784->634879] (req 630784->634879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.322330:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca44ad lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [630784->634879] (req 630784->634879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531972.372588:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869366 is committed
00010000:00010000:0.0:1651531972.372603:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca44ad lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [630784->634879] (req 630784->634879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.372610:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca44ad lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [630784->634879] (req 630784->634879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531972.372631:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006e255cae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438146:x1731754467624000:12345-10.240.43.64@tcp:4:fio.0 Request processed in 50316us (50337us total) trans 21474869366 rc 0/0
00010000:00010000:1.0:1651531972.372634:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca44ad lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [630784->634879] (req 630784->634879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531972.372634:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250318
00010000:00010000:1.0:1651531972.372639:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000080362f27 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531972.372640:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca44ad lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [630784->634879] (req 630784->634879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.372643:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca44ad lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [630784->634879] (req 630784->634879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.372649:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca44ad lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [630784->634879] (req 630784->634879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.372652:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca44ad lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [630784->634879] (req 630784->634879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531972.372928:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531972.372937:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467624128
00000100:00100000:0.0:1651531972.372947:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250319
00000100:00100000:0.0:1651531972.372948:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000009c4c564 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438147:x1731754467624128:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531972.372956:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca44b4 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.372960:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531972.372960:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531972.372961:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca44b4 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [569344->573439] (req 569344->573439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.372965:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca44b4 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [569344->573439] (req 569344->573439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.372976:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca44b4 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [569344->573439] (req 569344->573439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.372979:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca44b4 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [569344->573439] (req 569344->573439) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.373002:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca44b4 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [569344->573439] (req 569344->573439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531972.373004:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000009c4c564 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438147:x1731754467624128:12345-10.240.43.64@tcp:3:fio.0 Request processed in 55us (76us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531972.373007:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250319
00010000:00010000:1.0:1651531972.373010:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f765708a already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531972.373011:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca44b4 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [569344->573439] (req 569344->573439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.373014:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca44b4 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [569344->573439] (req 569344->573439) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.373018:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca44b4 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [569344->573439] (req 569344->573439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.373021:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca44b4 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [569344->573439] (req 569344->573439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531972.373488:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531972.373497:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467624384
00000100:00100000:0.0:1651531972.373506:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250320
00000100:00100000:0.0:1651531972.373508:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c683c211 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438146:x1731754467624384:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531972.373515:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca44bb lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.373519:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531972.373520:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531972.373521:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca44bb lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.373525:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca44bb lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531972.373648:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531972.373656:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467624640
00000100:00100000:0.0:1651531972.373672:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250321
00000100:00100000:0.0:1651531972.373674:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c4ea889e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438147:x1731754467624640:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531972.373681:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca44c2 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.373685:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531972.373687:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531972.373688:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca44c2 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [589824->593919] (req 589824->593919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.373692:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca44c2 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [589824->593919] (req 589824->593919) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531972.415310:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869368 is committed
00010000:00010000:0.0:1651531972.415326:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca44bb lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.415330:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca44bb lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531972.415346:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c683c211 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438146:x1731754467624384:12345-10.240.43.64@tcp:4:fio.0 Request processed in 41837us (41858us total) trans 21474869367 rc 0/0
00000100:00100000:0.0:1651531972.415349:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250320
00010000:00010000:0.0:1651531972.415355:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca44bb lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.415359:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000032ee36ee already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531972.415360:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca44bb lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.415363:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca44bb lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.415367:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca44bb lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.415375:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca44bb lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.415385:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca44c2 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [589824->593919] (req 589824->593919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.415388:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca44c2 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [589824->593919] (req 589824->593919) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531972.415405:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c4ea889e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438147:x1731754467624640:12345-10.240.43.64@tcp:4:fio.0 Request processed in 41730us (41758us total) trans 21474869368 rc 0/0
00000100:00100000:0.0:1651531972.415408:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250321
00010000:00010000:1.0:1651531972.415411:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca44c2 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [589824->593919] (req 589824->593919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.415416:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fab23815 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531972.415417:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca44c2 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [589824->593919] (req 589824->593919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.415420:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca44c2 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [589824->593919] (req 589824->593919) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.415425:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca44c2 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [589824->593919] (req 589824->593919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.415427:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca44c2 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [589824->593919] (req 589824->593919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531972.415469:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531972.415490:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467624768
00000100:00100000:1.0:1651531972.415503:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44627
00000100:00100000:1.0:1651531972.415505:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000059e5b3a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438148:x1731754467624768:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531972.415509:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531972.415512:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca44c9 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446035 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.415518:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531972.415518:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531972.415520:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca44c9 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446035 expref: 7 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531972.415525:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca44c9 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446035 expref: 7 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531972.415529:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000968553c1, rc 0)
00000100:00100000:1.0:1651531972.415543:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000059e5b3a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438148:x1731754467624768:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (75us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531972.415546:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44627
00000100:00100000:0.0:1651531972.415664:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531972.415672:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467624896
00000100:00100000:0.0:1651531972.415682:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250322
00000100:00100000:0.0:1651531972.415684:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c0b460ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438146:x1731754467624896:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531972.415691:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca44d0 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.415696:0:216321:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca44c9 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446035 expref: 7 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531972.415700:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531972.415700:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531972.415701:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca44d0 lrc: 4/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [249856->253951] (req 249856->253951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.415712:0:216321:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca44c9 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446035 expref: 7 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531972.415717:0:216321:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca44c9 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446035 expref: 7 pid: 166113 timeout: 22781 lvb_type: 1
00000100:00100000:0.0:1651531972.415721:0:216321:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007a05c3e3 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997357376:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531972.415733:0:216321:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f23eeb5f going to sleep for 6 seconds
00000100:00100000:0.0:1651531972.416032:0:216321:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007a05c3e3 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997357376:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651531972.416037:0:216321:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca44d0 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [249856->253951] (req 249856->253951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531972.416131:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531972.416139:0:166104:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467625344
00010000:00010000:0.0:1651531972.416145:0:166104:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca44c9 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446035 expref: 8 pid: 166113 timeout: 22781 lvb_type: 1
00000100:00100000:0.0:1651531972.416158:0:166104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 233
00000100:00100000:0.0:1651531972.416160:0:166104:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007a05c3e3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467625344:12345-10.240.43.64@tcp:103:ldlm_bl_04.0
00010000:00010000:0.0:1651531972.416163:0:166104:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531972.416167:0:166104:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca44c9 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446035 expref: 8 pid: 166113 timeout: 22781 lvb_type: 1
00010000:00010000:0.0:1651531972.416171:0:166104:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca44c9 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446035 expref: 8 pid: 166113 timeout: 22781 lvb_type: 1
00010000:00010000:0.0:1651531972.416179:0:166104:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca44c9 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446035 expref: 8 pid: 166113 timeout: 22781 lvb_type: 1
00010000:00010000:0.0:1651531972.416183:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531972.416183:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531972.416184:0:166104:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca44d0 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [249856->253951] (req 249856->253951) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.416187:0:166104:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca44d0 lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [249856->253951] (req 249856->253951) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.416195:0:166104:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651531972.416203:0:166104:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007a05c3e3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438149:x1731754467625344:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 43us (73us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531972.416206:0:166104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 233
00010000:00010000:0.0:1651531972.416221:0:216321:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca44d0 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [249856->253951] (req 249856->253951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.416241:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca44d0 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [249856->253951] (req 249856->253951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531972.416482:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531972.416490:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467625536
00000100:00100000:0.0:1651531972.416507:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250323
00000100:00100000:0.0:1651531972.416509:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000df1eb0d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438149:x1731754467625536:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531972.416516:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca44d7 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.416521:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531972.416522:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531972.416523:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca44d7 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [929792->933887] (req 929792->933887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.416527:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca44d7 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [929792->933887] (req 929792->933887) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.416540:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca44d7 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [929792->933887] (req 929792->933887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.416543:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca44d7 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [929792->933887] (req 929792->933887) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.416554:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca44d7 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [929792->933887] (req 929792->933887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.416558:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000820577fb already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531972.416559:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca44d7 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [929792->933887] (req 929792->933887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531972.416561:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000df1eb0d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438149:x1731754467625536:12345-10.240.43.64@tcp:3:fio.0 Request processed in 52us (80us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531972.416564:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250323
00010000:00010000:1.0:1651531972.416566:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca44d7 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [929792->933887] (req 929792->933887) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.416571:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca44d7 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [929792->933887] (req 929792->933887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.416574:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca44d7 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [929792->933887] (req 929792->933887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531972.416875:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531972.416883:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467625664
00000100:00100000:0.0:1651531972.416897:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250324
00000100:00100000:0.0:1651531972.416899:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000000615301 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754467625664:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531972.416906:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca44de lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.416910:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531972.416910:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531972.416911:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca44de lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [348160->352255] (req 348160->352255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.416919:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca44de lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [348160->352255] (req 348160->352255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.416930:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca44de lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [348160->352255] (req 348160->352255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.416933:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca44de lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [348160->352255] (req 348160->352255) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531972.416947:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000000615301 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754467625664:12345-10.240.43.64@tcp:3:fio.0 Request processed in 47us (72us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531972.416949:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250324
00010000:00010000:0.0:1651531972.416956:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca44de lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [348160->352255] (req 348160->352255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.416959:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000075a78972 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531972.416960:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca44de lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [348160->352255] (req 348160->352255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.416963:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca44de lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [348160->352255] (req 348160->352255) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.416967:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca44de lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [348160->352255] (req 348160->352255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.416970:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca44de lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [348160->352255] (req 348160->352255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531972.451947:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869369 is committed
00010000:00010000:0.0:1651531972.451961:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca44d0 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [249856->253951] (req 249856->253951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.451965:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca44d0 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [249856->253951] (req 249856->253951) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531972.451986:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c0b460ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438146:x1731754467624896:12345-10.240.43.64@tcp:4:fio.0 Request processed in 36301us (36322us total) trans 21474869369 rc 0/0
00010000:00010000:1.0:1651531972.451987:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca44d0 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [249856->253951] (req 249856->253951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531972.451989:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250322
00010000:00010000:1.0:1651531972.451992:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000775318ab already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531972.451993:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca44d0 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [249856->253951] (req 249856->253951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.451996:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca44d0 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [249856->253951] (req 249856->253951) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.452001:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca44d0 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [249856->253951] (req 249856->253951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.452003:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca44d0 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [249856->253951] (req 249856->253951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531972.452698:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531972.452706:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467626176
00000100:00100000:0.0:1651531972.452716:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250325
00000100:00100000:0.0:1651531972.452718:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000008e0501d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438146:x1731754467626176:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531972.452724:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca44e5 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.452729:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531972.452729:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531972.452730:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca44e5 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [798720->802815] (req 798720->802815) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.452734:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca44e5 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [798720->802815] (req 798720->802815) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531972.477796:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531972.477804:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531972.477816:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531972.477826:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467626304
00000100:00100000:1.0:1651531972.477835:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467626368
00000100:00100000:1.0:1651531972.477848:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467626560
00000100:00100000:1.0:1651531972.477862:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250326
00000100:00100000:1.0:1651531972.477865:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001e61ed2d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754467626368:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531972.477873:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca44ec lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531972.477873:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250327
00000100:00100000:0.0:1651531972.477875:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f99d9ea1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754467626304:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531972.477877:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531972.477878:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531972.477879:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca44ec lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [258048->262143] (req 258048->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.477882:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca44f3 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.477883:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca44ec lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [258048->262143] (req 258048->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.477887:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531972.477888:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531972.477889:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca44f3 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [851968->856063] (req 851968->856063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.477893:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca44f3 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [851968->856063] (req 851968->856063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.477895:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca44ec lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [258048->262143] (req 258048->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.477899:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca44ec lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [258048->262143] (req 258048->262143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531972.477917:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001e61ed2d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754467626368:12345-10.240.43.64@tcp:3:fio.0 Request processed in 52us (113us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531972.477921:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250326
00000100:00100000:1.0:1651531972.477926:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250328
00000100:00100000:1.0:1651531972.477928:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000043b0f16d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438147:x1731754467626560:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531972.477934:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca44fa lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.477937:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531972.477938:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531972.477940:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca44fa lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [536576->540671] (req 536576->540671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.477944:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca44fa lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [536576->540671] (req 536576->540671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.477953:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca44fa lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [536576->540671] (req 536576->540671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.477957:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca44fa lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [536576->540671] (req 536576->540671) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531972.477970:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000043b0f16d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754467626560:12345-10.240.43.64@tcp:3:fio.0 Request processed in 42us (154us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531972.477973:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250328
00010000:00010000:1.0:1651531972.477981:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca44ec lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [258048->262143] (req 258048->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.477985:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001e36c601 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531972.477986:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca44ec lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [258048->262143] (req 258048->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.477989:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca44ec lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [258048->262143] (req 258048->262143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.477996:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca44fa lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [536576->540671] (req 536576->540671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.478003:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca44ec lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [258048->262143] (req 258048->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.478003:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006da7a892 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531972.478004:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca44fa lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [536576->540671] (req 536576->540671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.478006:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca44ec lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [258048->262143] (req 258048->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.478007:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca44fa lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [536576->540671] (req 536576->540671) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.478012:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca44fa lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [536576->540671] (req 536576->540671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.478015:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca44fa lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [536576->540671] (req 536576->540671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531972.502567:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869370 is committed
00010000:00010000:0.0:1651531972.502610:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca44e5 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [798720->802815] (req 798720->802815) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.502614:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca44e5 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [798720->802815] (req 798720->802815) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531972.502635:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000008e0501d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438146:x1731754467626176:12345-10.240.43.64@tcp:4:fio.0 Request processed in 49916us (49938us total) trans 21474869370 rc 0/0
00010000:00010000:1.0:1651531972.502636:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca44e5 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [798720->802815] (req 798720->802815) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531972.502638:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250325
00010000:00010000:1.0:1651531972.502641:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000075a78972 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531972.502642:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca44e5 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [798720->802815] (req 798720->802815) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.502645:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca44e5 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [798720->802815] (req 798720->802815) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.502658:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca44e5 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [798720->802815] (req 798720->802815) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.502661:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca44e5 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [798720->802815] (req 798720->802815) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531972.502935:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531972.502943:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467626880
00000100:00100000:0.0:1651531972.502958:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250329
00000100:00100000:0.0:1651531972.502960:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000052cf3c08 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438147:x1731754467626880:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531972.502976:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca4501 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.502980:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531972.502981:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531972.502982:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca4501 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [749568->753663] (req 749568->753663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.502986:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca4501 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [749568->753663] (req 749568->753663) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.502999:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca4501 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [749568->753663] (req 749568->753663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.503006:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca4501 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [749568->753663] (req 749568->753663) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.503023:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca4501 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [749568->753663] (req 749568->753663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531972.503026:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000052cf3c08 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438147:x1731754467626880:12345-10.240.43.64@tcp:3:fio.0 Request processed in 65us (92us total) trans 0 rc 4096/4096
00010000:00010000:1.0:1651531972.503027:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000014685f38 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531972.503028:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca4501 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [749568->753663] (req 749568->753663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531972.503029:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250329
00010000:00010000:1.0:1651531972.503030:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca4501 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [749568->753663] (req 749568->753663) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.503035:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca4501 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [749568->753663] (req 749568->753663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.503039:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca4501 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [749568->753663] (req 749568->753663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531972.539890:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531972.539899:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467627264
00000100:00100000:0.0:1651531972.539914:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250330
00000100:00100000:0.0:1651531972.539915:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000b1a9136 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438147:x1731754467627264:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531972.539923:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca4508 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.539927:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531972.539927:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531972.539928:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca4508 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [995328->999423] (req 995328->999423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.539932:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca4508 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [995328->999423] (req 995328->999423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531972.540143:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869371 is committed
00010000:00010000:0.0:1651531972.540155:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca44f3 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [851968->856063] (req 851968->856063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.540159:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca44f3 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [851968->856063] (req 851968->856063) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531972.540178:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f99d9ea1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438149:x1731754467626304:12345-10.240.43.64@tcp:4:fio.0 Request processed in 62302us (62382us total) trans 21474869371 rc 0/0
00000100:00100000:0.0:1651531972.540181:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250327
00010000:00010000:0.0:1651531972.540187:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca44f3 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [851968->856063] (req 851968->856063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.540190:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000032ee36ee already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531972.540192:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca44f3 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [851968->856063] (req 851968->856063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.540194:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca44f3 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [851968->856063] (req 851968->856063) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.540249:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca44f3 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [851968->856063] (req 851968->856063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.540253:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca44f3 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [851968->856063] (req 851968->856063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531972.540294:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531972.540305:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467627392
00000100:00100000:0.0:1651531972.540318:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250331
00000100:00100000:0.0:1651531972.540320:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d76314b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438146:x1731754467627392:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531972.540327:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca450f lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.540331:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531972.540333:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531972.540334:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca450f lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [557056->561151] (req 557056->561151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.540338:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca450f lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [557056->561151] (req 557056->561151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.540349:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca450f lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [557056->561151] (req 557056->561151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.540352:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca450f lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [557056->561151] (req 557056->561151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.540365:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca450f lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [557056->561151] (req 557056->561151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.540369:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000075a78972 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531972.540370:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca450f lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [557056->561151] (req 557056->561151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531972.540370:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d76314b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438146:x1731754467627392:12345-10.240.43.64@tcp:3:fio.0 Request processed in 50us (77us total) trans 0 rc 4096/4096
00010000:00010000:1.0:1651531972.540373:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca450f lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [557056->561151] (req 557056->561151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531972.540373:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250331
00010000:00010000:1.0:1651531972.540378:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca450f lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [557056->561151] (req 557056->561151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.540381:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca450f lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [557056->561151] (req 557056->561151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531972.540675:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531972.540686:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467627648
00000100:00100000:0.0:1651531972.540700:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250332
00000100:00100000:0.0:1651531972.540702:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000099b6616a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438147:x1731754467627648:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531972.540709:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca4516 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.540713:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531972.540714:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531972.540715:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca4516 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [1028096->1032191] (req 1028096->1032191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.540718:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca4516 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [1028096->1032191] (req 1028096->1032191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531972.590906:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869373 is committed
00010000:00010000:0.0:1651531972.590921:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca4516 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [1028096->1032191] (req 1028096->1032191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.590925:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca4516 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [1028096->1032191] (req 1028096->1032191) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531972.590946:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000099b6616a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438147:x1731754467627648:12345-10.240.43.64@tcp:4:fio.0 Request processed in 50242us (50271us total) trans 21474869373 rc 0/0
00010000:00010000:1.0:1651531972.590947:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca4516 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [1028096->1032191] (req 1028096->1032191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531972.590949:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250332
00010000:00010000:1.0:1651531972.590951:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000775318ab already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531972.590952:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca4516 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [1028096->1032191] (req 1028096->1032191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.590959:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca4516 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [1028096->1032191] (req 1028096->1032191) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.590964:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca4516 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [1028096->1032191] (req 1028096->1032191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.590967:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca4516 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [1028096->1032191] (req 1028096->1032191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.590991:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca4508 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [995328->999423] (req 995328->999423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.590995:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca4508 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [995328->999423] (req 995328->999423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531972.591016:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000b1a9136 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438147:x1731754467627264:12345-10.240.43.64@tcp:4:fio.0 Request processed in 51100us (51126us total) trans 21474869372 rc 0/0
00000100:00100000:1.0:1651531972.591019:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250330
00010000:00010000:0.0:1651531972.591020:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca4508 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [995328->999423] (req 995328->999423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.591024:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000014685f38 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531972.591025:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca4508 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [995328->999423] (req 995328->999423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.591028:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca4508 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [995328->999423] (req 995328->999423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.591034:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca4508 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [995328->999423] (req 995328->999423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.591036:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca4508 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [995328->999423] (req 995328->999423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531972.591261:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531972.591280:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467627904
00000100:00100000:1.0:1651531972.591295:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250333
00000100:00100000:1.0:1651531972.591297:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000f4bed26 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438148:x1731754467627904:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531972.591304:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca451d lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.591309:0:216321:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca2e56 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [999424->1003519] (req 999424->1003519) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4454c0 expref: 6 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.591316:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531972.591317:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651531972.591318:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca451d lrc: 4/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [516096->1032191] (req 516096->1032191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.591325:0:216321:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca2e56 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [999424->1003519] (req 999424->1003519) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4454c0 expref: 6 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.591329:0:216321:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca2e56 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [999424->1003519] (req 999424->1003519) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4454c0 expref: 6 pid: 166112 timeout: 22781 lvb_type: 0
00000100:00100000:1.0:1651531972.591333:0:216321:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000033696ffa pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997357440:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531972.591346:0:216321:0:(client.c:2492:ptlrpc_set_wait()) set 00000000996f1fed going to sleep for 6 seconds
00000100:00100000:0.0:1651531972.591396:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531972.591407:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467628096
00000100:00100000:1.0:1651531972.591418:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44628
00000100:00100000:1.0:1651531972.591420:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bf4022bf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438149:x1731754467628096:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531972.591423:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531972.591427:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca4524 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446043 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.591433:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531972.591436:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca4524 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446043 expref: 8 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531972.591440:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca4524 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446043 expref: 8 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531972.591449:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d44eb74d, rc 0)
00000100:00100000:1.0:1651531972.591459:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bf4022bf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438149:x1731754467628096:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (63us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531972.591462:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44628
00000100:00100000:0.0:1651531972.591617:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531972.591624:0:166104:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467628160
00000100:00100000:1.0:1651531972.591625:0:216321:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000033696ffa pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997357440:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651531972.591630:0:216321:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca451d lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [516096->1032191] (req 516096->1032191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.591631:0:166104:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca2e56 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [999424->1003519] (req 999424->1003519) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4454c0 expref: 7 pid: 166112 timeout: 22781 lvb_type: 0
00000100:00100000:0.0:1651531972.591642:0:166104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 234
00000100:00100000:0.0:1651531972.591644:0:166104:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004237e3f1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438146:x1731754467628160:12345-10.240.43.64@tcp:103:ldlm_bl_05.0
00010000:00010000:0.0:1651531972.591647:0:166104:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531972.591651:0:166104:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca2e56 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [999424->1003519] (req 999424->1003519) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4454c0 expref: 7 pid: 166112 timeout: 22781 lvb_type: 0
00010000:00010000:0.0:1651531972.591655:0:166104:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca2e56 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [999424->1003519] (req 999424->1003519) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4454c0 expref: 7 pid: 166112 timeout: 22781 lvb_type: 0
00010000:00010000:0.0:1651531972.591661:0:166104:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca2e56 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [999424->1003519] (req 999424->1003519) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4454c0 expref: 7 pid: 166112 timeout: 22781 lvb_type: 0
00010000:00010000:0.0:1651531972.591665:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531972.591666:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531972.591667:0:166104:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca451d lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [516096->1032191] (req 516096->1032191) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.591670:0:166104:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca451d lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [516096->1032191] (req 516096->1032191) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.591679:0:166104:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1651531972.591680:0:216321:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca451d lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [516096->1032191] (req 516096->1032191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.591684:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca451d lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [516096->1032191] (req 516096->1032191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531972.591690:0:166104:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004237e3f1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438146:x1731754467628160:12345-10.240.43.64@tcp:103:ldlm_bl_05.0 Request processed in 45us (73us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531972.591695:0:166104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 234
00000001:00080000:0.0:1651531972.632655:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869374 is committed
00010000:00010000:1.0:1651531972.632684:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca451d lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [516096->1032191] (req 516096->1032191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.632688:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca451d lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [516096->1032191] (req 516096->1032191) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531972.632706:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000f4bed26 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438148:x1731754467627904:12345-10.240.43.64@tcp:4:fio.0 Request processed in 41408us (41445us total) trans 21474869374 rc 0/0
00000100:00100000:1.0:1651531972.632709:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250333
00010000:00010000:1.0:1651531972.632716:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca451d lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [516096->1032191] (req 516096->1032191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.632723:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001e36c601 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531972.632724:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca451d lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [516096->1032191] (req 516096->1032191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.632727:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca451d lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [516096->1032191] (req 516096->1032191) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.632731:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca451d lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [516096->1032191] (req 516096->1032191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.632734:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca451d lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [516096->1032191] (req 516096->1032191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531972.633065:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531972.633066:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531972.633079:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467628608
00000100:00100000:1.0:1651531972.633094:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44629
00000100:00100000:1.0:1651531972.633096:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000033696ffa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438149:x1731754467628608:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531972.633100:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531972.633104:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca452b lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446051 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651531972.633110:0:166113:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34545:0x0] initial LVB size: 6291456, mtime: 0x627060c4, atime: 0x627060b4, ctime: 0x627060c4, blocks: 0x3000
00010000:00010000:1.0:1651531972.633114:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531972.633115:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531972.633116:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca452b lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446051 expref: 6 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531972.633125:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca452b lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446051 expref: 6 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531972.633129:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d44eb74d, rc 0)
00000100:00100000:1.0:1651531972.633143:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000033696ffa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467628608:12345-10.240.43.64@tcp:101:fio.0 Request processed in 46us (79us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531972.633146:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44629
00000100:00100000:1.0:1651531972.633155:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467628672
00000100:00100000:1.0:1651531972.633165:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250334
00000100:00100000:1.0:1651531972.633167:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f7096c29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438146:x1731754467628672:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531972.633181:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4532 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.633186:0:216321:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca452b lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446051 expref: 6 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531972.633189:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531972.633190:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531972.633191:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4532 lrc: 4/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [262144->266239] (req 262144->266239) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.633198:0:216321:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca452b lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446051 expref: 6 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531972.633201:0:216321:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca452b lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446051 expref: 6 pid: 166113 timeout: 22781 lvb_type: 1
00000100:00100000:1.0:1651531972.633210:0:216321:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002ae2aeac pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997357504:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531972.633246:0:216321:0:(client.c:2492:ptlrpc_set_wait()) set 00000000996f1fed going to sleep for 6 seconds
00000100:00100000:0.0:1651531972.633492:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531972.633500:0:216321:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002ae2aeac pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997357504:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531972.633501:0:166104:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467628736
00010000:00010000:1.0:1651531972.633504:0:216321:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4532 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [262144->266239] (req 262144->266239) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.633507:0:166104:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca452b lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446051 expref: 7 pid: 166113 timeout: 22781 lvb_type: 1
00000100:00100000:0.0:1651531972.633518:0:166104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 235
00000100:00100000:0.0:1651531972.633520:0:166104:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007b76f7f6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438147:x1731754467628736:12345-10.240.43.64@tcp:103:ldlm_bl_01.0
00010000:00010000:0.0:1651531972.633523:0:166104:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531972.633527:0:166104:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca452b lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446051 expref: 7 pid: 166113 timeout: 22781 lvb_type: 1
00010000:00010000:0.0:1651531972.633531:0:166104:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca452b lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446051 expref: 7 pid: 166113 timeout: 22781 lvb_type: 1
00010000:00010000:0.0:1651531972.633537:0:166104:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca452b lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446051 expref: 7 pid: 166113 timeout: 22781 lvb_type: 1
00010000:00010000:0.0:1651531972.633541:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531972.633542:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531972.633543:0:166104:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4532 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [262144->266239] (req 262144->266239) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.633546:0:166104:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4532 lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [262144->266239] (req 262144->266239) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.633561:0:166104:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1651531972.633569:0:216321:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4532 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [262144->266239] (req 262144->266239) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531972.633572:0:166104:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007b76f7f6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438147:x1731754467628736:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 52us (81us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531972.633576:0:166104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 235
00010000:00010000:1.0:1651531972.633577:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4532 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [262144->266239] (req 262144->266239) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531972.633704:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531972.633715:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531972.633726:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467628992
00000100:00100000:0.0:1651531972.633726:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467628864
00000100:00100000:0.0:1651531972.633743:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44630
00000100:00100000:0.0:1651531972.633745:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002ae2aeac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438146:x1731754467628864:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531972.633749:0:206699:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651531972.633754:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44631
00000100:00100000:1.0:1651531972.633756:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000315bf4eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754467628992:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531972.633760:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531972.633764:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca4539 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44606d expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.633766:0:206699:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca4540 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44605f expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.633772:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca4539 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44606d expref: 11 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531972.633774:0:206699:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca4540 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44605f expref: 11 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531972.633776:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca4539 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44606d expref: 11 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531972.633779:0:206699:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca4540 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44605f expref: 11 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531972.633781:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a8889a80, rc 0)
00010000:00010000:0.0:1651531972.633782:0:206699:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f968d777, rc 0)
00000100:00100000:1.0:1651531972.633794:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000315bf4eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754467628992:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (78us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531972.633796:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44631
00000100:00100000:0.0:1651531972.633799:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002ae2aeac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467628864:12345-10.240.43.64@tcp:101:fio.0 Request processed in 53us (96us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531972.633802:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44630
00000100:00100000:1.0:1651531972.634397:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531972.634415:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467629312
00000100:00100000:0.0:1651531972.634431:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250335
00000100:00100000:0.0:1651531972.634433:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a9fc5082 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467629312:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531972.634440:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca4547 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.634447:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531972.634448:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531972.634449:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca4547 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [757760->761855] (req 757760->761855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.634453:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca4547 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [757760->761855] (req 757760->761855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.634466:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca4547 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [757760->761855] (req 757760->761855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.634469:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca4547 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [757760->761855] (req 757760->761855) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.634487:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca4547 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [757760->761855] (req 757760->761855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531972.634490:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a9fc5082 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467629312:12345-10.240.43.64@tcp:3:fio.0 Request processed in 56us (93us total) trans 0 rc 4096/4096
00010000:00010000:1.0:1651531972.634491:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000014685f38 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531972.634492:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca4547 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [757760->761855] (req 757760->761855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531972.634493:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250335
00010000:00010000:1.0:1651531972.634496:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca4547 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [757760->761855] (req 757760->761855) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.634501:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca4547 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [757760->761855] (req 757760->761855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.634504:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca4547 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [757760->761855] (req 757760->761855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531972.635054:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531972.635072:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467629760
00000100:00100000:0.0:1651531972.635087:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250336
00000100:00100000:0.0:1651531972.635089:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c62d1815 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467629760:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531972.635096:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca454e lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.635100:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531972.635101:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531972.635102:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca454e lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [548864->552959] (req 548864->552959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.635109:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca454e lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [548864->552959] (req 548864->552959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.635120:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca454e lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [548864->552959] (req 548864->552959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.635123:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca454e lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [548864->552959] (req 548864->552959) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531972.635137:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c62d1815 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467629760:12345-10.240.43.64@tcp:3:fio.0 Request processed in 48us (83us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531972.635140:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250336
00010000:00010000:0.0:1651531972.635146:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca454e lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [548864->552959] (req 548864->552959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.635150:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000032ee36ee already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531972.635151:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca454e lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [548864->552959] (req 548864->552959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.635154:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca454e lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [548864->552959] (req 548864->552959) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.635158:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca454e lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [548864->552959] (req 548864->552959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.635161:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca454e lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [548864->552959] (req 548864->552959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531972.635561:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531972.635568:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467630208
00000100:00100000:1.0:1651531972.635581:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44632
00000100:00100000:1.0:1651531972.635583:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a23bcd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467630208:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531972.635589:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531972.635592:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca4555 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44607b expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.635600:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca4555 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44607b expref: 9 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531972.635604:0:166111:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca4555 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44607b expref: 9 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531972.635607:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e9b84540, rc 0)
00000100:00100000:1.0:1651531972.635621:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a23bcd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467630208:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (61us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531972.635623:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44632
00000100:00100000:1.0:1651531972.636168:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531972.636176:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467630336
00000100:00100000:1.0:1651531972.636188:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44633
00000100:00100000:1.0:1651531972.636190:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000033723645 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467630336:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531972.636193:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531972.636197:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca455c lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446089 expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.636204:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca455c lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446089 expref: 9 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531972.636208:0:166111:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca455c lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446089 expref: 9 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531972.636220:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006da7a892, rc 0)
00000100:00100000:1.0:1651531972.636244:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000033723645 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467630336:12345-10.240.43.64@tcp:101:fio.0 Request processed in 53us (76us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531972.636247:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44633
00000100:00100000:1.0:1651531972.636557:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531972.636575:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467630592
00000100:00100000:0.0:1651531972.636590:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250337
00000100:00100000:0.0:1651531972.636592:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005ec1cbc3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467630592:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531972.636599:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca4563 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.636603:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531972.636604:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531972.636605:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca4563 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [430080->434175] (req 430080->434175) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.636608:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca4563 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [430080->434175] (req 430080->434175) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.636619:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca4563 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [430080->434175] (req 430080->434175) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.636622:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca4563 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [430080->434175] (req 430080->434175) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.636639:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca4563 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [430080->434175] (req 430080->434175) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531972.636642:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005ec1cbc3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467630592:12345-10.240.43.64@tcp:3:fio.0 Request processed in 49us (85us total) trans 0 rc 4096/4096
00010000:00010000:1.0:1651531972.636643:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000820577fb already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531972.636644:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca4563 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [430080->434175] (req 430080->434175) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531972.636644:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250337
00010000:00010000:1.0:1651531972.636647:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca4563 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [430080->434175] (req 430080->434175) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.636653:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca4563 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [430080->434175] (req 430080->434175) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.636656:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca4563 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [430080->434175] (req 430080->434175) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531972.636940:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531972.636947:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467630848
00000100:00100000:1.0:1651531972.636957:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44634
00000100:00100000:1.0:1651531972.636959:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b9b10d48 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467630848:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531972.636962:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531972.636967:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca456a lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446097 expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.636974:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca456a lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446097 expref: 9 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531972.636978:0:166111:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca456a lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446097 expref: 9 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531972.636981:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001e36c601, rc 0)
00000100:00100000:1.0:1651531972.636992:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b9b10d48 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467630848:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (53us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531972.636995:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44634
00000100:00100000:1.0:1651531972.637287:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531972.637305:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467630976
00000100:00100000:0.0:1651531972.637318:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250338
00000100:00100000:0.0:1651531972.637320:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000be4b467 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467630976:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531972.637329:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca4571 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.637333:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531972.637334:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531972.637334:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca4571 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [634880->638975] (req 634880->638975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.637338:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca4571 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [634880->638975] (req 634880->638975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.637349:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca4571 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [634880->638975] (req 634880->638975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.637352:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca4571 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [634880->638975] (req 634880->638975) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.637370:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca4571 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [634880->638975] (req 634880->638975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531972.637372:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000be4b467 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467630976:12345-10.240.43.64@tcp:3:fio.0 Request processed in 51us (85us total) trans 0 rc 4096/4096
00010000:00010000:1.0:1651531972.637374:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fab23815 already unused, calling callback (0000000049fddea7)
00000100:00100000:0.0:1651531972.637374:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250338
00010000:00010000:1.0:1651531972.637375:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca4571 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [634880->638975] (req 634880->638975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.637379:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca4571 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [634880->638975] (req 634880->638975) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.637384:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca4571 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [634880->638975] (req 634880->638975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.637386:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca4571 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [634880->638975] (req 634880->638975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531972.637662:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531972.637669:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467631104
00000100:00100000:1.0:1651531972.637679:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44635
00000100:00100000:1.0:1651531972.637681:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009c946e88 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467631104:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531972.637684:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531972.637687:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4578 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4460a5 expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.637694:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4578 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4460a5 expref: 9 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531972.637698:0:166111:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4578 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4460a5 expref: 9 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531972.637701:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000968553c1, rc 0)
00000100:00100000:1.0:1651531972.637712:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009c946e88 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467631104:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (51us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531972.637715:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44635
00000100:00100000:1.0:1651531972.638381:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531972.638388:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467631360
00000100:00100000:1.0:1651531972.638400:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44636
00000100:00100000:1.0:1651531972.638402:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f18d8e18 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467631360:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531972.638405:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531972.638409:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca457f lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4460b3 expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.638419:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca457f lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4460b3 expref: 9 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531972.638423:0:166111:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca457f lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4460b3 expref: 9 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531972.638427:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a8889a80, rc 0)
00000100:00100000:1.0:1651531972.638438:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f18d8e18 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467631360:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (57us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531972.638440:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44636
00000100:00100000:1.0:1651531972.638715:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531972.638737:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467631488
00000100:00100000:0.0:1651531972.638752:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250339
00000100:00100000:0.0:1651531972.638753:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d0a08679 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467631488:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531972.638760:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4586 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.638764:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531972.638765:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531972.638767:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4586 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [552960->557055] (req 552960->557055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.638771:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4586 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [552960->557055] (req 552960->557055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.638781:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4586 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [552960->557055] (req 552960->557055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.638785:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4586 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [552960->557055] (req 552960->557055) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531972.638799:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d0a08679 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467631488:12345-10.240.43.64@tcp:3:fio.0 Request processed in 45us (84us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531972.638801:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250339
00010000:00010000:0.0:1651531972.638807:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4586 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [552960->557055] (req 552960->557055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.638811:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000032ee36ee already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531972.638812:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4586 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [552960->557055] (req 552960->557055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.638815:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4586 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [552960->557055] (req 552960->557055) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.638819:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4586 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [552960->557055] (req 552960->557055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.638822:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4586 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [552960->557055] (req 552960->557055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531972.639100:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531972.639107:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467631616
00000100:00100000:1.0:1651531972.639117:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44637
00000100:00100000:1.0:1651531972.639118:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000205abf78 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467631616:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531972.639121:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531972.639125:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca458d lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4460c1 expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.639131:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca458d lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4460c1 expref: 9 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531972.639135:0:166111:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca458d lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4460c1 expref: 9 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531972.639142:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c2b76533, rc 0)
00000100:00100000:1.0:1651531972.639153:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000205abf78 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467631616:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (54us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531972.639156:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44637
00000100:00100000:1.0:1651531972.639853:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531972.639860:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467631872
00000100:00100000:1.0:1651531972.639873:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44638
00000100:00100000:1.0:1651531972.639874:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002dee0a2a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467631872:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531972.639878:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531972.639881:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4594 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4460cf expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.639888:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4594 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4460cf expref: 9 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531972.639892:0:166111:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4594 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4460cf expref: 9 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531972.639895:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008558d1b3, rc 0)
00000100:00100000:1.0:1651531972.639908:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002dee0a2a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467631872:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (55us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531972.639910:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44638
00000100:00100000:1.0:1651531972.640193:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531972.640210:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467632000
00000100:00100000:0.0:1651531972.640241:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250340
00000100:00100000:0.0:1651531972.640243:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004f05a5e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467632000:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531972.640250:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca459b lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.640254:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531972.640254:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531972.640255:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca459b lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [475136->479231] (req 475136->479231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.640259:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca459b lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [475136->479231] (req 475136->479231) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.640270:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca459b lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [475136->479231] (req 475136->479231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.640273:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca459b lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [475136->479231] (req 475136->479231) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.640290:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca459b lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [475136->479231] (req 475136->479231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531972.640292:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004f05a5e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467632000:12345-10.240.43.64@tcp:3:fio.0 Request processed in 48us (100us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531972.640295:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250340
00010000:00010000:1.0:1651531972.640298:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f968d777 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531972.640299:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca459b lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [475136->479231] (req 475136->479231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.640302:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca459b lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [475136->479231] (req 475136->479231) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.640307:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca459b lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [475136->479231] (req 475136->479231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.640310:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca459b lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [475136->479231] (req 475136->479231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531972.682844:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869375 is committed
00010000:00010000:1.0:1651531972.682874:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4532 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [262144->266239] (req 262144->266239) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.682878:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4532 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [262144->266239] (req 262144->266239) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531972.682893:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f7096c29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438146:x1731754467628672:12345-10.240.43.64@tcp:4:fio.0 Request processed in 49725us (49828us total) trans 21474869375 rc 0/0
00000100:00100000:1.0:1651531972.682896:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250334
00010000:00010000:1.0:1651531972.682903:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4532 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [262144->266239] (req 262144->266239) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.682906:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b4c8742a already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531972.682907:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4532 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [262144->266239] (req 262144->266239) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.682911:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4532 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [262144->266239] (req 262144->266239) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.682916:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4532 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [262144->266239] (req 262144->266239) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.682918:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4532 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [262144->266239] (req 262144->266239) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531972.683198:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531972.683236:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467632256
00000100:00100000:1.0:1651531972.683251:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250341
00000100:00100000:1.0:1651531972.683253:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b6b1b79d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438147:x1731754467632256:12345-10.240.43.64@tcp:4:fio.0
00002000:00010000:1.0:1651531972.683262:0:216321:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34545:0x0] initial LVB size: 6291456, mtime: 0x627060c4, atime: 0x627060b4, ctime: 0x627060c4, blocks: 0x3000
00010000:00010000:1.0:1651531972.683264:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca45a2 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.683268:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531972.683269:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531972.683270:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca45a2 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [1032192->1036287] (req 1032192->1036287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.683274:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca45a2 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [1032192->1036287] (req 1032192->1036287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531972.703181:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531972.703205:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467632384
00000100:00100000:0.0:1651531972.703239:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250342
00000100:00100000:0.0:1651531972.703242:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000042dc8e7d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467632384:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531972.703250:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca45a9 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.703254:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531972.703255:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531972.703256:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca45a9 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [155648->159743] (req 155648->159743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.703260:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca45a9 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [155648->159743] (req 155648->159743) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531972.728997:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869376 is committed
00010000:00010000:1.0:1651531972.729027:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca45a2 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [1032192->1036287] (req 1032192->1036287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.729034:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca45a2 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [1032192->1036287] (req 1032192->1036287) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.729049:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca45a2 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [1032192->1036287] (req 1032192->1036287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.729054:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008558d1b3 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531972.729055:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca45a2 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [1032192->1036287] (req 1032192->1036287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531972.729060:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b6b1b79d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467632256:12345-10.240.43.64@tcp:4:fio.0 Request processed in 45805us (45862us total) trans 21474869376 rc 0/0
00000100:00100000:1.0:1651531972.729063:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250341
00010000:00010000:0.0:1651531972.729064:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca45a2 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [1032192->1036287] (req 1032192->1036287) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.729070:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca45a2 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [1032192->1036287] (req 1032192->1036287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.729073:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca45a2 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [1032192->1036287] (req 1032192->1036287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531972.729388:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531972.729396:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467632512
00000100:00100000:1.0:1651531972.729406:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250343
00000100:00100000:1.0:1651531972.729408:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000074ceacc7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467632512:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531972.729414:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca45b0 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.729418:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531972.729419:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531972.729420:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca45b0 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [102400->106495] (req 102400->106495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.729424:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca45b0 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [102400->106495] (req 102400->106495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531972.729624:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531972.729633:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531972.729644:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467632768
00000100:00100000:0.0:1651531972.729651:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467632704
00000100:00100000:1.0:1651531972.729653:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44639
00000100:00100000:1.0:1651531972.729654:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c550f111 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754467632768:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651531972.729664:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44640
00010000:00010000:1.0:1651531972.729666:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651531972.729666:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d3ac27c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438149:x1731754467632704:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531972.729670:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca45b7 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4460eb expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.729670:0:206699:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531972.729673:0:206699:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca45be lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4460e4 expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.729678:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca45b7 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4460eb expref: 14 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531972.729682:0:166111:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca45b7 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4460eb expref: 14 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531972.729682:0:206699:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca45be lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4460e4 expref: 14 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531972.729686:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c2b76533, rc 0)
00010000:00010000:0.0:1651531972.729687:0:206699:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca45be lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4460e4 expref: 13 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531972.729690:0:206699:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f765708a, rc 0)
00000100:00100000:1.0:1651531972.729695:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c550f111 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754467632768:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (72us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531972.729698:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44639
00000100:00100000:0.0:1651531972.729699:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d3ac27c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438149:x1731754467632704:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (66us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531972.729702:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44640
00000100:00100000:1.0:1651531972.730073:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531972.730081:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467633024
00000100:00100000:1.0:1651531972.730090:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250344
00000100:00100000:1.0:1651531972.730092:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000028779db6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754467633024:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531972.730099:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca45c5 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.730103:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531972.730104:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531972.730105:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca45c5 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [12288->16383] (req 12288->16383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.730109:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca45c5 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [12288->16383] (req 12288->16383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.730123:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca45c5 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [12288->16383] (req 12288->16383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.730126:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca45c5 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [12288->16383] (req 12288->16383) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531972.730151:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000028779db6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754467633024:12345-10.240.43.64@tcp:3:fio.0 Request processed in 58us (78us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531972.730155:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250344
00010000:00010000:1.0:1651531972.730162:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca45c5 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [12288->16383] (req 12288->16383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.730166:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a8889a80 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531972.730167:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca45c5 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [12288->16383] (req 12288->16383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.730170:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca45c5 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [12288->16383] (req 12288->16383) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.730174:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca45c5 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [12288->16383] (req 12288->16383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.730177:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca45c5 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [12288->16383] (req 12288->16383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531972.730496:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531972.730525:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531972.730535:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467633152
00000100:00100000:1.0:1651531972.730544:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467633216
00000100:00100000:1.0:1651531972.730555:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250345
00000100:00100000:1.0:1651531972.730557:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000add44b2e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754467633152:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531972.730564:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca45cc lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531972.730566:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250346
00010000:00010000:1.0:1651531972.730568:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:0.0:1651531972.730568:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000670433b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754467633216:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531972.730569:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531972.730570:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca45cc lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [565248->569343] (req 565248->569343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.730574:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca45cc lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [565248->569343] (req 565248->569343) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.730577:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca45d3 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.730581:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531972.730582:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531972.730583:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca45d3 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [266240->270335] (req 266240->270335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.730588:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca45d3 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [266240->270335] (req 266240->270335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.730602:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca45d3 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [266240->270335] (req 266240->270335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.730605:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca45d3 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [266240->270335] (req 266240->270335) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531972.730625:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000670433b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754467633216:12345-10.240.43.64@tcp:3:fio.0 Request processed in 57us (100us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531972.730628:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250346
00010000:00010000:1.0:1651531972.730636:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca45d3 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [266240->270335] (req 266240->270335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.730640:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000080362f27 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531972.730641:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca45d3 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [266240->270335] (req 266240->270335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.730644:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca45d3 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [266240->270335] (req 266240->270335) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.730649:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca45d3 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [266240->270335] (req 266240->270335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.730652:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca45d3 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [266240->270335] (req 266240->270335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531972.730923:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531972.730942:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467633408
00000100:00100000:1.0:1651531972.730955:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250347
00000100:00100000:1.0:1651531972.730957:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006a8dcc9d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754467633408:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531972.730964:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca45da lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.730968:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531972.730968:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531972.730969:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca45da lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [126976->131071] (req 126976->131071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.730973:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca45da lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [126976->131071] (req 126976->131071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.730984:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca45da lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [126976->131071] (req 126976->131071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.730987:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca45da lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [126976->131071] (req 126976->131071) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.730998:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca45da lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [126976->131071] (req 126976->131071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.731002:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001e36c601 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531972.731003:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca45da lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [126976->131071] (req 126976->131071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.731006:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca45da lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [126976->131071] (req 126976->131071) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.731012:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca45da lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [126976->131071] (req 126976->131071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531972.731013:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006a8dcc9d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754467633408:12345-10.240.43.64@tcp:3:fio.0 Request processed in 55us (91us total) trans 0 rc 4096/4096
00010000:00010000:0.0:1651531972.731014:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca45da lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [126976->131071] (req 126976->131071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531972.731016:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250347
00000001:00080000:0.0:1651531972.779121:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869377 is committed
00010000:00010000:1.0:1651531972.779157:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca45a9 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [155648->159743] (req 155648->159743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.779161:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca45a9 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [155648->159743] (req 155648->159743) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531972.779183:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000042dc8e7d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754467632384:12345-10.240.43.64@tcp:4:fio.0 Request processed in 75940us (76002us total) trans 21474869377 rc 0/0
00000100:00100000:1.0:1651531972.779187:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250342
00010000:00010000:1.0:1651531972.779194:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca45a9 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [155648->159743] (req 155648->159743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.779197:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000032ee36ee already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531972.779198:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca45a9 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [155648->159743] (req 155648->159743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.779201:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca45a9 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [155648->159743] (req 155648->159743) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.779242:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca45a9 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [155648->159743] (req 155648->159743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.779245:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca45a9 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [155648->159743] (req 155648->159743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531972.779533:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531972.779558:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467633792
00000100:00100000:0.0:1651531972.779571:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44641
00000100:00100000:0.0:1651531972.779573:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002d3e5ae4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754467633792:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531972.779577:0:206699:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531972.779581:0:206699:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca45e1 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4460f9 expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.779589:0:206699:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca45e1 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4460f9 expref: 12 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531972.779594:0:206699:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca45e1 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4460f9 expref: 12 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531972.779597:0:206699:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f765708a, rc 0)
00000100:00100000:0.0:1651531972.779608:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002d3e5ae4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754467633792:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (76us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531972.779611:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44641
00000100:00100000:1.0:1651531972.779944:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531972.779951:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467633920
00000100:00100000:1.0:1651531972.779961:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250348
00000100:00100000:1.0:1651531972.779963:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b67ad021 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754467633920:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531972.779970:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca45e8 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.779977:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531972.779978:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531972.779979:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca45e8 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [815104->819199] (req 815104->819199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.779983:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca45e8 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [815104->819199] (req 815104->819199) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.779994:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca45e8 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [815104->819199] (req 815104->819199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.779997:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca45e8 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [815104->819199] (req 815104->819199) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531972.780018:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b67ad021 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754467633920:12345-10.240.43.64@tcp:3:fio.0 Request processed in 54us (74us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531972.780021:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250348
00010000:00010000:1.0:1651531972.780028:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca45e8 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [815104->819199] (req 815104->819199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.780031:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a8889a80 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531972.780032:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca45e8 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [815104->819199] (req 815104->819199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.780035:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca45e8 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [815104->819199] (req 815104->819199) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.780040:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca45e8 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [815104->819199] (req 815104->819199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.780043:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca45e8 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [815104->819199] (req 815104->819199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531972.780309:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531972.780320:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467634048
00000100:00100000:0.0:1651531972.780331:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44642
00000100:00100000:0.0:1651531972.780333:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dce6a2c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754467634048:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531972.780336:0:206699:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531972.780340:0:206699:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca45ef lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446107 expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.780351:0:206699:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca45ef lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446107 expref: 12 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531972.780356:0:206699:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca45ef lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446107 expref: 12 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531972.780359:0:206699:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002c5e01dd, rc 0)
00000100:00100000:0.0:1651531972.780370:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dce6a2c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754467634048:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (61us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531972.780372:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44642
00000100:00100000:1.0:1651531972.780688:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531972.780706:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467634176
00000100:00100000:0.0:1651531972.780721:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250349
00000100:00100000:0.0:1651531972.780723:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009078ca7d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754467634176:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531972.780730:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca45f6 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.780734:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531972.780735:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531972.780736:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca45f6 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [405504->409599] (req 405504->409599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.780740:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca45f6 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [405504->409599] (req 405504->409599) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.780753:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca45f6 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [405504->409599] (req 405504->409599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.780760:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca45f6 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [405504->409599] (req 405504->409599) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531972.780775:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009078ca7d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754467634176:12345-10.240.43.64@tcp:3:fio.0 Request processed in 51us (87us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531972.780778:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250349
00010000:00010000:0.0:1651531972.780784:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca45f6 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [405504->409599] (req 405504->409599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.780787:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e2ec18e1 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531972.780788:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca45f6 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [405504->409599] (req 405504->409599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.780791:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca45f6 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [405504->409599] (req 405504->409599) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.780795:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca45f6 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [405504->409599] (req 405504->409599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.780798:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca45f6 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [405504->409599] (req 405504->409599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531972.781088:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531972.781100:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467634304
00000100:00100000:0.0:1651531972.781114:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250350
00000100:00100000:0.0:1651531972.781116:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fb90eb28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754467634304:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531972.781123:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca45fd lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.781128:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531972.781129:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531972.781130:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca45fd lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [352256->356351] (req 352256->356351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.781134:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca45fd lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [352256->356351] (req 352256->356351) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531972.792323:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531972.792332:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467634432
00000100:00100000:0.0:1651531972.792345:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44643
00000100:00100000:0.0:1651531972.792346:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009e786cd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754467634432:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531972.792350:0:206699:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531972.792362:0:206699:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4604 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446115 expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.792370:0:206699:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4604 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446115 expref: 15 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531972.792374:0:206699:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4604 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446115 expref: 15 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531972.792378:0:206699:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e2ec18e1, rc 0)
00000100:00100000:0.0:1651531972.792392:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009e786cd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754467634432:12345-10.240.43.64@tcp:101:fio.0 Request processed in 45us (70us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531972.792395:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44643
00000100:00100000:0.0:1651531972.793513:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531972.793535:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467634816
00000100:00100000:1.0:1651531972.793550:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250351
00000100:00100000:1.0:1651531972.793552:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008bb4a649 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754467634816:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531972.793559:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca460b lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.793563:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531972.793564:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531972.793565:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca460b lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [577536->581631] (req 577536->581631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.793569:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca460b lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [577536->581631] (req 577536->581631) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531972.804496:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869379 is committed
00010000:00010000:1.0:1651531972.804525:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca45cc lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [565248->569343] (req 565248->569343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.804530:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca45cc lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [565248->569343] (req 565248->569343) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531972.804545:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000add44b2e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754467633152:12345-10.240.43.64@tcp:4:fio.0 Request processed in 73987us (74050us total) trans 21474869379 rc 0/0
00000100:00100000:1.0:1651531972.804549:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250345
00010000:00010000:1.0:1651531972.804556:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca45cc lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [565248->569343] (req 565248->569343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.804559:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000968553c1 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531972.804561:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca45cc lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [565248->569343] (req 565248->569343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.804563:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca45cc lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [565248->569343] (req 565248->569343) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.804568:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca45cc lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [565248->569343] (req 565248->569343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.804571:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca45cc lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [565248->569343] (req 565248->569343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.804617:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca45b0 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [102400->106495] (req 102400->106495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.804621:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca45b0 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [102400->106495] (req 102400->106495) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531972.804639:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000074ceacc7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438146:x1731754467632512:12345-10.240.43.64@tcp:4:fio.0 Request processed in 75231us (75252us total) trans 21474869378 rc 0/0
00000100:00100000:1.0:1651531972.804642:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250343
00010000:00010000:1.0:1651531972.804649:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca45b0 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [102400->106495] (req 102400->106495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.804656:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b4c8742a already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531972.804657:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca45b0 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [102400->106495] (req 102400->106495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.804660:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca45b0 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [102400->106495] (req 102400->106495) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.804665:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca45b0 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [102400->106495] (req 102400->106495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.804667:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca45b0 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [102400->106495] (req 102400->106495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531972.805062:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531972.805070:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467634944
00000100:00100000:1.0:1651531972.805079:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250352
00000100:00100000:1.0:1651531972.805081:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dccc50c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438146:x1731754467634944:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531972.805088:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4612 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.805092:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531972.805092:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531972.805093:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4612 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [294912->299007] (req 294912->299007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.805097:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4612 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [294912->299007] (req 294912->299007) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531972.855511:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531972.855520:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467635392
00000100:00100000:0.0:1651531972.855534:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44644
00000100:00100000:0.0:1651531972.855536:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cb694635 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754467635392:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531972.855539:0:206699:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531972.855543:0:206699:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4619 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446123 expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.855552:0:206699:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4619 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446123 expref: 15 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531972.855556:0:206699:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4619 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446123 expref: 15 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531972.855559:0:206699:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e2ec18e1, rc 0)
00000100:00100000:0.0:1651531972.855574:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cb694635 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754467635392:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (64us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531972.855576:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44644
00000001:00080000:0.0:1651531972.855650:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869381 is committed
00010000:00010000:1.0:1651531972.855680:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca460b lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [577536->581631] (req 577536->581631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.855685:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca460b lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [577536->581631] (req 577536->581631) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531972.855704:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008bb4a649 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754467634816:12345-10.240.43.64@tcp:4:fio.0 Request processed in 62151us (62191us total) trans 21474869381 rc 0/0
00000100:00100000:1.0:1651531972.855707:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250351
00010000:00010000:1.0:1651531972.855720:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca460b lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [577536->581631] (req 577536->581631) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.855724:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a8889a80 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531972.855725:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca460b lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [577536->581631] (req 577536->581631) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.855727:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca460b lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [577536->581631] (req 577536->581631) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.855732:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca460b lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [577536->581631] (req 577536->581631) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.855735:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca460b lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [577536->581631] (req 577536->581631) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.855754:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca45fd lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [352256->356351] (req 352256->356351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.855761:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca45fd lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [352256->356351] (req 352256->356351) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531972.855787:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fb90eb28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467634304:12345-10.240.43.64@tcp:4:fio.0 Request processed in 74670us (74699us total) trans 21474869380 rc 0/0
00000100:00100000:1.0:1651531972.855790:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250350
00010000:00010000:1.0:1651531972.855796:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca45fd lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [352256->356351] (req 352256->356351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.855800:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fb2f6575 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531972.855801:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca45fd lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [352256->356351] (req 352256->356351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.855804:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca45fd lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [352256->356351] (req 352256->356351) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.855808:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca45fd lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [352256->356351] (req 352256->356351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.855811:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca45fd lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [352256->356351] (req 352256->356351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531972.856128:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531972.856148:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467635648
00000100:00100000:1.0:1651531972.856159:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250353
00000100:00100000:1.0:1651531972.856160:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c65d6bc4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467635648:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531972.856167:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4620 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.856173:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531972.856173:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531972.856174:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4620 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [81920->86015] (req 81920->86015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.856178:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4620 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [81920->86015] (req 81920->86015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.856189:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4620 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [81920->86015] (req 81920->86015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.856192:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4620 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [81920->86015] (req 81920->86015) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531972.856207:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c65d6bc4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467635648:12345-10.240.43.64@tcp:3:fio.0 Request processed in 46us (79us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531972.856209:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250353
00010000:00010000:0.0:1651531972.856250:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4620 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [81920->86015] (req 81920->86015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.856254:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b4c8742a already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531972.856255:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4620 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [81920->86015] (req 81920->86015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.856260:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4620 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [81920->86015] (req 81920->86015) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.856266:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4620 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [81920->86015] (req 81920->86015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.856268:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4620 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [81920->86015] (req 81920->86015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531972.856808:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531972.856826:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467636160
00000100:00100000:1.0:1651531972.856836:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250354
00000100:00100000:1.0:1651531972.856838:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ecb6b3b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467636160:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531972.856845:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4627 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.856849:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531972.856850:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531972.856851:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4627 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [692224->696319] (req 692224->696319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.856858:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4627 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [692224->696319] (req 692224->696319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.856869:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4627 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [692224->696319] (req 692224->696319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.856872:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4627 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [692224->696319] (req 692224->696319) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531972.856885:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ecb6b3b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467636160:12345-10.240.43.64@tcp:3:fio.0 Request processed in 46us (77us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531972.856887:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250354
00010000:00010000:1.0:1651531972.856893:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4627 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [692224->696319] (req 692224->696319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.856896:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000968553c1 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531972.856897:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4627 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [692224->696319] (req 692224->696319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.856900:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4627 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [692224->696319] (req 692224->696319) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.856905:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4627 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [692224->696319] (req 692224->696319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.856907:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4627 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [692224->696319] (req 692224->696319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531972.856996:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531972.857007:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467636352
00000100:00100000:1.0:1651531972.857017:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250355
00000100:00100000:1.0:1651531972.857018:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000065be21ea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467636352:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531972.857025:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca462e lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.857029:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531972.857029:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531972.857030:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca462e lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [565248->569343] (req 565248->569343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.857034:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca462e lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [565248->569343] (req 565248->569343) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531972.857208:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531972.857243:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467636480
00000100:00100000:0.0:1651531972.857254:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44645
00000100:00100000:0.0:1651531972.857256:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000071f9ee43 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754467636480:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531972.857259:0:206699:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531972.857263:0:206699:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca4635 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446131 expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.857270:0:206699:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca4635 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446131 expref: 12 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531972.857275:0:206699:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca4635 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446131 expref: 12 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531972.857278:0:206699:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002c5e01dd, rc 0)
00000100:00100000:0.0:1651531972.857289:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000071f9ee43 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754467636480:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (81us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531972.857294:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44645
00000100:00100000:1.0:1651531972.857631:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531972.857638:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467636608
00000100:00100000:1.0:1651531972.857647:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250356
00000100:00100000:1.0:1651531972.857649:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e4e3ecb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754467636608:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531972.857656:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca463c lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.857660:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531972.857661:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531972.857662:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca463c lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [1032192->1036287] (req 1032192->1036287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.857666:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca463c lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [1032192->1036287] (req 1032192->1036287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.857677:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca463c lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [1032192->1036287] (req 1032192->1036287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.857680:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca463c lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [1032192->1036287] (req 1032192->1036287) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531972.857702:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e4e3ecb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754467636608:12345-10.240.43.64@tcp:3:fio.0 Request processed in 51us (71us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531972.857704:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250356
00010000:00010000:1.0:1651531972.857712:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca463c lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [1032192->1036287] (req 1032192->1036287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.857715:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e9b84540 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531972.857716:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca463c lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [1032192->1036287] (req 1032192->1036287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.857719:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca463c lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [1032192->1036287] (req 1032192->1036287) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.857724:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca463c lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [1032192->1036287] (req 1032192->1036287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.857726:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca463c lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [1032192->1036287] (req 1032192->1036287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531972.858016:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531972.858027:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467636736
00000100:00100000:0.0:1651531972.858040:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44646
00000100:00100000:0.0:1651531972.858042:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002bdf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754467636736:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531972.858045:0:206699:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531972.858049:0:206699:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca4643 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44613f expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.858056:0:206699:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca4643 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44613f expref: 12 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531972.858060:0:206699:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca4643 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44613f expref: 12 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531972.858064:0:206699:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f765708a, rc 0)
00000100:00100000:0.0:1651531972.858074:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002bdf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754467636736:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (59us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531972.858077:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44646
00000100:00100000:1.0:1651531972.858361:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531972.858370:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467636864
00000100:00100000:1.0:1651531972.858379:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250357
00000100:00100000:1.0:1651531972.858380:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000da31c48f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754467636864:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531972.858388:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca464a lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.858391:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531972.858392:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531972.858393:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca464a lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [499712->503807] (req 499712->503807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.858397:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca464a lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [499712->503807] (req 499712->503807) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.858407:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca464a lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [499712->503807] (req 499712->503807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.858410:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca464a lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [499712->503807] (req 499712->503807) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.858422:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca464a lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [499712->503807] (req 499712->503807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.858426:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001e36c601 already unused, calling callback (0000000049fddea7)
00000100:00100000:1.0:1651531972.858429:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000da31c48f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754467636864:12345-10.240.43.64@tcp:3:fio.0 Request processed in 48us (69us total) trans 0 rc 4096/4096
00010000:00010000:0.0:1651531972.858432:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca464a lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [499712->503807] (req 499712->503807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531972.858433:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250357
00010000:00010000:0.0:1651531972.858436:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca464a lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [499712->503807] (req 499712->503807) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.858443:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca464a lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [499712->503807] (req 499712->503807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.858446:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca464a lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [499712->503807] (req 499712->503807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531972.858729:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531972.858740:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467636992
00000100:00100000:0.0:1651531972.858753:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44647
00000100:00100000:0.0:1651531972.858754:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003a5ac9b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754467636992:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531972.858758:0:206699:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531972.858761:0:206699:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4651 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44614d expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.858768:0:206699:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4651 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44614d expref: 12 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531972.858772:0:206699:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4651 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44614d expref: 12 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531972.858776:0:206699:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c1022d42, rc 0)
00000100:00100000:0.0:1651531972.858786:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003a5ac9b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754467636992:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (58us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531972.858789:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44647
00000100:00100000:1.0:1651531972.859480:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531972.859498:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467637248
00000100:00100000:0.0:1651531972.859511:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44648
00000100:00100000:0.0:1651531972.859512:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000880cd1d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754467637248:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531972.859517:0:206699:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531972.859521:0:206699:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4658 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44615b expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.859527:0:206699:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4658 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44615b expref: 12 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531972.859531:0:206699:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4658 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44615b expref: 12 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531972.859535:0:206699:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e2ec18e1, rc 0)
00000100:00100000:0.0:1651531972.859545:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000880cd1d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754467637248:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (66us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531972.859548:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44648
00000001:00080000:0.0:1651531972.905770:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869382 is committed
00010000:00010000:1.0:1651531972.905803:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4612 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [294912->299007] (req 294912->299007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.905808:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4612 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [294912->299007] (req 294912->299007) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531972.905835:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dccc50c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467634944:12345-10.240.43.64@tcp:4:fio.0 Request processed in 100753us (100774us total) trans 21474869382 rc 0/0
00000100:00100000:1.0:1651531972.905839:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250352
00010000:00010000:1.0:1651531972.905846:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4612 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [294912->299007] (req 294912->299007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.905849:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c2b76533 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531972.905850:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4612 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [294912->299007] (req 294912->299007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.905853:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4612 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [294912->299007] (req 294912->299007) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.905858:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4612 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [294912->299007] (req 294912->299007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.905861:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4612 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [294912->299007] (req 294912->299007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531972.917633:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531972.917642:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467637760
00000100:00100000:0.0:1651531972.917657:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44649
00000100:00100000:0.0:1651531972.917659:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bcdb3319 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467637760:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531972.917662:0:206699:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531972.917666:0:206699:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca465f lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446169 expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.917674:0:206699:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca465f lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446169 expref: 9 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531972.917678:0:206699:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca465f lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446169 expref: 9 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531972.917683:0:206699:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e2ec18e1, rc 0)
00000100:00100000:0.0:1651531972.917698:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bcdb3319 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467637760:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (65us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531972.917701:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44649
00000100:00100000:0.0:1651531972.918012:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531972.918035:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467637888
00000100:00100000:1.0:1651531972.918047:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250358
00000100:00100000:1.0:1651531972.918049:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002bf85ab5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467637888:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531972.918056:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4666 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.918060:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531972.918070:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531972.918071:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4666 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [897024->901119] (req 897024->901119) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.918075:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4666 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [897024->901119] (req 897024->901119) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.918087:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4666 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [897024->901119] (req 897024->901119) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.918090:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4666 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [897024->901119] (req 897024->901119) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.918110:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4666 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [897024->901119] (req 897024->901119) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531972.918111:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002bf85ab5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467637888:12345-10.240.43.64@tcp:3:fio.0 Request processed in 61us (99us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531972.918114:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250358
00010000:00010000:0.0:1651531972.918114:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c2b76533 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531972.918115:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4666 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [897024->901119] (req 897024->901119) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.918119:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4666 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [897024->901119] (req 897024->901119) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.918124:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4666 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [897024->901119] (req 897024->901119) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.918127:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4666 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [897024->901119] (req 897024->901119) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531972.918438:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531972.918447:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467638016
00000100:00100000:0.0:1651531972.918464:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44650
00000100:00100000:0.0:1651531972.918467:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f47fde78 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467638016:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531972.918471:0:206699:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531972.918476:0:206699:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca466d lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446177 expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.918486:0:206699:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca466d lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446177 expref: 9 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531972.918493:0:206699:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca466d lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446177 expref: 9 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531972.918497:0:206699:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c1022d42, rc 0)
00000100:00100000:0.0:1651531972.918513:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f47fde78 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467638016:12345-10.240.43.64@tcp:101:fio.0 Request processed in 46us (76us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531972.918516:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44650
00000100:00100000:0.0:1651531972.919254:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531972.919262:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467638272
00000100:00100000:0.0:1651531972.919276:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44651
00000100:00100000:0.0:1651531972.919278:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000083fa1d86 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467638272:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531972.919281:0:206699:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531972.919285:0:206699:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca4674 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446185 expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.919293:0:206699:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca4674 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446185 expref: 9 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531972.919297:0:206699:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca4674 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446185 expref: 9 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531972.919304:0:206699:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f765708a, rc 0)
00000100:00100000:0.0:1651531972.919318:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000083fa1d86 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467638272:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (65us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531972.919321:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44651
00000100:00100000:0.0:1651531972.919991:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531972.920015:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467638528
00000100:00100000:1.0:1651531972.920027:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250359
00000100:00100000:1.0:1651531972.920028:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000481279c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467638528:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531972.920035:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca467b lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.920039:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531972.920040:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531972.920041:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca467b lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [172032->176127] (req 172032->176127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.920045:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca467b lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [172032->176127] (req 172032->176127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531972.955092:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869383 is committed
00010000:00010000:1.0:1651531972.955122:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca462e lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [565248->569343] (req 565248->569343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.955127:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca462e lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [565248->569343] (req 565248->569343) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.955137:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca462e lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [565248->569343] (req 565248->569343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.955142:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006da7a892 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531972.955143:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca462e lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [565248->569343] (req 565248->569343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531972.955144:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000065be21ea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467636352:12345-10.240.43.64@tcp:4:fio.0 Request processed in 98125us (98149us total) trans 21474869383 rc 0/0
00010000:00010000:0.0:1651531972.955146:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca462e lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [565248->569343] (req 565248->569343) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531972.955147:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250355
00010000:00010000:0.0:1651531972.955152:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca462e lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [565248->569343] (req 565248->569343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.955154:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca462e lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [565248->569343] (req 565248->569343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531972.955465:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531972.955473:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467638656
00000100:00100000:0.0:1651531972.955488:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44652
00000100:00100000:0.0:1651531972.955490:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000097ff3001 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467638656:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531972.955496:0:206699:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531972.955500:0:206699:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca4682 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446193 expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.955507:0:206699:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca4682 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446193 expref: 9 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531972.955512:0:206699:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca4682 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446193 expref: 9 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531972.955515:0:206699:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f765708a, rc 0)
00000100:00100000:0.0:1651531972.955529:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000097ff3001 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467638656:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (65us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531972.955532:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44652
00000100:00100000:0.0:1651531972.955992:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531972.956000:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531972.956013:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467639040
00000100:00100000:0.0:1651531972.956019:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467638976
00000100:00100000:1.0:1651531972.956028:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44653
00000100:00100000:1.0:1651531972.956031:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000398f3634 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754467639040:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651531972.956031:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44654
00000100:00100000:0.0:1651531972.956032:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007104508b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438146:x1731754467638976:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531972.956035:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531972.956036:0:206699:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531972.956039:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4689 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4461af expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.956039:0:206699:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4690 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4461a8 expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.956048:0:206699:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4690 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4461a8 expref: 11 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531972.956049:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4689 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4461af expref: 11 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531972.956053:0:166112:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4689 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4461af expref: 11 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531972.956056:0:206699:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4690 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4461a8 expref: 11 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531972.956057:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000968553c1, rc 0)
00010000:00010000:0.0:1651531972.956059:0:206699:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c1022d42, rc 0)
00000100:00100000:1.0:1651531972.956067:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000398f3634 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754467639040:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (75us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531972.956067:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007104508b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438146:x1731754467638976:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (67us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531972.956070:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44654
00000100:00100000:1.0:1651531972.956071:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44653
00000100:00100000:0.0:1651531972.956560:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531972.956578:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467639232
00000100:00100000:1.0:1651531972.956589:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250360
00000100:00100000:1.0:1651531972.956591:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d65563cf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467639232:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531972.956598:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca4697 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.956602:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531972.956603:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531972.956604:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca4697 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [897024->901119] (req 897024->901119) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.956608:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca4697 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [897024->901119] (req 897024->901119) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.956619:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca4697 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [897024->901119] (req 897024->901119) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.956622:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca4697 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [897024->901119] (req 897024->901119) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531972.956644:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d65563cf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467639232:12345-10.240.43.64@tcp:3:fio.0 Request processed in 52us (84us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531972.956647:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250360
00010000:00010000:1.0:1651531972.956653:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca4697 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [897024->901119] (req 897024->901119) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.956657:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a8889a80 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531972.956658:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca4697 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [897024->901119] (req 897024->901119) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.956672:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca4697 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [897024->901119] (req 897024->901119) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.956685:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca4697 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [897024->901119] (req 897024->901119) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.956688:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca4697 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [897024->901119] (req 897024->901119) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531972.956967:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531972.956974:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467639552
00000100:00100000:0.0:1651531972.956989:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250361
00000100:00100000:0.0:1651531972.956991:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000006f627e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467639552:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531972.956998:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca469e lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.957002:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531972.957003:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531972.957004:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca469e lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [12288->16383] (req 12288->16383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531972.957008:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca469e lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [12288->16383] (req 12288->16383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531972.957144:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531972.957154:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467639808
00000100:00100000:1.0:1651531972.957164:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250362
00000100:00100000:1.0:1651531972.957166:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009af72390 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754467639808:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531972.957172:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca46a5 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.957176:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531972.957176:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531972.957177:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca46a5 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [876544->880639] (req 876544->880639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531972.957181:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca46a5 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [876544->880639] (req 876544->880639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531973.005760:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869384 is committed
00010000:00010000:1.0:1651531973.005796:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca467b lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [172032->176127] (req 172032->176127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.005800:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca467b lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [172032->176127] (req 172032->176127) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531973.005831:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000481279c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754467638528:12345-10.240.43.64@tcp:4:fio.0 Request processed in 85802us (85840us total) trans 21474869384 rc 0/0
00000100:00100000:1.0:1651531973.005834:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250359
00010000:00010000:0.0:1651531973.005835:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca467b lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [172032->176127] (req 172032->176127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.005841:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e9b84540 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531973.005842:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca467b lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [172032->176127] (req 172032->176127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.005846:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca467b lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [172032->176127] (req 172032->176127) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.005851:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca467b lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [172032->176127] (req 172032->176127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.005854:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca467b lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [172032->176127] (req 172032->176127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531973.018984:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531973.019011:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467640064
00000100:00100000:1.0:1651531973.019024:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44655
00000100:00100000:1.0:1651531973.019026:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000039b2328f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438146:x1731754467640064:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531973.019029:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531973.019033:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca46ac lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4461bd expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.019041:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca46ac lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4461bd expref: 12 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531973.019046:0:166112:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca46ac lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4461bd expref: 12 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531973.019049:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a8889a80, rc 0)
00000100:00100000:1.0:1651531973.019060:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000039b2328f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438146:x1731754467640064:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (77us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531973.019062:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44655
00000100:00100000:0.0:1651531973.019788:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531973.019806:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467640320
00000100:00100000:1.0:1651531973.019819:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44656
00000100:00100000:1.0:1651531973.019821:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007a950a20 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438147:x1731754467640320:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531973.019824:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531973.019837:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca46b3 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4461cb expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.019844:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca46b3 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4461cb expref: 12 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531973.019848:0:166112:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca46b3 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4461cb expref: 12 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531973.019852:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000968553c1, rc 0)
00000100:00100000:1.0:1651531973.019862:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007a950a20 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438147:x1731754467640320:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (75us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531973.019865:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44656
00000100:00100000:0.0:1651531973.020571:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531973.020589:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467640576
00000100:00100000:1.0:1651531973.020601:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44657
00000100:00100000:1.0:1651531973.020603:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000000f0ee82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438146:x1731754467640576:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531973.020606:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531973.020610:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca46ba lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4461d9 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.020617:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca46ba lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4461d9 expref: 12 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531973.020621:0:166112:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca46ba lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4461d9 expref: 12 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531973.020625:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d44eb74d, rc 0)
00000100:00100000:1.0:1651531973.020644:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000000f0ee82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438146:x1731754467640576:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (74us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531973.020647:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44657
00000100:00100000:0.0:1651531973.020942:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531973.020960:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467640704
00000100:00100000:1.0:1651531973.020970:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250363
00000100:00100000:1.0:1651531973.020972:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000991d4dbd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438147:x1731754467640704:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531973.020979:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca46c1 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.020983:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531973.020983:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531973.020984:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca46c1 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [901120->905215] (req 901120->905215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.020988:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca46c1 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [901120->905215] (req 901120->905215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.020999:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca46c1 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [901120->905215] (req 901120->905215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.021003:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca46c1 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [901120->905215] (req 901120->905215) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531973.021024:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000991d4dbd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438147:x1731754467640704:12345-10.240.43.64@tcp:3:fio.0 Request processed in 52us (83us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531973.021027:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250363
00010000:00010000:0.0:1651531973.021027:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca46c1 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [901120->905215] (req 901120->905215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.021032:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e9b84540 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531973.021033:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca46c1 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [901120->905215] (req 901120->905215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.021036:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca46c1 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [901120->905215] (req 901120->905215) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.021042:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca46c1 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [901120->905215] (req 901120->905215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.021046:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca46c1 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [901120->905215] (req 901120->905215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531973.043094:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869386 is committed
00010000:00010000:1.0:1651531973.043123:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca46a5 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [876544->880639] (req 876544->880639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.043138:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca46a5 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [876544->880639] (req 876544->880639) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531973.043158:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009af72390 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467639808:12345-10.240.43.64@tcp:4:fio.0 Request processed in 85991us (86015us total) trans 21474869386 rc 0/0
00000100:00100000:1.0:1651531973.043161:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250362
00010000:00010000:1.0:1651531973.043168:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca46a5 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [876544->880639] (req 876544->880639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.043171:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008558d1b3 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531973.043172:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca46a5 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [876544->880639] (req 876544->880639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.043175:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca46a5 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [876544->880639] (req 876544->880639) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.043180:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca46a5 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [876544->880639] (req 876544->880639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.043182:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca46a5 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [876544->880639] (req 876544->880639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.043202:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca469e lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [12288->16383] (req 12288->16383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.043205:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca469e lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [12288->16383] (req 12288->16383) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.043254:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca469e lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [12288->16383] (req 12288->16383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531973.043255:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000006f627e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438146:x1731754467639552:12345-10.240.43.64@tcp:4:fio.0 Request processed in 86263us (86289us total) trans 21474869385 rc 0/0
00000100:00100000:1.0:1651531973.043258:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250361
00010000:00010000:0.0:1651531973.043258:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e2ec18e1 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531973.043260:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca469e lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [12288->16383] (req 12288->16383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.043263:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca469e lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [12288->16383] (req 12288->16383) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.043268:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca469e lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [12288->16383] (req 12288->16383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.043271:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca469e lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [12288->16383] (req 12288->16383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531973.043557:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531973.043572:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531973.043578:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467640960
00000100:00100000:0.0:1651531973.043580:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467641088
00000100:00100000:1.0:1651531973.043590:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44658
00000100:00100000:1.0:1651531973.043591:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000092cb3f97 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438148:x1731754467640960:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531973.043595:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651531973.043597:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44659
00010000:00010000:1.0:1651531973.043599:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca46c8 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4461e7 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531973.043599:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001e18aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438147:x1731754467641088:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531973.043603:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00002000:00010000:1.0:1651531973.043604:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34545:0x0] initial LVB size: 6291456, mtime: 0x627060c4, atime: 0x627060b4, ctime: 0x627060c4, blocks: 0x3000
00010000:00010000:0.0:1651531973.043607:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca46cf lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4461f5 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.043608:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531973.043609:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531973.043611:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca46c8 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4461e7 expref: 7 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531973.043615:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531973.043616:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531973.043618:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca46cf lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4461f5 expref: 8 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531973.043623:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca46c8 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4461e7 expref: 8 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531973.043623:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca46cf lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4461f5 expref: 8 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531973.043627:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c1022d42, rc 0)
00010000:00010000:1.0:1651531973.043628:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d44eb74d, rc 0)
00000100:00100000:0.0:1651531973.043642:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001e18aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467641088:12345-10.240.43.64@tcp:101:fio.0 Request processed in 42us (70us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531973.043645:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44659
00000100:00100000:1.0:1651531973.043647:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000092cb3f97 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467640960:12345-10.240.43.64@tcp:101:fio.0 Request processed in 54us (90us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531973.043649:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44658
00000100:00100000:0.0:1651531973.044145:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531973.044164:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467641344
00000100:00100000:1.0:1651531973.044175:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250364
00000100:00100000:1.0:1651531973.044178:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006bce4824 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438146:x1731754467641344:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531973.044184:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca46d6 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.044188:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531973.044189:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531973.044190:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca46d6 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [561152->565247] (req 561152->565247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.044193:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca46d6 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [561152->565247] (req 561152->565247) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.044205:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca46d6 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [561152->565247] (req 561152->565247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.044208:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca46d6 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [561152->565247] (req 561152->565247) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.044245:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca46d6 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [561152->565247] (req 561152->565247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531973.044248:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006bce4824 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438146:x1731754467641344:12345-10.240.43.64@tcp:3:fio.0 Request processed in 69us (103us total) trans 0 rc 4096/4096
00010000:00010000:0.0:1651531973.044249:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000968553c1 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531973.044250:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca46d6 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [561152->565247] (req 561152->565247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531973.044251:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250364
00010000:00010000:0.0:1651531973.044253:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca46d6 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [561152->565247] (req 561152->565247) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.044258:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca46d6 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [561152->565247] (req 561152->565247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.044261:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca46d6 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [561152->565247] (req 561152->565247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531973.044521:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531973.044532:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467641600
00000100:00100000:1.0:1651531973.044542:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250365
00000100:00100000:1.0:1651531973.044544:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000083fa1d86 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438146:x1731754467641600:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531973.044551:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca46dd lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.044555:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531973.044557:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531973.044558:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca46dd lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [888832->892927] (req 888832->892927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.044562:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca46dd lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [888832->892927] (req 888832->892927) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.044572:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca46dd lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [888832->892927] (req 888832->892927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.044576:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca46dd lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [888832->892927] (req 888832->892927) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531973.044589:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000083fa1d86 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438146:x1731754467641600:12345-10.240.43.64@tcp:3:fio.0 Request processed in 44us (69us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531973.044591:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250365
00010000:00010000:1.0:1651531973.044597:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca46dd lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [888832->892927] (req 888832->892927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.044601:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a8889a80 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531973.044602:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca46dd lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [888832->892927] (req 888832->892927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.044604:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca46dd lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [888832->892927] (req 888832->892927) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.044609:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca46dd lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [888832->892927] (req 888832->892927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.044611:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca46dd lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [888832->892927] (req 888832->892927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531973.045286:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531973.045297:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467641856
00000100:00100000:1.0:1651531973.045307:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250366
00000100:00100000:1.0:1651531973.045309:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000097ff3001 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438147:x1731754467641856:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531973.045316:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca46e4 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.045320:0:216321:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca46c8 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4461e7 expref: 7 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531973.045324:0:216321:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca46cf lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4461f5 expref: 7 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531973.045327:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531973.045327:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531973.045328:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca46e4 lrc: 5/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [802816->806911] (req 802816->806911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.045335:0:216321:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca46cf lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4461f5 expref: 7 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531973.045339:0:216321:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca46cf lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4461f5 expref: 7 pid: 166113 timeout: 22781 lvb_type: 1
00000100:00100000:1.0:1651531973.045343:0:216321:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002bdf9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997357568:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651531973.045357:0:216321:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca46c8 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4461e7 expref: 7 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531973.045364:0:216321:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca46c8 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4461e7 expref: 7 pid: 166112 timeout: 22781 lvb_type: 1
00000100:00100000:1.0:1651531973.045368:0:216321:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003a5ac9b4 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997357632:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531973.045373:0:216321:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ec524534 going to sleep for 6 seconds
00000100:00100000:0.0:1651531973.045672:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531973.045681:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531973.045689:0:216321:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002bdf9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997357568:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531973.045690:0:166104:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467641920
00000100:00100000:1.0:1651531973.045693:0:216321:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003a5ac9b4 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997357632:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651531973.045696:0:166104:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca46cf lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4461f5 expref: 8 pid: 166113 timeout: 22781 lvb_type: 1
00010000:00010000:1.0:1651531973.045697:0:216321:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca46e4 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [802816->806911] (req 802816->806911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531973.045706:0:166104:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467641984
00010000:00010000:0.0:1651531973.045709:0:166104:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca46c8 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4461e7 expref: 9 pid: 166112 timeout: 22781 lvb_type: 1
00000100:00100000:1.0:1651531973.045713:0:166103:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 236
00000100:00100000:1.0:1651531973.045715:0:166103:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007104508b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438146:x1731754467641920:12345-10.240.43.64@tcp:103:ldlm_bl_03.0
00000100:00100000:0.0:1651531973.045719:0:166104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 237
00000100:00100000:0.0:1651531973.045721:0:166104:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000398f3634 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438146:x1731754467641984:12345-10.240.43.64@tcp:103:ldlm_bl_03.0
00010000:00010000:1.0:1651531973.045723:0:166103:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531973.045724:0:166104:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531973.045727:0:166104:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca46c8 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4461e7 expref: 9 pid: 166112 timeout: 22781 lvb_type: 1
00010000:00010000:1.0:1651531973.045728:0:166103:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca46cf lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4461f5 expref: 9 pid: 166113 timeout: 22781 lvb_type: 1
00010000:00010000:0.0:1651531973.045731:0:166104:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca46c8 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4461e7 expref: 9 pid: 166112 timeout: 22781 lvb_type: 1
00010000:00010000:1.0:1651531973.045736:0:166103:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca46cf lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4461f5 expref: 9 pid: 166113 timeout: 22781 lvb_type: 1
00010000:00010000:0.0:1651531973.045742:0:166104:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca46c8 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4461e7 expref: 9 pid: 166112 timeout: 22781 lvb_type: 1
00010000:00010000:1.0:1651531973.045745:0:166103:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca46cf lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4461f5 expref: 9 pid: 166113 timeout: 22781 lvb_type: 1
00010000:00010000:0.0:1651531973.045746:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531973.045746:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531973.045749:0:166104:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca46e4 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [802816->806911] (req 802816->806911) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.045752:0:166104:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca46e4 lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [802816->806911] (req 802816->806911) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.045755:0:166103:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1651531973.045760:0:166104:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651531973.045771:0:166104:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000398f3634 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438146:x1731754467641984:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 50us (90us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531973.045774:0:166104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 237
00000100:00100000:1.0:1651531973.045780:0:166103:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007104508b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438146:x1731754467641920:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 64us (107us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531973.045783:0:166103:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 236
00010000:00010000:1.0:1651531973.045791:0:216321:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca46e4 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [802816->806911] (req 802816->806911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.045794:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca46e4 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [802816->806911] (req 802816->806911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531973.107481:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531973.107504:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467642304
00000100:00100000:1.0:1651531973.107517:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44660
00000100:00100000:1.0:1651531973.107519:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bf4022bf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467642304:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531973.107522:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531973.107526:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca46eb lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446203 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.107534:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca46eb lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446203 expref: 9 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531973.107538:0:166112:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca46eb lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446203 expref: 9 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531973.107542:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a8889a80, rc 0)
00000100:00100000:1.0:1651531973.107552:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bf4022bf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467642304:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (72us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531973.107555:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44660
00000001:00080000:0.0:1651531973.107591:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869387 is committed
00002000:00010000:1.0:1651531973.107612:0:216321:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x34545:0x0] updating lvb mtime from disk: 1651531972 -> 1651531973
00002000:00010000:1.0:1651531973.107624:0:216321:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x34545:0x0] updating lvb ctime from disk: 1651531972 -> 1651531973
00010000:00010000:1.0:1651531973.107627:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca46e4 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [802816->806911] (req 802816->806911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.107630:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca46e4 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [802816->806911] (req 802816->806911) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531973.107648:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000097ff3001 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438147:x1731754467641856:12345-10.240.43.64@tcp:4:fio.0 Request processed in 62338us (62362us total) trans 21474869387 rc 0/0
00000100:00100000:1.0:1651531973.107651:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250366
00010000:00010000:0.0:1651531973.107653:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca46e4 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [802816->806911] (req 802816->806911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.107657:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006da7a892 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531973.107658:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca46e4 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [802816->806911] (req 802816->806911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.107674:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca46e4 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [802816->806911] (req 802816->806911) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.107680:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca46e4 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [802816->806911] (req 802816->806911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.107682:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca46e4 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [802816->806911] (req 802816->806911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531973.108001:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531973.108009:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467642624
00000100:00100000:1.0:1651531973.108020:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44661
00000100:00100000:1.0:1651531973.108021:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003a5ac9b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438147:x1731754467642624:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531973.108025:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531973.108029:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca46f2 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446211 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651531973.108034:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34545:0x0] initial LVB size: 6291456, mtime: 0x627060c5, atime: 0x627060b4, ctime: 0x627060c5, blocks: 0x3000
00010000:00010000:1.0:1651531973.108038:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531973.108038:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531973.108040:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca46f2 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446211 expref: 6 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531973.108045:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca46f2 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446211 expref: 6 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531973.108049:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008558d1b3, rc 0)
00000100:00100000:1.0:1651531973.108069:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003a5ac9b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438147:x1731754467642624:12345-10.240.43.64@tcp:101:fio.0 Request processed in 47us (69us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531973.108072:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44661
00000100:00100000:1.0:1651531973.109210:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531973.109238:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467643392
00000100:00100000:1.0:1651531973.109248:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250367
00000100:00100000:1.0:1651531973.109250:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002bdf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438146:x1731754467643392:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531973.109257:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca46f9 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.109261:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531973.109262:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531973.109262:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca46f9 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [352256->356351] (req 352256->356351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.109266:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca46f9 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [352256->356351] (req 352256->356351) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.109278:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca46f9 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [352256->356351] (req 352256->356351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.109281:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca46f9 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [352256->356351] (req 352256->356351) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531973.109302:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002bdf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438146:x1731754467643392:12345-10.240.43.64@tcp:3:fio.0 Request processed in 51us (93us total) trans 0 rc 4096/4096
00010000:00010000:0.0:1651531973.109304:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca46f9 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [352256->356351] (req 352256->356351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531973.109305:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250367
00010000:00010000:0.0:1651531973.109321:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c2b76533 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531973.109322:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca46f9 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [352256->356351] (req 352256->356351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.109325:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca46f9 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [352256->356351] (req 352256->356351) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.109330:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca46f9 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [352256->356351] (req 352256->356351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.109333:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca46f9 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [352256->356351] (req 352256->356351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531973.132839:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531973.132847:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467643648
00000100:00100000:1.0:1651531973.132870:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250368
00000100:00100000:1.0:1651531973.132872:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000880cd1d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438148:x1731754467643648:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531973.132885:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca4700 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.132889:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531973.132890:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531973.132891:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca4700 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [581632->585727] (req 581632->585727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.132894:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca4700 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [581632->585727] (req 581632->585727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.132906:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca4700 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [581632->585727] (req 581632->585727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.132909:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca4700 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [581632->585727] (req 581632->585727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531973.132923:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000880cd1d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438148:x1731754467643648:12345-10.240.43.64@tcp:3:fio.0 Request processed in 51us (85us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531973.132926:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250368
00010000:00010000:1.0:1651531973.132932:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca4700 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [581632->585727] (req 581632->585727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.132936:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a8889a80 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531973.132937:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca4700 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [581632->585727] (req 581632->585727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.132943:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca4700 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [581632->585727] (req 581632->585727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.132948:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca4700 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [581632->585727] (req 581632->585727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.132951:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca4700 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [581632->585727] (req 581632->585727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531973.133279:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531973.133287:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467643776
00000100:00100000:1.0:1651531973.133300:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250369
00000100:00100000:1.0:1651531973.133302:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b338475a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467643776:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531973.133309:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4707 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.133314:0:216321:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca46f2 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446211 expref: 6 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531973.133317:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531973.133317:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531973.133318:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4707 lrc: 4/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [503808->507903] (req 503808->507903) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.133325:0:216321:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca46f2 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446211 expref: 6 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531973.133333:0:216321:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca46f2 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446211 expref: 6 pid: 166112 timeout: 22781 lvb_type: 1
00000100:00100000:1.0:1651531973.133337:0:216321:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006c903446 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997357696:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531973.133348:0:216321:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ec524534 going to sleep for 6 seconds
00000100:00100000:1.0:1651531973.133585:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531973.133592:0:166103:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467643840
00010000:00010000:1.0:1651531973.133597:0:166103:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca46f2 lrc: 5/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446211 expref: 7 pid: 166112 timeout: 22781 lvb_type: 1
00000100:00100000:1.0:1651531973.133611:0:166103:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 238
00000100:00100000:1.0:1651531973.133613:0:166103:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e15376c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438146:x1731754467643840:12345-10.240.43.64@tcp:103:ldlm_bl_01.0
00010000:00010000:1.0:1651531973.133616:0:166103:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1651531973.133620:0:166103:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca46f2 lrc: 5/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446211 expref: 7 pid: 166112 timeout: 22781 lvb_type: 1
00010000:00010000:1.0:1651531973.133624:0:166103:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca46f2 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446211 expref: 7 pid: 166112 timeout: 22781 lvb_type: 1
00010000:00010000:1.0:1651531973.133630:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531973.133630:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531973.133631:0:166103:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4707 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [503808->507903] (req 503808->507903) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.133634:0:166103:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4707 lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [503808->507903] (req 503808->507903) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.133640:0:166103:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1651531973.133650:0:166103:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e15376c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438146:x1731754467643840:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 36us (65us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531973.133653:0:166103:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 238
00010000:00010000:1.0:1651531973.133690:0:216321:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca46f2 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446211 expref: 6 pid: 166112 timeout: 22781 lvb_type: 1
00000100:00100000:1.0:1651531973.133695:0:216321:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006c903446 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997357696:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651531973.133699:0:216321:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4707 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [503808->507903] (req 503808->507903) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.133702:0:216321:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4707 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [503808->507903] (req 503808->507903) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.133705:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4707 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [503808->507903] (req 503808->507903) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531973.182118:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531973.182126:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467643968
00000100:00100000:1.0:1651531973.182139:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44662
00000100:00100000:1.0:1651531973.182141:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006c903446 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467643968:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531973.182144:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531973.182148:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca470e lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44621f expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.182156:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca470e lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44621f expref: 9 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531973.182161:0:166112:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca470e lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44621f expref: 9 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531973.182165:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008558d1b3, rc 0)
00000100:00100000:1.0:1651531973.182175:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006c903446 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467643968:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (58us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531973.182177:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44662
00000001:00080000:0.0:1651531973.182263:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869388 is committed
00010000:00010000:1.0:1651531973.182290:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4707 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [503808->507903] (req 503808->507903) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.182294:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4707 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [503808->507903] (req 503808->507903) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531973.182315:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b338475a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438149:x1731754467643776:12345-10.240.43.64@tcp:4:fio.0 Request processed in 49012us (49036us total) trans 21474869388 rc 0/0
00010000:00010000:0.0:1651531973.182316:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4707 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [503808->507903] (req 503808->507903) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531973.182318:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250369
00010000:00010000:0.0:1651531973.182321:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001e36c601 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531973.182322:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4707 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [503808->507903] (req 503808->507903) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.182325:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4707 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [503808->507903] (req 503808->507903) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.182331:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4707 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [503808->507903] (req 503808->507903) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.182334:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4707 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [503808->507903] (req 503808->507903) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531973.182453:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531973.182471:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531973.182482:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467644096
00000100:00100000:0.0:1651531973.182484:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467644224
00000100:00100000:1.0:1651531973.182493:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250370
00000100:00100000:1.0:1651531973.182500:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000137fd3d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438146:x1731754467644096:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651531973.182500:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250371
00000100:00100000:0.0:1651531973.182502:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c4db449c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438147:x1731754467644224:12345-10.240.43.64@tcp:4:fio.0
00002000:00010000:1.0:1651531973.182509:0:216321:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34545:0x0] initial LVB size: 6291456, mtime: 0x627060c5, atime: 0x627060b4, ctime: 0x627060c5, blocks: 0x3000
00010000:00010000:1.0:1651531973.182512:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca4715 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.182513:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca471c lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.182518:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531973.182518:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531973.182519:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca471c lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [471040->475135] (req 471040->475135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.182523:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca471c lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [471040->475135] (req 471040->475135) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.182528:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531973.182529:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531973.182530:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca4715 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [638976->643071] (req 638976->643071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.182534:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca4715 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [638976->643071] (req 638976->643071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531973.224206:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869390 is committed
00010000:00010000:1.0:1651531973.224240:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca4715 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [638976->643071] (req 638976->643071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.224245:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca4715 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [638976->643071] (req 638976->643071) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.224250:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca471c lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [471040->475135] (req 471040->475135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.224259:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca471c lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [471040->475135] (req 471040->475135) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531973.224264:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000137fd3d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438146:x1731754467644096:12345-10.240.43.64@tcp:4:fio.0 Request processed in 41768us (41811us total) trans 21474869390 rc 0/0
00000100:00100000:1.0:1651531973.224272:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250370
00000100:00100000:0.0:1651531973.224278:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c4db449c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438147:x1731754467644224:12345-10.240.43.64@tcp:4:fio.0 Request processed in 41776us (41807us total) trans 21474869389 rc 0/0
00010000:00010000:1.0:1651531973.224280:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca4715 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [638976->643071] (req 638976->643071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531973.224282:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250371
00010000:00010000:1.0:1651531973.224283:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a8889a80 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531973.224284:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca4715 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [638976->643071] (req 638976->643071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.224287:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca4715 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [638976->643071] (req 638976->643071) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.224290:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca471c lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [471040->475135] (req 471040->475135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.224292:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca4715 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [638976->643071] (req 638976->643071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.224305:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca4715 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [638976->643071] (req 638976->643071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.224307:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e2ec18e1 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531973.224308:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca471c lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [471040->475135] (req 471040->475135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.224312:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca471c lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [471040->475135] (req 471040->475135) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.224317:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca471c lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [471040->475135] (req 471040->475135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.224319:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca471c lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [471040->475135] (req 471040->475135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531973.224704:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531973.224723:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467644800
00000100:00100000:0.0:1651531973.224740:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250372
00000100:00100000:0.0:1651531973.224742:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000530f55ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438146:x1731754467644800:12345-10.240.43.64@tcp:4:fio.0
00002000:00010000:0.0:1651531973.224751:0:192755:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34545:0x0] initial LVB size: 6291456, mtime: 0x627060c5, atime: 0x627060b4, ctime: 0x627060c5, blocks: 0x3000
00010000:00010000:0.0:1651531973.224754:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca4723 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.224757:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531973.224758:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531973.224759:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca4723 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [438272->442367] (req 438272->442367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.224763:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca4723 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [438272->442367] (req 438272->442367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531973.224859:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531973.224880:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467645056
00000100:00100000:1.0:1651531973.224888:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44663
00000100:00100000:1.0:1651531973.224889:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b5b5b4c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467645056:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531973.224893:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531973.224897:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca472a lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44622d expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.224904:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca472a lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44622d expref: 9 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531973.224908:0:166112:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca472a lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44622d expref: 9 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531973.224912:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008558d1b3, rc 0)
00000100:00100000:1.0:1651531973.224921:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b5b5b4c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467645056:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (62us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531973.224924:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44663
00000100:00100000:1.0:1651531973.225683:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531973.225690:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467645440
00000100:00100000:1.0:1651531973.225703:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44664
00000100:00100000:1.0:1651531973.225705:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f05c0b82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467645440:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531973.225716:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531973.225720:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4731 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44623b expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.225727:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4731 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44623b expref: 9 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531973.225732:0:166112:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4731 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44623b expref: 9 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531973.225735:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b4c8742a, rc 0)
00000100:00100000:1.0:1651531973.225745:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f05c0b82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467645440:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (62us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531973.225747:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44664
00000100:00100000:1.0:1651531973.226022:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531973.226030:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467645568
00000100:00100000:1.0:1651531973.226045:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250373
00000100:00100000:1.0:1651531973.226047:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001eda4376 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467645568:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531973.226055:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4738 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.226059:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531973.226059:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531973.226060:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4738 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [524288->528383] (req 524288->528383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.226064:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4738 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [524288->528383] (req 524288->528383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.226085:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4738 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [524288->528383] (req 524288->528383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.226088:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4738 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [524288->528383] (req 524288->528383) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.226106:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4738 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [524288->528383] (req 524288->528383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531973.226107:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001eda4376 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467645568:12345-10.240.43.64@tcp:3:fio.0 Request processed in 59us (85us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531973.226110:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250373
00010000:00010000:0.0:1651531973.226110:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001e36c601 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531973.226111:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4738 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [524288->528383] (req 524288->528383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.226115:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4738 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [524288->528383] (req 524288->528383) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.226120:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4738 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [524288->528383] (req 524288->528383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.226123:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4738 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [524288->528383] (req 524288->528383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531973.275137:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869391 is committed
00010000:00010000:0.0:1651531973.275151:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca4723 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [438272->442367] (req 438272->442367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.275155:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca4723 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [438272->442367] (req 438272->442367) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531973.275177:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000530f55ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438146:x1731754467644800:12345-10.240.43.64@tcp:4:fio.0 Request processed in 50434us (50473us total) trans 21474869391 rc 0/0
00010000:00010000:1.0:1651531973.275180:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca4723 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [438272->442367] (req 438272->442367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531973.275180:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250372
00010000:00010000:1.0:1651531973.275184:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f765708a already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531973.275185:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca4723 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [438272->442367] (req 438272->442367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.275188:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca4723 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [438272->442367] (req 438272->442367) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.275194:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca4723 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [438272->442367] (req 438272->442367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.275197:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca4723 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [438272->442367] (req 438272->442367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531973.275499:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531973.275516:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467645952
00000100:00100000:1.0:1651531973.275538:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44665
00000100:00100000:1.0:1651531973.275539:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001797bd5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438147:x1731754467645952:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531973.275543:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531973.275547:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca473f lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446249 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651531973.275552:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34545:0x0] initial LVB size: 6291456, mtime: 0x627060c5, atime: 0x627060b4, ctime: 0x627060c5, blocks: 0x3000
00010000:00010000:1.0:1651531973.275556:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531973.275557:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531973.275559:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca473f lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446249 expref: 6 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531973.275563:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca473f lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446249 expref: 6 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531973.275567:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b4c8742a, rc 0)
00000100:00100000:1.0:1651531973.275579:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001797bd5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438147:x1731754467645952:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (81us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531973.275582:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44665
00000100:00100000:1.0:1651531973.345921:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531973.345946:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467647552
00000100:00100000:0.0:1651531973.345982:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250374
00000100:00100000:0.0:1651531973.345986:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ac545f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467647552:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531973.345994:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4746 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.346000:0:192755:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca473f lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446249 expref: 6 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531973.346003:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531973.346004:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531973.346005:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4746 lrc: 4/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [712704->716799] (req 712704->716799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.346013:0:192755:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca473f lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446249 expref: 6 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531973.346017:0:192755:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca473f lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446249 expref: 6 pid: 166112 timeout: 22782 lvb_type: 1
00000100:00100000:0.0:1651531973.346021:0:192755:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a899ddab pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0001_UUID:192755:1731745997357760:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531973.346036:0:192755:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a01e87d3 going to sleep for 6 seconds
00000100:00100000:0.0:1651531973.346262:0:192755:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a899ddab pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0001_UUID:192755:1731745997357760:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651531973.346267:0:192755:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4746 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [712704->716799] (req 712704->716799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531973.346321:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531973.346347:0:166103:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467647680
00010000:00010000:1.0:1651531973.346354:0:166103:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca473f lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446249 expref: 7 pid: 166112 timeout: 22782 lvb_type: 1
00000100:00100000:1.0:1651531973.346365:0:166103:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 239
00000100:00100000:1.0:1651531973.346366:0:166103:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007f8a68aa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438148:x1731754467647680:12345-10.240.43.64@tcp:103:ldlm_bl_06.0
00010000:00010000:1.0:1651531973.346370:0:166103:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1651531973.346382:0:166103:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca473f lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446249 expref: 7 pid: 166112 timeout: 22782 lvb_type: 1
00010000:00010000:1.0:1651531973.346386:0:166103:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca473f lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446249 expref: 7 pid: 166112 timeout: 22782 lvb_type: 1
00010000:00010000:1.0:1651531973.346393:0:166103:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca473f lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446249 expref: 7 pid: 166112 timeout: 22782 lvb_type: 1
00010000:00010000:1.0:1651531973.346397:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531973.346397:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531973.346398:0:166103:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4746 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [712704->716799] (req 712704->716799) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.346401:0:166103:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4746 lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [712704->716799] (req 712704->716799) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.346410:0:166103:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1651531973.346416:0:192755:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4746 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [712704->716799] (req 712704->716799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531973.346421:0:166103:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007f8a68aa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438148:x1731754467647680:12345-10.240.43.64@tcp:103:ldlm_bl_06.0 Request processed in 54us (100us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531973.346424:0:166103:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 239
00010000:00010000:0.0:1651531973.346428:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4746 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [712704->716799] (req 712704->716799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531973.398003:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531973.398026:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467647808
00000100:00100000:1.0:1651531973.398040:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44666
00000100:00100000:1.0:1651531973.398041:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a899ddab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467647808:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531973.398045:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531973.398049:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca474d lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446257 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.398057:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca474d lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446257 expref: 9 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531973.398070:0:166112:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca474d lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446257 expref: 9 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531973.398074:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b4c8742a, rc 0)
00000100:00100000:1.0:1651531973.398085:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a899ddab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467647808:12345-10.240.43.64@tcp:101:fio.0 Request processed in 43us (83us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531973.398088:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44666
00000001:00080000:0.0:1651531973.408609:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869392 is committed
00010000:00010000:0.0:1651531973.408624:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4746 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [712704->716799] (req 712704->716799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.408628:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4746 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [712704->716799] (req 712704->716799) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531973.408644:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ac545f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438149:x1731754467647552:12345-10.240.43.64@tcp:4:fio.0 Request processed in 62659us (62724us total) trans 21474869392 rc 0/0
00000100:00100000:0.0:1651531973.408648:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250374
00010000:00010000:0.0:1651531973.408655:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4746 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [712704->716799] (req 712704->716799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.408658:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e2ec18e1 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531973.408659:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4746 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [712704->716799] (req 712704->716799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.408662:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4746 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [712704->716799] (req 712704->716799) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.408667:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4746 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [712704->716799] (req 712704->716799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.408682:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4746 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [712704->716799] (req 712704->716799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531973.409009:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531973.409017:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467648320
00000100:00100000:1.0:1651531973.409029:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44667
00000100:00100000:1.0:1651531973.409031:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007a05c3e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438148:x1731754467648320:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531973.409034:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531973.409038:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4754 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446265 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651531973.409044:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34545:0x0] initial LVB size: 6291456, mtime: 0x627060c5, atime: 0x627060b4, ctime: 0x627060c5, blocks: 0x3000
00010000:00010000:1.0:1651531973.409048:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531973.409048:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531973.409050:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4754 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446265 expref: 6 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531973.409055:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4754 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446265 expref: 6 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531973.409059:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b4c8742a, rc 0)
00000100:00100000:1.0:1651531973.409080:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007a05c3e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438148:x1731754467648320:12345-10.240.43.64@tcp:101:fio.0 Request processed in 48us (71us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531973.409082:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44667
00000100:00100000:1.0:1651531973.409458:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531973.409470:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467648448
00000100:00100000:0.0:1651531973.409486:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250375
00000100:00100000:0.0:1651531973.409488:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004237e3f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467648448:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531973.409497:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca475b lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.409501:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531973.409501:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531973.409502:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca475b lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [135168->139263] (req 135168->139263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.409506:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca475b lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [135168->139263] (req 135168->139263) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.409519:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca475b lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [135168->139263] (req 135168->139263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.409522:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca475b lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [135168->139263] (req 135168->139263) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531973.409538:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004237e3f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467648448:12345-10.240.43.64@tcp:3:fio.0 Request processed in 49us (80us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531973.409540:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250375
00010000:00010000:0.0:1651531973.409547:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca475b lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [135168->139263] (req 135168->139263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.409560:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002c5e01dd already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531973.409561:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca475b lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [135168->139263] (req 135168->139263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.409564:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca475b lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [135168->139263] (req 135168->139263) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.409569:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca475b lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [135168->139263] (req 135168->139263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.409572:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca475b lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [135168->139263] (req 135168->139263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531973.410293:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531973.410312:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467648704
00000100:00100000:0.0:1651531973.410328:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250376
00000100:00100000:0.0:1651531973.410330:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007b76f7f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467648704:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531973.410337:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4762 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.410342:0:192755:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4754 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446265 expref: 6 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531973.410346:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531973.410347:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531973.410347:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4762 lrc: 4/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [589824->593919] (req 589824->593919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.410366:0:192755:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4754 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446265 expref: 6 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531973.410371:0:192755:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4754 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446265 expref: 6 pid: 166112 timeout: 22782 lvb_type: 1
00000100:00100000:0.0:1651531973.410375:0:192755:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000033696ffa pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0001_UUID:192755:1731745997357824:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531973.410388:0:192755:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a01e87d3 going to sleep for 6 seconds
00000100:00100000:0.0:1651531973.410640:0:192755:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000033696ffa pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0001_UUID:192755:1731745997357824:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531973.410644:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651531973.410644:0:192755:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4762 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [589824->593919] (req 589824->593919) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531973.410652:0:166103:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467648768
00010000:00010000:1.0:1651531973.410657:0:166103:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4754 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446265 expref: 7 pid: 166112 timeout: 22782 lvb_type: 1
00000100:00100000:1.0:1651531973.410667:0:166103:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 240
00000100:00100000:1.0:1651531973.410669:0:166103:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000398f3634 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438147:x1731754467648768:12345-10.240.43.64@tcp:103:ldlm_bl_04.0
00010000:00010000:1.0:1651531973.410672:0:166103:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1651531973.410675:0:166103:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4754 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446265 expref: 7 pid: 166112 timeout: 22782 lvb_type: 1
00010000:00010000:1.0:1651531973.410679:0:166103:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4754 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446265 expref: 7 pid: 166112 timeout: 22782 lvb_type: 1
00010000:00010000:1.0:1651531973.410685:0:166103:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4754 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446265 expref: 7 pid: 166112 timeout: 22782 lvb_type: 1
00010000:00010000:1.0:1651531973.410689:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531973.410690:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531973.410691:0:166103:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4762 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [589824->593919] (req 589824->593919) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.410694:0:166103:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4762 lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [589824->593919] (req 589824->593919) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.410714:0:166103:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1651531973.410723:0:192755:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4762 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [589824->593919] (req 589824->593919) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531973.410726:0:166103:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000398f3634 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438147:x1731754467648768:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 56us (82us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531973.410729:0:166103:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 240
00010000:00010000:0.0:1651531973.410731:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4762 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [589824->593919] (req 589824->593919) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531973.434062:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531973.434070:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467648896
00000100:00100000:1.0:1651531973.434082:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44668
00000100:00100000:1.0:1651531973.434084:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007104508b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467648896:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531973.434088:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531973.434091:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4769 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446273 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.434099:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4769 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446273 expref: 9 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531973.434103:0:166112:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4769 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446273 expref: 9 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531973.434106:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b4c8742a, rc 0)
00000100:00100000:1.0:1651531973.434119:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007104508b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467648896:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (58us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531973.434132:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44668
00000100:00100000:1.0:1651531973.434885:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531973.434892:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467649152
00000100:00100000:1.0:1651531973.434905:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44669
00000100:00100000:1.0:1651531973.434907:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000315bf4eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467649152:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531973.434918:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531973.434922:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4770 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446281 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.434929:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4770 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446281 expref: 9 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531973.434933:0:166112:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4770 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446281 expref: 9 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531973.434936:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008558d1b3, rc 0)
00000100:00100000:1.0:1651531973.434946:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000315bf4eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467649152:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (62us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531973.434949:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44669
00000001:00080000:0.0:1651531973.445974:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869393 is committed
00010000:00010000:0.0:1651531973.445988:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4762 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [589824->593919] (req 589824->593919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.445992:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4762 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [589824->593919] (req 589824->593919) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531973.446012:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007b76f7f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438149:x1731754467648704:12345-10.240.43.64@tcp:4:fio.0 Request processed in 35681us (35719us total) trans 21474869393 rc 0/0
00010000:00010000:1.0:1651531973.446016:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4762 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [589824->593919] (req 589824->593919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.446020:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f5657138 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531973.446021:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4762 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [589824->593919] (req 589824->593919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.446025:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4762 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [589824->593919] (req 589824->593919) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531973.446025:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250376
00010000:00010000:1.0:1651531973.446030:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4762 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [589824->593919] (req 589824->593919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.446033:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4762 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [589824->593919] (req 589824->593919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531973.467013:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531973.467022:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531973.467033:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467649728
00000100:00100000:1.0:1651531973.467040:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467649792
00000100:00100000:1.0:1651531973.467044:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44670
00000100:00100000:1.0:1651531973.467045:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a23bcd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467649728:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651531973.467047:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44671
00010000:00010000:1.0:1651531973.467049:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651531973.467049:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000033723645 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438146:x1731754467649792:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531973.467052:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4777 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446296 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.467054:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00002000:00010000:1.0:1651531973.467057:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34545:0x0] initial LVB size: 6291456, mtime: 0x627060c5, atime: 0x627060b4, ctime: 0x627060c5, blocks: 0x3000
00010000:00010000:0.0:1651531973.467058:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca477e lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44629d expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.467062:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531973.467062:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531973.467064:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4777 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446296 expref: 8 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531973.467069:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531973.467069:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531973.467072:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca477e lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44629d expref: 8 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531973.467077:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4777 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446296 expref: 8 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531973.467077:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca477e lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44629d expref: 8 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531973.467081:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008558d1b3, rc 0)
00010000:00010000:0.0:1651531973.467081:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002c5e01dd, rc 0)
00000100:00100000:1.0:1651531973.467093:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a23bcd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467649728:12345-10.240.43.64@tcp:101:fio.0 Request processed in 47us (81us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531973.467093:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000033723645 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467649792:12345-10.240.43.64@tcp:101:fio.0 Request processed in 43us (71us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531973.467095:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44670
00000100:00100000:0.0:1651531973.467097:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44671
00000100:00100000:1.0:1651531973.467460:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531973.467483:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467650048
00000100:00100000:0.0:1651531973.467498:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250377
00000100:00100000:0.0:1651531973.467500:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b9b10d48 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438148:x1731754467650048:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531973.467507:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4785 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.467511:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531973.467521:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531973.467522:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4785 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [380928->385023] (req 380928->385023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.467526:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4785 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [380928->385023] (req 380928->385023) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.467539:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4785 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [380928->385023] (req 380928->385023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.467542:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4785 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [380928->385023] (req 380928->385023) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531973.467563:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b9b10d48 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438148:x1731754467650048:12345-10.240.43.64@tcp:3:fio.0 Request processed in 62us (104us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531973.467566:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250377
00010000:00010000:0.0:1651531973.467573:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4785 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [380928->385023] (req 380928->385023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.467577:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e2ec18e1 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531973.467578:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4785 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [380928->385023] (req 380928->385023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.467581:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4785 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [380928->385023] (req 380928->385023) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.467585:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4785 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [380928->385023] (req 380928->385023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.467588:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4785 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [380928->385023] (req 380928->385023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531973.467885:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531973.467897:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467650304
00000100:00100000:0.0:1651531973.467911:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250378
00000100:00100000:0.0:1651531973.467913:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b2fdb973 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438147:x1731754467650304:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531973.467920:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca478c lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.467924:0:192755:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4777 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446296 expref: 7 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531973.467928:0:192755:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca477e lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44629d expref: 7 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531973.467930:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531973.467931:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531973.467932:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca478c lrc: 5/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [1032192->1036287] (req 1032192->1036287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.467939:0:192755:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca477e lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44629d expref: 7 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531973.467943:0:192755:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca477e lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44629d expref: 7 pid: 166111 timeout: 22782 lvb_type: 1
00000100:00100000:0.0:1651531973.467947:0:192755:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000033696ffa pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0001_UUID:192755:1731745997357888:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651531973.467967:0:192755:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4777 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446296 expref: 7 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531973.467982:0:192755:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4777 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446296 expref: 7 pid: 166112 timeout: 22782 lvb_type: 1
00000100:00100000:0.0:1651531973.467986:0:192755:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002ae2aeac pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0001_UUID:192755:1731745997357952:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531973.467997:0:192755:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a01e87d3 going to sleep for 6 seconds
00000100:00100000:0.0:1651531973.468338:0:192755:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000033696ffa pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0001_UUID:192755:1731745997357888:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531973.468339:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531973.468341:0:192755:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002ae2aeac pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0001_UUID:192755:1731745997357952:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651531973.468346:0:192755:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca478c lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [1032192->1036287] (req 1032192->1036287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531973.468357:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531973.468358:0:166103:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467650432
00010000:00010000:0.0:1651531973.468363:0:166103:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca477e lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44629d expref: 8 pid: 166111 timeout: 22782 lvb_type: 1
00000100:00100000:1.0:1651531973.468364:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531973.468374:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467650496
00000100:00100000:0.0:1651531973.468379:0:166103:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467650560
00010000:00010000:0.0:1651531973.468383:0:166103:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4777 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446296 expref: 10 pid: 166112 timeout: 22782 lvb_type: 1
00000100:00100000:1.0:1651531973.468387:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250379
00000100:00100000:1.0:1651531973.468389:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e72632c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438148:x1731754467650496:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651531973.468394:0:166103:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 241
00000100:00100000:0.0:1651531973.468396:0:166103:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000deba47dc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438147:x1731754467650432:12345-10.240.43.64@tcp:103:ldlm_bl_03.0
00010000:00010000:1.0:1651531973.468397:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4793 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.468399:0:166103:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1651531973.468401:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531973.468401:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531973.468402:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4793 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [974848->978943] (req 974848->978943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.468406:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4793 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [974848->978943] (req 974848->978943) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.468408:0:166103:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca477e lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44629d expref: 10 pid: 166111 timeout: 22782 lvb_type: 1
00010000:00010000:1.0:1651531973.468418:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4793 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [974848->978943] (req 974848->978943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.468421:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4793 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [974848->978943] (req 974848->978943) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.468427:0:166103:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca477e lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44629d expref: 10 pid: 166111 timeout: 22782 lvb_type: 1
00010000:00010000:0.0:1651531973.468438:0:166103:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca477e lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44629d expref: 10 pid: 166111 timeout: 22782 lvb_type: 1
00000100:00100000:1.0:1651531973.468439:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e72632c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438148:x1731754467650496:12345-10.240.43.64@tcp:3:fio.0 Request processed in 50us (82us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531973.468442:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250379
00010000:00010000:0.0:1651531973.468442:0:166103:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651531973.468456:0:166103:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000deba47dc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467650432:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 59us (117us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531973.468459:0:166103:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 241
00000100:00100000:0.0:1651531973.468464:0:166103:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 242
00000100:00100000:0.0:1651531973.468466:0:166103:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009c946e88 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438147:x1731754467650560:12345-10.240.43.64@tcp:103:ldlm_bl_05.0
00010000:00010000:0.0:1651531973.468469:0:166103:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531973.468472:0:166103:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4777 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446296 expref: 7 pid: 166112 timeout: 22782 lvb_type: 1
00010000:00010000:0.0:1651531973.468476:0:166103:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4777 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446296 expref: 7 pid: 166112 timeout: 22782 lvb_type: 1
00010000:00010000:0.0:1651531973.468481:0:166103:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4777 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446296 expref: 7 pid: 166112 timeout: 22782 lvb_type: 1
00010000:00010000:0.0:1651531973.468484:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531973.468485:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531973.468486:0:166103:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca478c lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [1032192->1036287] (req 1032192->1036287) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.468497:0:166103:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca478c lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [1032192->1036287] (req 1032192->1036287) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.468505:0:166103:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651531973.468534:0:166103:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009c946e88 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438147:x1731754467650560:12345-10.240.43.64@tcp:103:ldlm_bl_05.0 Request processed in 67us (169us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531973.468537:0:166103:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 242
00010000:00010000:0.0:1651531973.468547:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4793 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [974848->978943] (req 974848->978943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.468551:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b4c8742a already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531973.468552:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4793 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [974848->978943] (req 974848->978943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.468555:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4793 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [974848->978943] (req 974848->978943) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.468559:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4793 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [974848->978943] (req 974848->978943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.468562:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4793 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [974848->978943] (req 974848->978943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.468567:0:192755:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca478c lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [1032192->1036287] (req 1032192->1036287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.468570:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca478c lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [1032192->1036287] (req 1032192->1036287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531973.514790:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869394 is committed
00000100:00100000:1.0:1651531973.514793:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531973.514808:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651531973.514810:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca478c lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [1032192->1036287] (req 1032192->1036287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.514819:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca478c lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [1032192->1036287] (req 1032192->1036287) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531973.514825:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467650880
00000100:00100000:0.0:1651531973.514845:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b2fdb973 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438147:x1731754467650304:12345-10.240.43.64@tcp:4:fio.0 Request processed in 46931us (46959us total) trans 21474869394 rc 0/0
00000100:00100000:1.0:1651531973.514846:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44672
00000100:00100000:0.0:1651531973.514848:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250378
00000100:00100000:0.0:1651531973.514854:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467650944
00000100:00100000:1.0:1651531973.514858:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f18d8e18 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438146:x1731754467650880:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531973.514862:0:206699:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651531973.514867:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250380
00000100:00100000:0.0:1651531973.514868:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000205abf78 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467650944:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531973.514872:0:206699:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca479a lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4462ab expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.514875:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca47a1 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.514879:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531973.514880:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531973.514881:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca47a1 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [73728->77823] (req 73728->77823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.514885:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca47a1 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [73728->77823] (req 73728->77823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.514888:0:206699:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca479a lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4462ab expref: 7 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531973.514893:0:206699:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca479a lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4462ab expref: 7 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531973.514897:0:206699:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a8889a80, rc 0)
00000100:00100000:1.0:1651531973.514907:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f18d8e18 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438146:x1731754467650880:12345-10.240.43.64@tcp:101:fio.0 Request processed in 49us (115us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531973.514910:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44672
00010000:00010000:1.0:1651531973.514918:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca478c lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [1032192->1036287] (req 1032192->1036287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.514922:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f5657138 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531973.514923:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca478c lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [1032192->1036287] (req 1032192->1036287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.514926:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca478c lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [1032192->1036287] (req 1032192->1036287) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.514931:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca478c lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [1032192->1036287] (req 1032192->1036287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.514946:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca478c lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [1032192->1036287] (req 1032192->1036287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531973.515434:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531973.515449:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467651200
00000100:00100000:0.0:1651531973.515463:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250381
00000100:00100000:0.0:1651531973.515464:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002dee0a2a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467651200:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531973.515481:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca47a8 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.515485:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531973.515485:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531973.515486:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca47a8 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [675840->679935] (req 675840->679935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.515491:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca47a8 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [675840->679935] (req 675840->679935) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.515503:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca47a8 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [675840->679935] (req 675840->679935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.515507:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca47a8 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [675840->679935] (req 675840->679935) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531973.515528:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002dee0a2a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467651200:12345-10.240.43.64@tcp:3:fio.0 Request processed in 63us (95us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531973.515531:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250381
00010000:00010000:0.0:1651531973.515539:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca47a8 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [675840->679935] (req 675840->679935) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.515542:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e2ec18e1 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531973.515543:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca47a8 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [675840->679935] (req 675840->679935) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.515546:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca47a8 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [675840->679935] (req 675840->679935) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.515570:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca47a8 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [675840->679935] (req 675840->679935) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.515572:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca47a8 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [675840->679935] (req 675840->679935) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531973.515868:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531973.515888:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467651328
00000100:00100000:0.0:1651531973.515901:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44673
00000100:00100000:0.0:1651531973.515903:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c550f111 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467651328:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531973.515907:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531973.515910:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca47af lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4462b9 expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.515918:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca47af lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4462b9 expref: 9 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531973.515923:0:166111:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca47af lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4462b9 expref: 9 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531973.515926:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f765708a, rc 0)
00000100:00100000:0.0:1651531973.515941:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c550f111 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467651328:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (73us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531973.515943:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44673
00000100:00100000:1.0:1651531973.516261:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531973.516280:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467651456
00000100:00100000:0.0:1651531973.516295:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250382
00000100:00100000:0.0:1651531973.516297:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d3ac27c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467651456:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531973.516312:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca47b6 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.516316:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531973.516317:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531973.516318:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca47b6 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [978944->983039] (req 978944->983039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.516322:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca47b6 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [978944->983039] (req 978944->983039) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.516333:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca47b6 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [978944->983039] (req 978944->983039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.516336:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca47b6 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [978944->983039] (req 978944->983039) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531973.516357:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d3ac27c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467651456:12345-10.240.43.64@tcp:3:fio.0 Request processed in 59us (95us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531973.516359:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250382
00010000:00010000:0.0:1651531973.516366:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca47b6 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [978944->983039] (req 978944->983039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.516370:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c1022d42 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531973.516371:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca47b6 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [978944->983039] (req 978944->983039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.516374:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca47b6 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [978944->983039] (req 978944->983039) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.516382:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca47b6 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [978944->983039] (req 978944->983039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.516385:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca47b6 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [978944->983039] (req 978944->983039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531973.516674:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531973.516685:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467651584
00000100:00100000:0.0:1651531973.516699:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250383
00000100:00100000:0.0:1651531973.516701:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009e786cd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467651584:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531973.516707:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca47bd lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.516711:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531973.516711:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531973.516712:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca47bd lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [299008->303103] (req 299008->303103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.516716:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca47bd lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [299008->303103] (req 299008->303103) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531973.563882:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869395 is committed
00010000:00010000:0.0:1651531973.563926:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca47a1 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [73728->77823] (req 73728->77823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.563930:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca47a1 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [73728->77823] (req 73728->77823) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531973.563952:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000205abf78 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467650944:12345-10.240.43.64@tcp:4:fio.0 Request processed in 49083us (49144us total) trans 21474869395 rc 0/0
00000100:00100000:0.0:1651531973.563957:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250380
00010000:00010000:1.0:1651531973.563966:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca47a1 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [73728->77823] (req 73728->77823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.563980:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002c5e01dd already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531973.563981:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca47a1 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [73728->77823] (req 73728->77823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.563985:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca47a1 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [73728->77823] (req 73728->77823) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.563990:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca47a1 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [73728->77823] (req 73728->77823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.563993:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca47a1 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [73728->77823] (req 73728->77823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531973.564306:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531973.564328:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467651840
00000100:00100000:0.0:1651531973.564343:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44674
00000100:00100000:0.0:1651531973.564344:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cb694635 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467651840:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531973.564348:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531973.564352:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca47c4 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4462c7 expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.564360:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca47c4 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4462c7 expref: 9 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531973.564364:0:166111:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca47c4 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4462c7 expref: 9 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531973.564368:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c1022d42, rc 0)
00000100:00100000:0.0:1651531973.564387:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cb694635 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467651840:12345-10.240.43.64@tcp:101:fio.0 Request processed in 42us (82us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531973.564390:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44674
00000100:00100000:1.0:1651531973.565136:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531973.565154:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467652096
00000100:00100000:0.0:1651531973.565167:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44675
00000100:00100000:0.0:1651531973.565168:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002d3e5ae4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467652096:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531973.565172:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531973.565175:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca47cb lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4462d5 expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.565182:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca47cb lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4462d5 expref: 9 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531973.565188:0:166111:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca47cb lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4462d5 expref: 9 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531973.565191:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f765708a, rc 0)
00000100:00100000:0.0:1651531973.565202:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002d3e5ae4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467652096:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (66us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531973.565204:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44675
00000100:00100000:1.0:1651531973.565528:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531973.565546:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467652224
00000100:00100000:0.0:1651531973.565562:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250384
00000100:00100000:0.0:1651531973.565564:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dce6a2c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467652224:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531973.565571:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca47d2 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.565575:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531973.565576:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531973.565577:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca47d2 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [856064->860159] (req 856064->860159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.565581:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca47d2 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [856064->860159] (req 856064->860159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.565593:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca47d2 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [856064->860159] (req 856064->860159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.565596:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca47d2 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [856064->860159] (req 856064->860159) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531973.565615:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dce6a2c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467652224:12345-10.240.43.64@tcp:3:fio.0 Request processed in 51us (87us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531973.565618:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250384
00010000:00010000:0.0:1651531973.565624:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca47d2 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [856064->860159] (req 856064->860159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.565628:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e2ec18e1 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531973.565629:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca47d2 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [856064->860159] (req 856064->860159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.565631:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca47d2 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [856064->860159] (req 856064->860159) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.565636:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca47d2 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [856064->860159] (req 856064->860159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.565639:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca47d2 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [856064->860159] (req 856064->860159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531973.588417:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869396 is committed
00010000:00010000:0.0:1651531973.588430:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca47bd lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [299008->303103] (req 299008->303103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.588434:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca47bd lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [299008->303103] (req 299008->303103) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531973.588454:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009e786cd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438149:x1731754467651584:12345-10.240.43.64@tcp:4:fio.0 Request processed in 71752us (71780us total) trans 21474869396 rc 0/0
00000100:00100000:0.0:1651531973.588465:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250383
00010000:00010000:0.0:1651531973.588479:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca47bd lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [299008->303103] (req 299008->303103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.588482:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fb2f6575 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531973.588483:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca47bd lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [299008->303103] (req 299008->303103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.588486:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca47bd lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [299008->303103] (req 299008->303103) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.588491:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca47bd lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [299008->303103] (req 299008->303103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.588494:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca47bd lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [299008->303103] (req 299008->303103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531973.588814:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531973.588822:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467652480
00000100:00100000:0.0:1651531973.588836:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44676
00000100:00100000:0.0:1651531973.588837:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002ae2aeac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438148:x1731754467652480:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531973.588841:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531973.588845:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca47d9 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4462e3 expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00002000:00010000:0.0:1651531973.588850:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34545:0x0] initial LVB size: 6291456, mtime: 0x627060c5, atime: 0x627060b4, ctime: 0x627060c5, blocks: 0x3000
00010000:00010000:0.0:1651531973.588854:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531973.588863:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531973.588865:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca47d9 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4462e3 expref: 6 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531973.588870:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca47d9 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4462e3 expref: 6 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531973.588874:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e2ec18e1, rc 0)
00000100:00100000:0.0:1651531973.588889:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002ae2aeac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438148:x1731754467652480:12345-10.240.43.64@tcp:101:fio.0 Request processed in 51us (76us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531973.588892:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44676
00000100:00100000:0.0:1651531973.613759:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531973.613767:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467653504
00000100:00100000:0.0:1651531973.613776:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250385
00000100:00100000:0.0:1651531973.613778:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000033696ffa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467653504:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531973.613785:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca47e0 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.613790:0:192754:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca47d9 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4462e3 expref: 6 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531973.613793:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531973.613794:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531973.613794:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca47e0 lrc: 4/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [569344->573439] (req 569344->573439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.613802:0:192754:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca47d9 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4462e3 expref: 6 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531973.613818:0:192754:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca47d9 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4462e3 expref: 6 pid: 166111 timeout: 22782 lvb_type: 1
00000100:00100000:0.0:1651531973.613823:0:192754:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bcdb3319 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_005:lustre-OST0001_UUID:192754:1731745997358016:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531973.613839:0:192754:0:(client.c:2492:ptlrpc_set_wait()) set 00000000474a15c8 going to sleep for 6 seconds
00000100:00100000:0.0:1651531973.614076:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531973.614084:0:166104:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467653696
00010000:00010000:0.0:1651531973.614089:0:166104:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca47d9 lrc: 5/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4462e3 expref: 7 pid: 166111 timeout: 22782 lvb_type: 1
00000100:00100000:0.0:1651531973.614097:0:166104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 243
00000100:00100000:0.0:1651531973.614099:0:166104:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f47fde78 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438147:x1731754467653696:12345-10.240.43.64@tcp:103:ldlm_bl_01.0
00010000:00010000:0.0:1651531973.614101:0:166104:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531973.614105:0:166104:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca47d9 lrc: 5/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4462e3 expref: 7 pid: 166111 timeout: 22782 lvb_type: 1
00010000:00010000:0.0:1651531973.614109:0:166104:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca47d9 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4462e3 expref: 7 pid: 166111 timeout: 22782 lvb_type: 1
00010000:00010000:0.0:1651531973.614115:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531973.614115:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531973.614116:0:166104:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca47e0 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [569344->573439] (req 569344->573439) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.614119:0:166104:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca47e0 lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [569344->573439] (req 569344->573439) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.614134:0:166104:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651531973.614149:0:166104:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f47fde78 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438147:x1731754467653696:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 49us (73us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531973.614152:0:166104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 243
00010000:00010000:0.0:1651531973.614164:0:192754:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca47d9 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4462e3 expref: 6 pid: 166111 timeout: 22782 lvb_type: 1
00000100:00100000:0.0:1651531973.614168:0:192754:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bcdb3319 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_005:lustre-OST0001_UUID:192754:1731745997358016:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651531973.614172:0:192754:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca47e0 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [569344->573439] (req 569344->573439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.614175:0:192754:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca47e0 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [569344->573439] (req 569344->573439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.614178:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca47e0 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [569344->573439] (req 569344->573439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531973.614317:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531973.614334:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467653824
00000100:00100000:0.0:1651531973.614346:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44677
00000100:00100000:0.0:1651531973.614348:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bcdb3319 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467653824:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531973.614351:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531973.614355:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca47e7 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4462f1 expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.614363:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca47e7 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4462f1 expref: 9 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531973.614386:0:166111:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca47e7 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4462f1 expref: 9 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531973.614390:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f765708a, rc 0)
00000100:00100000:0.0:1651531973.614406:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bcdb3319 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467653824:12345-10.240.43.64@tcp:101:fio.0 Request processed in 58us (90us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531973.614409:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44677
00000100:00100000:0.0:1651531973.614677:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531973.614685:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467653952
00000100:00100000:0.0:1651531973.614702:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250386
00000100:00100000:0.0:1651531973.614703:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029096870 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467653952:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531973.614711:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca47ee lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.614716:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531973.614716:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531973.614717:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca47ee lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [598016->602111] (req 598016->602111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.614721:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca47ee lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [598016->602111] (req 598016->602111) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.614734:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca47ee lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [598016->602111] (req 598016->602111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.614737:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca47ee lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [598016->602111] (req 598016->602111) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531973.614765:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029096870 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467653952:12345-10.240.43.64@tcp:3:fio.0 Request processed in 60us (87us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531973.614768:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250386
00010000:00010000:1.0:1651531973.614769:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca47ee lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [598016->602111] (req 598016->602111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.614782:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c1022d42 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531973.614783:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca47ee lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [598016->602111] (req 598016->602111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.614787:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca47ee lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [598016->602111] (req 598016->602111) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.614792:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca47ee lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [598016->602111] (req 598016->602111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.614795:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca47ee lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [598016->602111] (req 598016->602111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531973.615078:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531973.615087:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467654080
00000100:00100000:0.0:1651531973.615099:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44678
00000100:00100000:0.0:1651531973.615100:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dfff0362 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467654080:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531973.615104:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531973.615108:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca47f5 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4462ff expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.615115:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca47f5 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4462ff expref: 9 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531973.615120:0:166111:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca47f5 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4462ff expref: 9 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531973.615123:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000032ee36ee, rc 0)
00000100:00100000:0.0:1651531973.615137:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dfff0362 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467654080:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (59us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531973.615139:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44678
00000100:00100000:0.0:1651531973.615801:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531973.615808:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467654336
00000100:00100000:0.0:1651531973.615821:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44679
00000100:00100000:0.0:1651531973.615823:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e15376c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467654336:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531973.615835:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531973.615838:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca47fc lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44630d expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.615846:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca47fc lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44630d expref: 9 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531973.615850:0:166111:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca47fc lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44630d expref: 9 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531973.615853:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000080362f27, rc 0)
00000100:00100000:0.0:1651531973.615867:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e15376c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467654336:12345-10.240.43.64@tcp:101:fio.0 Request processed in 43us (67us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531973.615870:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44679
00000100:00100000:0.0:1651531973.616560:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531973.616568:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467654592
00000100:00100000:0.0:1651531973.616580:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44680
00000100:00100000:0.0:1651531973.616581:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aa58c961 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467654592:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531973.616585:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531973.616594:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca4803 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44631b expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.616602:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca4803 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44631b expref: 9 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531973.616606:0:166111:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca4803 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44631b expref: 9 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531973.616615:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f968d777, rc 0)
00000100:00100000:0.0:1651531973.616629:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aa58c961 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467654592:12345-10.240.43.64@tcp:101:fio.0 Request processed in 47us (69us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531973.616632:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44680
00000100:00100000:0.0:1651531973.660566:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531973.660575:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467654976
00000100:00100000:0.0:1651531973.660590:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250387
00000100:00100000:0.0:1651531973.660592:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000914087bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467654976:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531973.660599:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca480a lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.660603:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531973.660604:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531973.660605:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca480a lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [999424->1003519] (req 999424->1003519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.660609:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca480a lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [999424->1003519] (req 999424->1003519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531973.660674:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869397 is committed
00010000:00010000:0.0:1651531973.660685:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca47e0 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [569344->573439] (req 569344->573439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.660689:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca47e0 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [569344->573439] (req 569344->573439) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531973.660709:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000033696ffa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467653504:12345-10.240.43.64@tcp:4:fio.0 Request processed in 46930us (46951us total) trans 21474869397 rc 0/0
00000100:00100000:0.0:1651531973.660722:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250385
00010000:00010000:0.0:1651531973.660730:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca47e0 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [569344->573439] (req 569344->573439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.660733:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fb2f6575 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531973.660734:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca47e0 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [569344->573439] (req 569344->573439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.660737:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca47e0 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [569344->573439] (req 569344->573439) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.660742:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca47e0 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [569344->573439] (req 569344->573439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.660745:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca47e0 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [569344->573439] (req 569344->573439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531973.733272:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869398 is committed
00010000:00010000:0.0:1651531973.733286:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca480a lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [999424->1003519] (req 999424->1003519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.733290:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca480a lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [999424->1003519] (req 999424->1003519) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531973.733305:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000914087bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438146:x1731754467654976:12345-10.240.43.64@tcp:4:fio.0 Request processed in 72712us (72739us total) trans 21474869398 rc 0/0
00000100:00100000:0.0:1651531973.733308:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250387
00010000:00010000:0.0:1651531973.733384:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca480a lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [999424->1003519] (req 999424->1003519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.733390:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f968d777 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531973.733392:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca480a lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [999424->1003519] (req 999424->1003519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.733394:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca480a lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [999424->1003519] (req 999424->1003519) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.733400:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca480a lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [999424->1003519] (req 999424->1003519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.733402:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca480a lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [999424->1003519] (req 999424->1003519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531973.733725:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531973.733743:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467655488
00000100:00100000:0.0:1651531973.733757:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44681
00000100:00100000:0.0:1651531973.733759:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000071f9ee43 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438147:x1731754467655488:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531973.733763:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531973.733766:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca4811 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446329 expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00002000:00010000:0.0:1651531973.733771:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34545:0x0] initial LVB size: 6291456, mtime: 0x627060c5, atime: 0x627060b4, ctime: 0x627060c5, blocks: 0x3000
00010000:00010000:0.0:1651531973.733775:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531973.733776:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531973.733778:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca4811 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446329 expref: 6 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531973.733782:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca4811 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446329 expref: 6 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531973.733788:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fb2f6575, rc 0)
00000100:00100000:0.0:1651531973.733798:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000071f9ee43 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438147:x1731754467655488:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (75us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531973.733801:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44681
00000100:00100000:1.0:1651531973.734130:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531973.734148:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467655616
00000100:00100000:0.0:1651531973.734159:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250388
00000100:00100000:0.0:1651531973.734161:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000028779db6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438146:x1731754467655616:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531973.734167:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4818 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.734171:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531973.734172:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531973.734173:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4818 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [892928->897023] (req 892928->897023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.734176:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4818 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [892928->897023] (req 892928->897023) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.734188:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4818 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [892928->897023] (req 892928->897023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.734191:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4818 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [892928->897023] (req 892928->897023) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.734233:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4818 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [892928->897023] (req 892928->897023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531973.734237:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000028779db6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438146:x1731754467655616:12345-10.240.43.64@tcp:3:fio.0 Request processed in 52us (84us total) trans 0 rc 4096/4096
00010000:00010000:1.0:1651531973.734243:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000080362f27 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531973.734244:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4818 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [892928->897023] (req 892928->897023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531973.734244:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250388
00010000:00010000:1.0:1651531973.734248:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4818 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [892928->897023] (req 892928->897023) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.734253:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4818 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [892928->897023] (req 892928->897023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.734268:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4818 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [892928->897023] (req 892928->897023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531973.734556:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531973.734568:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467655808
00000100:00100000:1.0:1651531973.734571:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531973.734587:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467655936
00000100:00100000:1.0:1651531973.734590:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250389
00000100:00100000:1.0:1651531973.734593:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cc11a3b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438146:x1731754467655808:12345-10.240.43.64@tcp:4:fio.0
00000100:00100000:0.0:1651531973.734597:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250390
00000100:00100000:0.0:1651531973.734599:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000670433b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438146:x1731754467655936:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531973.734606:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca481f lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.734607:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4826 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.734612:0:216321:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca4811 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446329 expref: 7 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531973.734615:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531973.734616:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531973.734617:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca481f lrc: 4/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [913408->917503] (req 913408->917503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.734620:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531973.734621:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531973.734623:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4826 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [16384->20479] (req 16384->20479) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.734627:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4826 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [16384->20479] (req 16384->20479) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.734631:0:216321:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca4811 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446329 expref: 7 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531973.734635:0:216321:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca4811 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446329 expref: 7 pid: 166111 timeout: 22782 lvb_type: 1
00010000:00010000:0.0:1651531973.734639:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4826 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [16384->20479] (req 16384->20479) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531973.734640:0:216321:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b67ad021 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997358080:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651531973.734642:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4826 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [16384->20479] (req 16384->20479) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531973.734655:0:216321:0:(client.c:2492:ptlrpc_set_wait()) set 0000000030e02371 going to sleep for 6 seconds
00000100:00100000:0.0:1651531973.734665:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000670433b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438146:x1731754467655936:12345-10.240.43.64@tcp:3:fio.0 Request processed in 65us (94us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531973.734668:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250390
00010000:00010000:1.0:1651531973.734671:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4826 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [16384->20479] (req 16384->20479) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.734684:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000032ee36ee already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531973.734685:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4826 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [16384->20479] (req 16384->20479) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.734688:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4826 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [16384->20479] (req 16384->20479) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.734694:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4826 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [16384->20479] (req 16384->20479) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.734708:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4826 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [16384->20479] (req 16384->20479) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531973.734916:0:216321:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b67ad021 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997358080:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651531973.734921:0:216321:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca481f lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [913408->917503] (req 913408->917503) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531973.735055:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531973.735066:0:169267:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467656064
00000100:00100000:1.0:1651531973.735067:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651531973.735078:0:169267:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca4811 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446329 expref: 7 pid: 166111 timeout: 22782 lvb_type: 1
00000100:00100000:0.0:1651531973.735097:0:169267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 244
00000100:00100000:0.0:1651531973.735099:0:169267:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b67ad021 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438148:x1731754467656064:12345-10.240.43.64@tcp:103:ldlm_bl_02.0
00010000:00010000:0.0:1651531973.735103:0:169267:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531973.735106:0:169267:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca4811 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446329 expref: 7 pid: 166111 timeout: 22782 lvb_type: 1
00010000:00010000:0.0:1651531973.735110:0:169267:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca4811 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446329 expref: 7 pid: 166111 timeout: 22782 lvb_type: 1
00010000:00010000:0.0:1651531973.735116:0:169267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca4811 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446329 expref: 7 pid: 166111 timeout: 22782 lvb_type: 1
00010000:00010000:0.0:1651531973.735120:0:169267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531973.735121:0:169267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531973.735122:0:169267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca481f lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [913408->917503] (req 913408->917503) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.735125:0:169267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca481f lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [913408->917503] (req 913408->917503) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.735136:0:169267:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1651531973.735145:0:216321:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca481f lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [913408->917503] (req 913408->917503) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531973.735147:0:169267:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b67ad021 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438148:x1731754467656064:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 47us (92us total) trans 0 rc 0/0
00010000:00010000:1.0:1651531973.735149:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca481f lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [913408->917503] (req 913408->917503) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531973.735149:0:169267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 244
00000100:00100000:0.0:1651531973.735158:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467656192
00000100:00100000:0.0:1651531973.735167:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44682
00000100:00100000:0.0:1651531973.735176:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009078ca7d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438148:x1731754467656192:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531973.735179:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531973.735183:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca482d lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446337 expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.735190:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca482d lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446337 expref: 7 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531973.735194:0:166111:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca482d lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446337 expref: 7 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531973.735197:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f765708a, rc 0)
00000100:00100000:0.0:1651531973.735204:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009078ca7d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438148:x1731754467656192:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (138us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531973.735207:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44682
00000100:00100000:1.0:1651531973.735507:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531973.735527:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467656320
00000100:00100000:0.0:1651531973.735537:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250391
00000100:00100000:0.0:1651531973.735539:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000add44b2e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467656320:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531973.735545:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4834 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.735549:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531973.735550:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531973.735551:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4834 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [663552->667647] (req 663552->667647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.735555:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4834 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [663552->667647] (req 663552->667647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.735577:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4834 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [663552->667647] (req 663552->667647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.735580:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4834 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [663552->667647] (req 663552->667647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531973.735595:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000add44b2e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467656320:12345-10.240.43.64@tcp:3:fio.0 Request processed in 55us (88us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531973.735598:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250391
00010000:00010000:0.0:1651531973.735604:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4834 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [663552->667647] (req 663552->667647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.735608:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e2ec18e1 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531973.735609:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4834 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [663552->667647] (req 663552->667647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.735611:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4834 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [663552->667647] (req 663552->667647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.735616:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4834 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [663552->667647] (req 663552->667647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.735619:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4834 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [663552->667647] (req 663552->667647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531973.735948:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531973.735957:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467656448
00000100:00100000:1.0:1651531973.735970:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44683
00000100:00100000:1.0:1651531973.735972:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fb90eb28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467656448:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531973.735976:0:206699:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531973.735980:0:206699:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca483b lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446345 expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.735988:0:206699:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca483b lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446345 expref: 9 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531973.735992:0:206699:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca483b lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446345 expref: 9 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531973.735996:0:206699:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c2b76533, rc 0)
00000100:00100000:1.0:1651531973.736009:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fb90eb28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467656448:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (61us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531973.736012:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44683
00000100:00100000:1.0:1651531973.736651:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531973.736658:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467656704
00000100:00100000:1.0:1651531973.736671:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44684
00000100:00100000:1.0:1651531973.736673:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e4e3ecb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467656704:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531973.736676:0:206699:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531973.736680:0:206699:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4842 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446353 expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.736687:0:206699:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4842 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446353 expref: 9 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531973.736695:0:206699:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4842 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446353 expref: 9 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531973.736699:0:206699:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006da7a892, rc 0)
00000100:00100000:1.0:1651531973.736712:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e4e3ecb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467656704:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (62us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531973.736715:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44684
00000100:00100000:1.0:1651531973.737044:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531973.737062:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467656832
00000100:00100000:0.0:1651531973.737072:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250392
00000100:00100000:0.0:1651531973.737083:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dccc50c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467656832:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531973.737091:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca4849 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.737095:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531973.737095:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531973.737096:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca4849 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [438272->442367] (req 438272->442367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.737100:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca4849 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [438272->442367] (req 438272->442367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.737111:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca4849 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [438272->442367] (req 438272->442367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.737114:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca4849 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [438272->442367] (req 438272->442367) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.737133:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca4849 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [438272->442367] (req 438272->442367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531973.737134:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dccc50c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467656832:12345-10.240.43.64@tcp:3:fio.0 Request processed in 50us (91us total) trans 0 rc 4096/4096
00010000:00010000:1.0:1651531973.737137:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fab23815 already unused, calling callback (0000000049fddea7)
00000100:00100000:0.0:1651531973.737137:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250392
00010000:00010000:1.0:1651531973.737138:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca4849 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [438272->442367] (req 438272->442367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.737141:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca4849 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [438272->442367] (req 438272->442367) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.737146:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca4849 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [438272->442367] (req 438272->442367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.737149:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca4849 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [438272->442367] (req 438272->442367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531973.737425:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531973.737432:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467656960
00000100:00100000:1.0:1651531973.737444:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44685
00000100:00100000:1.0:1651531973.737446:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dce6a2c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467656960:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531973.737449:0:206699:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531973.737453:0:206699:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca4850 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446361 expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.737460:0:206699:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca4850 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446361 expref: 9 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531973.737464:0:206699:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca4850 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446361 expref: 9 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531973.737467:0:206699:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d44eb74d, rc 0)
00000100:00100000:1.0:1651531973.737479:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dce6a2c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467656960:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (55us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531973.737481:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44685
00000100:00100000:1.0:1651531973.737783:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531973.737801:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467657088
00000100:00100000:0.0:1651531973.737811:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250393
00000100:00100000:0.0:1651531973.737813:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000be87d738 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467657088:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531973.737820:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca4857 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.737824:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531973.737834:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531973.737835:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca4857 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [671744->675839] (req 671744->675839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.737839:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca4857 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [671744->675839] (req 671744->675839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.737851:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca4857 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [671744->675839] (req 671744->675839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.737854:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca4857 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [671744->675839] (req 671744->675839) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.737873:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca4857 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [671744->675839] (req 671744->675839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531973.737874:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000be87d738 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467657088:12345-10.240.43.64@tcp:3:fio.0 Request processed in 60us (92us total) trans 0 rc 4096/4096
00010000:00010000:1.0:1651531973.737877:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f968d777 already unused, calling callback (0000000049fddea7)
00000100:00100000:0.0:1651531973.737877:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250393
00010000:00010000:1.0:1651531973.737878:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca4857 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [671744->675839] (req 671744->675839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.737881:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca4857 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [671744->675839] (req 671744->675839) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.737886:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca4857 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [671744->675839] (req 671744->675839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.737891:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca4857 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [671744->675839] (req 671744->675839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531973.738165:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531973.738176:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467657216
00000100:00100000:0.0:1651531973.738186:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250394
00000100:00100000:0.0:1651531973.738188:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002512e905 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467657216:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531973.738194:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca485e lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.738198:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531973.738199:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531973.738199:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca485e lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [536576->540671] (req 536576->540671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.738203:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca485e lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [536576->540671] (req 536576->540671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531973.770415:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531973.770446:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467657344
00000100:00100000:1.0:1651531973.770458:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44686
00000100:00100000:1.0:1651531973.770459:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000053de45f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754467657344:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531973.770463:0:206699:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531973.770467:0:206699:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca4865 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44636f expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.770474:0:206699:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca4865 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44636f expref: 12 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531973.770479:0:206699:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca4865 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44636f expref: 12 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531973.770482:0:206699:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d44eb74d, rc 0)
00000100:00100000:1.0:1651531973.770494:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000053de45f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754467657344:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (80us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531973.770496:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44686
00000100:00100000:0.0:1651531973.771207:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531973.771240:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467657600
00000100:00100000:1.0:1651531973.771252:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44687
00000100:00100000:1.0:1651531973.771254:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000e33e11e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754467657600:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531973.771258:0:206699:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531973.771270:0:206699:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca486c lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44637d expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.771278:0:206699:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca486c lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44637d expref: 12 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531973.771282:0:206699:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca486c lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44637d expref: 12 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531973.771285:0:206699:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006da7a892, rc 0)
00000100:00100000:1.0:1651531973.771296:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000e33e11e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754467657600:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (89us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531973.771298:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44687
00000100:00100000:0.0:1651531973.771963:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531973.771981:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467657856
00000100:00100000:1.0:1651531973.771994:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44688
00000100:00100000:1.0:1651531973.771995:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000021f31110 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754467657856:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531973.771999:0:206699:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531973.772002:0:206699:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4873 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44638b expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.772009:0:206699:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4873 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44638b expref: 12 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531973.772013:0:206699:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4873 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44638b expref: 12 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531973.772017:0:206699:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c2b76533, rc 0)
00000100:00100000:1.0:1651531973.772036:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000021f31110 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754467657856:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (74us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531973.772039:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44688
00000100:00100000:0.0:1651531973.772344:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531973.772352:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467657984
00000100:00100000:0.0:1651531973.772368:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250395
00000100:00100000:0.0:1651531973.772370:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003158b8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754467657984:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531973.772378:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca487a lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.772382:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531973.772383:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531973.772384:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca487a lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [385024->389119] (req 385024->389119) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.772388:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca487a lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [385024->389119] (req 385024->389119) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.772399:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca487a lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [385024->389119] (req 385024->389119) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.772402:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca487a lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [385024->389119] (req 385024->389119) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531973.772423:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003158b8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754467657984:12345-10.240.43.64@tcp:3:fio.0 Request processed in 52us (79us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531973.772425:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250395
00010000:00010000:0.0:1651531973.772441:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca487a lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [385024->389119] (req 385024->389119) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.772445:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e2ec18e1 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531973.772446:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca487a lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [385024->389119] (req 385024->389119) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.772449:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca487a lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [385024->389119] (req 385024->389119) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.772454:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca487a lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [385024->389119] (req 385024->389119) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.772457:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca487a lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [385024->389119] (req 385024->389119) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531973.772702:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531973.772709:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467658112
00000100:00100000:0.0:1651531973.772724:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250396
00000100:00100000:0.0:1651531973.772726:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000000615301 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754467658112:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531973.772732:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca4881 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.772736:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531973.772737:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531973.772738:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca4881 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [274432->278527] (req 274432->278527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.772742:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca4881 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [274432->278527] (req 274432->278527) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531973.842872:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869400 is committed
00010000:00010000:1.0:1651531973.842906:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca481f lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [913408->917503] (req 913408->917503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.842911:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca481f lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [913408->917503] (req 913408->917503) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.842923:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca485e lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [536576->540671] (req 536576->540671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531973.842927:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cc11a3b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438146:x1731754467655808:12345-10.240.43.64@tcp:4:fio.0 Request processed in 108334us (108372us total) trans 21474869399 rc 0/0
00010000:00010000:0.0:1651531973.842927:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca485e lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [536576->540671] (req 536576->540671) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531973.842931:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250389
00010000:00010000:1.0:1651531973.842945:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca481f lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [913408->917503] (req 913408->917503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531973.842945:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002512e905 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467657216:12345-10.240.43.64@tcp:4:fio.0 Request processed in 104757us (104780us total) trans 21474869400 rc 0/0
00010000:00010000:1.0:1651531973.842948:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a8889a80 already unused, calling callback (0000000049fddea7)
00000100:00100000:0.0:1651531973.842948:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250394
00010000:00010000:1.0:1651531973.842949:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca481f lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [913408->917503] (req 913408->917503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.842952:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca481f lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [913408->917503] (req 913408->917503) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.842957:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca481f lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [913408->917503] (req 913408->917503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.842970:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca481f lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [913408->917503] (req 913408->917503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.842974:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca485e lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [536576->540671] (req 536576->540671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.842987:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000820577fb already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531973.842988:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca485e lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [536576->540671] (req 536576->540671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.842991:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca485e lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [536576->540671] (req 536576->540671) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.842995:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca485e lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [536576->540671] (req 536576->540671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.842997:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca485e lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [536576->540671] (req 536576->540671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531973.843032:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531973.843059:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467658240
00000100:00100000:0.0:1651531973.843074:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250397
00000100:00100000:0.0:1651531973.843076:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d710c5fd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467658240:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531973.843083:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4888 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.843087:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531973.843088:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531973.843089:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4888 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [413696->417791] (req 413696->417791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.843093:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4888 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [413696->417791] (req 413696->417791) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531973.843308:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531973.843321:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531973.843327:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467658432
00000100:00100000:0.0:1651531973.843329:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467658496
00000100:00100000:1.0:1651531973.843337:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44689
00000100:00100000:1.0:1651531973.843338:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006c46ca95 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438147:x1731754467658432:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531973.843342:0:206699:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531973.843346:0:206699:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca488f lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4463a0 expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531973.843347:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44690
00000100:00100000:0.0:1651531973.843349:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005dd15341 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754467658496:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531973.843352:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531973.843353:0:206699:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca488f lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4463a0 expref: 13 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531973.843356:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca4896 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4463a7 expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.843357:0:206699:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca488f lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4463a0 expref: 13 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531973.843365:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca4896 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4463a7 expref: 14 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531973.843369:0:166111:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca4896 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4463a7 expref: 14 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531973.843373:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fb2f6575, rc 0)
00010000:00010000:1.0:1651531973.843374:0:206699:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c2b76533, rc 0)
00000100:00100000:0.0:1651531973.843386:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005dd15341 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754467658496:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (65us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531973.843389:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44690
00000100:00100000:1.0:1651531973.843391:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006c46ca95 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754467658432:12345-10.240.43.64@tcp:101:fio.0 Request processed in 51us (83us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531973.843394:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44689
00000100:00100000:0.0:1651531973.844360:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531973.844379:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467658880
00000100:00100000:1.0:1651531973.844391:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250398
00000100:00100000:1.0:1651531973.844392:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c65d6bc4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754467658880:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531973.844399:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca489d lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.844403:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531973.844404:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531973.844405:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca489d lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [679936->684031] (req 679936->684031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.844409:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca489d lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [679936->684031] (req 679936->684031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.844421:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca489d lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [679936->684031] (req 679936->684031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.844425:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca489d lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [679936->684031] (req 679936->684031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.844445:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca489d lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [679936->684031] (req 679936->684031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531973.844446:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c65d6bc4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754467658880:12345-10.240.43.64@tcp:3:fio.0 Request processed in 53us (86us total) trans 0 rc 4096/4096
00010000:00010000:0.0:1651531973.844449:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006da7a892 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531973.844451:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca489d lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [679936->684031] (req 679936->684031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.844454:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca489d lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [679936->684031] (req 679936->684031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531973.844459:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250398
00010000:00010000:0.0:1651531973.844459:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca489d lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [679936->684031] (req 679936->684031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.844471:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca489d lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [679936->684031] (req 679936->684031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531973.844929:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531973.844936:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467659200
00000100:00100000:0.0:1651531973.844949:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44691
00000100:00100000:0.0:1651531973.844951:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ecb6b3b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754467659200:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531973.844954:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531973.844958:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca48a4 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4463b5 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.844966:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca48a4 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4463b5 expref: 12 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531973.844970:0:166112:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca48a4 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4463b5 expref: 12 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531973.844973:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000014685f38, rc 0)
00000100:00100000:0.0:1651531973.844987:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ecb6b3b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754467659200:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (59us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531973.844990:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44691
00000001:00080000:0.0:1651531973.915757:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869401 is committed
00010000:00010000:0.0:1651531973.915801:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca4881 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [274432->278527] (req 274432->278527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.915806:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca4881 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [274432->278527] (req 274432->278527) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531973.915836:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000000615301 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467658112:12345-10.240.43.64@tcp:4:fio.0 Request processed in 143109us (143134us total) trans 21474869401 rc 0/0
00010000:00010000:1.0:1651531973.915839:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca4881 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [274432->278527] (req 274432->278527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531973.915840:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250396
00010000:00010000:1.0:1651531973.915852:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f765708a already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531973.915854:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca4881 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [274432->278527] (req 274432->278527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.915857:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca4881 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [274432->278527] (req 274432->278527) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.915863:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca4881 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [274432->278527] (req 274432->278527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.915865:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca4881 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [274432->278527] (req 274432->278527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531973.916250:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531973.916261:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467659712
00000100:00100000:0.0:1651531973.916278:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250399
00000100:00100000:0.0:1651531973.916280:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000374facb9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467659712:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531973.916287:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca48ab lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.916291:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531973.916292:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531973.916293:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca48ab lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [122880->126975] (req 122880->126975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.916297:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca48ab lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [122880->126975] (req 122880->126975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531973.952824:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531973.952832:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467659840
00000100:00100000:0.0:1651531973.952846:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44692
00000100:00100000:0.0:1651531973.952848:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002bf85ab5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754467659840:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531973.952852:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531973.952856:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca48b2 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4463c3 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.952864:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca48b2 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4463c3 expref: 12 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531973.952878:0:166112:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca48b2 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4463c3 expref: 12 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531973.952882:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fb2f6575, rc 0)
00000100:00100000:0.0:1651531973.952897:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002bf85ab5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754467659840:12345-10.240.43.64@tcp:101:fio.0 Request processed in 48us (74us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531973.952900:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44692
00000100:00100000:0.0:1651531973.953300:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531973.953322:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467659968
00000100:00100000:1.0:1651531973.953335:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250400
00000100:00100000:1.0:1651531973.953337:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000065be21ea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754467659968:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531973.953345:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca48b9 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.953350:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531973.953350:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531973.953351:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca48b9 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [1007616->1011711] (req 1007616->1011711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.953368:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca48b9 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [1007616->1011711] (req 1007616->1011711) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.953381:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca48b9 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [1007616->1011711] (req 1007616->1011711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.953384:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca48b9 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [1007616->1011711] (req 1007616->1011711) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.953404:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca48b9 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [1007616->1011711] (req 1007616->1011711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531973.953405:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000065be21ea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754467659968:12345-10.240.43.64@tcp:3:fio.0 Request processed in 67us (105us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531973.953408:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250400
00010000:00010000:0.0:1651531973.953408:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c2b76533 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531973.953409:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca48b9 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [1007616->1011711] (req 1007616->1011711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.953412:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca48b9 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [1007616->1011711] (req 1007616->1011711) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.953418:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca48b9 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [1007616->1011711] (req 1007616->1011711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.953420:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca48b9 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [1007616->1011711] (req 1007616->1011711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531973.953741:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531973.953749:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467660096
00000100:00100000:0.0:1651531973.953764:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44693
00000100:00100000:0.0:1651531973.953766:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d65563cf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754467660096:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531973.953770:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531973.953773:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca48c0 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4463d1 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.953781:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca48c0 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4463d1 expref: 12 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531973.953785:0:166112:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca48c0 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4463d1 expref: 12 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531973.953788:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000775318ab, rc 0)
00000100:00100000:0.0:1651531973.953803:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d65563cf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754467660096:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (62us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531973.953805:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44693
00000100:00100000:0.0:1651531973.954114:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531973.954136:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467660224
00000100:00100000:1.0:1651531973.954148:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250401
00000100:00100000:1.0:1651531973.954149:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000481279c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754467660224:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531973.954156:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca48c7 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.954161:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531973.954161:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531973.954162:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca48c7 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [409600->413695] (req 409600->413695) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.954166:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca48c7 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [409600->413695] (req 409600->413695) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.954177:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca48c7 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [409600->413695] (req 409600->413695) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.954182:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca48c7 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [409600->413695] (req 409600->413695) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531973.954196:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000481279c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754467660224:12345-10.240.43.64@tcp:3:fio.0 Request processed in 46us (83us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531973.954199:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250401
00010000:00010000:1.0:1651531973.954205:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca48c7 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [409600->413695] (req 409600->413695) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.954208:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a8889a80 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531973.954209:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca48c7 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [409600->413695] (req 409600->413695) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.954212:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca48c7 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [409600->413695] (req 409600->413695) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.954242:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca48c7 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [409600->413695] (req 409600->413695) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.954245:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca48c7 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [409600->413695] (req 409600->413695) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531973.954552:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531973.954572:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467660352
00000100:00100000:1.0:1651531973.954582:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250402
00000100:00100000:1.0:1651531973.954584:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000991d4dbd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754467660352:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531973.954590:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca48ce lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.954595:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531973.954596:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531973.954597:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca48ce lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [684032->688127] (req 684032->688127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.954601:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca48ce lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [684032->688127] (req 684032->688127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531973.963513:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869402 is committed
00010000:00010000:1.0:1651531973.963551:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4888 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [413696->417791] (req 413696->417791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.963555:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4888 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [413696->417791] (req 413696->417791) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531973.963571:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d710c5fd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754467658240:12345-10.240.43.64@tcp:4:fio.0 Request processed in 120495us (120540us total) trans 21474869402 rc 0/0
00000100:00100000:1.0:1651531973.963574:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250397
00010000:00010000:1.0:1651531973.963581:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4888 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [413696->417791] (req 413696->417791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.963585:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e2ec18e1 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531973.963586:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4888 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [413696->417791] (req 413696->417791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.963589:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4888 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [413696->417791] (req 413696->417791) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.963594:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4888 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [413696->417791] (req 413696->417791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.963598:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4888 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [413696->417791] (req 413696->417791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531973.963972:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531973.963980:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467660480
00000100:00100000:0.0:1651531973.963994:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44694
00000100:00100000:0.0:1651531973.963996:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009af72390 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754467660480:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531973.964000:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531973.964004:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca48d5 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4463df expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531973.964024:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca48d5 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4463df expref: 12 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531973.964028:0:166112:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca48d5 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4463df expref: 12 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531973.964032:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000775318ab, rc 0)
00000100:00100000:0.0:1651531973.964047:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009af72390 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754467660480:12345-10.240.43.64@tcp:101:fio.0 Request processed in 50us (75us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531973.964049:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44694
00000100:00100000:0.0:1651531973.964776:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531973.964789:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467660736
00000100:00100000:1.0:1651531973.964802:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250403
00000100:00100000:1.0:1651531973.964804:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000006f627e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754467660736:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531973.964811:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca48dc lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.964816:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531973.964816:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531973.964817:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca48dc lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [241664->245759] (req 241664->245759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531973.964821:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca48dc lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [241664->245759] (req 241664->245759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531974.001910:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531974.001919:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467660864
00000100:00100000:1.0:1651531974.001936:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250404
00000100:00100000:1.0:1651531974.001938:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002ef35a72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754467660864:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531974.001945:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca48e3 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.001950:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531974.001950:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531974.001951:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca48e3 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [647168->651263] (req 647168->651263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.001957:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca48e3 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [647168->651263] (req 647168->651263) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531974.002002:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869404 is committed
00002000:00010000:1.0:1651531974.002037:0:166118:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x34545:0x0] updating lvb mtime from disk: 1651531973 -> 1651531974
00002000:00010000:1.0:1651531974.002039:0:166118:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x34545:0x0] updating lvb ctime from disk: 1651531973 -> 1651531974
00010000:00010000:1.0:1651531974.002041:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca48ce lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [684032->688127] (req 684032->688127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.002045:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca48ce lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [684032->688127] (req 684032->688127) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531974.002065:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000991d4dbd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754467660352:12345-10.240.43.64@tcp:4:fio.0 Request processed in 47480us (47513us total) trans 21474869404 rc 0/0
00000100:00100000:1.0:1651531974.002068:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250402
00010000:00010000:0.0:1651531974.002068:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca48ce lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [684032->688127] (req 684032->688127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.002073:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d44eb74d already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531974.002074:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca48ce lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [684032->688127] (req 684032->688127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.002077:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca48ce lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [684032->688127] (req 684032->688127) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.002084:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca48ab lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [122880->126975] (req 122880->126975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.002088:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca48ab lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [122880->126975] (req 122880->126975) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.002091:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca48ce lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [684032->688127] (req 684032->688127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.002094:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca48ce lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [684032->688127] (req 684032->688127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.002106:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca48ab lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [122880->126975] (req 122880->126975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.002109:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000014685f38 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531974.002110:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca48ab lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [122880->126975] (req 122880->126975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.002113:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca48ab lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [122880->126975] (req 122880->126975) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.002117:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca48ab lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [122880->126975] (req 122880->126975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.002119:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca48ab lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [122880->126975] (req 122880->126975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531974.002126:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000374facb9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754467659712:12345-10.240.43.64@tcp:4:fio.0 Request processed in 85818us (85850us total) trans 21474869403 rc 0/0
00000100:00100000:1.0:1651531974.002130:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250399
00000100:00100000:1.0:1651531974.002589:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531974.002602:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531974.002608:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467660992
00000100:00100000:1.0:1651531974.002610:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467661120
00000100:00100000:0.0:1651531974.002618:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44695
00000100:00100000:0.0:1651531974.002620:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001304ce4c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754467660992:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531974.002623:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651531974.002630:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44696
00000100:00100000:1.0:1651531974.002632:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000063869776 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438149:x1731754467661120:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531974.002633:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca48ea lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4463ed expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.002635:0:206699:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531974.002640:0:206699:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca48f1 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4463fb expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.002641:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca48ea lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4463ed expref: 13 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531974.002645:0:166112:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca48ea lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4463ed expref: 14 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531974.002649:0:206699:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca48f1 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4463fb expref: 14 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531974.002653:0:206699:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca48f1 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4463fb expref: 14 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531974.002657:0:206699:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e9b84540, rc 0)
00010000:00010000:0.0:1651531974.002658:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000775318ab, rc 0)
00000100:00100000:1.0:1651531974.002669:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000063869776 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438149:x1731754467661120:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (66us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531974.002672:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44696
00000100:00100000:0.0:1651531974.002674:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001304ce4c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438149:x1731754467660992:12345-10.240.43.64@tcp:101:fio.0 Request processed in 53us (85us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531974.002677:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44695
00000100:00100000:1.0:1651531974.003161:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531974.003169:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467661312
00000100:00100000:1.0:1651531974.003178:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250405
00000100:00100000:1.0:1651531974.003180:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009b569a7a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754467661312:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531974.003187:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca48f8 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.003191:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531974.003191:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531974.003192:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca48f8 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [151552->155647] (req 151552->155647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.003209:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca48f8 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [151552->155647] (req 151552->155647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.003246:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca48f8 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [151552->155647] (req 151552->155647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.003250:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca48f8 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [151552->155647] (req 151552->155647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531974.003270:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009b569a7a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754467661312:12345-10.240.43.64@tcp:3:fio.0 Request processed in 89us (109us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531974.003273:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250405
00010000:00010000:1.0:1651531974.003280:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca48f8 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [151552->155647] (req 151552->155647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.003283:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c2b76533 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531974.003284:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca48f8 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [151552->155647] (req 151552->155647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.003287:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca48f8 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [151552->155647] (req 151552->155647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.003292:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca48f8 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [151552->155647] (req 151552->155647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.003295:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca48f8 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [151552->155647] (req 151552->155647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531974.003681:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531974.003699:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467661632
00000100:00100000:0.0:1651531974.003716:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250406
00000100:00100000:0.0:1651531974.003718:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000052213cb9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754467661632:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531974.003725:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca48ff lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.003730:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531974.003731:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531974.003731:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca48ff lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [389120->393215] (req 389120->393215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.003736:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca48ff lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [389120->393215] (req 389120->393215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.003750:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca48ff lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [389120->393215] (req 389120->393215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.003753:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca48ff lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [389120->393215] (req 389120->393215) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531974.003769:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000052213cb9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754467661632:12345-10.240.43.64@tcp:3:fio.0 Request processed in 50us (89us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531974.003783:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250406
00010000:00010000:0.0:1651531974.003790:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca48ff lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [389120->393215] (req 389120->393215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.003794:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fb2f6575 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531974.003795:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca48ff lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [389120->393215] (req 389120->393215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.003798:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca48ff lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [389120->393215] (req 389120->393215) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.003803:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca48ff lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [389120->393215] (req 389120->393215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.003806:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca48ff lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [389120->393215] (req 389120->393215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531974.037675:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869406 is committed
00010000:00010000:1.0:1651531974.037707:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca48e3 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [647168->651263] (req 647168->651263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.037711:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca48e3 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [647168->651263] (req 647168->651263) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531974.037727:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002ef35a72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438147:x1731754467660864:12345-10.240.43.64@tcp:4:fio.0 Request processed in 35788us (35818us total) trans 21474869406 rc 0/0
00000100:00100000:1.0:1651531974.037730:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250404
00010000:00010000:1.0:1651531974.037737:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca48e3 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [647168->651263] (req 647168->651263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.037740:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000968553c1 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531974.037741:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca48e3 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [647168->651263] (req 647168->651263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.037744:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca48e3 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [647168->651263] (req 647168->651263) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.037749:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca48e3 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [647168->651263] (req 647168->651263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.037752:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca48e3 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [647168->651263] (req 647168->651263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.037761:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca48dc lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [241664->245759] (req 241664->245759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.037773:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca48dc lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [241664->245759] (req 241664->245759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531974.037786:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000006f627e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438148:x1731754467660736:12345-10.240.43.64@tcp:4:fio.0 Request processed in 72981us (73010us total) trans 21474869405 rc 0/0
00000100:00100000:1.0:1651531974.037788:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250403
00010000:00010000:1.0:1651531974.037794:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca48dc lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [241664->245759] (req 241664->245759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.037797:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a8889a80 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531974.037798:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca48dc lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [241664->245759] (req 241664->245759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.037801:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca48dc lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [241664->245759] (req 241664->245759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.037805:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca48dc lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [241664->245759] (req 241664->245759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.037808:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca48dc lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [241664->245759] (req 241664->245759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531974.038128:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531974.038147:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467662336
00000100:00100000:1.0:1651531974.038155:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44697
00000100:00100000:1.0:1651531974.038157:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006bce4824 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438146:x1731754467662336:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531974.038161:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531974.038174:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4906 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446409 expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651531974.038179:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34545:0x0] initial LVB size: 6291456, mtime: 0x627060c6, atime: 0x627060b4, ctime: 0x627060c6, blocks: 0x3000
00010000:00010000:1.0:1651531974.038184:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531974.038184:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531974.038186:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4906 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446409 expref: 6 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531974.038191:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4906 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446409 expref: 6 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531974.038195:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c2b76533, rc 0)
00000100:00100000:1.0:1651531974.038206:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006bce4824 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438146:x1731754467662336:12345-10.240.43.64@tcp:101:fio.0 Request processed in 48us (79us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531974.038209:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44697
00000100:00100000:0.0:1651531974.049830:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531974.049851:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467662912
00000100:00100000:1.0:1651531974.049862:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250407
00000100:00100000:1.0:1651531974.049864:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000083fa1d86 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438148:x1731754467662912:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531974.049871:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca490d lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.049875:0:192754:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4906 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446409 expref: 6 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531974.049879:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531974.049879:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531974.049880:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca490d lrc: 4/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [540672->544767] (req 540672->544767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.049889:0:192754:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4906 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446409 expref: 6 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531974.049893:0:192754:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4906 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446409 expref: 6 pid: 166111 timeout: 22782 lvb_type: 1
00000100:00100000:1.0:1651531974.049897:0:192754:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000054ed0749 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_005:lustre-OST0001_UUID:192754:1731745997358144:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531974.049910:0:192754:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fd6047a1 going to sleep for 6 seconds
00000100:00100000:0.0:1651531974.050160:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531974.050168:0:166104:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467662976
00000100:00100000:1.0:1651531974.050172:0:192754:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000054ed0749 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_005:lustre-OST0001_UUID:192754:1731745997358144:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651531974.050174:0:166104:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4906 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446409 expref: 7 pid: 166111 timeout: 22782 lvb_type: 1
00010000:00010000:1.0:1651531974.050177:0:192754:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca490d lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [540672->544767] (req 540672->544767) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531974.050183:0:166104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 245
00000100:00100000:0.0:1651531974.050185:0:166104:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000097ff3001 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438147:x1731754467662976:12345-10.240.43.64@tcp:103:ldlm_bl_01.0
00010000:00010000:0.0:1651531974.050198:0:166104:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531974.050203:0:166104:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4906 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446409 expref: 7 pid: 166111 timeout: 22782 lvb_type: 1
00010000:00010000:0.0:1651531974.050207:0:166104:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4906 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446409 expref: 7 pid: 166111 timeout: 22782 lvb_type: 1
00010000:00010000:0.0:1651531974.050237:0:166104:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4906 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446409 expref: 7 pid: 166111 timeout: 22782 lvb_type: 1
00010000:00010000:0.0:1651531974.050241:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531974.050242:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531974.050243:0:166104:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca490d lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [540672->544767] (req 540672->544767) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.050246:0:166104:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca490d lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [540672->544767] (req 540672->544767) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.050258:0:166104:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651531974.050268:0:166104:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000097ff3001 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438147:x1731754467662976:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 82us (108us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531974.050270:0:166104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 245
00010000:00010000:1.0:1651531974.050271:0:192754:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca490d lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [540672->544767] (req 540672->544767) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.050275:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca490d lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [540672->544767] (req 540672->544767) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531974.091184:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869407 is committed
00010000:00010000:1.0:1651531974.091242:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca490d lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [540672->544767] (req 540672->544767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.091249:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca490d lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [540672->544767] (req 540672->544767) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531974.091271:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000083fa1d86 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438148:x1731754467662912:12345-10.240.43.64@tcp:4:fio.0 Request processed in 41406us (41441us total) trans 21474869407 rc 0/0
00010000:00010000:0.0:1651531974.091273:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca490d lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [540672->544767] (req 540672->544767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531974.091278:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250407
00010000:00010000:0.0:1651531974.091278:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a8889a80 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531974.091279:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca490d lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [540672->544767] (req 540672->544767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.091291:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca490d lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [540672->544767] (req 540672->544767) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.091297:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca490d lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [540672->544767] (req 540672->544767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.091300:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca490d lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [540672->544767] (req 540672->544767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531974.091539:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531974.091548:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467663296
00000100:00100000:1.0:1651531974.091559:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250408
00000100:00100000:1.0:1651531974.091561:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000054ed0749 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438148:x1731754467663296:12345-10.240.43.64@tcp:4:fio.0
00002000:00010000:1.0:1651531974.091571:0:192754:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34545:0x0] initial LVB size: 6291456, mtime: 0x627060c6, atime: 0x627060b4, ctime: 0x627060c6, blocks: 0x3000
00010000:00010000:1.0:1651531974.091573:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4914 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.091577:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531974.091578:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531974.091579:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4914 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [978944->983039] (req 978944->983039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.091584:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4914 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [978944->983039] (req 978944->983039) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531974.091663:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531974.091671:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467663424
00000100:00100000:1.0:1651531974.091679:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44698
00000100:00100000:1.0:1651531974.091680:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467663424:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531974.091684:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531974.091700:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca491b lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446417 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.091709:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca491b lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446417 expref: 9 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531974.091719:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca491b lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446417 expref: 9 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531974.091722:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e9b84540, rc 0)
00000100:00100000:1.0:1651531974.091733:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467663424:12345-10.240.43.64@tcp:101:fio.0 Request processed in 52us (71us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531974.091747:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44698
00000001:00080000:0.0:1651531974.126627:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869408 is committed
00010000:00010000:1.0:1651531974.126659:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4914 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [978944->983039] (req 978944->983039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.126663:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4914 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [978944->983039] (req 978944->983039) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531974.126679:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000054ed0749 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438148:x1731754467663296:12345-10.240.43.64@tcp:4:fio.0 Request processed in 35117us (35141us total) trans 21474869408 rc 0/0
00000100:00100000:1.0:1651531974.126682:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250408
00010000:00010000:1.0:1651531974.126689:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4914 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [978944->983039] (req 978944->983039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.126693:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000968553c1 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531974.126694:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4914 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [978944->983039] (req 978944->983039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.126697:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4914 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [978944->983039] (req 978944->983039) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.126705:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4914 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [978944->983039] (req 978944->983039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.126708:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4914 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [978944->983039] (req 978944->983039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531974.127058:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531974.127066:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467663744
00000100:00100000:1.0:1651531974.127079:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44699
00000100:00100000:1.0:1651531974.127081:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000567318ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438148:x1731754467663744:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531974.127085:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531974.127089:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca4922 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446425 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651531974.127094:0:166113:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34545:0x0] initial LVB size: 6291456, mtime: 0x627060c6, atime: 0x627060b4, ctime: 0x627060c6, blocks: 0x3000
00010000:00010000:1.0:1651531974.127099:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531974.127099:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531974.127101:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca4922 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446425 expref: 6 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531974.127106:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca4922 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446425 expref: 6 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531974.127110:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e9b84540, rc 0)
00000100:00100000:1.0:1651531974.127120:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000567318ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438148:x1731754467663744:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (62us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531974.127125:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44699
00000100:00100000:1.0:1651531974.127497:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531974.127505:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467663872
00000100:00100000:1.0:1651531974.127515:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250409
00000100:00100000:1.0:1651531974.127516:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c43262d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467663872:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531974.127524:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4929 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.127528:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531974.127528:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531974.127529:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4929 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.127533:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4929 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.127545:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4929 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.127548:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4929 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531974.127562:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c43262d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467663872:12345-10.240.43.64@tcp:3:fio.0 Request processed in 45us (66us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531974.127565:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250409
00010000:00010000:1.0:1651531974.127571:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4929 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.127578:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006da7a892 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531974.127579:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4929 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.127582:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4929 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.127587:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4929 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.127589:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4929 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531974.127951:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531974.127959:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467664000
00000100:00100000:1.0:1651531974.127968:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250410
00000100:00100000:1.0:1651531974.127970:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009acffcb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467664000:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531974.127976:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4930 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.127981:0:216321:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca4922 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446425 expref: 6 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531974.127984:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531974.127985:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531974.127986:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4930 lrc: 4/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [106496->110591] (req 106496->110591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.127996:0:216321:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca4922 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446425 expref: 6 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531974.128000:0:216321:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca4922 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446425 expref: 6 pid: 166113 timeout: 22782 lvb_type: 1
00000100:00100000:1.0:1651531974.128005:0:216321:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d9e74b4c pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997358208:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531974.128016:0:216321:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fd6047a1 going to sleep for 6 seconds
00000100:00100000:1.0:1651531974.128259:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531974.128274:0:216321:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d9e74b4c pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997358208:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651531974.128279:0:216321:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4930 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [106496->110591] (req 106496->110591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531974.128282:0:166104:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467664064
00010000:00010000:0.0:1651531974.128291:0:166104:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca4922 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446425 expref: 7 pid: 166113 timeout: 22782 lvb_type: 1
00000100:00100000:0.0:1651531974.128302:0:166104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 246
00000100:00100000:0.0:1651531974.128304:0:166104:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009254777a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438146:x1731754467664064:12345-10.240.43.64@tcp:103:ldlm_bl_04.0
00010000:00010000:0.0:1651531974.128308:0:166104:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531974.128312:0:166104:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca4922 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446425 expref: 7 pid: 166113 timeout: 22782 lvb_type: 1
00010000:00010000:0.0:1651531974.128317:0:166104:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca4922 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446425 expref: 7 pid: 166113 timeout: 22782 lvb_type: 1
00010000:00010000:0.0:1651531974.128323:0:166104:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca4922 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446425 expref: 7 pid: 166113 timeout: 22782 lvb_type: 1
00010000:00010000:0.0:1651531974.128339:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531974.128340:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531974.128341:0:166104:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4930 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [106496->110591] (req 106496->110591) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.128344:0:166104:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4930 lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [106496->110591] (req 106496->110591) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.128355:0:166104:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1651531974.128364:0:216321:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4930 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [106496->110591] (req 106496->110591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531974.128369:0:166104:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009254777a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438146:x1731754467664064:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 64us (111us total) trans 0 rc 0/0
00010000:00010000:1.0:1651531974.128372:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4930 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [106496->110591] (req 106496->110591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531974.128372:0:166104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 246
00000100:00100000:1.0:1651531974.138649:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531974.138658:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467664256
00000100:00100000:1.0:1651531974.138673:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250411
00000100:00100000:1.0:1651531974.138675:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d9e74b4c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467664256:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531974.138683:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4937 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.138690:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531974.138691:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531974.138692:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4937 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [507904->511999] (req 507904->511999) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.138696:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4937 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [507904->511999] (req 507904->511999) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531974.179977:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869410 is committed
00010000:00010000:1.0:1651531974.180008:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4930 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [106496->110591] (req 106496->110591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.180012:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4930 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [106496->110591] (req 106496->110591) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.180031:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4930 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [106496->110591] (req 106496->110591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531974.180033:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009acffcb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467664000:12345-10.240.43.64@tcp:4:fio.0 Request processed in 52062us (52082us total) trans 21474869409 rc 0/0
00010000:00010000:0.0:1651531974.180035:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b4c8742a already unused, calling callback (0000000049fddea7)
00000100:00100000:1.0:1651531974.180036:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250410
00010000:00010000:0.0:1651531974.180037:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4930 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [106496->110591] (req 106496->110591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.180040:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4930 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [106496->110591] (req 106496->110591) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.180045:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4930 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [106496->110591] (req 106496->110591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.180048:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4937 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [507904->511999] (req 507904->511999) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.180048:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4930 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [106496->110591] (req 106496->110591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.180051:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4937 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [507904->511999] (req 507904->511999) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531974.180061:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d9e74b4c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438149:x1731754467664256:12345-10.240.43.64@tcp:4:fio.0 Request processed in 41385us (41412us total) trans 21474869410 rc 0/0
00000100:00100000:1.0:1651531974.180063:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250411
00010000:00010000:0.0:1651531974.180064:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4937 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [507904->511999] (req 507904->511999) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.180067:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006da7a892 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531974.180068:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4937 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [507904->511999] (req 507904->511999) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.180071:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4937 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [507904->511999] (req 507904->511999) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.180074:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4937 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [507904->511999] (req 507904->511999) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.180077:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4937 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [507904->511999] (req 507904->511999) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531974.180507:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531974.180517:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467664640
00000100:00100000:1.0:1651531974.180527:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250412
00000100:00100000:1.0:1651531974.180529:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003ffbc5dc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438148:x1731754467664640:12345-10.240.43.64@tcp:4:fio.0
00002000:00010000:1.0:1651531974.180537:0:192754:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34545:0x0] initial LVB size: 6291456, mtime: 0x627060c6, atime: 0x627060b4, ctime: 0x627060c6, blocks: 0x3000
00010000:00010000:1.0:1651531974.180539:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca493e lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.180543:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531974.180544:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531974.180544:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca493e lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [778240->782335] (req 778240->782335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.180548:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca493e lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [778240->782335] (req 778240->782335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531974.180701:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531974.180709:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467664960
00000100:00100000:1.0:1651531974.180732:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250413
00000100:00100000:1.0:1651531974.180733:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ffcc974c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467664960:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531974.180740:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4945 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.180744:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531974.180745:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531974.180746:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4945 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [102400->106495] (req 102400->106495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.180750:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4945 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [102400->106495] (req 102400->106495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531974.215552:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869411 is committed
00010000:00010000:1.0:1651531974.215581:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca493e lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [778240->782335] (req 778240->782335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.215585:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca493e lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [778240->782335] (req 778240->782335) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.215596:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca493e lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [778240->782335] (req 778240->782335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531974.215600:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003ffbc5dc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467664640:12345-10.240.43.64@tcp:4:fio.0 Request processed in 35071us (35093us total) trans 21474869411 rc 0/0
00010000:00010000:0.0:1651531974.215601:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000968553c1 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531974.215602:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca493e lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [778240->782335] (req 778240->782335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531974.215603:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250412
00010000:00010000:0.0:1651531974.215605:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca493e lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [778240->782335] (req 778240->782335) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.215610:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca493e lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [778240->782335] (req 778240->782335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.215622:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca493e lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [778240->782335] (req 778240->782335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531974.252956:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531974.252965:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531974.252976:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467665280
00000100:00100000:1.0:1651531974.252983:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467665344
00000100:00100000:1.0:1651531974.252987:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44700
00000100:00100000:1.0:1651531974.252989:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003562cf4d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438149:x1731754467665280:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651531974.252991:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44701
00010000:00010000:1.0:1651531974.252993:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651531974.252994:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f7006631 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438146:x1731754467665344:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531974.252997:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca494c lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44643a expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.252998:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531974.253002:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca4953 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446441 expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.253005:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca494c lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44643a expref: 10 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531974.253010:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca494c lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44643a expref: 11 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531974.253011:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca4953 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446441 expref: 11 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531974.253014:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001e36c601, rc 0)
00010000:00010000:0.0:1651531974.253016:0:166111:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca4953 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446441 expref: 10 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531974.253019:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fb2f6575, rc 0)
00000100:00100000:1.0:1651531974.253024:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003562cf4d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438149:x1731754467665280:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (69us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531974.253027:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44700
00000100:00100000:0.0:1651531974.253029:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f7006631 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467665344:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (64us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531974.253032:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44701
00000100:00100000:1.0:1651531974.253385:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531974.253404:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531974.253415:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467665472
00000100:00100000:0.0:1651531974.253416:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467665600
00000100:00100000:1.0:1651531974.253425:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250414
00000100:00100000:1.0:1651531974.253427:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a925fbf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438147:x1731754467665472:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:0.0:1651531974.253428:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250415
00000100:00100000:0.0:1651531974.253430:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006e255cae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754467665600:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531974.253434:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca495a lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.253438:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531974.253438:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca4961 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.253439:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531974.253440:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca495a lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [151552->155647] (req 151552->155647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.253444:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca495a lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [151552->155647] (req 151552->155647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.253455:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca495a lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [151552->155647] (req 151552->155647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.253458:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca495a lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [151552->155647] (req 151552->155647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.253462:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531974.253463:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531974.253464:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca4961 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [1003520->1007615] (req 1003520->1007615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.253468:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca4961 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [1003520->1007615] (req 1003520->1007615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531974.253472:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a925fbf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438147:x1731754467665472:12345-10.240.43.64@tcp:3:fio.0 Request processed in 44us (87us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531974.253475:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250414
00010000:00010000:1.0:1651531974.253481:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca495a lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [151552->155647] (req 151552->155647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.253483:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca4961 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [1003520->1007615] (req 1003520->1007615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.253487:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca4961 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [1003520->1007615] (req 1003520->1007615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.253491:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000968553c1 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531974.253492:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca495a lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [151552->155647] (req 151552->155647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.253496:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca495a lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [151552->155647] (req 151552->155647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.253500:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca495a lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [151552->155647] (req 151552->155647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531974.253502:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006e255cae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467665600:12345-10.240.43.64@tcp:3:fio.0 Request processed in 71us (98us total) trans 0 rc 4096/4096
00010000:00010000:1.0:1651531974.253503:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca495a lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [151552->155647] (req 151552->155647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531974.253505:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250415
00010000:00010000:1.0:1651531974.253507:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca4961 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [1003520->1007615] (req 1003520->1007615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.253509:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000775318ab already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531974.253510:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca4961 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [1003520->1007615] (req 1003520->1007615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.253513:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca4961 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [1003520->1007615] (req 1003520->1007615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.253516:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca4961 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [1003520->1007615] (req 1003520->1007615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.253519:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca4961 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [1003520->1007615] (req 1003520->1007615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531974.253858:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531974.253870:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467665792
00000100:00100000:1.0:1651531974.253879:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531974.253879:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44702
00000100:00100000:0.0:1651531974.253881:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000567a8eab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467665792:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531974.253885:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651531974.253888:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467665856
00010000:00010000:0.0:1651531974.253888:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca4968 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446456 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531974.253895:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44703
00010000:00010000:0.0:1651531974.253896:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca4968 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446456 expref: 10 pid: 166112 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651531974.253897:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000009c4c564 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438148:x1731754467665856:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531974.253900:0:206699:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531974.253904:0:206699:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca496f lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44645d expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.253912:0:206699:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca496f lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44645d expref: 11 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531974.253914:0:166112:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca4968 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446456 expref: 11 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531974.253916:0:206699:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca496f lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44645d expref: 11 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531974.253918:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000014685f38, rc 0)
00010000:00010000:1.0:1651531974.253920:0:206699:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006da7a892, rc 0)
00000100:00100000:0.0:1651531974.253932:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000567a8eab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438147:x1731754467665792:12345-10.240.43.64@tcp:101:fio.0 Request processed in 50us (74us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531974.253935:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44702
00000100:00100000:1.0:1651531974.253937:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000009c4c564 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754467665856:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (58us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531974.253940:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44703
00000100:00100000:1.0:1651531974.254820:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531974.254839:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467666240
00000100:00100000:0.0:1651531974.254847:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44704
00000100:00100000:0.0:1651531974.254849:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c683c211 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467666240:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531974.254852:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531974.254856:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca4976 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44646b expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.254863:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca4976 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44646b expref: 9 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531974.254867:0:166111:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca4976 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44646b expref: 9 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531974.254870:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000075a78972, rc 0)
00000100:00100000:0.0:1651531974.254886:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c683c211 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467666240:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (66us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531974.254889:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44704
00000100:00100000:1.0:1651531974.255252:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531974.255261:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467666432
00000100:00100000:0.0:1651531974.255272:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250416
00000100:00100000:0.0:1651531974.255274:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c4ea889e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467666432:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531974.255281:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca497d lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.255285:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531974.255285:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531974.255286:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca497d lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [319488->323583] (req 319488->323583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.255290:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca497d lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [319488->323583] (req 319488->323583) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.255302:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca497d lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [319488->323583] (req 319488->323583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.255305:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca497d lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [319488->323583] (req 319488->323583) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531974.255327:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c4ea889e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467666432:12345-10.240.43.64@tcp:3:fio.0 Request processed in 52us (75us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531974.255330:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250416
00010000:00010000:0.0:1651531974.255337:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca497d lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [319488->323583] (req 319488->323583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.255341:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e2ec18e1 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531974.255342:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca497d lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [319488->323583] (req 319488->323583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.255349:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca497d lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [319488->323583] (req 319488->323583) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.255354:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca497d lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [319488->323583] (req 319488->323583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.255357:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca497d lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [319488->323583] (req 319488->323583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531974.255634:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531974.255645:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467666560
00000100:00100000:0.0:1651531974.255653:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44705
00000100:00100000:0.0:1651531974.255655:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c0b460ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467666560:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531974.255658:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531974.255661:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca4984 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446479 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.255668:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca4984 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446479 expref: 9 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531974.255672:0:166112:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca4984 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446479 expref: 9 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531974.255676:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f765708a, rc 0)
00000100:00100000:0.0:1651531974.255699:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c0b460ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467666560:12345-10.240.43.64@tcp:101:fio.0 Request processed in 44us (66us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531974.255702:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44705
00000100:00100000:1.0:1651531974.256380:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531974.256397:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467666816
00000100:00100000:0.0:1651531974.256405:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44706
00000100:00100000:0.0:1651531974.256407:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003d9ef3c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467666816:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531974.256410:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531974.256413:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca498b lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446487 expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.256420:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca498b lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446487 expref: 9 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531974.256424:0:166111:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca498b lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446487 expref: 9 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531974.256427:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fb2f6575, rc 0)
00000100:00100000:0.0:1651531974.256443:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003d9ef3c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467666816:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (64us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531974.256446:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44706
00000100:00100000:1.0:1651531974.256755:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531974.256773:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467666944
00000100:00100000:0.0:1651531974.256783:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250417
00000100:00100000:0.0:1651531974.256784:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000059e5b3a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467666944:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531974.256791:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca4992 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.256795:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531974.256795:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531974.256796:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca4992 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [569344->573439] (req 569344->573439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.256805:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca4992 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [569344->573439] (req 569344->573439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.256816:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca4992 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [569344->573439] (req 569344->573439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.256819:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca4992 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [569344->573439] (req 569344->573439) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531974.256840:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000059e5b3a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467666944:12345-10.240.43.64@tcp:3:fio.0 Request processed in 55us (85us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531974.256843:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250417
00010000:00010000:0.0:1651531974.256850:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca4992 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [569344->573439] (req 569344->573439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.256853:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000820577fb already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531974.256855:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca4992 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [569344->573439] (req 569344->573439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.256857:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca4992 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [569344->573439] (req 569344->573439) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.256862:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca4992 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [569344->573439] (req 569344->573439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.256865:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca4992 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [569344->573439] (req 569344->573439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531974.257107:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531974.257119:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467667072
00000100:00100000:0.0:1651531974.257130:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250418
00000100:00100000:0.0:1651531974.257131:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003562cf4d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467667072:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531974.257137:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca4999 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.257141:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531974.257142:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531974.257143:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca4999 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [688128->692223] (req 688128->692223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.257146:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca4999 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [688128->692223] (req 688128->692223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531974.264580:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869412 is committed
00010000:00010000:1.0:1651531974.264610:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4945 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [102400->106495] (req 102400->106495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.264614:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4945 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [102400->106495] (req 102400->106495) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531974.264638:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ffcc974c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467664960:12345-10.240.43.64@tcp:4:fio.0 Request processed in 83903us (83937us total) trans 21474869412 rc 0/0
00000100:00100000:1.0:1651531974.264641:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250413
00010000:00010000:1.0:1651531974.264648:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4945 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [102400->106495] (req 102400->106495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.264651:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008558d1b3 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531974.264652:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4945 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [102400->106495] (req 102400->106495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.264655:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4945 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [102400->106495] (req 102400->106495) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.264660:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4945 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [102400->106495] (req 102400->106495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.264663:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4945 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [102400->106495] (req 102400->106495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531974.289561:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531974.289569:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467667328
00000100:00100000:1.0:1651531974.289584:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250419
00000100:00100000:1.0:1651531974.289585:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f7006631 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467667328:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531974.289593:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca49a0 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.289598:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531974.289598:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531974.289599:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca49a0 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [618496->622591] (req 618496->622591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.289603:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca49a0 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [618496->622591] (req 618496->622591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531974.301513:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869413 is committed
00010000:00010000:0.0:1651531974.301529:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca4999 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [688128->692223] (req 688128->692223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.301533:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca4999 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [688128->692223] (req 688128->692223) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531974.301555:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003562cf4d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467667072:12345-10.240.43.64@tcp:4:fio.0 Request processed in 44423us (44448us total) trans 21474869413 rc 0/0
00000100:00100000:0.0:1651531974.301559:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250418
00010000:00010000:0.0:1651531974.301566:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca4999 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [688128->692223] (req 688128->692223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.301574:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f968d777 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531974.301575:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca4999 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [688128->692223] (req 688128->692223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.301578:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca4999 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [688128->692223] (req 688128->692223) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.301583:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca4999 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [688128->692223] (req 688128->692223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.301586:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca4999 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [688128->692223] (req 688128->692223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531974.301937:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531974.301955:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467667456
00000100:00100000:0.0:1651531974.301967:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250420
00000100:00100000:0.0:1651531974.301969:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000315bf4eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467667456:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531974.301975:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca49a7 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.301980:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531974.301980:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531974.301981:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca49a7 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [905216->909311] (req 905216->909311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.301985:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca49a7 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [905216->909311] (req 905216->909311) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531974.314096:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531974.314117:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467667712
00000100:00100000:0.0:1651531974.314130:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250421
00000100:00100000:0.0:1651531974.314132:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a23bcd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438147:x1731754467667712:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531974.314139:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca49ae lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.314143:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531974.314143:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531974.314144:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca49ae lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [745472->749567] (req 745472->749567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.314148:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca49ae lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [745472->749567] (req 745472->749567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531974.373860:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869415 is committed
00010000:00010000:1.0:1651531974.373892:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca49a0 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [618496->622591] (req 618496->622591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.373896:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca49a0 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [618496->622591] (req 618496->622591) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531974.373915:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f7006631 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754467667328:12345-10.240.43.64@tcp:4:fio.0 Request processed in 84329us (84354us total) trans 21474869414 rc 0/0
00000100:00100000:1.0:1651531974.373918:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250419
00010000:00010000:0.0:1651531974.373918:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca49a7 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [905216->909311] (req 905216->909311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.373922:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca49a7 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [905216->909311] (req 905216->909311) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531974.373942:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000315bf4eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467667456:12345-10.240.43.64@tcp:4:fio.0 Request processed in 71972us (72006us total) trans 21474869415 rc 0/0
00000100:00100000:0.0:1651531974.373946:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250420
00010000:00010000:0.0:1651531974.373954:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca49a0 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [618496->622591] (req 618496->622591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.373957:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008558d1b3 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531974.373958:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca49a0 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [618496->622591] (req 618496->622591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.373964:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca49a0 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [618496->622591] (req 618496->622591) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.373970:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca49a0 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [618496->622591] (req 618496->622591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.373982:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca49a7 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [905216->909311] (req 905216->909311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.373986:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca49a0 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [618496->622591] (req 618496->622591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.373992:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000820577fb already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531974.373993:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca49a7 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [905216->909311] (req 905216->909311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.374000:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca49a7 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [905216->909311] (req 905216->909311) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.374005:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca49a7 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [905216->909311] (req 905216->909311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.374008:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca49a7 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [905216->909311] (req 905216->909311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531974.374458:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531974.374470:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467667968
00000100:00100000:0.0:1651531974.374484:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250422
00000100:00100000:0.0:1651531974.374486:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000033723645 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467667968:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531974.374493:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca49b5 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.374497:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531974.374497:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531974.374498:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca49b5 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [114688->118783] (req 114688->118783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.374502:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca49b5 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [114688->118783] (req 114688->118783) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531974.397659:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869416 is committed
00010000:00010000:0.0:1651531974.397702:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca49ae lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [745472->749567] (req 745472->749567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.397706:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca49ae lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [745472->749567] (req 745472->749567) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531974.397729:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a23bcd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467667712:12345-10.240.43.64@tcp:4:fio.0 Request processed in 83596us (83633us total) trans 21474869416 rc 0/0
00000100:00100000:0.0:1651531974.397732:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250421
00010000:00010000:0.0:1651531974.397739:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca49ae lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [745472->749567] (req 745472->749567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.397743:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f968d777 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531974.397744:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca49ae lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [745472->749567] (req 745472->749567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.397759:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca49ae lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [745472->749567] (req 745472->749567) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.397764:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca49ae lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [745472->749567] (req 745472->749567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.397767:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca49ae lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [745472->749567] (req 745472->749567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531974.398047:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531974.398065:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467668224
00000100:00100000:0.0:1651531974.398075:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44707
00000100:00100000:0.0:1651531974.398076:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a9fc5082 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467668224:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531974.398080:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531974.398084:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca49bc lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446495 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.398091:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca49bc lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446495 expref: 9 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531974.398097:0:166112:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca49bc lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446495 expref: 9 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531974.398100:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f765708a, rc 0)
00000100:00100000:0.0:1651531974.398118:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a9fc5082 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467668224:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (72us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531974.398121:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44707
00000100:00100000:1.0:1651531974.398459:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531974.398469:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467668352
00000100:00100000:0.0:1651531974.398484:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250423
00000100:00100000:0.0:1651531974.398486:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c62d1815 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467668352:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531974.398493:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca49c3 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.398496:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531974.398497:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531974.398498:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca49c3 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [356352->360447] (req 356352->360447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.398502:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca49c3 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [356352->360447] (req 356352->360447) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.398514:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca49c3 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [356352->360447] (req 356352->360447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.398517:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca49c3 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [356352->360447] (req 356352->360447) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531974.398542:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c62d1815 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467668352:12345-10.240.43.64@tcp:3:fio.0 Request processed in 55us (84us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531974.398545:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250423
00010000:00010000:0.0:1651531974.398552:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca49c3 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [356352->360447] (req 356352->360447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.398555:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e2ec18e1 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531974.398556:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca49c3 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [356352->360447] (req 356352->360447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.398559:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca49c3 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [356352->360447] (req 356352->360447) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.398564:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca49c3 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [356352->360447] (req 356352->360447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.398566:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca49c3 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [356352->360447] (req 356352->360447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531974.446164:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869417 is committed
00010000:00010000:1.0:1651531974.446193:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca49b5 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [114688->118783] (req 114688->118783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.446198:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca49b5 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [114688->118783] (req 114688->118783) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531974.446213:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000033723645 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438148:x1731754467667968:12345-10.240.43.64@tcp:4:fio.0 Request processed in 71726us (71755us total) trans 21474869417 rc 0/0
00000100:00100000:1.0:1651531974.446241:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250422
00010000:00010000:0.0:1651531974.446248:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca49b5 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [114688->118783] (req 114688->118783) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.446253:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fb2f6575 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531974.446254:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca49b5 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [114688->118783] (req 114688->118783) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.446261:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca49b5 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [114688->118783] (req 114688->118783) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.446266:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca49b5 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [114688->118783] (req 114688->118783) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.446269:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca49b5 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [114688->118783] (req 114688->118783) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531974.446596:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531974.446617:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467668608
00000100:00100000:0.0:1651531974.446627:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44708
00000100:00100000:0.0:1651531974.446628:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005ec1cbc3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438149:x1731754467668608:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531974.446632:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531974.446636:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca49ca lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4464a3 expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00002000:00010000:0.0:1651531974.446641:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34545:0x0] initial LVB size: 6291456, mtime: 0x627060c6, atime: 0x627060b4, ctime: 0x627060c6, blocks: 0x3000
00010000:00010000:0.0:1651531974.446646:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531974.446646:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531974.446648:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca49ca lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4464a3 expref: 6 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531974.446653:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca49ca lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4464a3 expref: 6 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531974.446657:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e2ec18e1, rc 0)
00000100:00100000:0.0:1651531974.446676:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005ec1cbc3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467668608:12345-10.240.43.64@tcp:101:fio.0 Request processed in 47us (80us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531974.446679:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44708
00000100:00100000:1.0:1651531974.447096:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531974.447104:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467668736
00000100:00100000:1.0:1651531974.447119:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250424
00000100:00100000:1.0:1651531974.447121:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b9b10d48 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438148:x1731754467668736:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531974.447131:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca49d1 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.447135:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531974.447136:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531974.447137:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca49d1 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [663552->667647] (req 663552->667647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.447141:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca49d1 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [663552->667647] (req 663552->667647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.447153:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca49d1 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [663552->667647] (req 663552->667647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.447156:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca49d1 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [663552->667647] (req 663552->667647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.447174:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca49d1 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [663552->667647] (req 663552->667647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531974.447175:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b9b10d48 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438148:x1731754467668736:12345-10.240.43.64@tcp:3:fio.0 Request processed in 53us (79us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531974.447178:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250424
00010000:00010000:0.0:1651531974.447178:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006da7a892 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531974.447179:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca49d1 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [663552->667647] (req 663552->667647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.447183:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca49d1 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [663552->667647] (req 663552->667647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.447188:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca49d1 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [663552->667647] (req 663552->667647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.447191:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca49d1 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [663552->667647] (req 663552->667647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531974.447694:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531974.447703:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467669120
00000100:00100000:1.0:1651531974.447718:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250425
00000100:00100000:1.0:1651531974.447720:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cb694635 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438148:x1731754467669120:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531974.447727:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca49d8 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.447732:0:192755:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca49ca lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4464a3 expref: 6 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531974.447738:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531974.447738:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531974.447739:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca49d8 lrc: 4/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [860160->864255] (req 860160->864255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.447746:0:192755:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca49ca lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4464a3 expref: 6 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531974.447750:0:192755:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca49ca lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4464a3 expref: 6 pid: 166111 timeout: 22783 lvb_type: 1
00000100:00100000:1.0:1651531974.447755:0:192755:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b6b1b79d pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0001_UUID:192755:1731745997358272:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531974.447767:0:192755:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fd6047a1 going to sleep for 6 seconds
00000100:00100000:1.0:1651531974.448027:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531974.448042:0:192755:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b6b1b79d pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0001_UUID:192755:1731745997358272:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531974.448045:0:166104:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467669184
00010000:00010000:1.0:1651531974.448047:0:192755:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca49d8 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [860160->864255] (req 860160->864255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.448052:0:166104:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca49ca lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4464a3 expref: 7 pid: 166111 timeout: 22783 lvb_type: 1
00000100:00100000:0.0:1651531974.448060:0:166104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 247
00000100:00100000:0.0:1651531974.448061:0:166104:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006a8dcc9d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438147:x1731754467669184:12345-10.240.43.64@tcp:103:ldlm_bl_03.0
00010000:00010000:0.0:1651531974.448065:0:166104:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531974.448068:0:166104:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca49ca lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4464a3 expref: 7 pid: 166111 timeout: 22783 lvb_type: 1
00010000:00010000:0.0:1651531974.448076:0:166104:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca49ca lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4464a3 expref: 7 pid: 166111 timeout: 22783 lvb_type: 1
00010000:00010000:0.0:1651531974.448111:0:166104:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca49ca lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4464a3 expref: 7 pid: 166111 timeout: 22783 lvb_type: 1
00010000:00010000:0.0:1651531974.448116:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531974.448117:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531974.448118:0:166104:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca49d8 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [860160->864255] (req 860160->864255) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.448121:0:166104:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca49d8 lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [860160->864255] (req 860160->864255) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.448127:0:166104:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1651531974.448131:0:192755:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca49d8 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [860160->864255] (req 860160->864255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.448135:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca49d8 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [860160->864255] (req 860160->864255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531974.448140:0:166104:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006a8dcc9d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438147:x1731754467669184:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 78us (113us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531974.448143:0:166104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 247
00000100:00100000:1.0:1651531974.448234:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531974.448288:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467669312
00000100:00100000:1.0:1651531974.448301:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44709
00000100:00100000:1.0:1651531974.448303:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b6b1b79d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467669312:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531974.448307:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531974.448311:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca49df lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4464b1 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.448319:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca49df lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4464b1 expref: 9 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531974.448323:0:166112:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca49df lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4464b1 expref: 9 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531974.448327:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001e36c601, rc 0)
00000100:00100000:1.0:1651531974.448350:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b6b1b79d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467669312:12345-10.240.43.64@tcp:101:fio.0 Request processed in 46us (137us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531974.448353:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44709
00000100:00100000:1.0:1651531974.496125:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531974.496133:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467669696
00000100:00100000:1.0:1651531974.496145:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44710
00000100:00100000:1.0:1651531974.496147:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008bb4a649 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467669696:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531974.496150:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531974.496154:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca49e6 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4464bf expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.496162:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca49e6 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4464bf expref: 9 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531974.496170:0:166112:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca49e6 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4464bf expref: 9 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531974.496173:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001e36c601, rc 0)
00000100:00100000:1.0:1651531974.496183:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008bb4a649 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467669696:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (59us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531974.496186:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44710
00000001:00080000:0.0:1651531974.496243:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869418 is committed
00010000:00010000:1.0:1651531974.496264:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca49d8 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [860160->864255] (req 860160->864255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.496268:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca49d8 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [860160->864255] (req 860160->864255) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.496285:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca49d8 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [860160->864255] (req 860160->864255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531974.496286:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cb694635 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438148:x1731754467669120:12345-10.240.43.64@tcp:4:fio.0 Request processed in 48565us (48592us total) trans 21474869418 rc 0/0
00000100:00100000:1.0:1651531974.496289:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250425
00010000:00010000:0.0:1651531974.496290:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000968553c1 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531974.496291:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca49d8 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [860160->864255] (req 860160->864255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.496295:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca49d8 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [860160->864255] (req 860160->864255) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.496302:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca49d8 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [860160->864255] (req 860160->864255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.496305:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca49d8 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [860160->864255] (req 860160->864255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531974.496987:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531974.496994:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467670080
00000100:00100000:1.0:1651531974.497007:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44711
00000100:00100000:1.0:1651531974.497009:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009e786cd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438147:x1731754467670080:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531974.497012:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531974.497016:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca49ed lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4464cd expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651531974.497021:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34545:0x0] initial LVB size: 6291456, mtime: 0x627060c6, atime: 0x627060b4, ctime: 0x627060c6, blocks: 0x3000
00010000:00010000:1.0:1651531974.497026:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531974.497027:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531974.497029:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca49ed lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4464cd expref: 6 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531974.497033:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca49ed lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4464cd expref: 6 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531974.497037:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b4c8742a, rc 0)
00000100:00100000:1.0:1651531974.497047:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009e786cd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438147:x1731754467670080:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (61us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531974.497049:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44711
00000100:00100000:1.0:1651531974.497357:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531974.497365:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467670208
00000100:00100000:1.0:1651531974.497380:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250426
00000100:00100000:1.0:1651531974.497381:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dfff0362 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438146:x1731754467670208:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531974.497388:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca49f4 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.497392:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531974.497393:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531974.497394:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca49f4 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [774144->778239] (req 774144->778239) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.497398:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca49f4 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [774144->778239] (req 774144->778239) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.497409:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca49f4 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [774144->778239] (req 774144->778239) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.497414:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca49f4 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [774144->778239] (req 774144->778239) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.497431:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca49f4 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [774144->778239] (req 774144->778239) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531974.497433:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dfff0362 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438146:x1731754467670208:12345-10.240.43.64@tcp:3:fio.0 Request processed in 51us (76us total) trans 0 rc 4096/4096
00010000:00010000:0.0:1651531974.497435:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e9b84540 already unused, calling callback (0000000049fddea7)
00000100:00100000:1.0:1651531974.497436:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250426
00010000:00010000:0.0:1651531974.497436:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca49f4 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [774144->778239] (req 774144->778239) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.497439:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca49f4 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [774144->778239] (req 774144->778239) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.497444:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca49f4 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [774144->778239] (req 774144->778239) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.497447:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca49f4 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [774144->778239] (req 774144->778239) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531974.497725:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531974.497732:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467670336
00000100:00100000:1.0:1651531974.497745:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250427
00000100:00100000:1.0:1651531974.497747:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bedaf1f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438146:x1731754467670336:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531974.497753:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca49fb lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.497757:0:192755:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca49ed lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4464cd expref: 6 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531974.497761:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531974.497761:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531974.497762:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca49fb lrc: 4/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [425984->430079] (req 425984->430079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.497769:0:192755:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca49ed lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4464cd expref: 6 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531974.497773:0:192755:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca49ed lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4464cd expref: 6 pid: 166112 timeout: 22783 lvb_type: 1
00000100:00100000:1.0:1651531974.497781:0:192755:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003b40261e pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0001_UUID:192755:1731745997358336:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531974.497793:0:192755:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fd6047a1 going to sleep for 6 seconds
00000100:00100000:1.0:1651531974.498021:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531974.498035:0:192755:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003b40261e pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0001_UUID:192755:1731745997358336:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531974.498039:0:166104:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467670400
00010000:00010000:1.0:1651531974.498040:0:192755:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca49fb lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [425984->430079] (req 425984->430079) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.498046:0:166104:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca49ed lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4464cd expref: 7 pid: 166112 timeout: 22783 lvb_type: 1
00000100:00100000:0.0:1651531974.498058:0:166104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 248
00000100:00100000:0.0:1651531974.498060:0:166104:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029096870 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438147:x1731754467670400:12345-10.240.43.64@tcp:103:ldlm_bl_05.0
00010000:00010000:0.0:1651531974.498064:0:166104:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531974.498068:0:166104:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca49ed lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4464cd expref: 7 pid: 166112 timeout: 22783 lvb_type: 1
00010000:00010000:0.0:1651531974.498072:0:166104:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca49ed lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4464cd expref: 7 pid: 166112 timeout: 22783 lvb_type: 1
00010000:00010000:0.0:1651531974.498078:0:166104:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca49ed lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4464cd expref: 7 pid: 166112 timeout: 22783 lvb_type: 1
00010000:00010000:0.0:1651531974.498082:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531974.498083:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531974.498084:0:166104:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca49fb lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [425984->430079] (req 425984->430079) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.498087:0:166104:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca49fb lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [425984->430079] (req 425984->430079) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.498098:0:166104:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1651531974.498106:0:192755:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca49fb lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [425984->430079] (req 425984->430079) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531974.498111:0:166104:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029096870 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438147:x1731754467670400:12345-10.240.43.64@tcp:103:ldlm_bl_05.0 Request processed in 51us (91us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531974.498114:0:166104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 248
00010000:00010000:1.0:1651531974.498115:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca49fb lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [425984->430079] (req 425984->430079) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531974.543918:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531974.543926:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467670528
00000100:00100000:1.0:1651531974.543939:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44712
00000100:00100000:1.0:1651531974.543941:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003b40261e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467670528:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531974.543944:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531974.543956:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4a02 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4464db expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.543964:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4a02 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4464db expref: 9 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531974.543980:0:166112:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4a02 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4464db expref: 9 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531974.543985:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001e36c601, rc 0)
00000100:00100000:1.0:1651531974.543996:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003b40261e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467670528:12345-10.240.43.64@tcp:101:fio.0 Request processed in 55us (79us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531974.543999:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44712
00000001:00080000:0.0:1651531974.544000:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869419 is committed
00010000:00010000:1.0:1651531974.544046:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca49fb lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [425984->430079] (req 425984->430079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.544050:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca49fb lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [425984->430079] (req 425984->430079) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531974.544069:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bedaf1f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438146:x1731754467670336:12345-10.240.43.64@tcp:4:fio.0 Request processed in 46321us (46344us total) trans 21474869419 rc 0/0
00000100:00100000:1.0:1651531974.544072:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250427
00010000:00010000:0.0:1651531974.544073:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca49fb lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [425984->430079] (req 425984->430079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.544077:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a8889a80 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531974.544078:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca49fb lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [425984->430079] (req 425984->430079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.544083:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca49fb lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [425984->430079] (req 425984->430079) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.544089:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca49fb lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [425984->430079] (req 425984->430079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.544091:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca49fb lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [425984->430079] (req 425984->430079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531974.544334:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531974.544341:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467670784
00000100:00100000:1.0:1651531974.544352:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44713
00000100:00100000:1.0:1651531974.544354:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a899ddab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438147:x1731754467670784:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531974.544358:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531974.544362:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4a09 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4464e9 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651531974.544367:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34545:0x0] initial LVB size: 6291456, mtime: 0x627060c6, atime: 0x627060b4, ctime: 0x627060c6, blocks: 0x3000
00010000:00010000:1.0:1651531974.544371:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531974.544371:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531974.544373:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4a09 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4464e9 expref: 6 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531974.544381:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4a09 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4464e9 expref: 6 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531974.544385:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c2b76533, rc 0)
00000100:00100000:1.0:1651531974.544395:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a899ddab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438147:x1731754467670784:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (62us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531974.544397:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44713
00000100:00100000:1.0:1651531974.545313:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531974.545338:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531974.545351:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467671296
00000100:00100000:0.0:1651531974.545356:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467671232
00000100:00100000:1.0:1651531974.545361:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250428
00000100:00100000:1.0:1651531974.545363:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002ae2aeac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438148:x1731754467671296:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531974.545369:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca4a10 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531974.545369:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250429
00000100:00100000:0.0:1651531974.545371:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b97e3b28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438148:x1731754467671232:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531974.545373:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531974.545374:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531974.545375:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca4a10 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.545379:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca4a10 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.545379:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4a17 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.545384:0:192753:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4a09 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4464e9 expref: 7 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531974.545387:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531974.545387:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531974.545388:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4a17 lrc: 4/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [155648->159743] (req 155648->159743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.545391:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca4a10 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.545394:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca4a10 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.545403:0:192753:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4a09 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4464e9 expref: 7 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531974.545407:0:192753:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4a09 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4464e9 expref: 7 pid: 166112 timeout: 22783 lvb_type: 1
00000100:00100000:1.0:1651531974.545411:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002ae2aeac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438148:x1731754467671296:12345-10.240.43.64@tcp:3:fio.0 Request processed in 47us (98us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531974.545412:0:192753:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007a950a20 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:192753:1731745997358400:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531974.545413:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250428
00010000:00010000:1.0:1651531974.545420:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca4a10 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.545423:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d44eb74d already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531974.545424:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca4a10 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531974.545424:0:192753:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a2b9dcac going to sleep for 6 seconds
00010000:00010000:1.0:1651531974.545427:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca4a10 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.545432:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca4a10 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.545435:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca4a10 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531974.545711:0:192753:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007a950a20 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:192753:1731745997358400:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651531974.545716:0:192753:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4a17 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [155648->159743] (req 155648->159743) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531974.545719:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531974.545738:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531974.545746:0:166104:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467671424
00010000:00010000:0.0:1651531974.545751:0:166104:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4a09 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4464e9 expref: 7 pid: 166112 timeout: 22783 lvb_type: 1
00000100:00100000:0.0:1651531974.545765:0:166104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 249
00000100:00100000:0.0:1651531974.545767:0:166104:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007a950a20 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438146:x1731754467671424:12345-10.240.43.64@tcp:103:ldlm_bl_01.0
00010000:00010000:0.0:1651531974.545770:0:166104:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531974.545774:0:166104:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4a09 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4464e9 expref: 7 pid: 166112 timeout: 22783 lvb_type: 1
00010000:00010000:0.0:1651531974.545778:0:166104:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4a09 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4464e9 expref: 7 pid: 166112 timeout: 22783 lvb_type: 1
00010000:00010000:0.0:1651531974.545784:0:166104:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4a09 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4464e9 expref: 7 pid: 166112 timeout: 22783 lvb_type: 1
00010000:00010000:0.0:1651531974.545788:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531974.545791:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531974.545792:0:166104:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4a17 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [155648->159743] (req 155648->159743) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.545795:0:166104:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4a17 lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [155648->159743] (req 155648->159743) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.545802:0:166104:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651531974.545816:0:166104:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007a950a20 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438146:x1731754467671424:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 48us (79us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531974.545819:0:166104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 249
00010000:00010000:0.0:1651531974.545826:0:192753:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4a17 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [155648->159743] (req 155648->159743) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.545829:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4a17 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [155648->159743] (req 155648->159743) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531974.545889:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467671552
00000100:00100000:0.0:1651531974.545904:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250430
00000100:00100000:0.0:1651531974.545907:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a20162bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467671552:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531974.545917:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca4a1e lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.545923:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531974.545924:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531974.545925:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca4a1e lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [667648->671743] (req 667648->671743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.545930:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca4a1e lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [667648->671743] (req 667648->671743) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531974.580063:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531974.580085:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467671680
00000100:00100000:1.0:1651531974.580098:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44714
00000100:00100000:1.0:1651531974.580100:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000000f0ee82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754467671680:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531974.580137:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531974.580141:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca4a25 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4464f7 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.580153:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca4a25 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4464f7 expref: 12 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531974.580157:0:166112:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca4a25 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4464f7 expref: 12 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531974.580161:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d44eb74d, rc 0)
00000100:00100000:1.0:1651531974.580172:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000000f0ee82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754467671680:12345-10.240.43.64@tcp:101:fio.0 Request processed in 71us (110us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531974.580174:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44714
00000001:00080000:0.0:1651531974.593328:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869421 is committed
00010000:00010000:0.0:1651531974.593344:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4a17 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [155648->159743] (req 155648->159743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.593348:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4a17 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [155648->159743] (req 155648->159743) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531974.593365:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b97e3b28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438148:x1731754467671232:12345-10.240.43.64@tcp:4:fio.0 Request processed in 47993us (48027us total) trans 21474869420 rc 0/0
00000100:00100000:0.0:1651531974.593368:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250429
00010000:00010000:0.0:1651531974.593374:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4a17 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [155648->159743] (req 155648->159743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.593378:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e2ec18e1 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531974.593379:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4a17 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [155648->159743] (req 155648->159743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.593382:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4a17 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [155648->159743] (req 155648->159743) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.593387:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4a17 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [155648->159743] (req 155648->159743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.593389:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4a17 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [155648->159743] (req 155648->159743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.593403:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca4a1e lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [667648->671743] (req 667648->671743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.593406:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca4a1e lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [667648->671743] (req 667648->671743) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531974.593416:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a20162bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438149:x1731754467671552:12345-10.240.43.64@tcp:4:fio.0 Request processed in 47510us (47698us total) trans 21474869421 rc 0/0
00000100:00100000:0.0:1651531974.593419:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250430
00010000:00010000:0.0:1651531974.593424:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca4a1e lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [667648->671743] (req 667648->671743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.593427:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fb2f6575 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531974.593428:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca4a1e lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [667648->671743] (req 667648->671743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.593431:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca4a1e lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [667648->671743] (req 667648->671743) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.593435:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca4a1e lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [667648->671743] (req 667648->671743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.593438:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca4a1e lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [667648->671743] (req 667648->671743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531974.593933:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531974.593944:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531974.593948:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467672064
00000100:00100000:0.0:1651531974.593953:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467672192
00000100:00100000:1.0:1651531974.593959:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44715
00000100:00100000:1.0:1651531974.593961:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008b42dfe9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438148:x1731754467672064:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531974.593965:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531974.593969:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca4a2c lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446505 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531974.593970:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250431
00000100:00100000:0.0:1651531974.593972:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001e18aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438147:x1731754467672192:12345-10.240.43.64@tcp:4:fio.0
00002000:00010000:1.0:1651531974.593974:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34545:0x0] initial LVB size: 6291456, mtime: 0x627060c6, atime: 0x627060b4, ctime: 0x627060c6, blocks: 0x3000
00010000:00010000:1.0:1651531974.593978:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531974.593978:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531974.593979:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca4a33 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.593980:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca4a2c lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446505 expref: 7 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531974.593986:0:216321:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca4a2c lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446505 expref: 7 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531974.593989:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531974.593990:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531974.593991:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca4a33 lrc: 4/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [655360->659455] (req 655360->659455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.593995:0:166112:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca4a2c lrc: 5/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446505 expref: 7 pid: 166112 timeout: 22783 lvb_type: 1
00010000:00010000:1.0:1651531974.594000:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca4a2c lrc: 5/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446505 expref: 7 pid: 166112 timeout: 22783 lvb_type: 1
00010000:00010000:0.0:1651531974.594004:0:216321:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca4a2c lrc: 5/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446505 expref: 7 pid: 166112 timeout: 22783 lvb_type: 1
00010000:00010000:0.0:1651531974.594008:0:216321:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca4a2c lrc: 5/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446505 expref: 7 pid: 166112 timeout: 22783 lvb_type: 1
00010000:00010000:1.0:1651531974.594011:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d44eb74d, rc 0)
00000100:00100000:0.0:1651531974.594012:0:216321:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000092cb3f97 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997358464:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531974.594022:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008b42dfe9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438148:x1731754467672064:12345-10.240.43.64@tcp:101:fio.0 Request processed in 60us (90us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531974.594022:0:216321:0:(client.c:2492:ptlrpc_set_wait()) set 000000000073caa3 going to sleep for 6 seconds
00000100:00100000:1.0:1651531974.594024:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44715
00000100:00100000:0.0:1651531974.594212:0:216321:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000092cb3f97 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997358464:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651531974.594245:0:216321:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca4a33 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [655360->659455] (req 655360->659455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531974.594339:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531974.594353:0:166104:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467672320
00010000:00010000:0.0:1651531974.594360:0:166104:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca4a2c lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446505 expref: 7 pid: 166112 timeout: 22783 lvb_type: 1
00000100:00100000:0.0:1651531974.594372:0:166104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250
00000100:00100000:0.0:1651531974.594374:0:166104:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f3a0807 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438147:x1731754467672320:12345-10.240.43.64@tcp:103:ldlm_bl_02.0
00010000:00010000:0.0:1651531974.594377:0:166104:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531974.594381:0:166104:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca4a2c lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446505 expref: 7 pid: 166112 timeout: 22783 lvb_type: 1
00010000:00010000:0.0:1651531974.594385:0:166104:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca4a2c lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446505 expref: 7 pid: 166112 timeout: 22783 lvb_type: 1
00010000:00010000:0.0:1651531974.594391:0:166104:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca4a2c lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446505 expref: 7 pid: 166112 timeout: 22783 lvb_type: 1
00010000:00010000:0.0:1651531974.594395:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531974.594395:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531974.594396:0:166104:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca4a33 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [655360->659455] (req 655360->659455) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.594399:0:166104:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca4a33 lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [655360->659455] (req 655360->659455) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.594406:0:166104:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651531974.594415:0:166104:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f3a0807 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438147:x1731754467672320:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 41us (77us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531974.594418:0:166104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250
00010000:00010000:0.0:1651531974.594424:0:216321:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca4a33 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [655360->659455] (req 655360->659455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.594441:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca4a33 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [655360->659455] (req 655360->659455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531974.594729:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531974.594736:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467672512
00000100:00100000:1.0:1651531974.594745:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44716
00000100:00100000:1.0:1651531974.594747:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b10bc064 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467672512:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531974.594750:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531974.594754:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4a3a lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446513 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.594762:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4a3a lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446513 expref: 9 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531974.594766:0:166112:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4a3a lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446513 expref: 9 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531974.594769:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001e36c601, rc 0)
00000100:00100000:1.0:1651531974.594780:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b10bc064 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467672512:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (52us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531974.594786:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44716
00000100:00100000:1.0:1651531974.616238:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531974.616246:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467672896
00000100:00100000:1.0:1651531974.616258:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44717
00000100:00100000:1.0:1651531974.616260:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000427633c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467672896:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531974.616263:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531974.616266:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4a41 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446521 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.616285:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4a41 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446521 expref: 9 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531974.616289:0:166112:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4a41 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446521 expref: 9 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531974.616293:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001e36c601, rc 0)
00000100:00100000:1.0:1651531974.616304:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000427633c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467672896:12345-10.240.43.64@tcp:101:fio.0 Request processed in 43us (66us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531974.616306:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44717
00000001:00080000:0.0:1651531974.629478:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869422 is committed
00010000:00010000:0.0:1651531974.629493:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca4a33 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [655360->659455] (req 655360->659455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.629497:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca4a33 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [655360->659455] (req 655360->659455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531974.629518:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001e18aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438147:x1731754467672192:12345-10.240.43.64@tcp:4:fio.0 Request processed in 35545us (35575us total) trans 21474869422 rc 0/0
00010000:00010000:1.0:1651531974.629521:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca4a33 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [655360->659455] (req 655360->659455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531974.629522:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250431
00010000:00010000:1.0:1651531974.629525:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f765708a already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531974.629526:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca4a33 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [655360->659455] (req 655360->659455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.629533:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca4a33 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [655360->659455] (req 655360->659455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.629539:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca4a33 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [655360->659455] (req 655360->659455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.629541:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca4a33 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [655360->659455] (req 655360->659455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531974.629852:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531974.629860:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467673280
00000100:00100000:1.0:1651531974.629873:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44718
00000100:00100000:1.0:1651531974.629874:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000329eeeee pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438146:x1731754467673280:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531974.629877:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531974.629881:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4a48 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44652f expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651531974.629886:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34545:0x0] initial LVB size: 6291456, mtime: 0x627060c6, atime: 0x627060b4, ctime: 0x627060c6, blocks: 0x3000
00010000:00010000:1.0:1651531974.629890:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531974.629891:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531974.629893:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4a48 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44652f expref: 6 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531974.629897:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4a48 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44652f expref: 6 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531974.629901:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001e36c601, rc 0)
00000100:00100000:1.0:1651531974.629914:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000329eeeee pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438146:x1731754467673280:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (62us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531974.629916:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44718
00000100:00100000:1.0:1651531974.630661:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531974.630684:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467673536
00000100:00100000:0.0:1651531974.630696:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250432
00000100:00100000:0.0:1651531974.630698:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d76314b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438147:x1731754467673536:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531974.630705:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca4a4f lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.630710:0:216321:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4a48 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44652f expref: 6 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531974.630713:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531974.630714:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531974.630714:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca4a4f lrc: 4/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [1007616->1011711] (req 1007616->1011711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.630735:0:216321:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4a48 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44652f expref: 6 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531974.630739:0:216321:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4a48 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44652f expref: 6 pid: 166112 timeout: 22783 lvb_type: 1
00000100:00100000:0.0:1651531974.630744:0:216321:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000092cb3f97 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997358528:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531974.630756:0:216321:0:(client.c:2492:ptlrpc_set_wait()) set 000000000073caa3 going to sleep for 6 seconds
00000100:00100000:0.0:1651531974.630950:0:216321:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000092cb3f97 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997358528:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651531974.630955:0:216321:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca4a4f lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [1007616->1011711] (req 1007616->1011711) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531974.630996:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531974.631006:0:166104:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467673600
00010000:00010000:0.0:1651531974.631011:0:166104:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4a48 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44652f expref: 7 pid: 166112 timeout: 22783 lvb_type: 1
00000100:00100000:0.0:1651531974.631022:0:166104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 251
00000100:00100000:0.0:1651531974.631024:0:166104:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000092cb3f97 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438148:x1731754467673600:12345-10.240.43.64@tcp:103:ldlm_bl_06.0
00010000:00010000:0.0:1651531974.631027:0:166104:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531974.631031:0:166104:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4a48 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44652f expref: 7 pid: 166112 timeout: 22783 lvb_type: 1
00010000:00010000:0.0:1651531974.631035:0:166104:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4a48 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44652f expref: 7 pid: 166112 timeout: 22783 lvb_type: 1
00010000:00010000:0.0:1651531974.631050:0:166104:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4a48 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44652f expref: 7 pid: 166112 timeout: 22783 lvb_type: 1
00010000:00010000:0.0:1651531974.631054:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531974.631055:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531974.631056:0:166104:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca4a4f lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [1007616->1011711] (req 1007616->1011711) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.631059:0:166104:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca4a4f lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [1007616->1011711] (req 1007616->1011711) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.631066:0:166104:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651531974.631081:0:166104:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000092cb3f97 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438148:x1731754467673600:12345-10.240.43.64@tcp:103:ldlm_bl_06.0 Request processed in 56us (84us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531974.631084:0:166104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 251
00010000:00010000:0.0:1651531974.631091:0:216321:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca4a4f lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [1007616->1011711] (req 1007616->1011711) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.631094:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca4a4f lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [1007616->1011711] (req 1007616->1011711) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531974.653914:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531974.653935:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467673856
00000100:00100000:1.0:1651531974.653948:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44719
00000100:00100000:1.0:1651531974.653950:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007104508b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467673856:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531974.653953:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531974.653957:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4a56 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44653d expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.653965:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4a56 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44653d expref: 9 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531974.653969:0:166112:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4a56 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44653d expref: 9 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531974.653973:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001e36c601, rc 0)
00000100:00100000:1.0:1651531974.653983:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007104508b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467673856:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (70us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531974.653986:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44719
00000001:00080000:0.0:1651531974.665610:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869423 is committed
00010000:00010000:0.0:1651531974.665625:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca4a4f lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [1007616->1011711] (req 1007616->1011711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.665629:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca4a4f lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [1007616->1011711] (req 1007616->1011711) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531974.665655:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d76314b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438147:x1731754467673536:12345-10.240.43.64@tcp:4:fio.0 Request processed in 34956us (34995us total) trans 21474869423 rc 0/0
00000100:00100000:0.0:1651531974.665659:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250432
00010000:00010000:0.0:1651531974.665666:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca4a4f lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [1007616->1011711] (req 1007616->1011711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.665669:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fb2f6575 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531974.665671:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca4a4f lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [1007616->1011711] (req 1007616->1011711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.665674:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca4a4f lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [1007616->1011711] (req 1007616->1011711) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.665678:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca4a4f lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [1007616->1011711] (req 1007616->1011711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.665681:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca4a4f lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [1007616->1011711] (req 1007616->1011711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531974.666031:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531974.666038:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467674240
00000100:00100000:1.0:1651531974.666050:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44720
00000100:00100000:1.0:1651531974.666051:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000099b6616a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438146:x1731754467674240:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531974.666055:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531974.666059:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4a5d lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44654b expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651531974.666064:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34545:0x0] initial LVB size: 6291456, mtime: 0x627060c6, atime: 0x627060b4, ctime: 0x627060c6, blocks: 0x3000
00010000:00010000:1.0:1651531974.666069:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531974.666069:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531974.666071:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4a5d lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44654b expref: 6 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531974.666075:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4a5d lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44654b expref: 6 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531974.666079:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001e36c601, rc 0)
00000100:00100000:1.0:1651531974.666091:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000099b6616a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438146:x1731754467674240:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (61us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531974.666094:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44720
00000100:00100000:1.0:1651531974.666877:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531974.666896:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467674496
00000100:00100000:0.0:1651531974.666908:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250433
00000100:00100000:0.0:1651531974.666910:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000033696ffa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438147:x1731754467674496:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531974.666917:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4a64 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.666922:0:216321:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4a5d lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44654b expref: 6 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531974.666927:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531974.666927:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531974.666928:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4a64 lrc: 4/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [659456->663551] (req 659456->663551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.666935:0:216321:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4a5d lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44654b expref: 6 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531974.666939:0:216321:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4a5d lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44654b expref: 6 pid: 166112 timeout: 22783 lvb_type: 1
00000100:00100000:0.0:1651531974.666943:0:216321:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d65563cf pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997358592:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531974.666956:0:216321:0:(client.c:2492:ptlrpc_set_wait()) set 000000000073caa3 going to sleep for 6 seconds
00000100:00100000:1.0:1651531974.667195:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531974.667198:0:216321:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d65563cf pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997358592:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651531974.667208:0:216321:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4a64 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [659456->663551] (req 659456->663551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531974.667236:0:166104:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467674560
00010000:00010000:0.0:1651531974.667242:0:166104:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4a5d lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44654b expref: 7 pid: 166112 timeout: 22783 lvb_type: 1
00000100:00100000:0.0:1651531974.667254:0:166104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 252
00000100:00100000:0.0:1651531974.667256:0:166104:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007d76765b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438147:x1731754467674560:12345-10.240.43.64@tcp:103:ldlm_bl_03.0
00010000:00010000:0.0:1651531974.667259:0:166104:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531974.667263:0:166104:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4a5d lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44654b expref: 7 pid: 166112 timeout: 22783 lvb_type: 1
00010000:00010000:0.0:1651531974.667268:0:166104:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4a5d lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44654b expref: 7 pid: 166112 timeout: 22783 lvb_type: 1
00010000:00010000:0.0:1651531974.667274:0:166104:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4a5d lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44654b expref: 7 pid: 166112 timeout: 22783 lvb_type: 1
00010000:00010000:0.0:1651531974.667278:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531974.667279:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531974.667279:0:166104:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4a64 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [659456->663551] (req 659456->663551) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.667283:0:166104:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4a64 lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [659456->663551] (req 659456->663551) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.667290:0:166104:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651531974.667299:0:166104:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007d76765b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438147:x1731754467674560:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 43us (104us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531974.667302:0:166104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 252
00010000:00010000:0.0:1651531974.667308:0:216321:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4a64 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [659456->663551] (req 659456->663551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.667311:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4a64 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [659456->663551] (req 659456->663551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531974.701740:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869424 is committed
00010000:00010000:0.0:1651531974.701755:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4a64 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [659456->663551] (req 659456->663551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.701763:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4a64 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [659456->663551] (req 659456->663551) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531974.701785:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000033696ffa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438147:x1731754467674496:12345-10.240.43.64@tcp:4:fio.0 Request processed in 34874us (34908us total) trans 21474869424 rc 0/0
00000100:00100000:0.0:1651531974.701788:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250433
00010000:00010000:0.0:1651531974.701796:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4a64 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [659456->663551] (req 659456->663551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.701799:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e2ec18e1 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531974.701801:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4a64 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [659456->663551] (req 659456->663551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.701803:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4a64 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [659456->663551] (req 659456->663551) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.701808:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4a64 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [659456->663551] (req 659456->663551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.701811:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4a64 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [659456->663551] (req 659456->663551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531974.702087:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531974.702095:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467674816
00000100:00100000:0.0:1651531974.702106:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250434
00000100:00100000:0.0:1651531974.702107:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d65563cf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438146:x1731754467674816:12345-10.240.43.64@tcp:4:fio.0
00002000:00010000:0.0:1651531974.702118:0:216321:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34545:0x0] initial LVB size: 6291456, mtime: 0x627060c6, atime: 0x627060b4, ctime: 0x627060c6, blocks: 0x3000
00010000:00010000:0.0:1651531974.702121:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca4a6b lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.702124:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531974.702125:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531974.702126:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca4a6b lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [876544->880639] (req 876544->880639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.702130:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca4a6b lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [876544->880639] (req 876544->880639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531974.726178:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531974.726201:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467675072
00000100:00100000:0.0:1651531974.726237:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250435
00000100:00100000:0.0:1651531974.726239:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007f998d3c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467675072:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531974.726247:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4a72 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.726251:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531974.726252:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531974.726253:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4a72 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [880640->884735] (req 880640->884735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.726257:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4a72 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [880640->884735] (req 880640->884735) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531974.737891:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869425 is committed
00010000:00010000:0.0:1651531974.737904:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca4a6b lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [876544->880639] (req 876544->880639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.737911:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca4a6b lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [876544->880639] (req 876544->880639) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531974.737933:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d65563cf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467674816:12345-10.240.43.64@tcp:4:fio.0 Request processed in 35825us (35846us total) trans 21474869425 rc 0/0
00010000:00010000:1.0:1651531974.737934:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca4a6b lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [876544->880639] (req 876544->880639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531974.737936:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250434
00010000:00010000:1.0:1651531974.737939:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fb2f6575 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531974.737940:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca4a6b lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [876544->880639] (req 876544->880639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.737944:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca4a6b lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [876544->880639] (req 876544->880639) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.737954:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca4a6b lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [876544->880639] (req 876544->880639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.737957:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca4a6b lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [876544->880639] (req 876544->880639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531974.775394:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869426 is committed
00010000:00010000:0.0:1651531974.775409:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4a72 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [880640->884735] (req 880640->884735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.775413:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4a72 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [880640->884735] (req 880640->884735) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531974.775435:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007f998d3c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438149:x1731754467675072:12345-10.240.43.64@tcp:4:fio.0 Request processed in 49195us (49258us total) trans 21474869426 rc 0/0
00000100:00100000:0.0:1651531974.775438:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250435
00010000:00010000:0.0:1651531974.775446:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4a72 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [880640->884735] (req 880640->884735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.775449:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e2ec18e1 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531974.775450:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4a72 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [880640->884735] (req 880640->884735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.775453:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4a72 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [880640->884735] (req 880640->884735) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.775458:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4a72 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [880640->884735] (req 880640->884735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.775463:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4a72 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [880640->884735] (req 880640->884735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531974.786657:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531974.786679:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467675648
00000100:00100000:1.0:1651531974.786692:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44721
00000100:00100000:1.0:1651531974.786694:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009af72390 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438149:x1731754467675648:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531974.786697:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531974.786702:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca4a79 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446559 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651531974.786706:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34545:0x0] initial LVB size: 6291456, mtime: 0x627060c6, atime: 0x627060b4, ctime: 0x627060c6, blocks: 0x3000
00010000:00010000:1.0:1651531974.786711:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531974.786711:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531974.786713:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca4a79 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446559 expref: 6 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531974.786718:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca4a79 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446559 expref: 6 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531974.786722:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d44eb74d, rc 0)
00000100:00100000:1.0:1651531974.786732:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009af72390 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467675648:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (76us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531974.786735:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44721
00000100:00100000:0.0:1651531974.787090:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531974.787098:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467675840
00000100:00100000:0.0:1651531974.787108:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250436
00000100:00100000:0.0:1651531974.787110:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006bce4824 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438148:x1731754467675840:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531974.787118:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4a80 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.787122:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531974.787123:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531974.787124:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4a80 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [909312->913407] (req 909312->913407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.787128:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4a80 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [909312->913407] (req 909312->913407) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.787140:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4a80 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [909312->913407] (req 909312->913407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.787143:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4a80 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [909312->913407] (req 909312->913407) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531974.787164:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006bce4824 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438148:x1731754467675840:12345-10.240.43.64@tcp:3:fio.0 Request processed in 53us (74us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531974.787179:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250436
00010000:00010000:0.0:1651531974.787187:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4a80 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [909312->913407] (req 909312->913407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.787190:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e2ec18e1 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531974.787192:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4a80 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [909312->913407] (req 909312->913407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.787195:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4a80 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [909312->913407] (req 909312->913407) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.787199:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4a80 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [909312->913407] (req 909312->913407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.787202:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4a80 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [909312->913407] (req 909312->913407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531974.819621:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531974.819642:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467676416
00000100:00100000:1.0:1651531974.819657:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250437
00000100:00100000:1.0:1651531974.819659:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000398f3634 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467676416:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531974.819667:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4a87 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.819671:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531974.819672:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531974.819673:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4a87 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [991232->995327] (req 991232->995327) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.819677:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4a87 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [991232->995327] (req 991232->995327) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.819688:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4a87 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [991232->995327] (req 991232->995327) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.819691:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4a87 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [991232->995327] (req 991232->995327) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531974.819707:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000398f3634 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467676416:12345-10.240.43.64@tcp:3:fio.0 Request processed in 47us (87us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531974.819710:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250437
00010000:00010000:1.0:1651531974.819716:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4a87 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [991232->995327] (req 991232->995327) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.819719:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c2b76533 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531974.819720:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4a87 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [991232->995327] (req 991232->995327) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.819727:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4a87 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [991232->995327] (req 991232->995327) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.819732:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4a87 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [991232->995327] (req 991232->995327) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.819735:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4a87 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [991232->995327] (req 991232->995327) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531974.844121:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531974.844142:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467676864
00000100:00100000:1.0:1651531974.844157:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250438
00000100:00100000:1.0:1651531974.844159:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000097ff3001 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438147:x1731754467676864:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531974.844165:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4a8e lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.844170:0:216321:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca4a79 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446559 expref: 6 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531974.844173:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531974.844174:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531974.844175:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4a8e lrc: 4/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [180224->184319] (req 180224->184319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.844182:0:216321:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca4a79 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446559 expref: 6 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531974.844186:0:216321:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca4a79 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446559 expref: 6 pid: 166112 timeout: 22783 lvb_type: 1
00000100:00100000:1.0:1651531974.844192:0:216321:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009c93d7f2 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997358656:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531974.844204:0:216321:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fd6047a1 going to sleep for 6 seconds
00000100:00100000:0.0:1651531974.844473:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531974.844481:0:166104:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467676928
00000100:00100000:1.0:1651531974.844485:0:216321:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009c93d7f2 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997358656:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651531974.844488:0:166104:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca4a79 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446559 expref: 7 pid: 166112 timeout: 22783 lvb_type: 1
00010000:00010000:1.0:1651531974.844490:0:216321:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4a8e lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [180224->184319] (req 180224->184319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531974.844499:0:166104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 253
00000100:00100000:0.0:1651531974.844501:0:166104:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bf33c9a7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438147:x1731754467676928:12345-10.240.43.64@tcp:103:ldlm_bl_05.0
00010000:00010000:0.0:1651531974.844505:0:166104:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531974.844518:0:166104:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca4a79 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446559 expref: 7 pid: 166112 timeout: 22783 lvb_type: 1
00010000:00010000:0.0:1651531974.844522:0:166104:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca4a79 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446559 expref: 7 pid: 166112 timeout: 22783 lvb_type: 1
00010000:00010000:0.0:1651531974.844528:0:166104:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca4a79 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446559 expref: 7 pid: 166112 timeout: 22783 lvb_type: 1
00010000:00010000:0.0:1651531974.844532:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531974.844533:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531974.844534:0:166104:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4a8e lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [180224->184319] (req 180224->184319) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.844537:0:166104:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4a8e lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [180224->184319] (req 180224->184319) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.844548:0:166104:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651531974.844558:0:166104:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bf33c9a7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438147:x1731754467676928:12345-10.240.43.64@tcp:103:ldlm_bl_05.0 Request processed in 56us (85us total) trans 0 rc 0/0
00010000:00010000:1.0:1651531974.844561:0:216321:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4a8e lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [180224->184319] (req 180224->184319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531974.844561:0:166104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 253
00010000:00010000:1.0:1651531974.844564:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4a8e lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [180224->184319] (req 180224->184319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531974.880269:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531974.880292:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467677056
00000100:00100000:1.0:1651531974.880305:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44722
00000100:00100000:1.0:1651531974.880307:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007a950a20 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467677056:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531974.880310:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531974.880314:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca4a95 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446567 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.880322:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca4a95 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446567 expref: 9 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531974.880326:0:166112:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca4a95 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446567 expref: 9 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531974.880334:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a8889a80, rc 0)
00000100:00100000:1.0:1651531974.880344:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007a950a20 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467677056:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (76us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531974.880347:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44722
00000100:00100000:0.0:1651531974.880390:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531974.880406:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467677184
00000100:00100000:1.0:1651531974.880417:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44723
00000100:00100000:1.0:1651531974.880418:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000092cb3f97 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467677184:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531974.880422:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531974.880425:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4a9c lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446575 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.880432:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4a9c lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446575 expref: 9 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531974.880436:0:166112:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4a9c lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446575 expref: 9 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531974.880440:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b4c8742a, rc 0)
00000100:00100000:1.0:1651531974.880449:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000092cb3f97 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467677184:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (60us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531974.880452:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44723
00000100:00100000:0.0:1651531974.880894:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531974.880902:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467677312
00000100:00100000:0.0:1651531974.880912:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250439
00000100:00100000:0.0:1651531974.880914:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006a8dcc9d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467677312:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531974.880921:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4aa3 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.880935:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531974.880936:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531974.880937:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4aa3 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [331776->335871] (req 331776->335871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.880941:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4aa3 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [331776->335871] (req 331776->335871) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.880955:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4aa3 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [331776->335871] (req 331776->335871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.880958:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4aa3 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [331776->335871] (req 331776->335871) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531974.880979:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006a8dcc9d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467677312:12345-10.240.43.64@tcp:3:fio.0 Request processed in 65us (86us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531974.880982:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250439
00010000:00010000:0.0:1651531974.880990:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4aa3 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [331776->335871] (req 331776->335871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.880994:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e2ec18e1 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531974.880995:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4aa3 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [331776->335871] (req 331776->335871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.880998:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4aa3 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [331776->335871] (req 331776->335871) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.881003:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4aa3 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [331776->335871] (req 331776->335871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.881014:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4aa3 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [331776->335871] (req 331776->335871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531974.881462:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531974.881478:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467677696
00000100:00100000:1.0:1651531974.881489:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44724
00000100:00100000:1.0:1651531974.881491:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029096870 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467677696:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531974.881496:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531974.881500:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca4aaa lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446583 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.881507:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca4aaa lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446583 expref: 9 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531974.881510:0:166112:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca4aaa lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446583 expref: 9 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531974.881514:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e9b84540, rc 0)
00000100:00100000:1.0:1651531974.881524:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029096870 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467677696:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (62us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531974.881526:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44724
00000100:00100000:0.0:1651531974.882204:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531974.882237:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467677952
00000100:00100000:1.0:1651531974.882248:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44725
00000100:00100000:1.0:1651531974.882250:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f3a0807 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467677952:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531974.882253:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531974.882257:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4ab1 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446591 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.882264:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4ab1 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446591 expref: 9 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531974.882267:0:166112:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4ab1 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446591 expref: 9 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531974.882275:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000968553c1, rc 0)
00000100:00100000:1.0:1651531974.882285:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f3a0807 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467677952:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (81us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531974.882287:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44725
00000100:00100000:0.0:1651531974.882586:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531974.882594:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467678080
00000100:00100000:0.0:1651531974.882605:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250440
00000100:00100000:0.0:1651531974.882607:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007a05c3e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467678080:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531974.882614:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca4ab8 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.882618:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531974.882619:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531974.882620:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca4ab8 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [389120->393215] (req 389120->393215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.882624:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca4ab8 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [389120->393215] (req 389120->393215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.882635:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca4ab8 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [389120->393215] (req 389120->393215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.882638:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca4ab8 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [389120->393215] (req 389120->393215) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531974.882660:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007a05c3e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467678080:12345-10.240.43.64@tcp:3:fio.0 Request processed in 53us (75us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531974.882672:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250440
00010000:00010000:0.0:1651531974.882680:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca4ab8 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [389120->393215] (req 389120->393215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.882683:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f968d777 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531974.882684:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca4ab8 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [389120->393215] (req 389120->393215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.882687:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca4ab8 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [389120->393215] (req 389120->393215) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.882692:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca4ab8 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [389120->393215] (req 389120->393215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.882695:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca4ab8 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [389120->393215] (req 389120->393215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531974.882958:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531974.882965:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467678208
00000100:00100000:0.0:1651531974.882974:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250441
00000100:00100000:0.0:1651531974.882976:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005dd15341 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467678208:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531974.882982:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca4abf lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.882986:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531974.882987:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531974.882988:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca4abf lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [512000->516095] (req 512000->516095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.883003:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca4abf lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [512000->516095] (req 512000->516095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531974.915461:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869427 is committed
00010000:00010000:1.0:1651531974.915493:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4a8e lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [180224->184319] (req 180224->184319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.915498:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4a8e lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [180224->184319] (req 180224->184319) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.915511:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4a8e lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [180224->184319] (req 180224->184319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531974.915516:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000097ff3001 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467676864:12345-10.240.43.64@tcp:4:fio.0 Request processed in 71357us (71396us total) trans 21474869427 rc 0/0
00010000:00010000:0.0:1651531974.915517:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c2b76533 already unused, calling callback (0000000049fddea7)
00000100:00100000:1.0:1651531974.915520:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250438
00010000:00010000:0.0:1651531974.915520:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4a8e lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [180224->184319] (req 180224->184319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.915526:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4a8e lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [180224->184319] (req 180224->184319) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.915534:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4a8e lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [180224->184319] (req 180224->184319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.915540:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4a8e lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [180224->184319] (req 180224->184319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531974.915872:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531974.915896:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467678336
00000100:00100000:1.0:1651531974.915908:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44726
00000100:00100000:1.0:1651531974.915910:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aa58c961 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467678336:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531974.915913:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531974.915917:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4ac6 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44659f expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.915925:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4ac6 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44659f expref: 9 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531974.915929:0:166112:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4ac6 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44659f expref: 9 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531974.915936:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000968553c1, rc 0)
00000100:00100000:1.0:1651531974.915946:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aa58c961 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467678336:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (76us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531974.915949:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44726
00000100:00100000:0.0:1651531974.916677:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531974.916694:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467678592
00000100:00100000:1.0:1651531974.916706:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44727
00000100:00100000:1.0:1651531974.916708:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000053de45f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467678592:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531974.916711:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531974.916715:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca4acd lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4465ad expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.916722:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca4acd lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4465ad expref: 9 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531974.916726:0:166112:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca4acd lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4465ad expref: 9 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531974.916729:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e9b84540, rc 0)
00000100:00100000:1.0:1651531974.916739:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000053de45f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467678592:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (63us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531974.916741:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44727
00000100:00100000:0.0:1651531974.917024:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531974.917043:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467678720
00000100:00100000:1.0:1651531974.917058:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250442
00000100:00100000:1.0:1651531974.917060:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000e33e11e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467678720:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531974.917069:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4ad4 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.917073:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531974.917074:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531974.917075:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4ad4 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [778240->782335] (req 778240->782335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.917079:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4ad4 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [778240->782335] (req 778240->782335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.917091:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4ad4 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [778240->782335] (req 778240->782335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.917094:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4ad4 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [778240->782335] (req 778240->782335) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.917111:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4ad4 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [778240->782335] (req 778240->782335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531974.917113:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000e33e11e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467678720:12345-10.240.43.64@tcp:3:fio.0 Request processed in 53us (89us total) trans 0 rc 4096/4096
00010000:00010000:0.0:1651531974.917115:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b4c8742a already unused, calling callback (0000000049fddea7)
00000100:00100000:1.0:1651531974.917116:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250442
00010000:00010000:0.0:1651531974.917125:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4ad4 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [778240->782335] (req 778240->782335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.917128:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4ad4 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [778240->782335] (req 778240->782335) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.917134:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4ad4 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [778240->782335] (req 778240->782335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.917136:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4ad4 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [778240->782335] (req 778240->782335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531974.917405:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531974.917415:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467678848
00000100:00100000:1.0:1651531974.917429:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250443
00000100:00100000:1.0:1651531974.917430:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000021f31110 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467678848:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531974.917437:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca4adb lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.917441:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531974.917441:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531974.917444:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca4adb lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [917504->921599] (req 917504->921599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.917447:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca4adb lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [917504->921599] (req 917504->921599) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531974.928005:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531974.928013:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467678976
00000100:00100000:1.0:1651531974.928026:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44728
00000100:00100000:1.0:1651531974.928028:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009c93d7f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754467678976:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531974.928031:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531974.928035:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca4ae2 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4465bb expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.928043:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca4ae2 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4465bb expref: 12 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531974.928047:0:166112:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca4ae2 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4465bb expref: 12 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531974.928062:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e9b84540, rc 0)
00000100:00100000:1.0:1651531974.928074:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009c93d7f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754467678976:12345-10.240.43.64@tcp:101:fio.0 Request processed in 46us (70us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531974.928077:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44728
00000100:00100000:1.0:1651531974.928825:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531974.928832:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467679232
00000100:00100000:1.0:1651531974.928844:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44729
00000100:00100000:1.0:1651531974.928846:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000942b56fd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754467679232:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531974.928858:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531974.928862:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4ae9 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4465c9 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.928869:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4ae9 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4465c9 expref: 12 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531974.928873:0:166112:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4ae9 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4465c9 expref: 12 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531974.928877:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000968553c1, rc 0)
00000100:00100000:1.0:1651531974.928887:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000942b56fd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754467679232:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (62us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531974.928889:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44729
00000100:00100000:1.0:1651531974.929246:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531974.929270:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467679360
00000100:00100000:0.0:1651531974.929288:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250444
00000100:00100000:0.0:1651531974.929290:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000df1eb0d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754467679360:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531974.929299:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca4af0 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.929303:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531974.929304:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531974.929305:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca4af0 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [942080->946175] (req 942080->946175) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.929309:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca4af0 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [942080->946175] (req 942080->946175) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.929323:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca4af0 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [942080->946175] (req 942080->946175) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.929330:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca4af0 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [942080->946175] (req 942080->946175) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.929348:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca4af0 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [942080->946175] (req 942080->946175) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531974.929352:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000df1eb0d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754467679360:12345-10.240.43.64@tcp:3:fio.0 Request processed in 62us (107us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531974.929356:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250444
00010000:00010000:1.0:1651531974.929357:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f968d777 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531974.929358:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca4af0 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [942080->946175] (req 942080->946175) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.929361:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca4af0 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [942080->946175] (req 942080->946175) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.929366:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca4af0 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [942080->946175] (req 942080->946175) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.929380:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca4af0 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [942080->946175] (req 942080->946175) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531974.929709:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531974.929724:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467679488
00000100:00100000:0.0:1651531974.929739:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250445
00000100:00100000:0.0:1651531974.929740:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000053497d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754467679488:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531974.929747:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4af7 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.929752:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531974.929752:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531974.929753:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4af7 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [167936->172031] (req 167936->172031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.929757:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4af7 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [167936->172031] (req 167936->172031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531974.941236:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869428 is committed
00010000:00010000:0.0:1651531974.941256:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca4abf lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [512000->516095] (req 512000->516095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.941260:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca4abf lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [512000->516095] (req 512000->516095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531974.941285:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005dd15341 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754467678208:12345-10.240.43.64@tcp:4:fio.0 Request processed in 58308us (58327us total) trans 21474869428 rc 0/0
00000100:00100000:0.0:1651531974.941288:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250441
00010000:00010000:0.0:1651531974.941296:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca4abf lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [512000->516095] (req 512000->516095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.941300:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000075a78972 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531974.941301:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca4abf lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [512000->516095] (req 512000->516095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.941304:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca4abf lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [512000->516095] (req 512000->516095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.941309:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca4abf lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [512000->516095] (req 512000->516095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.941311:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca4abf lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [512000->516095] (req 512000->516095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531974.941638:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531974.941645:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467679616
00000100:00100000:1.0:1651531974.941658:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44730
00000100:00100000:1.0:1651531974.941659:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ffcdece2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754467679616:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531974.941663:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531974.941666:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4afe lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4465d7 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.941674:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4afe lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4465d7 expref: 12 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531974.941678:0:166112:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4afe lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4465d7 expref: 12 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531974.941681:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000968553c1, rc 0)
00000100:00100000:1.0:1651531974.941691:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ffcdece2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754467679616:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (54us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531974.941693:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44730
00000100:00100000:1.0:1651531974.967180:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531974.967188:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467680000
00000100:00100000:1.0:1651531974.967199:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44731
00000100:00100000:1.0:1651531974.967201:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007d76765b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754467680000:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531974.967212:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531974.967238:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4b05 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4465e5 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.967257:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4b05 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4465e5 expref: 12 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531974.967262:0:166112:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4b05 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4465e5 expref: 12 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531974.967265:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000968553c1, rc 0)
00000100:00100000:1.0:1651531974.967276:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007d76765b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754467680000:12345-10.240.43.64@tcp:101:fio.0 Request processed in 74us (96us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531974.967278:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44731
00000001:00080000:0.0:1651531974.979104:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869430 is committed
00010000:00010000:0.0:1651531974.979125:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4af7 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [167936->172031] (req 167936->172031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.979129:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4af7 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [167936->172031] (req 167936->172031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.979136:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca4adb lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [917504->921599] (req 917504->921599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.979140:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca4adb lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [917504->921599] (req 917504->921599) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531974.979149:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000053497d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467679488:12345-10.240.43.64@tcp:4:fio.0 Request processed in 49407us (49440us total) trans 21474869430 rc 0/0
00000100:00100000:0.0:1651531974.979153:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250445
00000100:00100000:1.0:1651531974.979161:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000021f31110 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438146:x1731754467678848:12345-10.240.43.64@tcp:4:fio.0 Request processed in 61730us (61757us total) trans 21474869429 rc 0/0
00010000:00010000:0.0:1651531974.979161:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4af7 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [167936->172031] (req 167936->172031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531974.979165:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250443
00010000:00010000:0.0:1651531974.979165:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e2ec18e1 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531974.979166:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4af7 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [167936->172031] (req 167936->172031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.979168:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4af7 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [167936->172031] (req 167936->172031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.979172:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca4adb lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [917504->921599] (req 917504->921599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.979173:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4af7 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [167936->172031] (req 167936->172031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.979175:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a8889a80 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531974.979176:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4af7 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [167936->172031] (req 167936->172031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.979186:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca4adb lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [917504->921599] (req 917504->921599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.979190:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca4adb lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [917504->921599] (req 917504->921599) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.979195:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca4adb lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [917504->921599] (req 917504->921599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.979198:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca4adb lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [917504->921599] (req 917504->921599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531974.979503:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531974.979511:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467680448
00000100:00100000:1.0:1651531974.979522:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44732
00000100:00100000:1.0:1651531974.979524:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000063869776 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438147:x1731754467680448:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531974.979527:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531974.979531:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4b0c lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4465f3 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651531974.979536:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34545:0x0] initial LVB size: 6291456, mtime: 0x627060c6, atime: 0x627060b4, ctime: 0x627060c6, blocks: 0x3000
00010000:00010000:1.0:1651531974.979541:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531974.979541:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531974.979543:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4b0c lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4465f3 expref: 6 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531974.979548:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4b0c lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4465f3 expref: 6 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531974.979563:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000968553c1, rc 0)
00000100:00100000:1.0:1651531974.979577:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000063869776 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438147:x1731754467680448:12345-10.240.43.64@tcp:101:fio.0 Request processed in 52us (74us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531974.979580:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44732
00000100:00100000:1.0:1651531974.979909:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531974.979916:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467680640
00000100:00100000:1.0:1651531974.979931:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250446
00000100:00100000:1.0:1651531974.979933:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001304ce4c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438146:x1731754467680640:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531974.979941:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca4b13 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.979945:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531974.979945:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531974.979946:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca4b13 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [438272->442367] (req 438272->442367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.979950:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca4b13 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [438272->442367] (req 438272->442367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.979962:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca4b13 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [438272->442367] (req 438272->442367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531974.979965:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca4b13 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [438272->442367] (req 438272->442367) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531974.979985:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001304ce4c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438146:x1731754467680640:12345-10.240.43.64@tcp:3:fio.0 Request processed in 51us (76us total) trans 0 rc 4096/4096
00010000:00010000:0.0:1651531974.979986:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca4b13 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [438272->442367] (req 438272->442367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.979991:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e9b84540 already unused, calling callback (0000000049fddea7)
00000100:00100000:1.0:1651531974.979992:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250446
00010000:00010000:0.0:1651531974.979992:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca4b13 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [438272->442367] (req 438272->442367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.979995:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca4b13 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [438272->442367] (req 438272->442367) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.980001:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca4b13 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [438272->442367] (req 438272->442367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531974.980005:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca4b13 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [438272->442367] (req 438272->442367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531975.023303:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531975.023311:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467681344
00000100:00100000:1.0:1651531975.023325:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250447
00000100:00100000:1.0:1651531975.023326:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438146:x1731754467681344:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531975.023334:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca4b1a lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.023338:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531975.023338:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531975.023339:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca4b1a lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [159744->163839] (req 159744->163839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.023343:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca4b1a lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [159744->163839] (req 159744->163839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.023354:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca4b1a lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [159744->163839] (req 159744->163839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.023356:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca4b1a lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [159744->163839] (req 159744->163839) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531975.023375:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438146:x1731754467681344:12345-10.240.43.64@tcp:3:fio.0 Request processed in 48us (73us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531975.023378:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250447
00010000:00010000:0.0:1651531975.023381:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca4b1a lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [159744->163839] (req 159744->163839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.023385:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a8889a80 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531975.023386:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca4b1a lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [159744->163839] (req 159744->163839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.023390:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca4b1a lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [159744->163839] (req 159744->163839) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.023395:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca4b1a lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [159744->163839] (req 159744->163839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.023398:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca4b1a lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [159744->163839] (req 159744->163839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531975.023547:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531975.023554:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467681536
00000100:00100000:1.0:1651531975.023569:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250448
00000100:00100000:1.0:1651531975.023571:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000567318ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438148:x1731754467681536:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531975.023578:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4b21 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.023582:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531975.023582:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531975.023583:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4b21 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [999424->1003519] (req 999424->1003519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.023587:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4b21 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [999424->1003519] (req 999424->1003519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.023597:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4b21 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [999424->1003519] (req 999424->1003519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.023600:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4b21 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [999424->1003519] (req 999424->1003519) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531975.023614:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000567318ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438148:x1731754467681536:12345-10.240.43.64@tcp:3:fio.0 Request processed in 42us (68us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531975.023617:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250448
00010000:00010000:1.0:1651531975.023623:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4b21 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [999424->1003519] (req 999424->1003519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.023626:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006da7a892 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531975.023627:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4b21 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [999424->1003519] (req 999424->1003519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.023634:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4b21 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [999424->1003519] (req 999424->1003519) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.023638:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4b21 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [999424->1003519] (req 999424->1003519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.023641:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4b21 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [999424->1003519] (req 999424->1003519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531975.023962:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531975.023969:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467681792
00000100:00100000:1.0:1651531975.023984:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250449
00000100:00100000:1.0:1651531975.023985:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bcdb3319 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467681792:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531975.023993:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4b28 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.023996:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531975.023997:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531975.023998:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4b28 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [196608->200703] (req 196608->200703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.024002:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4b28 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [196608->200703] (req 196608->200703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.024012:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4b28 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [196608->200703] (req 196608->200703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.024015:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4b28 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [196608->200703] (req 196608->200703) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.024033:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4b28 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [196608->200703] (req 196608->200703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531975.024034:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bcdb3319 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467681792:12345-10.240.43.64@tcp:3:fio.0 Request processed in 48us (73us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531975.024037:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250449
00010000:00010000:0.0:1651531975.024038:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008558d1b3 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531975.024039:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4b28 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [196608->200703] (req 196608->200703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.024042:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4b28 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [196608->200703] (req 196608->200703) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.024048:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4b28 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [196608->200703] (req 196608->200703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.024051:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4b28 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [196608->200703] (req 196608->200703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531975.024123:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531975.024130:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467681920
00000100:00100000:1.0:1651531975.024142:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250450
00000100:00100000:1.0:1651531975.024144:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ecb6b3b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438146:x1731754467681920:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531975.024151:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca4b2f lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.024155:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531975.024155:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531975.024156:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca4b2f lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [184320->188415] (req 184320->188415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.024160:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca4b2f lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [184320->188415] (req 184320->188415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.024170:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca4b2f lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [184320->188415] (req 184320->188415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.024173:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca4b2f lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [184320->188415] (req 184320->188415) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531975.024192:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ecb6b3b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438146:x1731754467681920:12345-10.240.43.64@tcp:3:fio.0 Request processed in 47us (69us total) trans 0 rc 4096/4096
00010000:00010000:0.0:1651531975.024192:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca4b2f lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [184320->188415] (req 184320->188415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531975.024194:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250450
00010000:00010000:0.0:1651531975.024195:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e9b84540 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531975.024196:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca4b2f lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [184320->188415] (req 184320->188415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.024199:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca4b2f lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [184320->188415] (req 184320->188415) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.024204:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca4b2f lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [184320->188415] (req 184320->188415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.024207:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca4b2f lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [184320->188415] (req 184320->188415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531975.048246:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531975.048254:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467682816
00000100:00100000:1.0:1651531975.048270:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250451
00000100:00100000:1.0:1651531975.048272:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002bf85ab5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438148:x1731754467682816:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531975.048279:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4b36 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.048284:0:216321:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4b0c lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4465f3 expref: 6 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531975.048287:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531975.048287:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531975.048288:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4b36 lrc: 4/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [839680->843775] (req 839680->843775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.048295:0:216321:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4b0c lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4465f3 expref: 6 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531975.048299:0:216321:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4b0c lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4465f3 expref: 6 pid: 166112 timeout: 22783 lvb_type: 1
00000100:00100000:1.0:1651531975.048304:0:216321:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f47fde78 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997358720:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531975.048316:0:216321:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fd6047a1 going to sleep for 6 seconds
00000100:00100000:1.0:1651531975.048565:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531975.048580:0:216321:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f47fde78 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997358720:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651531975.048585:0:216321:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4b36 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [839680->843775] (req 839680->843775) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531975.048588:0:166104:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467682880
00010000:00010000:0.0:1651531975.048595:0:166104:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4b0c lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4465f3 expref: 7 pid: 166112 timeout: 22783 lvb_type: 1
00000100:00100000:0.0:1651531975.048603:0:166104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 254
00000100:00100000:0.0:1651531975.048605:0:166104:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002d3e5ae4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438146:x1731754467682880:12345-10.240.43.64@tcp:103:ldlm_bl_01.0
00010000:00010000:0.0:1651531975.048610:0:166104:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531975.048614:0:166104:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4b0c lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4465f3 expref: 7 pid: 166112 timeout: 22783 lvb_type: 1
00010000:00010000:0.0:1651531975.048618:0:166104:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4b0c lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4465f3 expref: 7 pid: 166112 timeout: 22783 lvb_type: 1
00010000:00010000:0.0:1651531975.048624:0:166104:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4b0c lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4465f3 expref: 7 pid: 166112 timeout: 22783 lvb_type: 1
00010000:00010000:0.0:1651531975.048627:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531975.048628:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531975.048629:0:166104:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4b36 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [839680->843775] (req 839680->843775) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.048632:0:166104:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4b36 lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [839680->843775] (req 839680->843775) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.048644:0:166104:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651531975.048654:0:166104:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002d3e5ae4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438146:x1731754467682880:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 48us (89us total) trans 0 rc 0/0
00010000:00010000:1.0:1651531975.048657:0:216321:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4b36 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [839680->843775] (req 839680->843775) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531975.048657:0:166104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 254
00010000:00010000:1.0:1651531975.048661:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4b36 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [839680->843775] (req 839680->843775) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531975.084088:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531975.084097:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467683072
00000100:00100000:1.0:1651531975.084118:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44733
00000100:00100000:1.0:1651531975.084120:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000071f9ee43 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467683072:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531975.084124:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531975.084128:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4b3d lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446601 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.084136:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4b3d lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446601 expref: 9 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531975.084140:0:166112:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4b3d lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446601 expref: 9 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531975.084143:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b4c8742a, rc 0)
00000100:00100000:0.0:1651531975.084143:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531975.084154:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000071f9ee43 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467683072:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (76us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531975.084157:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44733
00000100:00100000:1.0:1651531975.084170:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467683136
00000100:00100000:1.0:1651531975.084190:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250452
00000100:00100000:1.0:1651531975.084192:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006c46ca95 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467683136:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531975.084199:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4b44 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.084202:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531975.084203:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531975.084204:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4b44 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [331776->335871] (req 331776->335871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.084207:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4b44 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [331776->335871] (req 331776->335871) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531975.084299:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531975.084307:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467683264
00000100:00100000:1.0:1651531975.084320:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44734
00000100:00100000:1.0:1651531975.084322:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009078ca7d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438146:x1731754467683264:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531975.084326:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531975.084329:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca4b4b lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44660f expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.084336:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca4b4b lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44660f expref: 12 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531975.084341:0:166112:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca4b4b lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44660f expref: 12 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531975.084344:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d44eb74d, rc 0)
00000100:00100000:1.0:1651531975.084357:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009078ca7d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438146:x1731754467683264:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (58us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531975.084360:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44734
00000100:00100000:1.0:1651531975.086011:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531975.086018:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467684416
00000100:00100000:1.0:1651531975.086030:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44735
00000100:00100000:1.0:1651531975.086032:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fb90eb28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754467684416:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531975.086035:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531975.086039:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4b52 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44661d expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.086046:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4b52 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44661d expref: 12 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531975.086050:0:166112:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4b52 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44661d expref: 12 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531975.086054:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001e36c601, rc 0)
00000100:00100000:1.0:1651531975.086067:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fb90eb28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754467684416:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (56us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531975.086069:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44735
00000100:00100000:1.0:1651531975.086512:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531975.086534:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467684544
00000100:00100000:0.0:1651531975.086550:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250453
00000100:00100000:0.0:1651531975.086552:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e4e3ecb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754467684544:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531975.086560:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4b59 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.086566:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531975.086567:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531975.086568:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4b59 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [241664->245759] (req 241664->245759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.086572:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4b59 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [241664->245759] (req 241664->245759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.086586:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4b59 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [241664->245759] (req 241664->245759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.086589:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4b59 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [241664->245759] (req 241664->245759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.086607:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4b59 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [241664->245759] (req 241664->245759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531975.086610:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e4e3ecb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754467684544:12345-10.240.43.64@tcp:3:fio.0 Request processed in 58us (98us total) trans 0 rc 4096/4096
00010000:00010000:1.0:1651531975.086611:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e2ec18e1 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531975.086612:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4b59 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [241664->245759] (req 241664->245759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531975.086614:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250453
00010000:00010000:1.0:1651531975.086625:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4b59 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [241664->245759] (req 241664->245759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.086631:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4b59 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [241664->245759] (req 241664->245759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.086634:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4b59 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [241664->245759] (req 241664->245759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531975.086937:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531975.086944:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467684672
00000100:00100000:1.0:1651531975.086955:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44736
00000100:00100000:1.0:1651531975.086956:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dce6a2c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754467684672:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531975.086960:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531975.086963:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4b60 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44662b expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.086970:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4b60 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44662b expref: 12 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531975.086975:0:166112:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4b60 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44662b expref: 12 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531975.086978:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000968553c1, rc 0)
00000100:00100000:1.0:1651531975.086989:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dce6a2c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754467684672:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (52us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531975.087001:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44736
00000100:00100000:1.0:1651531975.087687:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531975.087710:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467684928
00000100:00100000:0.0:1651531975.087724:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250454
00000100:00100000:0.0:1651531975.087726:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b67ad021 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754467684928:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531975.087733:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca4b67 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.087737:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531975.087738:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531975.087739:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca4b67 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [270336->274431] (req 270336->274431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.087747:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca4b67 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [270336->274431] (req 270336->274431) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531975.096485:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869431 is committed
00002000:00010000:1.0:1651531975.096511:0:216321:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x34545:0x0] updating lvb mtime from disk: 1651531974 -> 1651531975
00002000:00010000:1.0:1651531975.096513:0:216321:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x34545:0x0] updating lvb ctime from disk: 1651531974 -> 1651531975
00010000:00010000:1.0:1651531975.096516:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4b36 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [839680->843775] (req 839680->843775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.096519:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4b36 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [839680->843775] (req 839680->843775) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531975.096537:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002bf85ab5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754467682816:12345-10.240.43.64@tcp:4:fio.0 Request processed in 48264us (48291us total) trans 21474869431 rc 0/0
00000100:00100000:1.0:1651531975.096540:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250451
00010000:00010000:0.0:1651531975.096541:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4b36 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [839680->843775] (req 839680->843775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.096545:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006da7a892 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531975.096547:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4b36 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [839680->843775] (req 839680->843775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.096550:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4b36 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [839680->843775] (req 839680->843775) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.096555:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4b36 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [839680->843775] (req 839680->843775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.096558:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4b36 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [839680->843775] (req 839680->843775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531975.096893:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531975.096901:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467685056
00000100:00100000:1.0:1651531975.096910:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250455
00000100:00100000:1.0:1651531975.096911:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f47fde78 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754467685056:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531975.096918:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4b6e lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.096922:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531975.096922:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531975.096923:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4b6e lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [983040->987135] (req 983040->987135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.096927:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4b6e lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [983040->987135] (req 983040->987135) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531975.153017:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869434 is committed
00010000:00010000:0.0:1651531975.153040:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca4b67 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [270336->274431] (req 270336->274431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.153044:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca4b67 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [270336->274431] (req 270336->274431) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.153048:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4b44 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [331776->335871] (req 331776->335871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.153053:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4b44 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [331776->335871] (req 331776->335871) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531975.153064:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b67ad021 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438149:x1731754467684928:12345-10.240.43.64@tcp:4:fio.0 Request processed in 65337us (65377us total) trans 21474869433 rc 0/0
00000100:00100000:0.0:1651531975.153070:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250454
00000100:00100000:1.0:1651531975.153073:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006c46ca95 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438148:x1731754467683136:12345-10.240.43.64@tcp:4:fio.0 Request processed in 68879us (68931us total) trans 21474869432 rc 0/0
00000100:00100000:1.0:1651531975.153076:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250452
00010000:00010000:0.0:1651531975.153078:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca4b67 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [270336->274431] (req 270336->274431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.153082:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000075a78972 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531975.153083:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca4b67 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [270336->274431] (req 270336->274431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.153084:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4b44 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [331776->335871] (req 331776->335871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.153086:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca4b67 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [270336->274431] (req 270336->274431) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.153087:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c2b76533 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531975.153088:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4b44 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [331776->335871] (req 331776->335871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.153091:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4b44 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [331776->335871] (req 331776->335871) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.153091:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca4b67 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [270336->274431] (req 270336->274431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.153094:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca4b67 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [270336->274431] (req 270336->274431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.153096:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4b44 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [331776->335871] (req 331776->335871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.153099:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4b44 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [331776->335871] (req 331776->335871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.153109:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4b6e lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [983040->987135] (req 983040->987135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.153113:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4b6e lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [983040->987135] (req 983040->987135) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531975.153125:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f47fde78 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438149:x1731754467685056:12345-10.240.43.64@tcp:4:fio.0 Request processed in 56213us (56233us total) trans 21474869434 rc 0/0
00000100:00100000:0.0:1651531975.153128:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250455
00010000:00010000:0.0:1651531975.153134:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4b6e lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [983040->987135] (req 983040->987135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.153141:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000968553c1 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531975.153142:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4b6e lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [983040->987135] (req 983040->987135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.153144:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4b6e lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [983040->987135] (req 983040->987135) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.153149:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4b6e lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [983040->987135] (req 983040->987135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.153151:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4b6e lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [983040->987135] (req 983040->987135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531975.153486:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531975.153494:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467685312
00000100:00100000:1.0:1651531975.153516:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44737
00000100:00100000:1.0:1651531975.153518:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003a5ac9b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438149:x1731754467685312:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531975.153521:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531975.153525:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4b75 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446639 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651531975.153530:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34545:0x0] initial LVB size: 6291456, mtime: 0x627060c7, atime: 0x627060b4, ctime: 0x627060c7, blocks: 0x3000
00010000:00010000:1.0:1651531975.153535:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531975.153535:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531975.153537:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4b75 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446639 expref: 6 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531975.153542:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4b75 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446639 expref: 6 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531975.153546:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001e36c601, rc 0)
00000100:00100000:1.0:1651531975.153556:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003a5ac9b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467685312:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (70us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531975.153558:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44737
00000100:00100000:1.0:1651531975.154477:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531975.154496:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467685824
00000100:00100000:0.0:1651531975.154513:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250456
00000100:00100000:0.0:1651531975.154515:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006c903446 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438148:x1731754467685824:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531975.154522:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca4b7c lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.154527:0:216321:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4b75 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446639 expref: 6 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531975.154530:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531975.154531:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531975.154532:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca4b7c lrc: 4/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [180224->184319] (req 180224->184319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.154543:0:216321:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4b75 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446639 expref: 6 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531975.154547:0:216321:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4b75 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446639 expref: 6 pid: 166112 timeout: 22783 lvb_type: 1
00000100:00100000:0.0:1651531975.154551:0:216321:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001797bd5b pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997358784:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531975.154569:0:216321:0:(client.c:2492:ptlrpc_set_wait()) set 000000000073caa3 going to sleep for 6 seconds
00000100:00100000:0.0:1651531975.154779:0:216321:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001797bd5b pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997358784:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651531975.154784:0:216321:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca4b7c lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [180224->184319] (req 180224->184319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531975.154829:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531975.154842:0:166104:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467685888
00010000:00010000:0.0:1651531975.154848:0:166104:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4b75 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446639 expref: 7 pid: 166112 timeout: 22783 lvb_type: 1
00000100:00100000:0.0:1651531975.154858:0:166104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 255
00000100:00100000:0.0:1651531975.154860:0:166104:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b5b5b4c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438148:x1731754467685888:12345-10.240.43.64@tcp:103:ldlm_bl_06.0
00010000:00010000:0.0:1651531975.154863:0:166104:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531975.154867:0:166104:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4b75 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446639 expref: 7 pid: 166112 timeout: 22783 lvb_type: 1
00010000:00010000:0.0:1651531975.154871:0:166104:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4b75 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446639 expref: 7 pid: 166112 timeout: 22783 lvb_type: 1
00010000:00010000:0.0:1651531975.154881:0:166104:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4b75 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446639 expref: 7 pid: 166112 timeout: 22783 lvb_type: 1
00010000:00010000:0.0:1651531975.154885:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531975.154886:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531975.154886:0:166104:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca4b7c lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [180224->184319] (req 180224->184319) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.154890:0:166104:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca4b7c lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [180224->184319] (req 180224->184319) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.154897:0:166104:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651531975.154911:0:166104:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b5b5b4c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438148:x1731754467685888:12345-10.240.43.64@tcp:103:ldlm_bl_06.0 Request processed in 50us (82us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531975.154914:0:166104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 255
00010000:00010000:0.0:1651531975.154921:0:216321:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca4b7c lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [180224->184319] (req 180224->184319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.154925:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca4b7c lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [180224->184319] (req 180224->184319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531975.210357:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531975.210365:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467686016
00000100:00100000:1.0:1651531975.210376:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44738
00000100:00100000:1.0:1651531975.210378:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f05c0b82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467686016:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531975.210382:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531975.210385:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4b83 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446647 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.210394:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4b83 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446647 expref: 9 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531975.210398:0:166112:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4b83 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446647 expref: 9 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531975.210402:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c2b76533, rc 0)
00000100:00100000:1.0:1651531975.210411:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f05c0b82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467686016:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (56us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531975.210414:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44738
00000100:00100000:1.0:1651531975.211212:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531975.211258:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467686272
00000100:00100000:0.0:1651531975.211268:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44739
00000100:00100000:0.0:1651531975.211270:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e15376c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467686272:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531975.211274:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531975.211278:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca4b8a lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446655 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.211290:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca4b8a lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446655 expref: 9 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531975.211295:0:166112:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca4b8a lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446655 expref: 9 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531975.211298:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000075a78972, rc 0)
00000100:00100000:0.0:1651531975.211315:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e15376c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467686272:12345-10.240.43.64@tcp:101:fio.0 Request processed in 44us (104us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531975.211318:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44739
00000100:00100000:1.0:1651531975.211632:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531975.211639:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467686400
00000100:00100000:1.0:1651531975.211654:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250457
00000100:00100000:1.0:1651531975.211656:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000da31c48f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467686400:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531975.211663:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca4b91 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.211668:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531975.211668:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531975.211669:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca4b91 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [188416->192511] (req 188416->192511) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.211673:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca4b91 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [188416->192511] (req 188416->192511) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.211689:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca4b91 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [188416->192511] (req 188416->192511) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.211692:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca4b91 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [188416->192511] (req 188416->192511) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.211710:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca4b91 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [188416->192511] (req 188416->192511) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531975.211711:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000da31c48f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467686400:12345-10.240.43.64@tcp:3:fio.0 Request processed in 54us (80us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531975.211714:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250457
00010000:00010000:0.0:1651531975.211714:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d44eb74d already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531975.211715:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca4b91 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [188416->192511] (req 188416->192511) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.211719:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca4b91 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [188416->192511] (req 188416->192511) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.211724:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca4b91 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [188416->192511] (req 188416->192511) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.211727:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca4b91 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [188416->192511] (req 188416->192511) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531975.212016:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531975.212027:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467686528
00000100:00100000:0.0:1651531975.212036:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44740
00000100:00100000:0.0:1651531975.212038:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002bdf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467686528:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531975.212041:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531975.212045:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca4b98 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446663 expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.212052:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca4b98 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446663 expref: 9 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531975.212056:0:166111:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca4b98 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446663 expref: 9 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531975.212060:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fab23815, rc 0)
00000100:00100000:0.0:1651531975.212076:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002bdf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467686528:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (61us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531975.212079:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44740
00000001:00080000:0.0:1651531975.220992:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869435 is committed
00010000:00010000:0.0:1651531975.221006:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca4b7c lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [180224->184319] (req 180224->184319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.221010:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca4b7c lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [180224->184319] (req 180224->184319) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531975.221029:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006c903446 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438148:x1731754467685824:12345-10.240.43.64@tcp:4:fio.0 Request processed in 66514us (66552us total) trans 21474869435 rc 0/0
00000100:00100000:0.0:1651531975.221032:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250456
00010000:00010000:1.0:1651531975.221033:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca4b7c lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [180224->184319] (req 180224->184319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.221037:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000014685f38 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531975.221038:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca4b7c lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [180224->184319] (req 180224->184319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.221042:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca4b7c lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [180224->184319] (req 180224->184319) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.221047:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca4b7c lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [180224->184319] (req 180224->184319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.221050:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca4b7c lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [180224->184319] (req 180224->184319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531975.258129:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531975.258154:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467687360
00000100:00100000:0.0:1651531975.258165:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44741
00000100:00100000:0.0:1651531975.258167:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000880cd1d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438149:x1731754467687360:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531975.258171:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531975.258175:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca4b9f lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446671 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00002000:00010000:0.0:1651531975.258181:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34545:0x0] initial LVB size: 6291456, mtime: 0x627060c7, atime: 0x627060b4, ctime: 0x627060c7, blocks: 0x3000
00010000:00010000:0.0:1651531975.258185:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531975.258186:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531975.258187:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca4b9f lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446671 expref: 6 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531975.258192:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca4b9f lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446671 expref: 6 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531975.258196:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fab23815, rc 0)
00000100:00100000:0.0:1651531975.258207:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000880cd1d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467687360:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (79us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531975.258210:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44741
00000100:00100000:1.0:1651531975.324289:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531975.324315:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467688320
00000100:00100000:0.0:1651531975.324332:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250458
00000100:00100000:0.0:1651531975.324334:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b338475a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467688320:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531975.324342:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca4ba6 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.324347:0:216321:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca4b9f lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446671 expref: 6 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531975.324354:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531975.324355:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531975.324355:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca4ba6 lrc: 4/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [352256->356351] (req 352256->356351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.324363:0:216321:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca4b9f lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446671 expref: 6 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531975.324367:0:216321:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca4b9f lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446671 expref: 6 pid: 166112 timeout: 22783 lvb_type: 1
00000100:00100000:0.0:1651531975.324371:0:216321:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001797bd5b pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997358848:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531975.324385:0:216321:0:(client.c:2492:ptlrpc_set_wait()) set 000000000073caa3 going to sleep for 6 seconds
00000100:00100000:1.0:1651531975.324652:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531975.324665:0:216321:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001797bd5b pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997358848:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651531975.324670:0:216321:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca4ba6 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [352256->356351] (req 352256->356351) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531975.324678:0:166104:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467688384
00010000:00010000:0.0:1651531975.324683:0:166104:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca4b9f lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446671 expref: 7 pid: 166112 timeout: 22783 lvb_type: 1
00000100:00100000:0.0:1651531975.324697:0:166104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 256
00000100:00100000:0.0:1651531975.324698:0:166104:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000137fd3d9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438146:x1731754467688384:12345-10.240.43.64@tcp:103:ldlm_bl_03.0
00010000:00010000:0.0:1651531975.324702:0:166104:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531975.324706:0:166104:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca4b9f lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446671 expref: 7 pid: 166112 timeout: 22783 lvb_type: 1
00010000:00010000:0.0:1651531975.324711:0:166104:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca4b9f lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446671 expref: 7 pid: 166112 timeout: 22783 lvb_type: 1
00010000:00010000:0.0:1651531975.324717:0:166104:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca4b9f lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446671 expref: 7 pid: 166112 timeout: 22783 lvb_type: 1
00010000:00010000:0.0:1651531975.324721:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531975.324721:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531975.324722:0:166104:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca4ba6 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [352256->356351] (req 352256->356351) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.324725:0:166104:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca4ba6 lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [352256->356351] (req 352256->356351) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.324732:0:166104:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651531975.324741:0:166104:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000137fd3d9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438146:x1731754467688384:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 42us (90us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531975.324744:0:166104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 256
00010000:00010000:0.0:1651531975.324771:0:216321:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca4ba6 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [352256->356351] (req 352256->356351) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.324775:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca4ba6 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [352256->356351] (req 352256->356351) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531975.371569:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531975.371594:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467688576
00000100:00100000:0.0:1651531975.371604:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44742
00000100:00100000:0.0:1651531975.371606:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c4db449c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467688576:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531975.371611:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531975.371615:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca4bad lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44667f expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.371623:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca4bad lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44667f expref: 9 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531975.371628:0:166111:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca4bad lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44667f expref: 9 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531975.371645:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fab23815, rc 0)
00000100:00100000:0.0:1651531975.371656:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c4db449c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467688576:12345-10.240.43.64@tcp:101:fio.0 Request processed in 50us (89us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531975.371659:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44742
00000001:00080000:0.0:1651531975.371698:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869436 is committed
00000100:00100000:0.0:1651531975.371717:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651531975.371736:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca4ba6 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [352256->356351] (req 352256->356351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.371739:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca4ba6 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [352256->356351] (req 352256->356351) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531975.371753:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467688768
00000100:00100000:0.0:1651531975.371753:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b338475a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438149:x1731754467688320:12345-10.240.43.64@tcp:4:fio.0 Request processed in 47419us (47465us total) trans 21474869436 rc 0/0
00000100:00100000:0.0:1651531975.371757:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250458
00000100:00100000:1.0:1651531975.371769:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250459
00000100:00100000:1.0:1651531975.371772:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001797bd5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438147:x1731754467688768:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531975.371774:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca4ba6 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [352256->356351] (req 352256->356351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.371780:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4bb4 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.371781:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000075a78972 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531975.371782:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca4ba6 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [352256->356351] (req 352256->356351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.371786:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531975.371787:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531975.371788:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4bb4 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [229376->233471] (req 229376->233471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.371793:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4bb4 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [229376->233471] (req 229376->233471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.371793:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca4ba6 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [352256->356351] (req 352256->356351) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.371799:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca4ba6 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [352256->356351] (req 352256->356351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.371801:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca4ba6 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [352256->356351] (req 352256->356351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531975.372298:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531975.372317:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467689024
00000100:00100000:0.0:1651531975.372329:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250460
00000100:00100000:0.0:1651531975.372331:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001eda4376 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467689024:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531975.372338:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4bbb lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.372342:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531975.372343:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531975.372344:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4bbb lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [573440->577535] (req 573440->577535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.372348:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4bbb lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [573440->577535] (req 573440->577535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531975.372444:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531975.372453:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467689152
00000100:00100000:0.0:1651531975.372460:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44743
00000100:00100000:0.0:1651531975.372462:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bfdd313b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438146:x1731754467689152:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531975.372477:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531975.372481:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4bc2 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44668d expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.372489:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4bc2 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44668d expref: 12 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531975.372493:0:166112:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4bc2 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44668d expref: 12 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531975.372496:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000080362f27, rc 0)
00000100:00100000:0.0:1651531975.372512:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bfdd313b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438146:x1731754467689152:12345-10.240.43.64@tcp:101:fio.0 Request processed in 49us (68us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531975.372515:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44743
00000100:00100000:0.0:1651531975.409162:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531975.409170:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467689536
00000100:00100000:0.0:1651531975.409178:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44744
00000100:00100000:0.0:1651531975.409180:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f817afea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754467689536:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531975.409184:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531975.409188:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4bc9 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44669b expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.409196:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4bc9 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44669b expref: 12 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531975.409205:0:166111:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4bc9 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44669b expref: 12 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531975.409247:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000080362f27, rc 0)
00000100:00100000:0.0:1651531975.409261:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f817afea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754467689536:12345-10.240.43.64@tcp:101:fio.0 Request processed in 80us (100us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531975.409264:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44744
00000100:00100000:0.0:1651531975.409553:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531975.409561:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467689664
00000100:00100000:0.0:1651531975.409578:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250461
00000100:00100000:0.0:1651531975.409579:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b462545d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754467689664:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531975.409590:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca4bd0 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.409594:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531975.409595:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531975.409596:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca4bd0 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [700416->704511] (req 700416->704511) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.409600:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca4bd0 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [700416->704511] (req 700416->704511) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.409613:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca4bd0 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [700416->704511] (req 700416->704511) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.409616:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca4bd0 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [700416->704511] (req 700416->704511) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531975.409638:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b462545d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754467689664:12345-10.240.43.64@tcp:3:fio.0 Request processed in 57us (84us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531975.409641:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250461
00010000:00010000:0.0:1651531975.409648:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca4bd0 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [700416->704511] (req 700416->704511) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.409652:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000075a78972 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531975.409653:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca4bd0 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [700416->704511] (req 700416->704511) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.409656:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca4bd0 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [700416->704511] (req 700416->704511) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.409660:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca4bd0 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [700416->704511] (req 700416->704511) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.409663:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca4bd0 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [700416->704511] (req 700416->704511) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531975.409963:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531975.409971:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467689792
00000100:00100000:0.0:1651531975.409986:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250462
00000100:00100000:0.0:1651531975.409988:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004d72f458 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754467689792:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531975.409994:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca4bd7 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.409998:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531975.410000:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531975.410001:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca4bd7 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [782336->786431] (req 782336->786431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.410005:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca4bd7 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [782336->786431] (req 782336->786431) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531975.420726:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869438 is committed
00010000:00010000:0.0:1651531975.420746:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4bbb lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [573440->577535] (req 573440->577535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.420750:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4bbb lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [573440->577535] (req 573440->577535) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.420764:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4bb4 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [229376->233471] (req 229376->233471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531975.420770:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001eda4376 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754467689024:12345-10.240.43.64@tcp:4:fio.0 Request processed in 48438us (48472us total) trans 21474869438 rc 0/0
00000100:00100000:0.0:1651531975.420773:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250460
00010000:00010000:1.0:1651531975.420775:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4bb4 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [229376->233471] (req 229376->233471) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.420793:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4bbb lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [573440->577535] (req 573440->577535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531975.420796:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001797bd5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467688768:12345-10.240.43.64@tcp:4:fio.0 Request processed in 49023us (49078us total) trans 21474869437 rc 0/0
00010000:00010000:0.0:1651531975.420796:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000032ee36ee already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531975.420797:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4bbb lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [573440->577535] (req 573440->577535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531975.420799:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250459
00010000:00010000:0.0:1651531975.420800:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4bbb lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [573440->577535] (req 573440->577535) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.420806:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4bbb lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [573440->577535] (req 573440->577535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.420814:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4bbb lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [573440->577535] (req 573440->577535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.420817:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4bb4 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [229376->233471] (req 229376->233471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.420820:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c2b76533 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531975.420821:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4bb4 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [229376->233471] (req 229376->233471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.420823:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4bb4 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [229376->233471] (req 229376->233471) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.420827:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4bb4 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [229376->233471] (req 229376->233471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.420829:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4bb4 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [229376->233471] (req 229376->233471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531975.421097:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531975.421120:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467689920
00000100:00100000:1.0:1651531975.421134:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44745
00000100:00100000:1.0:1651531975.421138:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000091075bf7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467689920:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531975.421142:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531975.421146:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4bde lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4466a9 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.421155:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4bde lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4466a9 expref: 9 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531975.421160:0:166112:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4bde lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4466a9 expref: 9 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531975.421164:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b4c8742a, rc 0)
00000100:00100000:1.0:1651531975.421175:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000091075bf7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467689920:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (79us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531975.421178:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44745
00000100:00100000:0.0:1651531975.421549:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531975.421568:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467690176
00000100:00100000:1.0:1651531975.421584:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250463
00000100:00100000:1.0:1651531975.421586:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003b5b354a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467690176:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531975.421596:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca4be5 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.421601:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531975.421601:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531975.421602:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca4be5 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [851968->856063] (req 851968->856063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.421607:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca4be5 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [851968->856063] (req 851968->856063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.421620:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca4be5 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [851968->856063] (req 851968->856063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.421623:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca4be5 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [851968->856063] (req 851968->856063) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.421641:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca4be5 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [851968->856063] (req 851968->856063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531975.421644:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003b5b354a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467690176:12345-10.240.43.64@tcp:3:fio.0 Request processed in 57us (95us total) trans 0 rc 4096/4096
00010000:00010000:0.0:1651531975.421645:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e9b84540 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531975.421646:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca4be5 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [851968->856063] (req 851968->856063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531975.421647:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250463
00010000:00010000:0.0:1651531975.421652:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca4be5 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [851968->856063] (req 851968->856063) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.421658:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca4be5 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [851968->856063] (req 851968->856063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.421660:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca4be5 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [851968->856063] (req 851968->856063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531975.421948:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531975.421956:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467690304
00000100:00100000:1.0:1651531975.421967:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44746
00000100:00100000:1.0:1651531975.421969:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ac545f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467690304:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531975.421972:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531975.421976:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4bec lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4466b7 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.421984:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4bec lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4466b7 expref: 9 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531975.421988:0:166112:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4bec lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4466b7 expref: 9 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531975.421991:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008558d1b3, rc 0)
00000100:00100000:1.0:1651531975.422002:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ac545f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467690304:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (54us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531975.422007:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44746
00000100:00100000:0.0:1651531975.422752:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531975.422770:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467690560
00000100:00100000:1.0:1651531975.422783:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44747
00000100:00100000:1.0:1651531975.422785:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bf4022bf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467690560:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531975.422789:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531975.422792:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca4bf3 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4466c5 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.422800:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca4bf3 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4466c5 expref: 9 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531975.422804:0:166112:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca4bf3 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4466c5 expref: 9 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531975.422807:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a8889a80, rc 0)
00000100:00100000:1.0:1651531975.422818:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bf4022bf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467690560:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (67us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531975.422820:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44747
00000100:00100000:0.0:1651531975.423515:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531975.423532:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467690816
00000100:00100000:1.0:1651531975.423545:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44748
00000100:00100000:1.0:1651531975.423547:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001e61ed2d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467690816:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531975.423550:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531975.423553:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca4bfa lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4466d3 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.423561:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca4bfa lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4466d3 expref: 9 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531975.423566:0:166112:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca4bfa lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4466d3 expref: 9 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531975.423570:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d44eb74d, rc 0)
00000100:00100000:1.0:1651531975.423580:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001e61ed2d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467690816:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (65us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531975.423583:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44748
00000100:00100000:0.0:1651531975.445199:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531975.445237:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467691200
00000100:00100000:1.0:1651531975.445250:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44749
00000100:00100000:1.0:1651531975.445252:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c2e13c53 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467691200:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531975.445255:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531975.445266:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca4c01 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4466e1 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.445274:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca4c01 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4466e1 expref: 9 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531975.445278:0:166112:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca4c01 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4466e1 expref: 9 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531975.445282:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d44eb74d, rc 0)
00000100:00100000:1.0:1651531975.445293:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c2e13c53 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467691200:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (95us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531975.445295:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44749
00000100:00100000:0.0:1651531975.445613:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531975.445631:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467691328
00000100:00100000:1.0:1651531975.445647:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250464
00000100:00100000:1.0:1651531975.445649:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000043b0f16d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467691328:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531975.445657:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca4c08 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.445661:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531975.445661:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531975.445662:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca4c08 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [962560->966655] (req 962560->966655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.445666:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca4c08 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [962560->966655] (req 962560->966655) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.445678:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca4c08 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [962560->966655] (req 962560->966655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.445682:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca4c08 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [962560->966655] (req 962560->966655) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531975.445702:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000043b0f16d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467691328:12345-10.240.43.64@tcp:3:fio.0 Request processed in 52us (89us total) trans 0 rc 4096/4096
00010000:00010000:0.0:1651531975.445703:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca4c08 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [962560->966655] (req 962560->966655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531975.445705:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250464
00010000:00010000:0.0:1651531975.445708:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a8889a80 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531975.445709:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca4c08 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [962560->966655] (req 962560->966655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.445712:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca4c08 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [962560->966655] (req 962560->966655) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.445717:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca4c08 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [962560->966655] (req 962560->966655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.445720:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca4c08 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [962560->966655] (req 962560->966655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531975.480394:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869439 is committed
00010000:00010000:0.0:1651531975.480410:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca4bd7 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [782336->786431] (req 782336->786431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.480414:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca4bd7 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [782336->786431] (req 782336->786431) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531975.480436:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004d72f458 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438148:x1731754467689792:12345-10.240.43.64@tcp:4:fio.0 Request processed in 70447us (70473us total) trans 21474869439 rc 0/0
00010000:00010000:1.0:1651531975.480437:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca4bd7 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [782336->786431] (req 782336->786431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531975.480439:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250462
00010000:00010000:1.0:1651531975.480442:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fab23815 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531975.480443:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca4bd7 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [782336->786431] (req 782336->786431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.480451:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca4bd7 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [782336->786431] (req 782336->786431) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.480457:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca4bd7 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [782336->786431] (req 782336->786431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.480460:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca4bd7 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [782336->786431] (req 782336->786431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531975.480771:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531975.480780:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467691520
00000100:00100000:1.0:1651531975.480793:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44750
00000100:00100000:1.0:1651531975.480795:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003a5ac9b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438146:x1731754467691520:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531975.480799:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531975.480803:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca4c0f lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4466ef expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651531975.480808:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34545:0x0] initial LVB size: 6291456, mtime: 0x627060c7, atime: 0x627060b4, ctime: 0x627060c7, blocks: 0x3000
00010000:00010000:1.0:1651531975.480813:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531975.480813:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531975.480815:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca4c0f lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4466ef expref: 6 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531975.480820:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca4c0f lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4466ef expref: 6 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531975.480824:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d44eb74d, rc 0)
00000100:00100000:1.0:1651531975.480840:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003a5ac9b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438146:x1731754467691520:12345-10.240.43.64@tcp:101:fio.0 Request processed in 44us (70us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531975.480843:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44750
00000100:00100000:1.0:1651531975.481201:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531975.481233:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467691712
00000100:00100000:0.0:1651531975.481247:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250465
00000100:00100000:0.0:1651531975.481249:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f05c0b82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438147:x1731754467691712:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531975.481257:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4c16 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.481261:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531975.481262:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531975.481263:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4c16 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [782336->786431] (req 782336->786431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.481267:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4c16 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [782336->786431] (req 782336->786431) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.481279:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4c16 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [782336->786431] (req 782336->786431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.481286:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4c16 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [782336->786431] (req 782336->786431) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531975.481301:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f05c0b82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438147:x1731754467691712:12345-10.240.43.64@tcp:3:fio.0 Request processed in 52us (100us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531975.481304:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250465
00010000:00010000:0.0:1651531975.481310:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4c16 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [782336->786431] (req 782336->786431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.481314:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000032ee36ee already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531975.481315:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4c16 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [782336->786431] (req 782336->786431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.481318:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4c16 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [782336->786431] (req 782336->786431) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.481322:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4c16 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [782336->786431] (req 782336->786431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.481325:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4c16 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [782336->786431] (req 782336->786431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531975.481602:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531975.481620:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467691968
00000100:00100000:0.0:1651531975.481633:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250466
00000100:00100000:0.0:1651531975.481635:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e15376c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438148:x1731754467691968:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531975.481642:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca4c1d lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.481648:0:216321:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca4c0f lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4466ef expref: 6 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531975.481652:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531975.481652:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531975.481653:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca4c1d lrc: 4/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [872448->876543] (req 872448->876543) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.481660:0:216321:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca4c0f lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4466ef expref: 6 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531975.481664:0:216321:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca4c0f lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4466ef expref: 6 pid: 166112 timeout: 22784 lvb_type: 1
00000100:00100000:0.0:1651531975.481669:0:216321:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000008e0501d pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997358912:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531975.481682:0:216321:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a2b9dcac going to sleep for 6 seconds
00000100:00100000:1.0:1651531975.481738:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531975.481745:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467692096
00000100:00100000:1.0:1651531975.481758:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250467
00000100:00100000:1.0:1651531975.481760:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002bdf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438147:x1731754467692096:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531975.481767:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4c24 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.481771:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531975.481772:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531975.481773:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4c24 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [843776->847871] (req 843776->847871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.481777:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4c24 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [843776->847871] (req 843776->847871) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.481789:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4c24 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [843776->847871] (req 843776->847871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.481793:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4c24 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [843776->847871] (req 843776->847871) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.481804:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4c24 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [843776->847871] (req 843776->847871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.481808:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008558d1b3 already unused, calling callback (0000000049fddea7)
00000100:00100000:1.0:1651531975.481811:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002bdf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438147:x1731754467692096:12345-10.240.43.64@tcp:3:fio.0 Request processed in 51us (74us total) trans 0 rc 4096/4096
00010000:00010000:0.0:1651531975.481813:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4c24 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [843776->847871] (req 843776->847871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531975.481814:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250467
00010000:00010000:0.0:1651531975.481817:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4c24 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [843776->847871] (req 843776->847871) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.481823:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4c24 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [843776->847871] (req 843776->847871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.481827:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4c24 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [843776->847871] (req 843776->847871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531975.481928:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531975.481930:0:216321:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000008e0501d pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997358912:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651531975.481940:0:216321:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca4c1d lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [872448->876543] (req 872448->876543) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531975.481948:0:166104:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467692160
00010000:00010000:0.0:1651531975.481953:0:166104:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca4c0f lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4466ef expref: 7 pid: 166112 timeout: 22784 lvb_type: 1
00000100:00100000:0.0:1651531975.481964:0:166104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 257
00000100:00100000:0.0:1651531975.481965:0:166104:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000880cd1d7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438146:x1731754467692160:12345-10.240.43.64@tcp:103:ldlm_bl_05.0
00010000:00010000:0.0:1651531975.481968:0:166104:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531975.481972:0:166104:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca4c0f lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4466ef expref: 7 pid: 166112 timeout: 22784 lvb_type: 1
00010000:00010000:0.0:1651531975.481976:0:166104:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca4c0f lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4466ef expref: 7 pid: 166112 timeout: 22784 lvb_type: 1
00010000:00010000:0.0:1651531975.481982:0:166104:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca4c0f lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4466ef expref: 7 pid: 166112 timeout: 22784 lvb_type: 1
00010000:00010000:0.0:1651531975.481986:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531975.481986:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531975.481989:0:166104:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca4c1d lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [872448->876543] (req 872448->876543) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.481992:0:166104:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca4c1d lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [872448->876543] (req 872448->876543) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.481999:0:166104:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651531975.482008:0:166104:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000880cd1d7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438146:x1731754467692160:12345-10.240.43.64@tcp:103:ldlm_bl_05.0 Request processed in 42us (80us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531975.482011:0:166104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 257
00010000:00010000:0.0:1651531975.482037:0:216321:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca4c1d lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [872448->876543] (req 872448->876543) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.482041:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca4c1d lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [872448->876543] (req 872448->876543) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531975.517131:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869440 is committed
00010000:00010000:0.0:1651531975.517146:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca4c1d lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [872448->876543] (req 872448->876543) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.517150:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca4c1d lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [872448->876543] (req 872448->876543) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531975.517171:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e15376c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438148:x1731754467691968:12345-10.240.43.64@tcp:4:fio.0 Request processed in 35535us (35570us total) trans 21474869440 rc 0/0
00010000:00010000:1.0:1651531975.517174:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca4c1d lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [872448->876543] (req 872448->876543) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531975.517175:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250466
00010000:00010000:1.0:1651531975.517179:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000075a78972 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531975.517180:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca4c1d lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [872448->876543] (req 872448->876543) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.517183:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca4c1d lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [872448->876543] (req 872448->876543) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.517189:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca4c1d lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [872448->876543] (req 872448->876543) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.517192:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca4c1d lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [872448->876543] (req 872448->876543) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531975.517509:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531975.517528:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467692416
00000100:00100000:1.0:1651531975.517540:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44751
00000100:00100000:1.0:1651531975.517542:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000008e0501d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438149:x1731754467692416:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531975.517545:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531975.517549:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4c2b lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4466fd expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651531975.517554:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34545:0x0] initial LVB size: 6291456, mtime: 0x627060c7, atime: 0x627060b4, ctime: 0x627060c7, blocks: 0x3000
00010000:00010000:1.0:1651531975.517558:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531975.517559:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531975.517560:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4c2b lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4466fd expref: 6 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531975.517569:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4c2b lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4466fd expref: 6 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531975.517573:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b4c8742a, rc 0)
00000100:00100000:1.0:1651531975.517588:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000008e0501d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467692416:12345-10.240.43.64@tcp:101:fio.0 Request processed in 46us (80us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531975.517591:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44751
00000100:00100000:0.0:1651531975.518376:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531975.518385:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467692672
00000100:00100000:0.0:1651531975.518401:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250468
00000100:00100000:0.0:1651531975.518403:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000052cf3c08 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438148:x1731754467692672:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531975.518411:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4c32 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.518416:0:216321:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4c2b lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4466fd expref: 6 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531975.518419:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531975.518420:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531975.518420:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4c32 lrc: 4/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [704512->708607] (req 704512->708607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.518428:0:216321:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4c2b lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4466fd expref: 6 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531975.518431:0:216321:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4c2b lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4466fd expref: 6 pid: 166112 timeout: 22784 lvb_type: 1
00000100:00100000:0.0:1651531975.518436:0:216321:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f99d9ea1 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997358976:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531975.518448:0:216321:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a2b9dcac going to sleep for 6 seconds
00000100:00100000:0.0:1651531975.518687:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531975.518694:0:166104:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467692736
00010000:00010000:0.0:1651531975.518700:0:166104:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4c2b lrc: 5/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4466fd expref: 7 pid: 166112 timeout: 22784 lvb_type: 1
00000100:00100000:0.0:1651531975.518713:0:166104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 258
00000100:00100000:0.0:1651531975.518715:0:166104:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000b1a9136 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438147:x1731754467692736:12345-10.240.43.64@tcp:103:ldlm_bl_01.0
00010000:00010000:0.0:1651531975.518720:0:166104:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531975.518724:0:166104:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4c2b lrc: 5/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4466fd expref: 7 pid: 166112 timeout: 22784 lvb_type: 1
00010000:00010000:0.0:1651531975.518728:0:166104:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4c2b lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4466fd expref: 7 pid: 166112 timeout: 22784 lvb_type: 1
00010000:00010000:0.0:1651531975.518734:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531975.518734:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531975.518735:0:166104:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4c32 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [704512->708607] (req 704512->708607) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.518738:0:166104:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4c32 lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [704512->708607] (req 704512->708607) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.518743:0:166104:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651531975.518753:0:166104:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000b1a9136 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438147:x1731754467692736:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 37us (66us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531975.518756:0:166104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 258
00010000:00010000:0.0:1651531975.518787:0:216321:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4c2b lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4466fd expref: 6 pid: 166112 timeout: 22784 lvb_type: 1
00000100:00100000:0.0:1651531975.518791:0:216321:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f99d9ea1 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997358976:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651531975.518795:0:216321:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4c32 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [704512->708607] (req 704512->708607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.518798:0:216321:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4c32 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [704512->708607] (req 704512->708607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.518802:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4c32 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [704512->708607] (req 704512->708607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531975.542338:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531975.542347:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531975.542349:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467692992
00000100:00100000:1.0:1651531975.542367:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44752
00000100:00100000:0.0:1651531975.542368:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467693120
00000100:00100000:1.0:1651531975.542369:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f99d9ea1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467692992:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531975.542373:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531975.542377:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4c39 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44670b expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531975.542380:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250469
00000100:00100000:0.0:1651531975.542382:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000f4bed26 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438147:x1731754467693120:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531975.542386:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4c39 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44670b expref: 10 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531975.542390:0:166112:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4c39 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44670b expref: 10 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531975.542390:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4c40 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.542394:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001e36c601, rc 0)
00010000:00010000:0.0:1651531975.542394:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531975.542395:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531975.542396:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4c40 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [356352->360447] (req 356352->360447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.542400:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4c40 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [356352->360447] (req 356352->360447) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531975.542407:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f99d9ea1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438146:x1731754467692992:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (70us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531975.542410:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44752
00000100:00100000:0.0:1651531975.543107:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531975.543123:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467693376
00000100:00100000:1.0:1651531975.543132:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44753
00000100:00100000:1.0:1651531975.543133:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f7096c29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438147:x1731754467693376:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531975.543137:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531975.543140:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4c47 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446719 expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.543147:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4c47 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446719 expref: 12 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531975.543151:0:166111:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4c47 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446719 expref: 12 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531975.543154:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000968553c1, rc 0)
00000100:00100000:1.0:1651531975.543170:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f7096c29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438147:x1731754467693376:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (64us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531975.543173:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44753
00000001:00080000:0.0:1651531975.553743:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869441 is committed
00010000:00010000:0.0:1651531975.553757:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4c32 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [704512->708607] (req 704512->708607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.553760:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4c32 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [704512->708607] (req 704512->708607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531975.553776:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000052cf3c08 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467692672:12345-10.240.43.64@tcp:4:fio.0 Request processed in 35371us (35399us total) trans 21474869441 rc 0/0
00000100:00100000:0.0:1651531975.553780:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250468
00010000:00010000:0.0:1651531975.553787:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4c32 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [704512->708607] (req 704512->708607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.553790:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000032ee36ee already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531975.553791:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4c32 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [704512->708607] (req 704512->708607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.553794:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4c32 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [704512->708607] (req 704512->708607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.553799:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4c32 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [704512->708607] (req 704512->708607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.553802:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4c32 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [704512->708607] (req 704512->708607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531975.554162:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531975.554183:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467693760
00000100:00100000:1.0:1651531975.554191:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44754
00000100:00100000:1.0:1651531975.554192:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004237e3f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467693760:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531975.554196:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531975.554199:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4c4e lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446727 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.554206:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4c4e lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446727 expref: 9 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531975.554210:0:166112:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4c4e lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446727 expref: 9 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531975.554236:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000968553c1, rc 0)
00000100:00100000:1.0:1651531975.554254:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004237e3f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467693760:12345-10.240.43.64@tcp:101:fio.0 Request processed in 61us (92us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531975.554257:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44754
00000100:00100000:0.0:1651531975.554958:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531975.554965:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467694016
00000100:00100000:0.0:1651531975.554981:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250470
00000100:00100000:0.0:1651531975.554983:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007b76f7f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467694016:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531975.554990:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4c55 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.554994:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531975.554995:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531975.554996:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4c55 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [921600->925695] (req 921600->925695) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.555001:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4c55 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [921600->925695] (req 921600->925695) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531975.566532:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531975.566553:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467694144
00000100:00100000:1.0:1651531975.566564:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44755
00000100:00100000:1.0:1651531975.566566:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bf4022bf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754467694144:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531975.566569:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531975.566572:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4c5c lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446735 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.566579:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4c5c lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446735 expref: 12 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531975.566584:0:166112:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4c5c lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446735 expref: 12 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531975.566587:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000968553c1, rc 0)
00000100:00100000:1.0:1651531975.566601:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bf4022bf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754467694144:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (69us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531975.566603:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44755
00000100:00100000:0.0:1651531975.567315:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531975.567331:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467694400
00000100:00100000:1.0:1651531975.567343:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44756
00000100:00100000:1.0:1651531975.567345:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001e61ed2d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754467694400:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531975.567350:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531975.567354:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4c63 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446743 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.567361:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4c63 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446743 expref: 12 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531975.567365:0:166112:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4c63 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446743 expref: 12 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531975.567368:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001e36c601, rc 0)
00000100:00100000:1.0:1651531975.567381:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001e61ed2d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754467694400:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (66us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531975.567384:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44756
00000100:00100000:0.0:1651531975.568022:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531975.568039:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467694656
00000100:00100000:1.0:1651531975.568050:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44757
00000100:00100000:1.0:1651531975.568052:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003b40261e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754467694656:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531975.568055:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531975.568058:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4c6a lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446751 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.568064:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4c6a lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446751 expref: 12 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531975.568068:0:166112:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4c6a lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446751 expref: 12 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531975.568075:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006da7a892, rc 0)
00000100:00100000:1.0:1651531975.568089:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003b40261e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754467694656:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (67us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531975.568091:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44757
00000100:00100000:0.0:1651531975.568743:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531975.568759:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467694912
00000100:00100000:1.0:1651531975.568771:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44758
00000100:00100000:1.0:1651531975.568772:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029096870 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754467694912:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531975.568775:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531975.568779:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4c71 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44675f expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.568785:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4c71 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44675f expref: 12 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531975.568790:0:166112:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4c71 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44675f expref: 12 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531975.568793:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b4c8742a, rc 0)
00000100:00100000:1.0:1651531975.568806:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029096870 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754467694912:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (64us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531975.568809:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44758
00000100:00100000:0.0:1651531975.569474:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531975.569491:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467695168
00000100:00100000:1.0:1651531975.569503:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44759
00000100:00100000:1.0:1651531975.569504:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a899ddab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754467695168:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531975.569510:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531975.569513:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca4c78 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44676d expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.569519:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca4c78 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44676d expref: 12 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531975.569523:0:166112:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca4c78 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44676d expref: 12 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531975.569527:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d44eb74d, rc 0)
00000100:00100000:1.0:1651531975.569540:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a899ddab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754467695168:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (66us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531975.569542:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44759
00000100:00100000:0.0:1651531975.570269:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531975.570285:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467695424
00000100:00100000:1.0:1651531975.570295:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44760
00000100:00100000:1.0:1651531975.570297:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008b42dfe9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754467695424:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531975.570300:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531975.570303:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4c7f lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44677b expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.570310:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4c7f lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44677b expref: 12 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531975.570314:0:166112:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4c7f lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44677b expref: 12 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531975.570321:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008558d1b3, rc 0)
00000100:00100000:1.0:1651531975.570335:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008b42dfe9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754467695424:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (66us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531975.570337:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44760
00000100:00100000:0.0:1651531975.570964:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531975.570980:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467695680
00000100:00100000:1.0:1651531975.570991:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44761
00000100:00100000:1.0:1651531975.570993:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b10bc064 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754467695680:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531975.570996:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531975.570999:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca4c86 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446789 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.571006:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca4c86 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446789 expref: 12 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531975.571010:0:166112:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca4c86 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446789 expref: 12 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531975.571013:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a8889a80, rc 0)
00000100:00100000:1.0:1651531975.571026:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b10bc064 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754467695680:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (63us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531975.571028:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44761
00000100:00100000:0.0:1651531975.571706:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531975.571723:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467695936
00000100:00100000:1.0:1651531975.571735:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44762
00000100:00100000:1.0:1651531975.571736:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000427633c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754467695936:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531975.571752:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531975.571756:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca4c8d lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446797 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.571763:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca4c8d lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446797 expref: 12 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531975.571767:0:166112:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca4c8d lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446797 expref: 12 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531975.571770:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e9b84540, rc 0)
00000100:00100000:1.0:1651531975.571785:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000427633c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754467695936:12345-10.240.43.64@tcp:101:fio.0 Request processed in 47us (79us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531975.571787:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44762
00000100:00100000:0.0:1651531975.572051:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531975.572068:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467696064
00000100:00100000:1.0:1651531975.572078:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250471
00000100:00100000:1.0:1651531975.572079:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000329eeeee pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754467696064:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531975.572086:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4c94 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.572090:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531975.572091:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531975.572092:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4c94 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [761856->765951] (req 761856->765951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.572096:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4c94 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [761856->765951] (req 761856->765951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.572112:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4c94 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [761856->765951] (req 761856->765951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.572115:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4c94 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [761856->765951] (req 761856->765951) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531975.572136:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000329eeeee pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754467696064:12345-10.240.43.64@tcp:3:fio.0 Request processed in 55us (85us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531975.572139:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250471
00010000:00010000:0.0:1651531975.572141:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4c94 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [761856->765951] (req 761856->765951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.572145:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c2b76533 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531975.572146:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4c94 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [761856->765951] (req 761856->765951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.572150:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4c94 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [761856->765951] (req 761856->765951) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.572155:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4c94 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [761856->765951] (req 761856->765951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.572158:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4c94 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [761856->765951] (req 761856->765951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531975.614391:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869443 is committed
00010000:00010000:0.0:1651531975.614407:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4c40 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [356352->360447] (req 356352->360447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.614411:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4c40 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [356352->360447] (req 356352->360447) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531975.614433:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000f4bed26 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438147:x1731754467693120:12345-10.240.43.64@tcp:4:fio.0 Request processed in 72051us (72086us total) trans 21474869442 rc 0/0
00010000:00010000:1.0:1651531975.614435:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4c40 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [356352->360447] (req 356352->360447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531975.614437:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250469
00010000:00010000:1.0:1651531975.614440:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000080362f27 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531975.614441:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4c40 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [356352->360447] (req 356352->360447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.614444:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4c40 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [356352->360447] (req 356352->360447) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.614450:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4c40 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [356352->360447] (req 356352->360447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.614451:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4c55 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [921600->925695] (req 921600->925695) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.614453:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4c40 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [356352->360447] (req 356352->360447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.614454:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4c55 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [921600->925695] (req 921600->925695) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531975.614465:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007b76f7f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438148:x1731754467694016:12345-10.240.43.64@tcp:4:fio.0 Request processed in 59482us (59508us total) trans 21474869443 rc 0/0
00000100:00100000:0.0:1651531975.614468:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250470
00010000:00010000:0.0:1651531975.614473:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4c55 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [921600->925695] (req 921600->925695) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.614476:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c1022d42 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531975.614478:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4c55 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [921600->925695] (req 921600->925695) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.614480:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4c55 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [921600->925695] (req 921600->925695) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.614487:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4c55 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [921600->925695] (req 921600->925695) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.614490:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4c55 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [921600->925695] (req 921600->925695) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531975.614778:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531975.614801:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467696576
00000100:00100000:1.0:1651531975.614815:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44763
00000100:00100000:1.0:1651531975.614818:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000099b6616a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438149:x1731754467696576:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531975.614822:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531975.614826:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca4c9b lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4467a5 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651531975.614831:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34545:0x0] initial LVB size: 6291456, mtime: 0x627060c7, atime: 0x627060b4, ctime: 0x627060c7, blocks: 0x3000
00010000:00010000:1.0:1651531975.614835:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531975.614836:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531975.614838:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca4c9b lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4467a5 expref: 6 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531975.614843:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca4c9b lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4467a5 expref: 6 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531975.614847:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e9b84540, rc 0)
00000100:00100000:1.0:1651531975.614858:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000099b6616a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467696576:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (80us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531975.614861:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44763
00000100:00100000:0.0:1651531975.638874:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531975.638883:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467696960
00000100:00100000:0.0:1651531975.638894:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250472
00000100:00100000:0.0:1651531975.638895:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f3a0807 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438148:x1731754467696960:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531975.638902:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4ca2 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.638907:0:216321:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca4c9b lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4467a5 expref: 6 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531975.638911:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531975.638911:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531975.638912:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4ca2 lrc: 4/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [987136->991231] (req 987136->991231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.638920:0:216321:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca4c9b lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4467a5 expref: 6 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531975.638924:0:216321:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca4c9b lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4467a5 expref: 6 pid: 166112 timeout: 22784 lvb_type: 1
00000100:00100000:0.0:1651531975.638932:0:216321:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000aa58c961 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997359040:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531975.638950:0:216321:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a2b9dcac going to sleep for 6 seconds
00000100:00100000:0.0:1651531975.639204:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531975.639211:0:166104:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467697024
00010000:00010000:0.0:1651531975.639243:0:166104:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca4c9b lrc: 5/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4467a5 expref: 7 pid: 166112 timeout: 22784 lvb_type: 1
00000100:00100000:0.0:1651531975.639256:0:166104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 259
00000100:00100000:0.0:1651531975.639258:0:166104:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000053de45f6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438146:x1731754467697024:12345-10.240.43.64@tcp:103:ldlm_bl_02.0
00010000:00010000:0.0:1651531975.639261:0:166104:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531975.639265:0:166104:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca4c9b lrc: 5/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4467a5 expref: 7 pid: 166112 timeout: 22784 lvb_type: 1
00010000:00010000:0.0:1651531975.639269:0:166104:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca4c9b lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4467a5 expref: 7 pid: 166112 timeout: 22784 lvb_type: 1
00010000:00010000:0.0:1651531975.639275:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531975.639276:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531975.639277:0:166104:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4ca2 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [987136->991231] (req 987136->991231) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.639280:0:166104:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4ca2 lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [987136->991231] (req 987136->991231) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.639285:0:166104:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651531975.639299:0:166104:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000053de45f6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438146:x1731754467697024:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 40us (96us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531975.639305:0:166104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 259
00010000:00010000:0.0:1651531975.639316:0:216321:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca4c9b lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4467a5 expref: 6 pid: 166112 timeout: 22784 lvb_type: 1
00000100:00100000:0.0:1651531975.639320:0:216321:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000aa58c961 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997359040:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651531975.639324:0:216321:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4ca2 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [987136->991231] (req 987136->991231) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.639328:0:216321:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4ca2 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [987136->991231] (req 987136->991231) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.639330:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4ca2 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [987136->991231] (req 987136->991231) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531975.688005:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869444 is committed
00010000:00010000:0.0:1651531975.688020:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4ca2 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [987136->991231] (req 987136->991231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.688024:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4ca2 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [987136->991231] (req 987136->991231) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531975.688040:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f3a0807 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438148:x1731754467696960:12345-10.240.43.64@tcp:4:fio.0 Request processed in 49144us (49166us total) trans 21474869444 rc 0/0
00000100:00100000:0.0:1651531975.688043:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250472
00010000:00010000:0.0:1651531975.688050:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4ca2 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [987136->991231] (req 987136->991231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.688057:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c1022d42 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531975.688058:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4ca2 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [987136->991231] (req 987136->991231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.688061:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4ca2 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [987136->991231] (req 987136->991231) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.688102:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4ca2 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [987136->991231] (req 987136->991231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.688105:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4ca2 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [987136->991231] (req 987136->991231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531975.688119:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531975.688140:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467697280
00000100:00100000:0.0:1651531975.688152:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250473
00000100:00100000:0.0:1651531975.688153:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c4db449c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438147:x1731754467697280:12345-10.240.43.64@tcp:4:fio.0
00002000:00010000:0.0:1651531975.688162:0:216321:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34545:0x0] initial LVB size: 6291456, mtime: 0x627060c7, atime: 0x627060b4, ctime: 0x627060c7, blocks: 0x3000
00010000:00010000:0.0:1651531975.688164:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4ca9 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.688168:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531975.688169:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531975.688169:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4ca9 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [921600->925695] (req 921600->925695) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.688173:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4ca9 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [921600->925695] (req 921600->925695) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531975.688321:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531975.688342:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467697216
00000100:00100000:0.0:1651531975.688345:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531975.688355:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467697408
00000100:00100000:0.0:1651531975.688361:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44764
00000100:00100000:0.0:1651531975.688364:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aa58c961 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438149:x1731754467697216:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651531975.688365:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44765
00000100:00100000:1.0:1651531975.688366:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009c93d7f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438146:x1731754467697408:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531975.688369:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531975.688370:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531975.688373:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca4cb0 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4467b3 expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.688384:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca4cb7 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4467c1 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.688397:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca4cb0 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4467b3 expref: 11 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531975.688399:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca4cb7 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4467c1 expref: 11 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531975.688402:0:166111:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca4cb0 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4467b3 expref: 11 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531975.688403:0:166112:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca4cb7 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4467c1 expref: 11 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531975.688405:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002c5e01dd, rc 0)
00010000:00010000:1.0:1651531975.688407:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a8889a80, rc 0)
00000100:00100000:0.0:1651531975.688421:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aa58c961 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438149:x1731754467697216:12345-10.240.43.64@tcp:101:fio.0 Request processed in 57us (100us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531975.688424:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44764
00000100:00100000:1.0:1651531975.688425:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009c93d7f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438146:x1731754467697408:12345-10.240.43.64@tcp:101:fio.0 Request processed in 57us (81us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531975.688428:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44765
00000100:00100000:0.0:1651531975.688733:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531975.688752:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467697664
00000100:00100000:1.0:1651531975.688763:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250474
00000100:00100000:1.0:1651531975.688764:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000942b56fd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467697664:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531975.688771:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4cbe lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.688775:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531975.688776:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531975.688777:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4cbe lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [86016->450559] (req 86016->450559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.688781:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4cbe lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [86016->450559] (req 86016->450559) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.688960:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4cbe lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [86016->450559] (req 86016->450559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.688968:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4cbe lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [86016->450559] (req 86016->450559) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531975.688984:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000942b56fd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467697664:12345-10.240.43.64@tcp:3:fio.0 Request processed in 218us (251us total) trans 0 rc 8192/8192
00000100:00100000:1.0:1651531975.688987:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250474
00010000:00010000:1.0:1651531975.688993:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4cbe lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [86016->450559] (req 86016->450559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.688996:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008558d1b3 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531975.688997:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4cbe lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [86016->450559] (req 86016->450559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.689000:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4cbe lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [86016->450559] (req 86016->450559) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.689005:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4cbe lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [86016->450559] (req 86016->450559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.689007:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4cbe lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [86016->450559] (req 86016->450559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531975.689321:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531975.689339:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467698176
00000100:00100000:1.0:1651531975.689347:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44766
00000100:00100000:1.0:1651531975.689349:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ffcdece2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467698176:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531975.689352:0:206699:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531975.689357:0:206699:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca4cc5 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4467cf expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.689364:0:206699:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca4cc5 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4467cf expref: 9 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531975.689369:0:206699:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca4cc5 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4467cf expref: 9 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531975.689372:0:206699:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d44eb74d, rc 0)
00000100:00100000:1.0:1651531975.689381:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ffcdece2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467698176:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (61us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531975.689384:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44766
00000100:00100000:0.0:1651531975.689919:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531975.689937:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467698368
00000100:00100000:1.0:1651531975.689948:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250475
00000100:00100000:1.0:1651531975.689949:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007d76765b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467698368:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531975.689958:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4ccc lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.689962:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531975.689963:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531975.689964:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4ccc lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [20480->24575] (req 20480->24575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.689968:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4ccc lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [20480->24575] (req 20480->24575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.689978:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4ccc lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [20480->24575] (req 20480->24575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.689982:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4ccc lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [20480->24575] (req 20480->24575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.690003:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4ccc lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [20480->24575] (req 20480->24575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531975.690004:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007d76765b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467698368:12345-10.240.43.64@tcp:3:fio.0 Request processed in 54us (86us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531975.690007:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250475
00010000:00010000:0.0:1651531975.690007:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000b4c8742a already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531975.690009:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4ccc lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [20480->24575] (req 20480->24575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.690013:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4ccc lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [20480->24575] (req 20480->24575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.690018:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4ccc lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [20480->24575] (req 20480->24575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.690021:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4ccc lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [20480->24575] (req 20480->24575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531975.732033:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869445 is committed
00010000:00010000:0.0:1651531975.732049:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4ca9 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [921600->925695] (req 921600->925695) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.732053:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4ca9 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [921600->925695] (req 921600->925695) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531975.732069:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c4db449c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438147:x1731754467697280:12345-10.240.43.64@tcp:4:fio.0 Request processed in 43915us (43950us total) trans 21474869445 rc 0/0
00000100:00100000:0.0:1651531975.732072:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250473
00010000:00010000:0.0:1651531975.732079:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4ca9 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [921600->925695] (req 921600->925695) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.732082:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000032ee36ee already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531975.732083:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4ca9 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [921600->925695] (req 921600->925695) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.732090:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4ca9 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [921600->925695] (req 921600->925695) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.732095:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4ca9 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [921600->925695] (req 921600->925695) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.732098:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4ca9 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [921600->925695] (req 921600->925695) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531975.744046:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531975.744065:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467698752
00000100:00100000:1.0:1651531975.744074:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44767
00000100:00100000:1.0:1651531975.744076:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000530f55ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438148:x1731754467698752:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531975.744080:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531975.744084:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca4cd3 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4467dd expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651531975.744089:0:166113:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34545:0x0] initial LVB size: 6291456, mtime: 0x627060c7, atime: 0x627060b4, ctime: 0x627060c7, blocks: 0x3000
00010000:00010000:1.0:1651531975.744094:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531975.744094:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531975.744096:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca4cd3 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4467dd expref: 6 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531975.744101:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca4cd3 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4467dd expref: 6 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531975.744105:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d44eb74d, rc 0)
00000100:00100000:1.0:1651531975.744121:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000530f55ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438148:x1731754467698752:12345-10.240.43.64@tcp:101:fio.0 Request processed in 44us (75us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531975.744127:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44767
00000100:00100000:1.0:1651531975.744693:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531975.744716:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467699136
00000100:00100000:0.0:1651531975.744733:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250476
00000100:00100000:0.0:1651531975.744735:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000009c4c564 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467699136:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531975.744743:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4cda lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.744747:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531975.744747:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531975.744748:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4cda lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [966656->970751] (req 966656->970751) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.744752:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4cda lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [966656->970751] (req 966656->970751) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.744765:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4cda lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [966656->970751] (req 966656->970751) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.744768:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4cda lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [966656->970751] (req 966656->970751) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531975.744793:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000009c4c564 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467699136:12345-10.240.43.64@tcp:3:fio.0 Request processed in 57us (100us total) trans 0 rc 4096/4096
00010000:00010000:1.0:1651531975.744794:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4cda lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [966656->970751] (req 966656->970751) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531975.744796:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250476
00010000:00010000:1.0:1651531975.744798:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000032ee36ee already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531975.744799:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4cda lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [966656->970751] (req 966656->970751) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.744802:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4cda lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [966656->970751] (req 966656->970751) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.744808:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4cda lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [966656->970751] (req 966656->970751) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.744811:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4cda lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [966656->970751] (req 966656->970751) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531975.745099:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531975.745115:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467699264
00000100:00100000:0.0:1651531975.745129:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250477
00000100:00100000:0.0:1651531975.745131:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c683c211 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467699264:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531975.745138:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca4ce1 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.745142:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531975.745143:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531975.745144:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca4ce1 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [544768->548863] (req 544768->548863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.745148:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca4ce1 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [544768->548863] (req 544768->548863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.745159:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca4ce1 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [544768->548863] (req 544768->548863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.745162:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca4ce1 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [544768->548863] (req 544768->548863) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531975.745177:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c683c211 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467699264:12345-10.240.43.64@tcp:3:fio.0 Request processed in 46us (78us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531975.745180:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250477
00010000:00010000:0.0:1651531975.745186:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca4ce1 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [544768->548863] (req 544768->548863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.745190:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002c5e01dd already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531975.745192:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca4ce1 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [544768->548863] (req 544768->548863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.745194:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca4ce1 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [544768->548863] (req 544768->548863) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.745199:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca4ce1 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [544768->548863] (req 544768->548863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.745202:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca4ce1 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [544768->548863] (req 544768->548863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531975.745529:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531975.745541:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467699392
00000100:00100000:0.0:1651531975.745556:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250478
00000100:00100000:0.0:1651531975.745557:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c0b460ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438148:x1731754467699392:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531975.745564:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4ce8 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.745569:0:216321:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca4cd3 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4467dd expref: 6 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531975.745572:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531975.745573:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531975.745574:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4ce8 lrc: 4/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [1003520->1007615] (req 1003520->1007615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.745585:0:216321:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca4cd3 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4467dd expref: 6 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531975.745589:0:216321:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca4cd3 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4467dd expref: 6 pid: 166113 timeout: 22784 lvb_type: 1
00000100:00100000:0.0:1651531975.745594:0:216321:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000063869776 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997359104:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531975.745606:0:216321:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a2b9dcac going to sleep for 6 seconds
00000100:00100000:1.0:1651531975.745866:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531975.745868:0:216321:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000063869776 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997359104:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651531975.745879:0:216321:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4ce8 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [1003520->1007615] (req 1003520->1007615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531975.745887:0:166104:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467699456
00010000:00010000:0.0:1651531975.745892:0:166104:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca4cd3 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4467dd expref: 7 pid: 166113 timeout: 22784 lvb_type: 1
00000100:00100000:0.0:1651531975.745903:0:166104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 260
00000100:00100000:0.0:1651531975.745904:0:166104:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006ebf1ead pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438147:x1731754467699456:12345-10.240.43.64@tcp:103:ldlm_bl_03.0
00010000:00010000:0.0:1651531975.745907:0:166104:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531975.745911:0:166104:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca4cd3 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4467dd expref: 7 pid: 166113 timeout: 22784 lvb_type: 1
00010000:00010000:0.0:1651531975.745915:0:166104:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca4cd3 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4467dd expref: 7 pid: 166113 timeout: 22784 lvb_type: 1
00010000:00010000:0.0:1651531975.745925:0:166104:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca4cd3 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4467dd expref: 7 pid: 166113 timeout: 22784 lvb_type: 1
00010000:00010000:0.0:1651531975.745929:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531975.745930:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531975.745930:0:166104:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4ce8 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [1003520->1007615] (req 1003520->1007615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.745933:0:166104:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4ce8 lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [1003520->1007615] (req 1003520->1007615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.745940:0:166104:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651531975.745949:0:166104:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006ebf1ead pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438147:x1731754467699456:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 44us (84us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531975.745952:0:166104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 260
00010000:00010000:0.0:1651531975.745993:0:216321:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4ce8 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [1003520->1007615] (req 1003520->1007615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.745996:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4ce8 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [1003520->1007615] (req 1003520->1007615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531975.779769:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869446 is committed
00010000:00010000:0.0:1651531975.779783:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4ce8 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [1003520->1007615] (req 1003520->1007615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.779787:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4ce8 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [1003520->1007615] (req 1003520->1007615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531975.779812:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c0b460ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438148:x1731754467699392:12345-10.240.43.64@tcp:4:fio.0 Request processed in 34254us (34283us total) trans 21474869446 rc 0/0
00000100:00100000:0.0:1651531975.779816:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250478
00010000:00010000:0.0:1651531975.779823:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4ce8 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [1003520->1007615] (req 1003520->1007615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.779827:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c1022d42 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531975.779828:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4ce8 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [1003520->1007615] (req 1003520->1007615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.779831:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4ce8 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [1003520->1007615] (req 1003520->1007615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.779836:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4ce8 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [1003520->1007615] (req 1003520->1007615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.779839:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4ce8 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [1003520->1007615] (req 1003520->1007615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531975.780157:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531975.780166:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467699584
00000100:00100000:0.0:1651531975.780182:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250479
00000100:00100000:0.0:1651531975.780184:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000063869776 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438149:x1731754467699584:12345-10.240.43.64@tcp:4:fio.0
00002000:00010000:0.0:1651531975.780193:0:216321:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34545:0x0] initial LVB size: 6291456, mtime: 0x627060c7, atime: 0x627060b4, ctime: 0x627060c7, blocks: 0x3000
00010000:00010000:0.0:1651531975.780195:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca4cef lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.780200:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531975.780201:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531975.780202:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca4cef lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [135168->139263] (req 135168->139263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.780205:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca4cef lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [135168->139263] (req 135168->139263) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531975.793637:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531975.793643:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531975.793646:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467699776
00000100:00100000:1.0:1651531975.793659:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44768
00000100:00100000:0.0:1651531975.793659:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467699840
00000100:00100000:1.0:1651531975.793661:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003d9ef3c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754467699776:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531975.793664:0:206699:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531975.793668:0:206699:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4cf6 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4467eb expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531975.793673:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250480
00000100:00100000:0.0:1651531975.793674:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b5b5b4c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438147:x1731754467699840:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531975.793682:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4cfd lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.793685:0:206699:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4cf6 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4467eb expref: 10 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531975.793686:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531975.793687:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531975.793688:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4cfd lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [667648->671743] (req 667648->671743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.793692:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4cfd lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [667648->671743] (req 667648->671743) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.793693:0:206699:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4cf6 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4467eb expref: 10 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531975.793697:0:206699:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008558d1b3, rc 0)
00000100:00100000:1.0:1651531975.793707:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003d9ef3c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754467699776:12345-10.240.43.64@tcp:101:fio.0 Request processed in 46us (72us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531975.793710:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44768
00000100:00100000:0.0:1651531975.793784:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531975.793794:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467699968
00000100:00100000:1.0:1651531975.793805:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250481
00000100:00100000:1.0:1651531975.793807:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000137fd3d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754467699968:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531975.793823:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca4d04 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.793827:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531975.793828:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531975.793829:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca4d04 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [356352->360447] (req 356352->360447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.793833:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca4d04 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [356352->360447] (req 356352->360447) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531975.804310:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869447 is committed
00010000:00010000:0.0:1651531975.804324:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca4cef lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [135168->139263] (req 135168->139263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.804331:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca4cef lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [135168->139263] (req 135168->139263) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531975.804352:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000063869776 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754467699584:12345-10.240.43.64@tcp:4:fio.0 Request processed in 24167us (24194us total) trans 21474869447 rc 0/0
00010000:00010000:1.0:1651531975.804354:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca4cef lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [135168->139263] (req 135168->139263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531975.804355:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250479
00010000:00010000:1.0:1651531975.804362:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002c5e01dd already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531975.804363:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca4cef lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [135168->139263] (req 135168->139263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.804366:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca4cef lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [135168->139263] (req 135168->139263) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.804372:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca4cef lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [135168->139263] (req 135168->139263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.804375:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca4cef lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [135168->139263] (req 135168->139263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531975.861648:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869449 is committed
00010000:00010000:0.0:1651531975.861670:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4cfd lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [667648->671743] (req 667648->671743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.861674:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4cfd lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [667648->671743] (req 667648->671743) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.861679:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca4d04 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [356352->360447] (req 356352->360447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.861683:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca4d04 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [356352->360447] (req 356352->360447) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531975.861696:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b5b5b4c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438147:x1731754467699840:12345-10.240.43.64@tcp:4:fio.0 Request processed in 68015us (68048us total) trans 21474869448 rc 0/0
00000100:00100000:0.0:1651531975.861700:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250480
00000100:00100000:1.0:1651531975.861701:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000137fd3d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467699968:12345-10.240.43.64@tcp:4:fio.0 Request processed in 67893us (67917us total) trans 21474869449 rc 0/0
00000100:00100000:1.0:1651531975.861704:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250481
00010000:00010000:0.0:1651531975.861708:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4cfd lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [667648->671743] (req 667648->671743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.861711:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c1022d42 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531975.861712:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4cfd lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [667648->671743] (req 667648->671743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.861715:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4cfd lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [667648->671743] (req 667648->671743) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.861720:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4cfd lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [667648->671743] (req 667648->671743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.861724:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4cfd lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [667648->671743] (req 667648->671743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.861728:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca4d04 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [356352->360447] (req 356352->360447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.861730:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a8889a80 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531975.861731:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca4d04 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [356352->360447] (req 356352->360447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.861734:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca4d04 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [356352->360447] (req 356352->360447) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.861737:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca4d04 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [356352->360447] (req 356352->360447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.861740:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca4d04 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [356352->360447] (req 356352->360447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531975.862016:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531975.862040:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467700544
00000100:00100000:1.0:1651531975.862049:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44769
00000100:00100000:1.0:1651531975.862051:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000880cd1d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438146:x1731754467700544:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531975.862054:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531975.862060:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4d0b lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4467f9 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651531975.862065:0:166113:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34545:0x0] initial LVB size: 6291456, mtime: 0x627060c7, atime: 0x627060b4, ctime: 0x627060c7, blocks: 0x3000
00010000:00010000:1.0:1651531975.862069:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531975.862070:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531975.862071:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4d0b lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4467f9 expref: 6 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531975.862076:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4d0b lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4467f9 expref: 6 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531975.862080:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008558d1b3, rc 0)
00000100:00100000:1.0:1651531975.862100:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000880cd1d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438146:x1731754467700544:12345-10.240.43.64@tcp:101:fio.0 Request processed in 48us (84us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531975.862103:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44769
00000100:00100000:0.0:1651531975.862467:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531975.862488:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467700800
00000100:00100000:1.0:1651531975.862501:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250482
00000100:00100000:1.0:1651531975.862503:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000b1a9136 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438147:x1731754467700800:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531975.862510:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4d12 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.862514:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531975.862515:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531975.862516:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4d12 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [368640->372735] (req 368640->372735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.862520:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4d12 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [368640->372735] (req 368640->372735) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.862533:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4d12 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [368640->372735] (req 368640->372735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.862536:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4d12 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [368640->372735] (req 368640->372735) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531975.862560:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000b1a9136 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438147:x1731754467700800:12345-10.240.43.64@tcp:3:fio.0 Request processed in 57us (94us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531975.862563:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250482
00010000:00010000:1.0:1651531975.862570:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4d12 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [368640->372735] (req 368640->372735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.862573:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000006da7a892 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531975.862574:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4d12 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [368640->372735] (req 368640->372735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.862577:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4d12 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [368640->372735] (req 368640->372735) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.862582:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4d12 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [368640->372735] (req 368640->372735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.862584:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4d12 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [368640->372735] (req 368640->372735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531975.863243:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531975.863254:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467701312
00000100:00100000:1.0:1651531975.863269:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250483
00000100:00100000:1.0:1651531975.863273:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000053de45f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467701312:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531975.863279:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4d19 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.863284:0:166118:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4d0b lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4467f9 expref: 6 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531975.863287:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531975.863288:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531975.863289:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4d19 lrc: 4/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [716800->720895] (req 716800->720895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.863296:0:166118:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4d0b lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4467f9 expref: 6 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531975.863300:0:166118:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4d0b lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4467f9 expref: 6 pid: 166113 timeout: 22784 lvb_type: 1
00000100:00100000:1.0:1651531975.863305:0:166118:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a9fc5082 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:166118:1731745997359168:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531975.863318:0:166118:0:(client.c:2492:ptlrpc_set_wait()) set 000000002ddea5d6 going to sleep for 6 seconds
00000100:00100000:0.0:1651531975.863396:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531975.863405:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467701440
00000100:00100000:0.0:1651531975.863416:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250484
00000100:00100000:0.0:1651531975.863418:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b6192482 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438146:x1731754467701440:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531975.863425:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4d20 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.863430:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531975.863431:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531975.863432:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4d20 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.863435:0:192755:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4d20 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531975.863556:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531975.863567:0:166104:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467701504
00000100:00100000:1.0:1651531975.863569:0:166118:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a9fc5082 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:166118:1731745997359168:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651531975.863574:0:166118:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4d19 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [716800->720895] (req 716800->720895) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.863574:0:166104:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4d0b lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4467f9 expref: 8 pid: 166113 timeout: 22784 lvb_type: 1
00000100:00100000:0.0:1651531975.863585:0:166104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 261
00000100:00100000:0.0:1651531975.863586:0:166104:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005ec1cbc3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467701504:12345-10.240.43.64@tcp:103:ldlm_bl_01.0
00010000:00010000:0.0:1651531975.863590:0:166104:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531975.863593:0:166104:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4d0b lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4467f9 expref: 8 pid: 166113 timeout: 22784 lvb_type: 1
00010000:00010000:0.0:1651531975.863598:0:166104:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4d0b lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4467f9 expref: 8 pid: 166113 timeout: 22784 lvb_type: 1
00010000:00010000:0.0:1651531975.863604:0:166104:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4d0b lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4467f9 expref: 8 pid: 166113 timeout: 22784 lvb_type: 1
00010000:00010000:0.0:1651531975.863607:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531975.863608:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531975.863609:0:166104:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4d19 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [716800->720895] (req 716800->720895) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.863613:0:166104:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4d19 lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [716800->720895] (req 716800->720895) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.863616:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531975.863617:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531975.863618:0:166104:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4d20 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.863620:0:166104:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4d20 lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.863633:0:166104:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1651531975.863641:0:166118:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4d19 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [716800->720895] (req 716800->720895) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531975.863644:0:166104:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005ec1cbc3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438147:x1731754467701504:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 57us (88us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531975.863647:0:166104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 261
00010000:00010000:1.0:1651531975.863649:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4d19 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [716800->720895] (req 716800->720895) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.863654:0:192755:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4d20 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.863657:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4d20 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531975.903588:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869451 is committed
00010000:00010000:0.0:1651531975.903609:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4d20 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.903613:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4d20 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.903623:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4d19 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [716800->720895] (req 716800->720895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.903633:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4d19 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [716800->720895] (req 716800->720895) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531975.903639:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b6192482 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438146:x1731754467701440:12345-10.240.43.64@tcp:4:fio.0 Request processed in 40220us (40243us total) trans 21474869450 rc 0/0
00000100:00100000:0.0:1651531975.903642:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250484
00010000:00010000:0.0:1651531975.903656:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4d20 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.903660:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f5657138 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531975.903661:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4d20 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531975.903663:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000053de45f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438149:x1731754467701312:12345-10.240.43.64@tcp:4:fio.0 Request processed in 40390us (40420us total) trans 21474869451 rc 0/0
00010000:00010000:0.0:1651531975.903664:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4d20 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531975.903667:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250483
00010000:00010000:0.0:1651531975.903687:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4d20 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.903690:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4d20 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.903694:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4d19 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [716800->720895] (req 716800->720895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.903697:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001e36c601 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531975.903698:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4d19 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [716800->720895] (req 716800->720895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.903701:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4d19 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [716800->720895] (req 716800->720895) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.903705:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4d19 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [716800->720895] (req 716800->720895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.903708:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4d19 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [716800->720895] (req 716800->720895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531975.903730:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531975.903752:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467701632
00000100:00100000:1.0:1651531975.903760:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44770
00000100:00100000:1.0:1651531975.903762:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003158b8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438148:x1731754467701632:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531975.903765:0:206699:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531975.903770:0:206699:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4d27 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446807 expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651531975.903774:0:206699:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34545:0x0] initial LVB size: 6291456, mtime: 0x627060c7, atime: 0x627060b4, ctime: 0x627060c7, blocks: 0x3000
00010000:00010000:1.0:1651531975.903787:0:206699:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531975.903788:0:206699:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531975.903790:0:206699:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4d27 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446807 expref: 6 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531975.903795:0:206699:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4d27 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446807 expref: 6 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531975.903801:0:206699:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006da7a892, rc 0)
00000100:00100000:1.0:1651531975.903811:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003158b8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438148:x1731754467701632:12345-10.240.43.64@tcp:101:fio.0 Request processed in 49us (82us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531975.903814:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44770
00000100:00100000:0.0:1651531975.903877:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531975.903900:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467701760
00000100:00100000:1.0:1651531975.903912:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44771
00000100:00100000:1.0:1651531975.903914:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cc11a3b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467701760:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531975.903917:0:206699:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531975.903921:0:206699:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4d2e lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446815 expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.903926:0:206699:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531975.903927:0:206699:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531975.903929:0:206699:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4d2e lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446815 expref: 7 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531975.903933:0:206699:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4d2e lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446815 expref: 7 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531975.903937:0:206699:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000968553c1, rc 0)
00000100:00100000:1.0:1651531975.903947:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cc11a3b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438149:x1731754467701760:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (71us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531975.903950:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44771
00000100:00100000:0.0:1651531975.904063:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531975.904085:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467702016
00000100:00100000:1.0:1651531975.904095:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44772
00000100:00100000:1.0:1651531975.904106:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000000615301 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438147:x1731754467702016:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531975.904110:0:206699:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531975.904113:0:206699:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4d35 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446823 expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.904119:0:206699:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531975.904119:0:206699:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531975.904121:0:206699:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4d35 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446823 expref: 8 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531975.904125:0:206699:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4d35 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446823 expref: 8 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531975.904129:0:206699:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008558d1b3, rc 0)
00000100:00100000:1.0:1651531975.904139:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000000615301 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467702016:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (77us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531975.904142:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44772
00000100:00100000:0.0:1651531975.904524:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531975.904544:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467702272
00000100:00100000:1.0:1651531975.904559:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250485
00000100:00100000:1.0:1651531975.904561:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000e33e11e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467702272:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531975.904568:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca4d3c lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.904572:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531975.904572:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531975.904573:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca4d3c lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [397312->401407] (req 397312->401407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.904589:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca4d3c lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [397312->401407] (req 397312->401407) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.904601:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca4d3c lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [397312->401407] (req 397312->401407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.904605:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca4d3c lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [397312->401407] (req 397312->401407) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531975.904620:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000e33e11e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467702272:12345-10.240.43.64@tcp:3:fio.0 Request processed in 58us (97us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531975.904623:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250485
00010000:00010000:1.0:1651531975.904629:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca4d3c lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [397312->401407] (req 397312->401407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.904633:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000a8889a80 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531975.904634:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca4d3c lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [397312->401407] (req 397312->401407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.904637:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca4d3c lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [397312->401407] (req 397312->401407) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.904641:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca4d3c lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [397312->401407] (req 397312->401407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.904644:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8889a80/0x3234de053ca4d3c lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [397312->401407] (req 397312->401407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531975.905047:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531975.905062:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467702656
00000100:00100000:1.0:1651531975.905078:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250486
00000100:00100000:1.0:1651531975.905080:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000021f31110 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467702656:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531975.905086:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca4d43 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.905091:0:166118:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4d27 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446807 expref: 8 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531975.905094:0:166118:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4d2e lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446815 expref: 8 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531975.905097:0:166118:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4d35 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446823 expref: 8 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531975.905100:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531975.905100:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531975.905101:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca4d43 lrc: 6/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [692224->696319] (req 692224->696319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.905108:0:166118:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4d35 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446823 expref: 8 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531975.905112:0:166118:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4d35 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446823 expref: 8 pid: 206699 timeout: 22784 lvb_type: 1
00000100:00100000:1.0:1651531975.905120:0:166118:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000315bf4eb pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:166118:1731745997359232:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651531975.905135:0:166118:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4d2e lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446815 expref: 8 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531975.905139:0:166118:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4d2e lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446815 expref: 8 pid: 206699 timeout: 22784 lvb_type: 1
00000100:00100000:1.0:1651531975.905142:0:166118:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009a23bcd5 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:166118:1731745997359296:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651531975.905148:0:166118:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4d27 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446807 expref: 8 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531975.905152:0:166118:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4d27 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446807 expref: 8 pid: 206699 timeout: 22784 lvb_type: 1
00000100:00100000:1.0:1651531975.905155:0:166118:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c62d1815 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:166118:1731745997359360:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531975.905159:0:166118:0:(client.c:2492:ptlrpc_set_wait()) set 000000002ddea5d6 going to sleep for 6 seconds
00000100:00100000:0.0:1651531975.905207:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531975.905234:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467702784
00000100:00100000:0.0:1651531975.905252:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250487
00000100:00100000:0.0:1651531975.905254:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006c46ca95 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438149:x1731754467702784:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531975.905262:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4d4a lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.905266:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531975.905267:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531975.905268:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4d4a lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [753664->757759] (req 753664->757759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.905272:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4d4a lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [753664->757759] (req 753664->757759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.905285:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4d4a lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [753664->757759] (req 753664->757759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.905289:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4d4a lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [753664->757759] (req 753664->757759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531975.905311:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006c46ca95 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438149:x1731754467702784:12345-10.240.43.64@tcp:3:fio.0 Request processed in 56us (104us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531975.905314:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250487
00010000:00010000:0.0:1651531975.905322:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4d4a lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [753664->757759] (req 753664->757759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.905326:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c1022d42 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531975.905327:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4d4a lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [753664->757759] (req 753664->757759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.905329:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4d4a lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [753664->757759] (req 753664->757759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.905334:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4d4a lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [753664->757759] (req 753664->757759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.905337:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4d4a lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [753664->757759] (req 753664->757759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531975.905544:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531975.905554:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531975.905555:0:166104:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467702912
00000100:00100000:1.0:1651531975.905562:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651531975.905562:0:166104:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4d2e lrc: 5/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446815 expref: 9 pid: 206699 timeout: 22784 lvb_type: 1
00000100:00100000:1.0:1651531975.905571:0:169267:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467702976
00000100:00100000:0.0:1651531975.905575:0:166104:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467702848
00010000:00010000:1.0:1651531975.905577:0:169267:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4d27 lrc: 5/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446807 expref: 10 pid: 206699 timeout: 22784 lvb_type: 1
00010000:00010000:0.0:1651531975.905580:0:166104:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4d35 lrc: 5/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446823 expref: 11 pid: 206699 timeout: 22784 lvb_type: 1
00000100:00100000:1.0:1651531975.905584:0:169267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 262
00000100:00100000:1.0:1651531975.905587:0:169267:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000033723645 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438147:x1731754467702912:12345-10.240.43.64@tcp:103:ldlm_bl_03.0
00010000:00010000:1.0:1651531975.905590:0:169267:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00000100:00100000:0.0:1651531975.905590:0:166104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 263
00000100:00100000:0.0:1651531975.905592:0:166104:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b9b10d48 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754467702976:12345-10.240.43.64@tcp:103:ldlm_bl_06.0
00010000:00010000:1.0:1651531975.905594:0:169267:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4d2e lrc: 5/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446815 expref: 11 pid: 206699 timeout: 22784 lvb_type: 1
00010000:00010000:0.0:1651531975.905595:0:166104:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1651531975.905597:0:169267:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4d2e lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446815 expref: 11 pid: 206699 timeout: 22784 lvb_type: 1
00010000:00010000:0.0:1651531975.905601:0:166104:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4d27 lrc: 5/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446807 expref: 11 pid: 206699 timeout: 22784 lvb_type: 1
00010000:00010000:1.0:1651531975.905603:0:169267:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1651531975.905605:0:166104:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4d27 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446807 expref: 11 pid: 206699 timeout: 22784 lvb_type: 1
00010000:00010000:0.0:1651531975.905611:0:166104:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1651531975.905615:0:169267:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000033723645 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438147:x1731754467702912:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 28us (72us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531975.905618:0:169267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 262
00000100:00100000:1.0:1651531975.905623:0:169267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 264
00000100:00100000:0.0:1651531975.905624:0:166104:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b9b10d48 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754467702976:12345-10.240.43.64@tcp:103:ldlm_bl_06.0 Request processed in 32us (70us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531975.905625:0:169267:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a9fc5082 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754467702848:12345-10.240.43.64@tcp:103:ldlm_bl_06.0
00010000:00010000:1.0:1651531975.905627:0:169267:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1651531975.905630:0:169267:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4d35 lrc: 5/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446823 expref: 10 pid: 206699 timeout: 22784 lvb_type: 1
00010000:00010000:1.0:1651531975.905633:0:169267:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4d35 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446823 expref: 10 pid: 206699 timeout: 22784 lvb_type: 1
00010000:00010000:1.0:1651531975.905638:0:169267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531975.905639:0:169267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531975.905639:0:169267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca4d43 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [692224->696319] (req 692224->696319) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531975.905643:0:166104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 263
00010000:00010000:1.0:1651531975.905649:0:169267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca4d43 lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [692224->696319] (req 692224->696319) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.905655:0:169267:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1651531975.905663:0:169267:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a9fc5082 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438149:x1731754467702848:12345-10.240.43.64@tcp:103:ldlm_bl_06.0 Request processed in 37us (101us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531975.905665:0:169267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 264
00000100:00100000:0.0:1651531975.905675:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651531975.905692:0:166118:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008558d1b3/0x3234de053ca4d35 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446823 expref: 8 pid: 206699 timeout: 22784 lvb_type: 1
00000100:00100000:1.0:1651531975.905696:0:166118:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000315bf4eb pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:166118:1731745997359232:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651531975.905700:0:166118:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000968553c1/0x3234de053ca4d2e lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446815 expref: 7 pid: 206699 timeout: 22784 lvb_type: 1
00000100:00100000:1.0:1651531975.905709:0:166118:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009a23bcd5 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:166118:1731745997359296:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651531975.905712:0:166118:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006da7a892/0x3234de053ca4d27 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446807 expref: 6 pid: 206699 timeout: 22784 lvb_type: 1
00000100:00100000:1.0:1651531975.905715:0:166118:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c62d1815 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:166118:1731745997359360:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651531975.905720:0:166118:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca4d43 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [692224->696319] (req 692224->696319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.905723:0:166118:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca4d43 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [692224->696319] (req 692224->696319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.905725:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca4d43 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [692224->696319] (req 692224->696319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531975.905795:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467703104
00000100:00100000:1.0:1651531975.905805:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44773
00000100:00100000:1.0:1651531975.905807:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000053de45f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467703104:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531975.905810:0:206699:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531975.905813:0:206699:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4d51 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446831 expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.905821:0:206699:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4d51 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446831 expref: 9 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531975.905825:0:206699:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4c8742a/0x3234de053ca4d51 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446831 expref: 9 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531975.905828:0:206699:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b4c8742a, rc 0)
00000100:00100000:1.0:1651531975.905852:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000053de45f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467703104:12345-10.240.43.64@tcp:101:fio.0 Request processed in 45us (178us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531975.905855:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44773
00000100:00100000:0.0:1651531975.905918:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531975.905927:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467703232
00000100:00100000:1.0:1651531975.905936:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44774
00000100:00100000:1.0:1651531975.905937:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000028779db6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467703232:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531975.905940:0:206699:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531975.905943:0:206699:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca4d58 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44683f expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.905950:0:206699:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca4d58 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44683f expref: 9 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531975.905955:0:206699:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9b84540/0x3234de053ca4d58 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44683f expref: 9 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531975.905959:0:206699:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e9b84540, rc 0)
00000100:00100000:1.0:1651531975.905968:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000028779db6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467703232:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (50us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531975.905970:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44774
00000100:00100000:0.0:1651531975.906276:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531975.906287:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467703360
00000100:00100000:0.0:1651531975.906310:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250488
00000100:00100000:0.0:1651531975.906312:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000670433b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467703360:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531975.906320:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca4d5f lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.906325:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531975.906325:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531975.906328:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca4d5f lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [454656->458751] (req 454656->458751) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.906332:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca4d5f lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [454656->458751] (req 454656->458751) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.906345:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca4d5f lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [454656->458751] (req 454656->458751) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.906348:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca4d5f lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [454656->458751] (req 454656->458751) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.906367:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca4d5f lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [454656->458751] (req 454656->458751) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531975.906371:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000670433b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467703360:12345-10.240.43.64@tcp:3:fio.0 Request processed in 59us (96us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531975.906374:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250488
00010000:00010000:1.0:1651531975.906375:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002c5e01dd already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531975.906377:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca4d5f lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [454656->458751] (req 454656->458751) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.906380:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca4d5f lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [454656->458751] (req 454656->458751) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.906385:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca4d5f lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [454656->458751] (req 454656->458751) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.906388:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca4d5f lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [454656->458751] (req 454656->458751) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531975.906725:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531975.906733:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467703616
00000100:00100000:0.0:1651531975.906748:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250489
00000100:00100000:0.0:1651531975.906750:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000add44b2e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467703616:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531975.906757:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4d66 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.906761:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531975.906762:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531975.906763:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4d66 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [786432->790527] (req 786432->790527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.906767:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4d66 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [786432->790527] (req 786432->790527) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531975.906880:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531975.906897:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467703744
00000100:00100000:1.0:1651531975.906910:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44775
00000100:00100000:1.0:1651531975.906913:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c62d1815 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754467703744:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531975.906916:0:206699:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531975.906920:0:206699:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4d6d lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44684d expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.906927:0:206699:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4d6d lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44684d expref: 12 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531975.906931:0:206699:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2b76533/0x3234de053ca4d6d lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44684d expref: 12 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531975.906934:0:206699:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c2b76533, rc 0)
00000100:00100000:1.0:1651531975.906948:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c62d1815 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754467703744:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (68us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531975.906950:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44775
00000100:00100000:1.0:1651531975.907590:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531975.907597:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467704000
00000100:00100000:1.0:1651531975.907609:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44776
00000100:00100000:1.0:1651531975.907611:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a23bcd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754467704000:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531975.907614:0:206699:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531975.907618:0:206699:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4d74 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44685b expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.907625:0:206699:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4d74 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44685b expref: 12 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531975.907633:0:206699:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e36c601/0x3234de053ca4d74 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44685b expref: 12 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531975.907636:0:206699:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001e36c601, rc 0)
00000100:00100000:1.0:1651531975.907649:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a23bcd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754467704000:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (60us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531975.907652:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44776
00000100:00100000:1.0:1651531975.907964:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531975.907972:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467704128
00000100:00100000:1.0:1651531975.907980:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250490
00000100:00100000:1.0:1651531975.907982:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000315bf4eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754467704128:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531975.907989:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca4d7b lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.907993:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531975.907994:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531975.907995:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca4d7b lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [831488->835583] (req 831488->835583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.907999:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca4d7b lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [831488->835583] (req 831488->835583) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.908010:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca4d7b lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [831488->835583] (req 831488->835583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.908013:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca4d7b lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [831488->835583] (req 831488->835583) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531975.908035:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000315bf4eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754467704128:12345-10.240.43.64@tcp:3:fio.0 Request processed in 52us (71us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531975.908039:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250490
00010000:00010000:1.0:1651531975.908046:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca4d7b lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [831488->835583] (req 831488->835583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.908049:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008b0c325f already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531975.908050:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca4d7b lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [831488->835583] (req 831488->835583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.908053:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca4d7b lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [831488->835583] (req 831488->835583) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.908058:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca4d7b lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [831488->835583] (req 831488->835583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.908060:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca4d7b lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [831488->835583] (req 831488->835583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531975.908317:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531975.908324:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467704256
00000100:00100000:1.0:1651531975.908333:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250491
00000100:00100000:1.0:1651531975.908335:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dfff0362 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754467704256:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531975.908342:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca4d82 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.908346:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531975.908356:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531975.908357:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca4d82 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [405504->409599] (req 405504->409599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.908361:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca4d82 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [405504->409599] (req 405504->409599) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531975.939026:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869452 is committed
00010000:00010000:1.0:1651531975.939058:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca4d43 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [692224->696319] (req 692224->696319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.939063:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca4d43 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [692224->696319] (req 692224->696319) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.939073:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca4d43 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [692224->696319] (req 692224->696319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.939078:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d44eb74d already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531975.939079:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca4d43 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [692224->696319] (req 692224->696319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531975.939083:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000021f31110 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754467702656:12345-10.240.43.64@tcp:4:fio.0 Request processed in 34003us (34037us total) trans 21474869452 rc 0/0
00000100:00100000:1.0:1651531975.939087:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250486
00010000:00010000:0.0:1651531975.939089:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca4d43 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [692224->696319] (req 692224->696319) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.939095:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca4d43 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [692224->696319] (req 692224->696319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.939098:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d44eb74d/0x3234de053ca4d43 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [692224->696319] (req 692224->696319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531975.975071:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531975.975080:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467704512
00000100:00100000:1.0:1651531975.975093:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44777
00000100:00100000:1.0:1651531975.975095:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bedaf1f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754467704512:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531975.975099:0:206699:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531975.975103:0:206699:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca4d89 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446869 expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.975111:0:206699:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca4d89 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446869 expref: 12 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531975.975116:0:206699:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca4d89 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446869 expref: 12 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531975.975129:0:206699:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008b0c325f, rc 0)
00000100:00100000:1.0:1651531975.975140:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bedaf1f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754467704512:12345-10.240.43.64@tcp:101:fio.0 Request processed in 44us (70us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531975.975143:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44777
00000100:00100000:1.0:1651531975.975867:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531975.975875:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467704768
00000100:00100000:1.0:1651531975.975888:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44778
00000100:00100000:1.0:1651531975.975889:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007a05c3e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754467704768:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531975.975893:0:206699:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531975.975897:0:206699:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca4d90 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446877 expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.975904:0:206699:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca4d90 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446877 expref: 12 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531975.975908:0:206699:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca4d90 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446877 expref: 12 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531975.975912:0:206699:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000060a6272d, rc 0)
00000100:00100000:1.0:1651531975.975922:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007a05c3e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754467704768:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (56us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531975.975924:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44778
00000100:00100000:1.0:1651531975.976246:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531975.976254:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467704896
00000100:00100000:1.0:1651531975.976263:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250492
00000100:00100000:1.0:1651531975.976274:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005dd15341 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754467704896:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531975.976282:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca4d97 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.976286:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531975.976287:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531975.976288:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca4d97 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [905216->909311] (req 905216->909311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.976292:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca4d97 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [905216->909311] (req 905216->909311) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.976304:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca4d97 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [905216->909311] (req 905216->909311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.976307:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca4d97 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [905216->909311] (req 905216->909311) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531975.976321:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005dd15341 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754467704896:12345-10.240.43.64@tcp:3:fio.0 Request processed in 47us (76us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531975.976324:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250492
00010000:00010000:1.0:1651531975.976330:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca4d97 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [905216->909311] (req 905216->909311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.976334:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000000bb25cc already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531975.976335:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca4d97 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [905216->909311] (req 905216->909311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.976338:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca4d97 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [905216->909311] (req 905216->909311) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.976351:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca4d97 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [905216->909311] (req 905216->909311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.976354:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca4d97 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [905216->909311] (req 905216->909311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531975.986769:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869454 is committed
00010000:00010000:0.0:1651531975.986790:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4d66 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [786432->790527] (req 786432->790527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.986794:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4d66 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [786432->790527] (req 786432->790527) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.986803:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca4d82 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [405504->409599] (req 405504->409599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531975.986807:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca4d82 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [405504->409599] (req 405504->409599) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531975.986815:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000add44b2e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438146:x1731754467703616:12345-10.240.43.64@tcp:4:fio.0 Request processed in 80063us (80090us total) trans 21474869453 rc 0/0
00000100:00100000:0.0:1651531975.986818:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250489
00000100:00100000:1.0:1651531975.986830:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dfff0362 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438148:x1731754467704256:12345-10.240.43.64@tcp:4:fio.0 Request processed in 78494us (78513us total) trans 21474869454 rc 0/0
00000100:00100000:1.0:1651531975.986833:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250491
00010000:00010000:0.0:1651531975.986834:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4d66 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [786432->790527] (req 786432->790527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.986837:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000032ee36ee already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531975.986838:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4d66 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [786432->790527] (req 786432->790527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.986841:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4d66 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [786432->790527] (req 786432->790527) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.986846:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4d66 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [786432->790527] (req 786432->790527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.986849:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4d66 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [786432->790527] (req 786432->790527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.986852:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca4d82 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [405504->409599] (req 405504->409599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.986855:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001cf49bf2 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531975.986856:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca4d82 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [405504->409599] (req 405504->409599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.986859:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca4d82 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [405504->409599] (req 405504->409599) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.986862:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca4d82 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [405504->409599] (req 405504->409599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.986864:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca4d82 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [405504->409599] (req 405504->409599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531975.987212:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531975.987251:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531975.987260:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467705280
00000100:00100000:1.0:1651531975.987276:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250493
00000100:00100000:1.0:1651531975.987277:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c43262d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438149:x1731754467705280:12345-10.240.43.64@tcp:4:fio.0
00002000:00010000:1.0:1651531975.987287:0:192753:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34545:0x0] initial LVB size: 6291456, mtime: 0x627060c7, atime: 0x627060b4, ctime: 0x627060c7, blocks: 0x3000
00010000:00010000:1.0:1651531975.987289:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca4d9e lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531975.987291:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467705216
00010000:00010000:1.0:1651531975.987293:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531975.987293:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531975.987297:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca4d9e lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [110592->114687] (req 110592->114687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531975.987300:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44779
00010000:00010000:1.0:1651531975.987301:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca4d9e lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [110592->114687] (req 110592->114687) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531975.987302:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000054ed0749 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438147:x1731754467705216:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531975.987306:0:206699:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531975.987310:0:206699:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4da5 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446885 expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.987318:0:206699:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4da5 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446885 expref: 7 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531975.987323:0:206699:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4da5 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446885 expref: 7 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531975.987326:0:206699:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c1022d42, rc 0)
00000100:00100000:0.0:1651531975.987341:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000054ed0749 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438147:x1731754467705216:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (130us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531975.987344:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44779
00000100:00100000:0.0:1651531975.988158:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531975.988166:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467705536
00000100:00100000:0.0:1651531975.988174:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44780
00000100:00100000:0.0:1651531975.988176:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dccc50c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467705536:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531975.988179:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531975.988183:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4dac lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446893 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.988194:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4dac lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446893 expref: 9 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531975.988199:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4dac lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446893 expref: 9 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531975.988202:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f5657138, rc 0)
00000100:00100000:0.0:1651531975.988240:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dccc50c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467705536:12345-10.240.43.64@tcp:101:fio.0 Request processed in 63us (83us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531975.988243:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44780
00000100:00100000:0.0:1651531975.988972:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531975.988979:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467705792
00000100:00100000:0.0:1651531975.988986:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44781
00000100:00100000:0.0:1651531975.988988:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e4e3ecb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467705792:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531975.988992:0:206699:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531975.988995:0:206699:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4db3 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4468a1 expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.989002:0:206699:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4db3 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4468a1 expref: 9 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531975.989007:0:206699:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4db3 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4468a1 expref: 9 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531975.989010:0:206699:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000080362f27, rc 0)
00000100:00100000:0.0:1651531975.989027:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e4e3ecb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467705792:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (55us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531975.989030:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44781
00000100:00100000:0.0:1651531975.989706:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531975.989714:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467706048
00000100:00100000:0.0:1651531975.989729:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250494
00000100:00100000:0.0:1651531975.989731:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b67ad021 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467706048:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531975.989738:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca4dba lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.989742:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531975.989743:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531975.989744:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca4dba lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [442368->446463] (req 442368->446463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531975.989749:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca4dba lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [442368->446463] (req 442368->446463) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531976.000651:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531976.000673:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467706176
00000100:00100000:0.0:1651531976.000684:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44782
00000100:00100000:0.0:1651531976.000685:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009acffcb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754467706176:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531976.000689:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531976.000693:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4dc1 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4468af expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.000701:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4dc1 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4468af expref: 12 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531976.000710:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4dc1 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4468af expref: 12 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531976.000713:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000080362f27, rc 0)
00000100:00100000:0.0:1651531976.000725:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009acffcb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754467706176:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (74us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531976.000727:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44782
00000001:00080000:0.0:1651531976.012053:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869455 is committed
00010000:00010000:1.0:1651531976.012083:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca4d9e lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [110592->114687] (req 110592->114687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531976.012087:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca4d9e lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [110592->114687] (req 110592->114687) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.012099:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca4d9e lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [110592->114687] (req 110592->114687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531976.012103:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c43262d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467705280:12345-10.240.43.64@tcp:4:fio.0 Request processed in 24825us (24852us total) trans 21474869455 rc 0/0
00010000:00010000:0.0:1651531976.012103:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000000bb25cc already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531976.012104:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca4d9e lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [110592->114687] (req 110592->114687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531976.012106:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250493
00010000:00010000:0.0:1651531976.012108:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca4d9e lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [110592->114687] (req 110592->114687) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.012113:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca4d9e lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [110592->114687] (req 110592->114687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.012116:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca4d9e lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [110592->114687] (req 110592->114687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531976.025108:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531976.025116:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467706688
00000100:00100000:0.0:1651531976.025126:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44783
00000100:00100000:0.0:1651531976.025127:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002d3e5ae4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467706688:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531976.025131:0:206699:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531976.025135:0:206699:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4dc8 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4468bd expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.025143:0:206699:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4dc8 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4468bd expref: 9 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531976.025147:0:206699:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4dc8 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4468bd expref: 9 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531976.025151:0:206699:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000080362f27, rc 0)
00000100:00100000:0.0:1651531976.025166:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002d3e5ae4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467706688:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (60us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531976.025169:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44783
00000001:00080000:0.0:1651531976.047494:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869456 is committed
00010000:00010000:0.0:1651531976.047509:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca4dba lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [442368->446463] (req 442368->446463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.047513:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca4dba lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [442368->446463] (req 442368->446463) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531976.047528:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b67ad021 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438146:x1731754467706048:12345-10.240.43.64@tcp:4:fio.0 Request processed in 57796us (57822us total) trans 21474869456 rc 0/0
00000100:00100000:0.0:1651531976.047531:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250494
00010000:00010000:0.0:1651531976.047537:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca4dba lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [442368->446463] (req 442368->446463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.047542:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000075a78972 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531976.047543:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca4dba lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [442368->446463] (req 442368->446463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.047545:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca4dba lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [442368->446463] (req 442368->446463) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.047550:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca4dba lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [442368->446463] (req 442368->446463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.047553:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca4dba lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [442368->446463] (req 442368->446463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531976.047954:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531976.047972:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467707072
00000100:00100000:0.0:1651531976.047989:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250495
00000100:00100000:0.0:1651531976.047991:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d9e74b4c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438146:x1731754467707072:12345-10.240.43.64@tcp:4:fio.0
00002000:00010000:0.0:1651531976.048000:0:192755:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34545:0x0] initial LVB size: 6291456, mtime: 0x627060c7, atime: 0x627060b4, ctime: 0x627060c7, blocks: 0x3000
00010000:00010000:0.0:1651531976.048002:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4dcf lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.048006:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531976.048007:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531976.048008:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4dcf lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [413696->417791] (req 413696->417791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.048012:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4dcf lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [413696->417791] (req 413696->417791) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531976.061384:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531976.061393:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467707200
00000100:00100000:0.0:1651531976.061401:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44784
00000100:00100000:0.0:1651531976.061402:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000071f9ee43 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467707200:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531976.061406:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531976.061410:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca4dd6 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4468cb expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.061418:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca4dd6 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4468cb expref: 9 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531976.061422:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca4dd6 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4468cb expref: 9 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531976.061426:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000075a78972, rc 0)
00000100:00100000:0.0:1651531976.061457:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000071f9ee43 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467707200:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (59us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531976.061460:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44784
00000100:00100000:0.0:1651531976.061487:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531976.061494:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467707328
00000100:00100000:0.0:1651531976.061500:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44785
00000100:00100000:0.0:1651531976.061502:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009078ca7d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467707328:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531976.061505:0:206699:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531976.061508:0:206699:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4ddd lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4468d9 expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.061529:0:206699:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4ddd lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4468d9 expref: 9 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531976.061533:0:206699:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4ddd lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4468d9 expref: 9 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531976.061537:0:206699:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f5657138, rc 0)
00000100:00100000:0.0:1651531976.061551:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009078ca7d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467707328:12345-10.240.43.64@tcp:101:fio.0 Request processed in 49us (64us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531976.061554:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44785
00000100:00100000:0.0:1651531976.062448:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531976.062456:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467707712
00000100:00100000:0.0:1651531976.062463:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44786
00000100:00100000:0.0:1651531976.062464:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fb90eb28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467707712:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531976.062468:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531976.062471:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4de4 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4468e7 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.062478:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4de4 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4468e7 expref: 9 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531976.062482:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4de4 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4468e7 expref: 9 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531976.062485:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c1022d42, rc 0)
00000100:00100000:0.0:1651531976.062504:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fb90eb28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467707712:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (56us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531976.062507:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44786
00000100:00100000:0.0:1651531976.062585:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531976.062592:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467707840
00000100:00100000:0.0:1651531976.062599:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44787
00000100:00100000:0.0:1651531976.062601:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dce6a2c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467707840:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531976.062604:0:206699:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531976.062607:0:206699:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4deb lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4468f5 expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.062614:0:206699:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4deb lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4468f5 expref: 9 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531976.062618:0:206699:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4deb lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4468f5 expref: 9 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531976.062622:0:206699:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000032ee36ee, rc 0)
00000100:00100000:0.0:1651531976.062636:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dce6a2c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467707840:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (52us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531976.062639:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44787
00000100:00100000:0.0:1651531976.063082:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531976.063104:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467708096
00000100:00100000:1.0:1651531976.063116:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250496
00000100:00100000:1.0:1651531976.063118:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b462545d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467708096:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531976.063125:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca4df2 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531976.063130:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531976.063130:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531976.063131:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca4df2 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [552960->557055] (req 552960->557055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531976.063135:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca4df2 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [552960->557055] (req 552960->557055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531976.063148:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca4df2 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [552960->557055] (req 552960->557055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531976.063151:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca4df2 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [552960->557055] (req 552960->557055) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531976.063166:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b462545d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467708096:12345-10.240.43.64@tcp:3:fio.0 Request processed in 48us (84us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531976.063169:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250496
00010000:00010000:1.0:1651531976.063175:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca4df2 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [552960->557055] (req 552960->557055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531976.063178:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000060a6272d already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531976.063179:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca4df2 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [552960->557055] (req 552960->557055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531976.063182:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca4df2 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [552960->557055] (req 552960->557055) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531976.063187:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca4df2 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [552960->557055] (req 552960->557055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531976.063189:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca4df2 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [552960->557055] (req 552960->557055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531976.072745:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869457 is committed
00002000:00010000:0.0:1651531976.072758:0:192755:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x34545:0x0] updating lvb mtime from disk: 1651531975 -> 1651531976
00002000:00010000:0.0:1651531976.072760:0:192755:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x34545:0x0] updating lvb ctime from disk: 1651531975 -> 1651531976
00010000:00010000:0.0:1651531976.072762:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4dcf lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [413696->417791] (req 413696->417791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.072770:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4dcf lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [413696->417791] (req 413696->417791) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531976.072786:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d9e74b4c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438146:x1731754467707072:12345-10.240.43.64@tcp:4:fio.0 Request processed in 24795us (24833us total) trans 21474869457 rc 0/0
00000100:00100000:0.0:1651531976.072789:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250495
00010000:00010000:0.0:1651531976.072796:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4dcf lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [413696->417791] (req 413696->417791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.072799:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000080362f27 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531976.072800:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4dcf lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [413696->417791] (req 413696->417791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.072803:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4dcf lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [413696->417791] (req 413696->417791) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.072808:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4dcf lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [413696->417791] (req 413696->417791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.072811:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4dcf lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [413696->417791] (req 413696->417791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531976.073133:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531976.073152:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467708416
00000100:00100000:0.0:1651531976.073168:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250497
00000100:00100000:0.0:1651531976.073170:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003ffbc5dc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438147:x1731754467708416:12345-10.240.43.64@tcp:4:fio.0
00002000:00010000:0.0:1651531976.073179:0:192755:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34545:0x0] initial LVB size: 6291456, mtime: 0x627060c8, atime: 0x627060b4, ctime: 0x627060c8, blocks: 0x3000
00010000:00010000:0.0:1651531976.073182:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4df9 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.073186:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531976.073187:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531976.073188:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4df9 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [253952->258047] (req 253952->258047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.073192:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4df9 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [253952->258047] (req 253952->258047) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531976.085893:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531976.085902:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467708544
00000100:00100000:0.0:1651531976.085909:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44788
00000100:00100000:0.0:1651531976.085911:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001797bd5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467708544:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531976.085914:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531976.085927:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4e00 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446903 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.085935:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4e00 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446903 expref: 9 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531976.085939:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4e00 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446903 expref: 9 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531976.085943:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000080362f27, rc 0)
00000100:00100000:0.0:1651531976.085959:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001797bd5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467708544:12345-10.240.43.64@tcp:101:fio.0 Request processed in 47us (66us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531976.085964:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44788
00000100:00100000:0.0:1651531976.086278:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531976.086298:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467708672
00000100:00100000:1.0:1651531976.086311:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250498
00000100:00100000:1.0:1651531976.086313:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003b5b354a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467708672:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531976.086320:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca4e07 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531976.086325:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531976.086325:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531976.086326:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca4e07 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [720896->724991] (req 720896->724991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531976.086330:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca4e07 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [720896->724991] (req 720896->724991) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531976.086341:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca4e07 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [720896->724991] (req 720896->724991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531976.086345:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca4e07 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [720896->724991] (req 720896->724991) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.086365:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca4e07 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [720896->724991] (req 720896->724991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531976.086366:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003b5b354a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467708672:12345-10.240.43.64@tcp:3:fio.0 Request processed in 52us (88us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531976.086369:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250498
00010000:00010000:0.0:1651531976.086369:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000060a6272d already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531976.086370:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca4e07 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [720896->724991] (req 720896->724991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.086373:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca4e07 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [720896->724991] (req 720896->724991) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.086379:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca4e07 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [720896->724991] (req 720896->724991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.086382:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca4e07 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [720896->724991] (req 720896->724991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531976.086702:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531976.086717:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467708800
00000100:00100000:1.0:1651531976.086728:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250499
00000100:00100000:1.0:1651531976.086729:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004d72f458 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467708800:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531976.086736:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca4e0e lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531976.086740:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531976.086742:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531976.086743:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca4e0e lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [356352->360447] (req 356352->360447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531976.086746:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca4e0e lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [356352->360447] (req 356352->360447) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531976.097277:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869458 is committed
00010000:00010000:0.0:1651531976.097291:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4df9 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [253952->258047] (req 253952->258047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.097294:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4df9 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [253952->258047] (req 253952->258047) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531976.097314:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003ffbc5dc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467708416:12345-10.240.43.64@tcp:4:fio.0 Request processed in 24143us (24181us total) trans 21474869458 rc 0/0
00010000:00010000:1.0:1651531976.097318:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4df9 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [253952->258047] (req 253952->258047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531976.097320:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250497
00010000:00010000:1.0:1651531976.097322:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000032ee36ee already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531976.097323:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4df9 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [253952->258047] (req 253952->258047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531976.097327:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4df9 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [253952->258047] (req 253952->258047) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531976.097332:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4df9 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [253952->258047] (req 253952->258047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531976.097335:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca4df9 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [253952->258047] (req 253952->258047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531976.097635:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531976.097643:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467708928
00000100:00100000:0.0:1651531976.097651:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44789
00000100:00100000:0.0:1651531976.097653:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bfdd313b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467708928:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531976.097656:0:206699:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531976.097660:0:206699:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4e15 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446911 expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.097667:0:206699:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4e15 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446911 expref: 9 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531976.097672:0:206699:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4e15 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446911 expref: 9 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531976.097675:0:206699:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000080362f27, rc 0)
00000100:00100000:0.0:1651531976.097684:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bfdd313b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467708928:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (50us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531976.097687:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44789
00000100:00100000:0.0:1651531976.098445:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531976.098452:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467709184
00000100:00100000:0.0:1651531976.098458:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44790
00000100:00100000:0.0:1651531976.098460:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f817afea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467709184:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531976.098463:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531976.098467:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4e1c lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44691f expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.098475:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4e1c lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44691f expref: 9 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531976.098479:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4e1c lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44691f expref: 9 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531976.098482:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c1022d42, rc 0)
00000100:00100000:0.0:1651531976.098491:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f817afea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467709184:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (47us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531976.098494:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44790
00000100:00100000:0.0:1651531976.121536:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531976.121545:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467709632
00000100:00100000:0.0:1651531976.121561:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250500
00000100:00100000:0.0:1651531976.121563:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000091075bf7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467709632:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531976.121571:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4e23 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.121576:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531976.121576:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531976.121577:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4e23 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [851968->856063] (req 851968->856063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.121581:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4e23 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [851968->856063] (req 851968->856063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531976.156723:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869459 is committed
00010000:00010000:1.0:1651531976.156754:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca4e0e lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [356352->360447] (req 356352->360447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531976.156759:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca4e0e lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [356352->360447] (req 356352->360447) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531976.156778:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004d72f458 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467708800:12345-10.240.43.64@tcp:4:fio.0 Request processed in 70048us (70076us total) trans 21474869459 rc 0/0
00010000:00010000:0.0:1651531976.156780:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca4e0e lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [356352->360447] (req 356352->360447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531976.156783:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250499
00010000:00010000:0.0:1651531976.156785:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008b0c325f already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531976.156786:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca4e0e lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [356352->360447] (req 356352->360447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.156789:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca4e0e lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [356352->360447] (req 356352->360447) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.156795:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca4e0e lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [356352->360447] (req 356352->360447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.156798:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca4e0e lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [356352->360447] (req 356352->360447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531976.169260:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531976.169269:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467709952
00000100:00100000:0.0:1651531976.169278:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44791
00000100:00100000:0.0:1651531976.169280:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ac545f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467709952:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531976.169283:0:206699:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531976.169287:0:206699:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4e2a lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44692d expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.169295:0:206699:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4e2a lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44692d expref: 9 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531976.169299:0:206699:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4e2a lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44692d expref: 9 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531976.169304:0:206699:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000080362f27, rc 0)
00000100:00100000:0.0:1651531976.169321:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ac545f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467709952:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (62us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531976.169324:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44791
00000100:00100000:0.0:1651531976.170081:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531976.170088:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467710208
00000100:00100000:0.0:1651531976.170095:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44792
00000100:00100000:0.0:1651531976.170096:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007f998d3c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467710208:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531976.170100:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531976.170103:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4e31 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44693b expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.170110:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4e31 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44693b expref: 9 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531976.170114:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4e31 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44693b expref: 9 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531976.170118:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f5657138, rc 0)
00000100:00100000:0.0:1651531976.170134:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007f998d3c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467710208:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (54us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531976.170137:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44792
00000001:00080000:0.0:1651531976.205806:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869460 is committed
00010000:00010000:0.0:1651531976.205822:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4e23 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [851968->856063] (req 851968->856063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.205829:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4e23 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [851968->856063] (req 851968->856063) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531976.205845:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000091075bf7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438149:x1731754467709632:12345-10.240.43.64@tcp:4:fio.0 Request processed in 84281us (84310us total) trans 21474869460 rc 0/0
00000100:00100000:0.0:1651531976.205848:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250500
00010000:00010000:0.0:1651531976.205855:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4e23 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [851968->856063] (req 851968->856063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.205858:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c1022d42 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531976.205859:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4e23 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [851968->856063] (req 851968->856063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.205862:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4e23 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [851968->856063] (req 851968->856063) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.205867:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4e23 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [851968->856063] (req 851968->856063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.205870:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4e23 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [851968->856063] (req 851968->856063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531976.207147:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531976.207166:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467710848
00000100:00100000:0.0:1651531976.207183:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250501
00000100:00100000:0.0:1651531976.207184:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ffcc974c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438148:x1731754467710848:12345-10.240.43.64@tcp:4:fio.0
00002000:00010000:0.0:1651531976.207193:0:192755:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34545:0x0] initial LVB size: 6291456, mtime: 0x627060c8, atime: 0x627060b4, ctime: 0x627060c8, blocks: 0x3000
00010000:00010000:0.0:1651531976.207197:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4e38 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.207201:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531976.207201:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531976.207202:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4e38 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [475136->479231] (req 475136->479231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.207206:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4e38 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [475136->479231] (req 475136->479231) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531976.254516:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531976.254550:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467711040
00000100:00100000:1.0:1651531976.254563:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250502
00000001:00080000:0.0:1651531976.254564:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869461 is committed
00000100:00100000:1.0:1651531976.254565:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000df1eb0d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467711040:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531976.254572:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca4e3f lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531976.254576:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531976.254577:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531976.254578:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca4e3f lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [557056->561151] (req 557056->561151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531976.254582:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca4e3f lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [557056->561151] (req 557056->561151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.254584:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4e38 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [475136->479231] (req 475136->479231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.254588:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4e38 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [475136->479231] (req 475136->479231) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531976.254608:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ffcc974c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438148:x1731754467710848:12345-10.240.43.64@tcp:4:fio.0 Request processed in 47423us (47462us total) trans 21474869461 rc 0/0
00000100:00100000:0.0:1651531976.254611:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250501
00010000:00010000:0.0:1651531976.254624:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4e38 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [475136->479231] (req 475136->479231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.254627:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f5657138 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531976.254628:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4e38 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [475136->479231] (req 475136->479231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.254635:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4e38 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [475136->479231] (req 475136->479231) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.254641:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4e38 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [475136->479231] (req 475136->479231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.254643:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4e38 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [475136->479231] (req 475136->479231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531976.290634:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531976.290643:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467711360
00000100:00100000:0.0:1651531976.290651:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44793
00000100:00100000:0.0:1651531976.290653:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000053497d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467711360:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531976.290658:0:206699:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531976.290664:0:206699:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4e46 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446949 expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.290676:0:206699:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4e46 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446949 expref: 9 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531976.290681:0:206699:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4e46 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446949 expref: 9 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531976.290685:0:206699:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f5657138, rc 0)
00000100:00100000:0.0:1651531976.290713:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000053497d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467711360:12345-10.240.43.64@tcp:101:fio.0 Request processed in 59us (80us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531976.290720:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44793
00000001:00080000:0.0:1651531976.303855:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869462 is committed
00010000:00010000:1.0:1651531976.303885:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca4e3f lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [557056->561151] (req 557056->561151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531976.303889:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca4e3f lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [557056->561151] (req 557056->561151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531976.303909:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000df1eb0d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438149:x1731754467711040:12345-10.240.43.64@tcp:4:fio.0 Request processed in 49343us (49394us total) trans 21474869462 rc 0/0
00000100:00100000:1.0:1651531976.303912:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250502
00010000:00010000:0.0:1651531976.303913:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca4e3f lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [557056->561151] (req 557056->561151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.303917:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f2af03c8 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531976.303918:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca4e3f lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [557056->561151] (req 557056->561151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.303922:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca4e3f lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [557056->561151] (req 557056->561151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.303927:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca4e3f lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [557056->561151] (req 557056->561151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.303930:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca4e3f lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [557056->561151] (req 557056->561151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531976.304273:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531976.304281:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467711744
00000100:00100000:1.0:1651531976.304296:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44794
00000100:00100000:1.0:1651531976.304298:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438148:x1731754467711744:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531976.304302:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531976.304306:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca4e4d lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446957 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651531976.304311:0:166113:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34545:0x0] initial LVB size: 6291456, mtime: 0x627060c8, atime: 0x627060b4, ctime: 0x627060c8, blocks: 0x3000
00010000:00010000:1.0:1651531976.304316:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531976.304316:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531976.304318:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca4e4d lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446957 expref: 6 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531976.304323:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca4e4d lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446957 expref: 6 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531976.304327:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f6ecb7e5, rc 0)
00000100:00100000:1.0:1651531976.304337:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438148:x1731754467711744:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (64us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531976.304340:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44794
00000100:00100000:1.0:1651531976.374458:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531976.374468:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531976.374482:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467712128
00000100:00100000:1.0:1651531976.374496:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250503
00000100:00100000:0.0:1651531976.374497:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467712192
00000100:00100000:1.0:1651531976.374498:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000567318ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438148:x1731754467712128:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531976.374507:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca4e54 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531976.374513:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250504
00000100:00100000:0.0:1651531976.374514:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c65d6bc4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438148:x1731754467712192:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531976.374520:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531976.374521:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531976.374522:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca4e54 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [479232->483327] (req 479232->483327) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.374522:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4e5b lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531976.374527:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca4e54 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [479232->483327] (req 479232->483327) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.374528:0:216321:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca4e4d lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446957 expref: 7 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531976.374535:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531976.374536:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531976.374536:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4e5b lrc: 4/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [258048->262143] (req 258048->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531976.374539:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca4e54 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [479232->483327] (req 479232->483327) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531976.374543:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca4e54 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [479232->483327] (req 479232->483327) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.374555:0:216321:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca4e4d lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446957 expref: 7 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531976.374559:0:216321:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca4e4d lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446957 expref: 7 pid: 166113 timeout: 22785 lvb_type: 1
00000100:00100000:1.0:1651531976.374562:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000567318ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438148:x1731754467712128:12345-10.240.43.64@tcp:3:fio.0 Request processed in 63us (104us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531976.374564:0:216321:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000942b56fd pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997359424:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531976.374565:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250503
00000100:00100000:0.0:1651531976.374575:0:216321:0:(client.c:2492:ptlrpc_set_wait()) set 000000008ce9bece going to sleep for 6 seconds
00010000:00010000:0.0:1651531976.374580:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca4e54 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [479232->483327] (req 479232->483327) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.374583:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d3014069 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531976.374585:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca4e54 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [479232->483327] (req 479232->483327) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.374588:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca4e54 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [479232->483327] (req 479232->483327) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.374593:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca4e54 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [479232->483327] (req 479232->483327) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.374596:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca4e54 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [479232->483327] (req 479232->483327) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531976.374899:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531976.374902:0:216321:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000942b56fd pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997359424:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531976.374906:0:169267:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467712384
00010000:00010000:0.0:1651531976.374907:0:216321:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4e5b lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [258048->262143] (req 258048->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531976.374912:0:169267:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca4e4d lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446957 expref: 7 pid: 166113 timeout: 22785 lvb_type: 1
00000100:00100000:1.0:1651531976.374923:0:169267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 265
00000100:00100000:1.0:1651531976.374924:0:169267:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000065be21ea pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438147:x1731754467712384:12345-10.240.43.64@tcp:103:ldlm_bl_01.0
00010000:00010000:1.0:1651531976.374928:0:169267:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1651531976.374932:0:169267:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca4e4d lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446957 expref: 7 pid: 166113 timeout: 22785 lvb_type: 1
00010000:00010000:1.0:1651531976.374940:0:169267:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca4e4d lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446957 expref: 7 pid: 166113 timeout: 22785 lvb_type: 1
00010000:00010000:1.0:1651531976.374946:0:169267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca4e4d lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446957 expref: 7 pid: 166113 timeout: 22785 lvb_type: 1
00010000:00010000:1.0:1651531976.374950:0:169267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531976.374951:0:169267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531976.374951:0:169267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4e5b lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [258048->262143] (req 258048->262143) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531976.374955:0:169267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4e5b lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [258048->262143] (req 258048->262143) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531976.374963:0:169267:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1651531976.374965:0:216321:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4e5b lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [258048->262143] (req 258048->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.374968:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4e5b lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [258048->262143] (req 258048->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531976.374973:0:169267:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000065be21ea pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438147:x1731754467712384:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 48us (75us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531976.374976:0:169267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 265
00000001:00080000:0.0:1651531976.434611:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869463 is committed
00010000:00010000:0.0:1651531976.434627:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4e5b lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [258048->262143] (req 258048->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.434631:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4e5b lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [258048->262143] (req 258048->262143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531976.434653:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c65d6bc4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438148:x1731754467712192:12345-10.240.43.64@tcp:4:fio.0 Request processed in 60138us (60184us total) trans 21474869463 rc 0/0
00000100:00100000:0.0:1651531976.434657:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250504
00010000:00010000:0.0:1651531976.434665:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4e5b lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [258048->262143] (req 258048->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.434668:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f5657138 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531976.434669:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4e5b lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [258048->262143] (req 258048->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.434676:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4e5b lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [258048->262143] (req 258048->262143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.434681:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4e5b lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [258048->262143] (req 258048->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.434684:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4e5b lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [258048->262143] (req 258048->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531976.435029:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531976.435037:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467712832
00000100:00100000:1.0:1651531976.435050:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44795
00000100:00100000:1.0:1651531976.435051:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bcdb3319 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438147:x1731754467712832:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531976.435055:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531976.435059:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca4e62 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446965 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651531976.435064:0:166113:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34545:0x0] initial LVB size: 6291456, mtime: 0x627060c8, atime: 0x627060b4, ctime: 0x627060c8, blocks: 0x3000
00010000:00010000:1.0:1651531976.435078:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531976.435079:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531976.435081:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca4e62 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446965 expref: 6 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531976.435086:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca4e62 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446965 expref: 6 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531976.435090:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f6ecb7e5, rc 0)
00000100:00100000:1.0:1651531976.435100:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bcdb3319 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438147:x1731754467712832:12345-10.240.43.64@tcp:101:fio.0 Request processed in 48us (72us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531976.435103:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44795
00000100:00100000:1.0:1651531976.436644:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531976.436662:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467713344
00000100:00100000:0.0:1651531976.436675:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250505
00000100:00100000:0.0:1651531976.436677:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ecb6b3b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438146:x1731754467713344:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531976.436684:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4e69 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.436689:0:216321:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca4e62 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446965 expref: 6 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531976.436692:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531976.436693:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531976.436694:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4e69 lrc: 4/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [483328->487423] (req 483328->487423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.436701:0:216321:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca4e62 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446965 expref: 6 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531976.436705:0:216321:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca4e62 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446965 expref: 6 pid: 166113 timeout: 22785 lvb_type: 1
00000100:00100000:0.0:1651531976.436712:0:216321:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000942b56fd pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997359488:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531976.436731:0:216321:0:(client.c:2492:ptlrpc_set_wait()) set 000000008ce9bece going to sleep for 6 seconds
00000100:00100000:1.0:1651531976.436970:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531976.436973:0:216321:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000942b56fd pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997359488:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531976.436977:0:169267:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467713408
00010000:00010000:0.0:1651531976.436977:0:216321:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4e69 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [483328->487423] (req 483328->487423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531976.436983:0:169267:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca4e62 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446965 expref: 7 pid: 166113 timeout: 22785 lvb_type: 1
00000100:00100000:1.0:1651531976.436993:0:169267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 266
00000100:00100000:1.0:1651531976.436995:0:169267:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002bf85ab5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438146:x1731754467713408:12345-10.240.43.64@tcp:103:ldlm_bl_04.0
00010000:00010000:1.0:1651531976.436998:0:169267:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1651531976.437002:0:169267:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca4e62 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446965 expref: 7 pid: 166113 timeout: 22785 lvb_type: 1
00010000:00010000:1.0:1651531976.437006:0:169267:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca4e62 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446965 expref: 7 pid: 166113 timeout: 22785 lvb_type: 1
00010000:00010000:1.0:1651531976.437023:0:169267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca4e62 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446965 expref: 7 pid: 166113 timeout: 22785 lvb_type: 1
00010000:00010000:1.0:1651531976.437027:0:169267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531976.437028:0:169267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531976.437029:0:169267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4e69 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [483328->487423] (req 483328->487423) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531976.437032:0:169267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4e69 lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [483328->487423] (req 483328->487423) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531976.437044:0:169267:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1651531976.437050:0:216321:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4e69 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [483328->487423] (req 483328->487423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531976.437054:0:169267:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002bf85ab5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438146:x1731754467713408:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 58us (85us total) trans 0 rc 0/0
00010000:00010000:0.0:1651531976.437054:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4e69 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [483328->487423] (req 483328->487423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531976.437057:0:169267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 266
00000100:00100000:1.0:1651531976.483617:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531976.483626:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467713536
00000100:00100000:1.0:1651531976.483639:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44796
00000100:00100000:1.0:1651531976.483641:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009c17b179 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467713536:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531976.483644:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531976.483648:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca4e70 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446973 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531976.483657:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca4e70 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446973 expref: 9 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531976.483671:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca4e70 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446973 expref: 9 pid: 166113 timeout: 0 lvb_type: 1
00000001:00080000:0.0:1651531976.483677:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869464 is committed
00010000:00010000:1.0:1651531976.483684:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f6ecb7e5, rc 0)
00010000:00010000:0.0:1651531976.483692:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4e69 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [483328->487423] (req 483328->487423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531976.483695:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009c17b179 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467713536:12345-10.240.43.64@tcp:101:fio.0 Request processed in 54us (79us total) trans 0 rc 301/301
00010000:00010000:0.0:1651531976.483695:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4e69 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [483328->487423] (req 483328->487423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531976.483698:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44796
00000100:00100000:0.0:1651531976.483711:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ecb6b3b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438146:x1731754467713344:12345-10.240.43.64@tcp:4:fio.0 Request processed in 47033us (47067us total) trans 21474869464 rc 0/0
00000100:00100000:0.0:1651531976.483714:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250505
00010000:00010000:0.0:1651531976.483722:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4e69 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [483328->487423] (req 483328->487423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.483725:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c1022d42 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531976.483727:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4e69 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [483328->487423] (req 483328->487423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.483730:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4e69 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [483328->487423] (req 483328->487423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.483735:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4e69 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [483328->487423] (req 483328->487423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.483738:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4e69 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [483328->487423] (req 483328->487423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531976.484565:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531976.484573:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467713920
00000100:00100000:1.0:1651531976.484586:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44797
00000100:00100000:1.0:1651531976.484588:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bcdb3319 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438148:x1731754467713920:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531976.484591:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531976.484596:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca4e77 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446981 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651531976.484601:0:166113:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34545:0x0] initial LVB size: 6291456, mtime: 0x627060c8, atime: 0x627060b4, ctime: 0x627060c8, blocks: 0x3000
00010000:00010000:1.0:1651531976.484605:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531976.484606:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531976.484607:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca4e77 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446981 expref: 6 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531976.484612:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca4e77 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446981 expref: 6 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531976.484616:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c806f265, rc 0)
00000100:00100000:1.0:1651531976.484626:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bcdb3319 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438148:x1731754467713920:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (62us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531976.484629:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44797
00000100:00100000:1.0:1651531976.485394:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531976.485413:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467714176
00000100:00100000:0.0:1651531976.485425:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250506
00000100:00100000:0.0:1651531976.485427:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f47fde78 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438148:x1731754467714176:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531976.485434:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4e7e lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.485439:0:216321:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca4e77 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446981 expref: 6 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531976.485442:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531976.485443:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531976.485444:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4e7e lrc: 4/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [118784->122879] (req 118784->122879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.485451:0:216321:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca4e77 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446981 expref: 6 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531976.485458:0:216321:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca4e77 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446981 expref: 6 pid: 166113 timeout: 22785 lvb_type: 1
00000100:00100000:0.0:1651531976.485463:0:216321:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000942b56fd pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997359552:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531976.485482:0:216321:0:(client.c:2492:ptlrpc_set_wait()) set 000000008ce9bece going to sleep for 6 seconds
00000100:00100000:0.0:1651531976.485682:0:216321:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000942b56fd pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997359552:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651531976.485701:0:216321:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4e7e lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [118784->122879] (req 118784->122879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531976.485717:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531976.485731:0:169267:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467714240
00010000:00010000:1.0:1651531976.485737:0:169267:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca4e77 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446981 expref: 7 pid: 166113 timeout: 22785 lvb_type: 1
00000100:00100000:1.0:1651531976.485749:0:169267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 267
00000100:00100000:1.0:1651531976.485751:0:169267:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002d7b2943 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438149:x1731754467714240:12345-10.240.43.64@tcp:103:ldlm_bl_02.0
00010000:00010000:1.0:1651531976.485754:0:169267:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1651531976.485758:0:169267:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca4e77 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446981 expref: 7 pid: 166113 timeout: 22785 lvb_type: 1
00010000:00010000:1.0:1651531976.485762:0:169267:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca4e77 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446981 expref: 7 pid: 166113 timeout: 22785 lvb_type: 1
00010000:00010000:1.0:1651531976.485768:0:169267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca4e77 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446981 expref: 7 pid: 166113 timeout: 22785 lvb_type: 1
00010000:00010000:1.0:1651531976.485771:0:169267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531976.485772:0:169267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531976.485773:0:169267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4e7e lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [118784->122879] (req 118784->122879) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531976.485776:0:169267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4e7e lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [118784->122879] (req 118784->122879) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531976.485785:0:169267:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1651531976.485787:0:216321:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4e7e lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [118784->122879] (req 118784->122879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.485790:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4e7e lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [118784->122879] (req 118784->122879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531976.485794:0:169267:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002d7b2943 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467714240:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 43us (78us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531976.485799:0:169267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 267
00000100:00100000:1.0:1651531976.531363:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531976.531372:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467714368
00000100:00100000:1.0:1651531976.531384:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44798
00000100:00100000:1.0:1651531976.531386:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000065be21ea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467714368:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531976.531390:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531976.531393:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca4e85 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44698f expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531976.531401:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca4e85 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44698f expref: 9 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531976.531405:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca4e85 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44698f expref: 9 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531976.531409:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c806f265, rc 0)
00000100:00100000:1.0:1651531976.531419:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000065be21ea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467714368:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (56us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531976.531421:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44798
00000100:00100000:1.0:1651531976.531471:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531976.531478:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467714496
00000100:00100000:1.0:1651531976.531492:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44799
00000100:00100000:1.0:1651531976.531494:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002bf85ab5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467714496:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531976.531497:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531976.531500:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca4e8c lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44699d expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531976.531508:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca4e8c lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44699d expref: 9 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531976.531512:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca4e8c lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44699d expref: 9 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531976.531516:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f6ecb7e5, rc 0)
00000100:00100000:1.0:1651531976.531525:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002bf85ab5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467714496:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (54us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531976.531528:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44799
00000100:00100000:1.0:1651531976.531963:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531976.531986:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467714624
00000100:00100000:0.0:1651531976.532003:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250507
00000100:00100000:0.0:1651531976.532005:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aa58c961 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467714624:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531976.532013:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4e93 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.532017:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531976.532018:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531976.532019:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4e93 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [110592->114687] (req 110592->114687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.532027:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4e93 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [110592->114687] (req 110592->114687) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.532040:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4e93 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [110592->114687] (req 110592->114687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.532043:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4e93 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [110592->114687] (req 110592->114687) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531976.532066:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aa58c961 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467714624:12345-10.240.43.64@tcp:3:fio.0 Request processed in 60us (102us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531976.532069:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250507
00010000:00010000:0.0:1651531976.532077:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4e93 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [110592->114687] (req 110592->114687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.532080:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c1022d42 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531976.532081:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4e93 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [110592->114687] (req 110592->114687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.532084:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4e93 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [110592->114687] (req 110592->114687) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.532089:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4e93 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [110592->114687] (req 110592->114687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.532091:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4e93 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [110592->114687] (req 110592->114687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531976.532411:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531976.532422:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467714880
00000100:00100000:0.0:1651531976.532435:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250508
00000100:00100000:0.0:1651531976.532437:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003158b8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467714880:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531976.532444:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4e9a lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.532448:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531976.532449:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531976.532450:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4e9a lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [360448->364543] (req 360448->364543) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.532454:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4e9a lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [360448->364543] (req 360448->364543) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531976.532531:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531976.532556:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467715008
00000100:00100000:1.0:1651531976.532565:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44800
00000100:00100000:1.0:1651531976.532566:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cc11a3b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754467715008:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531976.532570:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531976.532573:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca4ea1 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4469ab expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531976.532581:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca4ea1 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4469ab expref: 12 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531976.532585:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca4ea1 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4469ab expref: 12 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531976.532592:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f6135e30, rc 0)
00000100:00100000:1.0:1651531976.532602:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cc11a3b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754467715008:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (71us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531976.532604:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44800
00000100:00100000:1.0:1651531976.533343:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531976.533350:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467715264
00000100:00100000:1.0:1651531976.533363:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44801
00000100:00100000:1.0:1651531976.533364:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000000615301 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754467715264:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531976.533368:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531976.533371:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca4ea8 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4469b9 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531976.533379:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca4ea8 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4469b9 expref: 12 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531976.533383:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca4ea8 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4469b9 expref: 12 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531976.533386:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f58aeba9, rc 0)
00000100:00100000:1.0:1651531976.533395:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000000615301 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754467715264:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (53us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531976.533398:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44801
00000100:00100000:1.0:1651531976.534107:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531976.534114:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467715520
00000100:00100000:1.0:1651531976.534127:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44802
00000100:00100000:1.0:1651531976.534131:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000053de45f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754467715520:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531976.534134:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531976.534137:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca4eaf lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4469c7 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531976.534144:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca4eaf lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4469c7 expref: 12 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531976.534148:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca4eaf lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4469c7 expref: 12 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531976.534152:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c8969b4f, rc 0)
00000100:00100000:1.0:1651531976.534161:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000053de45f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754467715520:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (54us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531976.534163:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44802
00000001:00080000:0.0:1651531976.543390:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869465 is committed
00010000:00010000:0.0:1651531976.543403:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4e7e lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [118784->122879] (req 118784->122879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.543407:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4e7e lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [118784->122879] (req 118784->122879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531976.543428:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f47fde78 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467714176:12345-10.240.43.64@tcp:4:fio.0 Request processed in 58000us (58034us total) trans 21474869465 rc 0/0
00000100:00100000:0.0:1651531976.543431:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250506
00010000:00010000:0.0:1651531976.543439:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4e7e lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [118784->122879] (req 118784->122879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.543446:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f5657138 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531976.543447:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4e7e lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [118784->122879] (req 118784->122879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.543450:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4e7e lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [118784->122879] (req 118784->122879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.543455:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4e7e lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [118784->122879] (req 118784->122879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.543457:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4e7e lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [118784->122879] (req 118784->122879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531976.543761:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531976.543769:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467715904
00000100:00100000:1.0:1651531976.543781:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44803
00000100:00100000:1.0:1651531976.543783:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003d9ef3c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467715904:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531976.543786:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531976.543790:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca4eb6 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4469d5 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531976.543797:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca4eb6 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4469d5 expref: 9 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531976.543805:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca4eb6 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4469d5 expref: 9 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531976.543808:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c8969b4f, rc 0)
00000100:00100000:1.0:1651531976.543818:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003d9ef3c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467715904:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (58us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531976.543820:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44803
00000001:00080000:0.0:1651531976.604081:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869466 is committed
00010000:00010000:0.0:1651531976.604097:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4e9a lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [360448->364543] (req 360448->364543) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.604100:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4e9a lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [360448->364543] (req 360448->364543) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531976.604122:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003158b8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438148:x1731754467714880:12345-10.240.43.64@tcp:4:fio.0 Request processed in 71683us (71711us total) trans 21474869466 rc 0/0
00000100:00100000:0.0:1651531976.604125:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250508
00010000:00010000:0.0:1651531976.604133:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4e9a lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [360448->364543] (req 360448->364543) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.604136:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000080362f27 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531976.604139:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4e9a lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [360448->364543] (req 360448->364543) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.604142:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4e9a lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [360448->364543] (req 360448->364543) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.604147:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4e9a lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [360448->364543] (req 360448->364543) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.604149:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4e9a lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [360448->364543] (req 360448->364543) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531976.605211:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531976.605241:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467716544
00000100:00100000:1.0:1651531976.605252:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44804
00000100:00100000:1.0:1651531976.605254:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a925fbf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438149:x1731754467716544:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531976.605257:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531976.605261:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca4ebd lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4469e3 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651531976.605266:0:166113:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34545:0x0] initial LVB size: 6291456, mtime: 0x627060c8, atime: 0x627060b4, ctime: 0x627060c8, blocks: 0x3000
00010000:00010000:1.0:1651531976.605270:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531976.605271:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531976.605273:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca4ebd lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4469e3 expref: 6 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531976.605277:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca4ebd lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4469e3 expref: 6 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531976.605281:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c8969b4f, rc 0)
00000100:00100000:1.0:1651531976.605292:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a925fbf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467716544:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (82us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531976.605295:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44804
00000100:00100000:1.0:1651531976.631538:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531976.631560:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467717184
00000100:00100000:0.0:1651531976.631572:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250509
00000100:00100000:0.0:1651531976.631574:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006e255cae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438147:x1731754467717184:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531976.631581:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4ec4 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.631585:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531976.631586:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531976.631587:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4ec4 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [790528->794623] (req 790528->794623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.631591:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4ec4 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [790528->794623] (req 790528->794623) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.631603:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4ec4 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [790528->794623] (req 790528->794623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.631606:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4ec4 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [790528->794623] (req 790528->794623) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531976.631629:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006e255cae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438147:x1731754467717184:12345-10.240.43.64@tcp:3:fio.0 Request processed in 54us (91us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531976.631632:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250509
00010000:00010000:0.0:1651531976.631639:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4ec4 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [790528->794623] (req 790528->794623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.631642:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000080362f27 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531976.631643:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4ec4 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [790528->794623] (req 790528->794623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.631646:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4ec4 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [790528->794623] (req 790528->794623) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.631650:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4ec4 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [790528->794623] (req 790528->794623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.631653:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4ec4 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [790528->794623] (req 790528->794623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531976.655633:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531976.655656:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467717568
00000100:00100000:0.0:1651531976.655668:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250510
00000100:00100000:0.0:1651531976.655669:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c4ea889e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467717568:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531976.655676:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4ecb lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.655680:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531976.655682:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531976.655683:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4ecb lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [417792->421887] (req 417792->421887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.655687:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4ecb lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [417792->421887] (req 417792->421887) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.655698:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4ecb lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [417792->421887] (req 417792->421887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.655702:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4ecb lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [417792->421887] (req 417792->421887) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531976.655722:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c4ea889e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467717568:12345-10.240.43.64@tcp:3:fio.0 Request processed in 52us (89us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531976.655725:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250510
00010000:00010000:0.0:1651531976.655732:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4ecb lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [417792->421887] (req 417792->421887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.655735:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000080362f27 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531976.655736:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4ecb lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [417792->421887] (req 417792->421887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.655739:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4ecb lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [417792->421887] (req 417792->421887) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.655743:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4ecb lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [417792->421887] (req 417792->421887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.655746:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4ecb lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [417792->421887] (req 417792->421887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531976.656066:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531976.656077:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467717696
00000100:00100000:0.0:1651531976.656087:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250511
00000100:00100000:0.0:1651531976.656088:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000059e5b3a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438148:x1731754467717696:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531976.656095:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4ed2 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.656098:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531976.656099:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531976.656100:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4ed2 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [520192->524287] (req 520192->524287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.656104:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4ed2 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [520192->524287] (req 520192->524287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.656114:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4ed2 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [520192->524287] (req 520192->524287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.656117:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4ed2 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [520192->524287] (req 520192->524287) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531976.656138:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000059e5b3a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438148:x1731754467717696:12345-10.240.43.64@tcp:3:fio.0 Request processed in 49us (72us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531976.656141:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250511
00010000:00010000:0.0:1651531976.656148:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4ed2 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [520192->524287] (req 520192->524287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.656151:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f5657138 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531976.656154:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4ed2 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [520192->524287] (req 520192->524287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.656157:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4ed2 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [520192->524287] (req 520192->524287) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.656161:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4ed2 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [520192->524287] (req 520192->524287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.656164:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4ed2 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [520192->524287] (req 520192->524287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531976.656251:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531976.656262:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467717824
00000100:00100000:0.0:1651531976.656273:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250512
00000100:00100000:0.0:1651531976.656274:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003562cf4d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438147:x1731754467717824:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531976.656281:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4ed9 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.656285:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531976.656285:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531976.656286:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4ed9 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [806912->811007] (req 806912->811007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.656290:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4ed9 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [806912->811007] (req 806912->811007) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.656300:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4ed9 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [806912->811007] (req 806912->811007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.656303:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4ed9 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [806912->811007] (req 806912->811007) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531976.656325:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003562cf4d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438147:x1731754467717824:12345-10.240.43.64@tcp:3:fio.0 Request processed in 50us (75us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531976.656328:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250512
00010000:00010000:0.0:1651531976.656335:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4ed9 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [806912->811007] (req 806912->811007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.656339:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c1022d42 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531976.656340:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4ed9 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [806912->811007] (req 806912->811007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.656342:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4ed9 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [806912->811007] (req 806912->811007) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.656347:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4ed9 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [806912->811007] (req 806912->811007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.656350:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4ed9 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [806912->811007] (req 806912->811007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531976.657090:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531976.657108:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467718208
00000100:00100000:0.0:1651531976.657118:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250513
00000100:00100000:0.0:1651531976.657120:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f7006631 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438147:x1731754467718208:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531976.657126:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca4ee0 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.657131:0:192755:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca4ebd lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4469e3 expref: 6 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531976.657135:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531976.657136:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531976.657137:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca4ee0 lrc: 4/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [262144->266239] (req 262144->266239) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.657144:0:192755:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca4ebd lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4469e3 expref: 6 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531976.657148:0:192755:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca4ebd lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4469e3 expref: 6 pid: 166113 timeout: 22785 lvb_type: 1
00000100:00100000:0.0:1651531976.657152:0:192755:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000942b56fd pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0001_UUID:192755:1731745997359616:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531976.657171:0:192755:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a4532c78 going to sleep for 6 seconds
00000100:00100000:0.0:1651531976.657429:0:192755:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000942b56fd pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0001_UUID:192755:1731745997359616:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531976.657434:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651531976.657434:0:192755:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca4ee0 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [262144->266239] (req 262144->266239) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531976.657442:0:169267:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467718272
00010000:00010000:1.0:1651531976.657447:0:169267:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca4ebd lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4469e3 expref: 7 pid: 166113 timeout: 22785 lvb_type: 1
00000100:00100000:1.0:1651531976.657457:0:169267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 268
00000100:00100000:1.0:1651531976.657459:0:169267:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000009c4c564 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438146:x1731754467718272:12345-10.240.43.64@tcp:103:ldlm_bl_03.0
00010000:00010000:1.0:1651531976.657462:0:169267:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1651531976.657466:0:169267:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca4ebd lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4469e3 expref: 7 pid: 166113 timeout: 22785 lvb_type: 1
00010000:00010000:1.0:1651531976.657470:0:169267:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca4ebd lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4469e3 expref: 7 pid: 166113 timeout: 22785 lvb_type: 1
00010000:00010000:1.0:1651531976.657476:0:169267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca4ebd lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4469e3 expref: 7 pid: 166113 timeout: 22785 lvb_type: 1
00010000:00010000:1.0:1651531976.657479:0:169267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531976.657480:0:169267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531976.657482:0:169267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca4ee0 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [262144->266239] (req 262144->266239) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531976.657486:0:169267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca4ee0 lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [262144->266239] (req 262144->266239) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531976.657494:0:169267:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1651531976.657496:0:192755:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca4ee0 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [262144->266239] (req 262144->266239) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.657499:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca4ee0 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [262144->266239] (req 262144->266239) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531976.657504:0:169267:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000009c4c564 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438146:x1731754467718272:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 44us (71us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531976.657507:0:169267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 268
00000100:00100000:1.0:1651531976.714541:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000001:00080000:0.0:1651531976.714553:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869467 is committed
00010000:00010000:0.0:1651531976.714567:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca4ee0 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [262144->266239] (req 262144->266239) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.714575:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca4ee0 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [262144->266239] (req 262144->266239) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531976.714596:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f7006631 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438147:x1731754467718208:12345-10.240.43.64@tcp:4:fio.0 Request processed in 57475us (57506us total) trans 21474869467 rc 0/0
00000100:00100000:0.0:1651531976.714600:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250513
00000100:00100000:0.0:1651531976.714606:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467718400
00000100:00100000:0.0:1651531976.714617:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250514
00000100:00100000:0.0:1651531976.714618:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c683c211 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438148:x1731754467718400:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531976.714625:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4ee7 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.714629:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531976.714630:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531976.714631:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4ee7 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [90112->94207] (req 90112->94207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.714635:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4ee7 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [90112->94207] (req 90112->94207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531976.714647:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca4ee0 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [262144->266239] (req 262144->266239) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531976.714651:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000075a78972 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531976.714652:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca4ee0 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [262144->266239] (req 262144->266239) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531976.714656:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca4ee0 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [262144->266239] (req 262144->266239) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531976.714661:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca4ee0 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [262144->266239] (req 262144->266239) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531976.714664:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca4ee0 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [262144->266239] (req 262144->266239) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531976.714956:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531976.714963:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467718528
00000100:00100000:1.0:1651531976.714974:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44805
00000100:00100000:1.0:1651531976.714977:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c0b460ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467718528:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531976.714981:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531976.714984:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca4eee lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4469f1 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531976.714992:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca4eee lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4469f1 expref: 9 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531976.714996:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca4eee lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4469f1 expref: 9 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531976.714999:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c8969b4f, rc 0)
00000100:00100000:1.0:1651531976.715009:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c0b460ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467718528:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (54us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531976.715011:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44805
00000001:00080000:0.0:1651531976.765263:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869468 is committed
00010000:00010000:0.0:1651531976.765278:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4ee7 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [90112->94207] (req 90112->94207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.765282:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4ee7 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [90112->94207] (req 90112->94207) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531976.765285:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531976.765295:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467718912
00000100:00100000:0.0:1651531976.765311:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c683c211 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438148:x1731754467718400:12345-10.240.43.64@tcp:4:fio.0 Request processed in 50686us (50765us total) trans 21474869468 rc 0/0
00000100:00100000:1.0:1651531976.765312:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44806
00000100:00100000:1.0:1651531976.765314:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000be87d738 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438148:x1731754467718912:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651531976.765314:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250514
00010000:00010000:1.0:1651531976.765319:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531976.765322:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4ee7 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [90112->94207] (req 90112->94207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531976.765323:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca4ef5 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4469ff expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.765325:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c1022d42 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531976.765327:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4ee7 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [90112->94207] (req 90112->94207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.765329:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4ee7 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [90112->94207] (req 90112->94207) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531976.765333:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca4ef5 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4469ff expref: 6 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531976.765335:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4ee7 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [90112->94207] (req 90112->94207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.765337:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4ee7 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [90112->94207] (req 90112->94207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531976.765343:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca4ef5 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4469ff expref: 6 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531976.765347:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c8969b4f, rc 0)
00000100:00100000:1.0:1651531976.765356:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000be87d738 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438148:x1731754467718912:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (72us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531976.765359:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44806
00000100:00100000:1.0:1651531976.765929:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531976.765948:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467719296
00000100:00100000:0.0:1651531976.765964:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250515
00000100:00100000:0.0:1651531976.765966:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002512e905 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438147:x1731754467719296:12345-10.240.43.64@tcp:3:fio.0
00002000:00010000:0.0:1651531976.765975:0:192755:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34545:0x0] initial LVB size: 6291456, mtime: 0x627060c8, atime: 0x627060b4, ctime: 0x627060c8, blocks: 0x3000
00010000:00010000:0.0:1651531976.765977:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4efc lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.765986:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531976.765987:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531976.765988:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4efc lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [577536->581631] (req 577536->581631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.765992:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4efc lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [577536->581631] (req 577536->581631) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.766003:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4efc lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [577536->581631] (req 577536->581631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.766006:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4efc lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [577536->581631] (req 577536->581631) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531976.766022:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002512e905 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438147:x1731754467719296:12345-10.240.43.64@tcp:3:fio.0 Request processed in 55us (93us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531976.766025:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250515
00010000:00010000:0.0:1651531976.766031:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4efc lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [577536->581631] (req 577536->581631) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.766035:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f5657138 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531976.766036:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4efc lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [577536->581631] (req 577536->581631) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.766038:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4efc lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [577536->581631] (req 577536->581631) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.766043:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4efc lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [577536->581631] (req 577536->581631) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.766047:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4efc lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [577536->581631] (req 577536->581631) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531976.790503:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531976.790510:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467719552
00000100:00100000:1.0:1651531976.790523:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44807
00000100:00100000:1.0:1651531976.790525:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d710c5fd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438146:x1731754467719552:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531976.790529:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531976.790540:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca4f03 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446a0d expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651531976.790547:0:166113:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34545:0x0] initial LVB size: 6291456, mtime: 0x627060c8, atime: 0x627060b4, ctime: 0x627060c8, blocks: 0x3000
00010000:00010000:1.0:1651531976.790551:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531976.790552:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531976.790554:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca4f03 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446a0d expref: 6 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531976.790559:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca4f03 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446a0d expref: 6 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531976.790567:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c8969b4f, rc 0)
00000100:00100000:1.0:1651531976.790582:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d710c5fd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438146:x1731754467719552:12345-10.240.43.64@tcp:101:fio.0 Request processed in 57us (80us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531976.790585:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44807
00000100:00100000:1.0:1651531976.815901:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531976.815926:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467720384
00000100:00100000:0.0:1651531976.815944:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250516
00000100:00100000:0.0:1651531976.815946:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000374facb9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467720384:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531976.815954:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4f0a lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.815959:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531976.815960:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531976.815961:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4f0a lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [700416->704511] (req 700416->704511) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.815965:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4f0a lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [700416->704511] (req 700416->704511) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.815978:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4f0a lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [700416->704511] (req 700416->704511) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.815981:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4f0a lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [700416->704511] (req 700416->704511) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531976.816002:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000374facb9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467720384:12345-10.240.43.64@tcp:3:fio.0 Request processed in 56us (102us total) trans 0 rc 4096/4096
00010000:00010000:1.0:1651531976.816003:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4f0a lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [700416->704511] (req 700416->704511) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531976.816005:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250516
00010000:00010000:1.0:1651531976.816008:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f5657138 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531976.816009:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4f0a lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [700416->704511] (req 700416->704511) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531976.816012:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4f0a lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [700416->704511] (req 700416->704511) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531976.816019:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4f0a lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [700416->704511] (req 700416->704511) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531976.816021:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca4f0a lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [700416->704511] (req 700416->704511) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531976.841213:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531976.841252:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467720960
00000100:00100000:0.0:1651531976.841268:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250517
00000100:00100000:0.0:1651531976.841269:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009b569a7a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438147:x1731754467720960:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531976.841277:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4f11 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.841282:0:192755:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca4f03 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446a0d expref: 6 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531976.841285:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531976.841286:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531976.841286:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4f11 lrc: 4/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [266240->270335] (req 266240->270335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.841294:0:192755:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca4f03 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446a0d expref: 6 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531976.841298:0:192755:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca4f03 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446a0d expref: 6 pid: 166113 timeout: 22785 lvb_type: 1
00000100:00100000:0.0:1651531976.841302:0:192755:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000942b56fd pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0001_UUID:192755:1731745997359680:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531976.841315:0:192755:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a4532c78 going to sleep for 6 seconds
00000100:00100000:1.0:1651531976.841568:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531976.841575:0:192755:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000942b56fd pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0001_UUID:192755:1731745997359680:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531976.841576:0:169267:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467721024
00010000:00010000:0.0:1651531976.841580:0:192755:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4f11 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [266240->270335] (req 266240->270335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531976.841583:0:169267:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca4f03 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446a0d expref: 7 pid: 166113 timeout: 22785 lvb_type: 1
00000100:00100000:1.0:1651531976.841598:0:169267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 269
00000100:00100000:1.0:1651531976.841600:0:169267:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000052213cb9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438146:x1731754467721024:12345-10.240.43.64@tcp:103:ldlm_bl_05.0
00010000:00010000:1.0:1651531976.841604:0:169267:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1651531976.841608:0:169267:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca4f03 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446a0d expref: 7 pid: 166113 timeout: 22785 lvb_type: 1
00010000:00010000:1.0:1651531976.841612:0:169267:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca4f03 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446a0d expref: 7 pid: 166113 timeout: 22785 lvb_type: 1
00010000:00010000:1.0:1651531976.841619:0:169267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca4f03 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446a0d expref: 7 pid: 166113 timeout: 22785 lvb_type: 1
00010000:00010000:1.0:1651531976.841622:0:169267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531976.841623:0:169267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531976.841624:0:169267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4f11 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [266240->270335] (req 266240->270335) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531976.841628:0:169267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4f11 lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [266240->270335] (req 266240->270335) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531976.841639:0:169267:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1651531976.841648:0:169267:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000052213cb9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438146:x1731754467721024:12345-10.240.43.64@tcp:103:ldlm_bl_05.0 Request processed in 47us (80us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531976.841651:0:169267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 269
00010000:00010000:0.0:1651531976.841651:0:192755:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4f11 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [266240->270335] (req 266240->270335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.841659:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4f11 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [266240->270335] (req 266240->270335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531976.890544:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531976.890554:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467721280
00000001:00080000:0.0:1651531976.890564:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869469 is committed
00000100:00100000:1.0:1651531976.890567:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250518
00000100:00100000:1.0:1651531976.890569:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002ef35a72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438146:x1731754467721280:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531976.890577:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca4f18 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.890579:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4f11 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [266240->270335] (req 266240->270335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.890583:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4f11 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [266240->270335] (req 266240->270335) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531976.890587:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531976.890587:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531976.890588:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca4f18 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [778240->782335] (req 778240->782335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531976.890593:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca4f18 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [778240->782335] (req 778240->782335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531976.890604:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009b569a7a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438147:x1731754467720960:12345-10.240.43.64@tcp:4:fio.0 Request processed in 49333us (49391us total) trans 21474869469 rc 0/0
00000100:00100000:0.0:1651531976.890607:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250517
00010000:00010000:0.0:1651531976.890615:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4f11 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [266240->270335] (req 266240->270335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.890618:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c1022d42 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531976.890619:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4f11 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [266240->270335] (req 266240->270335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.890622:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4f11 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [266240->270335] (req 266240->270335) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.890627:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4f11 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [266240->270335] (req 266240->270335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.890630:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4f11 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [266240->270335] (req 266240->270335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531976.890647:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531976.890667:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467721216
00000100:00100000:1.0:1651531976.890686:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44808
00000100:00100000:1.0:1651531976.890688:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000942b56fd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467721216:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531976.890692:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531976.890696:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca4f1f lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446a1b expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531976.890714:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca4f1f lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446a1b expref: 9 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531976.890719:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca4f1f lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446a1b expref: 9 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531976.890722:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f58aeba9, rc 0)
00000100:00100000:1.0:1651531976.890739:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000942b56fd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467721216:12345-10.240.43.64@tcp:101:fio.0 Request processed in 50us (92us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531976.890744:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44808
00000100:00100000:1.0:1651531976.928177:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651531976.928202:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951227072
00000100:00100000:0.0:1651531976.928215:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 466
00000100:00100000:0.0:1651531976.928243:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001304ce4c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951227072:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:0.0:1651531976.928249:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 28672 granted 350569920 pending 28672 free 81277214720 avail 77106302976
00000100:00100000:0.0:1651531976.928264:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001304ce4c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951227072:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 21us (89us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531976.928267:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 466
00000001:00080000:0.0:1651531976.957335:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869470 is committed
00010000:00010000:1.0:1651531976.957365:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca4f18 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [778240->782335] (req 778240->782335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531976.957370:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca4f18 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [778240->782335] (req 778240->782335) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531976.957388:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002ef35a72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438146:x1731754467721280:12345-10.240.43.64@tcp:4:fio.0 Request processed in 66818us (66844us total) trans 21474869470 rc 0/0
00000100:00100000:1.0:1651531976.957391:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250518
00010000:00010000:1.0:1651531976.957399:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca4f18 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [778240->782335] (req 778240->782335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531976.957402:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c8969b4f already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531976.957403:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca4f18 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [778240->782335] (req 778240->782335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531976.957406:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca4f18 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [778240->782335] (req 778240->782335) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531976.957411:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca4f18 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [778240->782335] (req 778240->782335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531976.957414:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca4f18 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [778240->782335] (req 778240->782335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531976.957772:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531976.957791:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467722048
00000100:00100000:1.0:1651531976.957806:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44809
00000100:00100000:1.0:1651531976.957808:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007d76765b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438147:x1731754467722048:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531976.957811:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531976.957815:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca4f26 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446a29 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651531976.957820:0:166113:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34545:0x0] initial LVB size: 6291456, mtime: 0x627060c8, atime: 0x627060b4, ctime: 0x627060c8, blocks: 0x3000
00010000:00010000:1.0:1651531976.957825:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531976.957825:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531976.957827:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca4f26 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446a29 expref: 6 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531976.957832:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca4f26 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446a29 expref: 6 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531976.957836:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f58aeba9, rc 0)
00000100:00100000:1.0:1651531976.957847:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007d76765b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438147:x1731754467722048:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (75us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531976.957850:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44809
00000100:00100000:0.0:1651531976.958414:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531976.958425:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467722560
00000100:00100000:1.0:1651531976.958436:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250519
00000100:00100000:1.0:1651531976.958438:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009c93d7f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467722560:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531976.958445:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca4f2d lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531976.958450:0:216321:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca4f26 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446a29 expref: 6 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531976.958457:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531976.958458:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531976.958458:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca4f2d lrc: 4/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [294912->299007] (req 294912->299007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531976.958465:0:216321:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca4f26 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446a29 expref: 6 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531976.958469:0:216321:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca4f26 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446a29 expref: 6 pid: 166113 timeout: 22785 lvb_type: 1
00000100:00100000:1.0:1651531976.958474:0:216321:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000063869776 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997359744:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531976.958486:0:216321:0:(client.c:2492:ptlrpc_set_wait()) set 000000003176d4e8 going to sleep for 6 seconds
00000100:00100000:1.0:1651531976.958939:0:216321:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000063869776 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997359744:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651531976.958944:0:216321:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca4f2d lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [294912->299007] (req 294912->299007) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531976.958951:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531976.958959:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531976.958967:0:169267:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467722624
00010000:00010000:1.0:1651531976.958972:0:169267:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca4f26 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446a29 expref: 7 pid: 166113 timeout: 22785 lvb_type: 1
00000100:00100000:0.0:1651531976.958973:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467722880
00000100:00100000:1.0:1651531976.958984:0:169267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 270
00000100:00100000:1.0:1651531976.958986:0:169267:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ffcdece2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467722624:12345-10.240.43.64@tcp:103:ldlm_bl_01.0
00010000:00010000:1.0:1651531976.958989:0:169267:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00000100:00100000:0.0:1651531976.958989:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44810
00000100:00100000:0.0:1651531976.958991:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007f998d3c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467722880:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531976.958993:0:169267:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca4f26 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446a29 expref: 8 pid: 166113 timeout: 22785 lvb_type: 1
00010000:00010000:0.0:1651531976.958995:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531976.958998:0:169267:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca4f26 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446a29 expref: 8 pid: 166113 timeout: 22785 lvb_type: 1
00010000:00010000:0.0:1651531976.959000:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4f34 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446a37 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531976.959004:0:169267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca4f26 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446a29 expref: 8 pid: 166113 timeout: 22785 lvb_type: 1
00010000:00010000:0.0:1651531976.959006:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531976.959008:0:169267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531976.959009:0:169267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531976.959010:0:169267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca4f2d lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [294912->299007] (req 294912->299007) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531976.959013:0:169267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca4f2d lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [294912->299007] (req 294912->299007) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.959018:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4f34 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446a37 expref: 8 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531976.959019:0:169267:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1651531976.959023:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4f34 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446a37 expref: 8 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531976.959028:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c1022d42, rc 0)
00000100:00100000:1.0:1651531976.959029:0:169267:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ffcdece2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438146:x1731754467722624:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 42us (78us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531976.959031:0:169267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 270
00000100:00100000:0.0:1651531976.959036:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007f998d3c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438148:x1731754467722880:12345-10.240.43.64@tcp:101:fio.0 Request processed in 44us (77us total) trans 0 rc 301/301
00010000:00010000:1.0:1651531976.959037:0:216321:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca4f2d lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [294912->299007] (req 294912->299007) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531976.959039:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44810
00010000:00010000:1.0:1651531976.959040:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca4f2d lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [294912->299007] (req 294912->299007) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531976.959829:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531976.959836:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467723136
00000100:00100000:0.0:1651531976.959843:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44811
00000100:00100000:0.0:1651531976.959845:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000053497d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467723136:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531976.959849:0:206699:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531976.959852:0:206699:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4f3b lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446a45 expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.959860:0:206699:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4f3b lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446a45 expref: 9 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531976.959864:0:206699:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4f3b lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446a45 expref: 9 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531976.959868:0:206699:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000080362f27, rc 0)
00000100:00100000:0.0:1651531976.959877:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000053497d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467723136:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (49us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531976.959880:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44811
00000100:00100000:0.0:1651531976.960595:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531976.960602:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467723392
00000100:00100000:0.0:1651531976.960609:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44812
00000100:00100000:0.0:1651531976.960612:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003a5ac9b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467723392:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531976.960615:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531976.960619:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca4f42 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446a53 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.960626:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca4f42 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446a53 expref: 9 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531976.960630:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca4f42 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446a53 expref: 9 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531976.960633:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fab23815, rc 0)
00000100:00100000:0.0:1651531976.960642:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003a5ac9b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467723392:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (48us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531976.960645:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44812
00000100:00100000:0.0:1651531976.961352:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531976.961359:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467723648
00000100:00100000:0.0:1651531976.961366:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44813
00000100:00100000:0.0:1651531976.961368:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000530f55ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467723648:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531976.961371:0:206699:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531976.961374:0:206699:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca4f49 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446a61 expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.961381:0:206699:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca4f49 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446a61 expref: 9 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531976.961389:0:206699:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca4f49 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446a61 expref: 9 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531976.961392:0:206699:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000014685f38, rc 0)
00000100:00100000:0.0:1651531976.961401:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000530f55ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467723648:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (49us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531976.961403:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44813
00000100:00100000:0.0:1651531976.962086:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531976.962093:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467723904
00000100:00100000:0.0:1651531976.962100:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44814
00000100:00100000:0.0:1651531976.962101:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000880cd1d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467723904:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531976.962105:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531976.962108:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4f50 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446a6f expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.962115:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4f50 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446a6f expref: 9 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531976.962119:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4f50 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446a6f expref: 9 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531976.962122:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e2ec18e1, rc 0)
00000100:00100000:0.0:1651531976.962131:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000880cd1d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467723904:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (45us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531976.962133:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44814
00000100:00100000:0.0:1651531976.962865:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531976.962872:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467724160
00000100:00100000:0.0:1651531976.962879:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44815
00000100:00100000:0.0:1651531976.962881:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000da31c48f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467724160:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531976.962884:0:206699:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531976.962887:0:206699:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca4f57 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446a7d expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.962894:0:206699:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca4f57 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446a7d expref: 9 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531976.962898:0:206699:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca4f57 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446a7d expref: 9 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531976.962902:0:206699:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f968d777, rc 0)
00000100:00100000:0.0:1651531976.962910:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000da31c48f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467724160:12345-10.240.43.64@tcp:101:fio.0 Request processed in 29us (46us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531976.962913:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44815
00000100:00100000:0.0:1651531976.963214:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531976.963249:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467724288
00000100:00100000:1.0:1651531976.963265:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250520
00000100:00100000:1.0:1651531976.963267:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006c903446 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467724288:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531976.963276:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca4f5e lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531976.963280:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531976.963281:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531976.963282:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca4f5e lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [282624->286719] (req 282624->286719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531976.963286:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca4f5e lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [282624->286719] (req 282624->286719) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531976.963297:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca4f5e lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [282624->286719] (req 282624->286719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531976.963301:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca4f5e lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [282624->286719] (req 282624->286719) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.963318:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca4f5e lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [282624->286719] (req 282624->286719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531976.963323:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006c903446 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467724288:12345-10.240.43.64@tcp:3:fio.0 Request processed in 55us (108us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531976.963326:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250520
00010000:00010000:0.0:1651531976.963327:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f58aeba9 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531976.963329:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca4f5e lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [282624->286719] (req 282624->286719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.963332:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca4f5e lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [282624->286719] (req 282624->286719) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.963339:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca4f5e lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [282624->286719] (req 282624->286719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.963342:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca4f5e lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [282624->286719] (req 282624->286719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531976.963658:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531976.963679:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467724416
00000100:00100000:1.0:1651531976.963691:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250521
00000100:00100000:1.0:1651531976.963693:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b338475a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467724416:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531976.963699:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca4f65 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531976.963703:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531976.963704:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531976.963706:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca4f65 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [811008->815103] (req 811008->815103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531976.963710:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca4f65 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [811008->815103] (req 811008->815103) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531976.996022:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869471 is committed
00010000:00010000:1.0:1651531976.996052:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca4f2d lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [294912->299007] (req 294912->299007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531976.996056:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca4f2d lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [294912->299007] (req 294912->299007) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531976.996075:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009c93d7f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467722560:12345-10.240.43.64@tcp:4:fio.0 Request processed in 37636us (37661us total) trans 21474869471 rc 0/0
00010000:00010000:0.0:1651531976.996077:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca4f2d lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [294912->299007] (req 294912->299007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531976.996078:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250519
00010000:00010000:0.0:1651531976.996081:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f6135e30 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531976.996082:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca4f2d lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [294912->299007] (req 294912->299007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.996086:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca4f2d lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [294912->299007] (req 294912->299007) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.996091:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca4f2d lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [294912->299007] (req 294912->299007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531976.996094:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca4f2d lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [294912->299007] (req 294912->299007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531977.033342:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531977.033352:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531977.033367:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467724672
00000100:00100000:1.0:1651531977.033381:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44816
00000100:00100000:1.0:1651531977.033383:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001eda4376 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467724672:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531977.033387:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531977.033391:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca4f6c lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446a8b expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.033399:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca4f6c lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446a8b expref: 9 pid: 166113 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651531977.033399:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467724800
00010000:00010000:1.0:1651531977.033403:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca4f6c lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446a8b expref: 10 pid: 166113 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651531977.033411:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250522
00010000:00010000:1.0:1651531977.033412:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f6ecb7e5, rc 0)
00000100:00100000:0.0:1651531977.033414:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f05c0b82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438147:x1731754467724800:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531977.033422:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca4f73 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531977.033423:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001eda4376 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754467724672:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (82us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531977.033426:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44816
00010000:00010000:0.0:1651531977.033426:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531977.033427:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531977.033428:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca4f73 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [131072->135167] (req 131072->135167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531977.033432:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca4f73 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [131072->135167] (req 131072->135167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531977.033717:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531977.033736:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467724928
00000100:00100000:1.0:1651531977.033747:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250523
00000100:00100000:1.0:1651531977.033749:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002bdf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754467724928:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531977.033756:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca4f7a lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.033760:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531977.033760:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531977.033761:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca4f7a lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [425984->430079] (req 425984->430079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.033766:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca4f7a lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [425984->430079] (req 425984->430079) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.033777:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca4f7a lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [425984->430079] (req 425984->430079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.033781:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca4f7a lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [425984->430079] (req 425984->430079) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531977.033795:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002bdf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754467724928:12345-10.240.43.64@tcp:3:fio.0 Request processed in 46us (79us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531977.033801:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250523
00010000:00010000:1.0:1651531977.033808:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca4f7a lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [425984->430079] (req 425984->430079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.033811:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c806f265 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531977.033812:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca4f7a lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [425984->430079] (req 425984->430079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.033815:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca4f7a lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [425984->430079] (req 425984->430079) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.033819:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca4f7a lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [425984->430079] (req 425984->430079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.033822:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca4f7a lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [425984->430079] (req 425984->430079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531977.034127:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531977.034143:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467725056
00000100:00100000:1.0:1651531977.034154:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44817
00000100:00100000:1.0:1651531977.034156:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e15376c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754467725056:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531977.034159:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531977.034163:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca4f81 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446a99 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.034170:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca4f81 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446a99 expref: 12 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531977.034179:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca4f81 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446a99 expref: 12 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531977.034182:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000eebd17a1, rc 0)
00000100:00100000:1.0:1651531977.034192:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e15376c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754467725056:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (66us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531977.034195:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44817
00000100:00100000:0.0:1651531977.034859:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531977.034877:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467725312
00000100:00100000:1.0:1651531977.034890:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44818
00000100:00100000:1.0:1651531977.034892:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c4db449c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754467725312:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531977.034895:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531977.034899:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca4f88 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446aa7 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.034906:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca4f88 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446aa7 expref: 12 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531977.034910:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca4f88 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446aa7 expref: 12 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531977.034913:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009c5faf65, rc 0)
00000100:00100000:1.0:1651531977.034923:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c4db449c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754467725312:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (65us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531977.034926:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44818
00000100:00100000:0.0:1651531977.035249:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531977.035266:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467725440
00000100:00100000:1.0:1651531977.035276:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250524
00000100:00100000:1.0:1651531977.035278:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b5b5b4c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754467725440:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531977.035285:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca4f8f lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.035289:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531977.035290:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531977.035291:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca4f8f lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [16384->20479] (req 16384->20479) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.035295:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca4f8f lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [16384->20479] (req 16384->20479) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.035306:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca4f8f lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [16384->20479] (req 16384->20479) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.035309:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca4f8f lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [16384->20479] (req 16384->20479) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531977.035331:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b5b5b4c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754467725440:12345-10.240.43.64@tcp:3:fio.0 Request processed in 52us (82us total) trans 0 rc 4096/4096
00010000:00010000:0.0:1651531977.035332:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca4f8f lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [16384->20479] (req 16384->20479) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531977.035333:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250524
00010000:00010000:0.0:1651531977.035337:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000022b2104e already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531977.035338:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca4f8f lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [16384->20479] (req 16384->20479) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531977.035341:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca4f8f lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [16384->20479] (req 16384->20479) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531977.035346:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca4f8f lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [16384->20479] (req 16384->20479) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531977.035353:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca4f8f lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [16384->20479] (req 16384->20479) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531977.035614:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531977.035625:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467725568
00000100:00100000:1.0:1651531977.035635:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44819
00000100:00100000:1.0:1651531977.035637:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000137fd3d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754467725568:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531977.035640:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531977.035644:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca4f96 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446ab5 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.035652:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca4f96 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446ab5 expref: 12 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531977.035656:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca4f96 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446ab5 expref: 12 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531977.035660:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f6135e30, rc 0)
00000100:00100000:1.0:1651531977.035670:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000137fd3d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754467725568:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (57us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531977.035672:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44819
00000100:00100000:0.0:1651531977.035970:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531977.035989:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467725696
00000100:00100000:1.0:1651531977.035999:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250525
00000100:00100000:1.0:1651531977.036001:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000008e0501d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754467725696:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531977.036008:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca4f9d lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.036012:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531977.036012:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531977.036013:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca4f9d lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [724992->729087] (req 724992->729087) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.036017:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca4f9d lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [724992->729087] (req 724992->729087) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.036028:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca4f9d lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [724992->729087] (req 724992->729087) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.036035:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca4f9d lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [724992->729087] (req 724992->729087) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531977.036054:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca4f9d lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [724992->729087] (req 724992->729087) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531977.036056:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000008e0501d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754467725696:12345-10.240.43.64@tcp:3:fio.0 Request processed in 54us (86us total) trans 0 rc 4096/4096
00010000:00010000:0.0:1651531977.036058:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f58aeba9 already unused, calling callback (0000000049fddea7)
00000100:00100000:1.0:1651531977.036059:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250525
00010000:00010000:0.0:1651531977.036059:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca4f9d lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [724992->729087] (req 724992->729087) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531977.036062:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca4f9d lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [724992->729087] (req 724992->729087) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531977.036067:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca4f9d lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [724992->729087] (req 724992->729087) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531977.036070:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca4f9d lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [724992->729087] (req 724992->729087) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531977.036331:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531977.036341:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467725824
00000100:00100000:1.0:1651531977.036351:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250526
00000100:00100000:1.0:1651531977.036353:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f99d9ea1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754467725824:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531977.036360:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca4fa4 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.036363:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531977.036364:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531977.036365:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca4fa4 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [139264->143359] (req 139264->143359) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.036369:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca4fa4 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [139264->143359] (req 139264->143359) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531977.045316:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869472 is committed
00002000:00010000:1.0:1651531977.045342:0:166118:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x34545:0x0] updating lvb mtime from disk: 1651531976 -> 1651531977
00002000:00010000:1.0:1651531977.045344:0:166118:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x34545:0x0] updating lvb ctime from disk: 1651531976 -> 1651531977
00010000:00010000:1.0:1651531977.045347:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca4f65 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [811008->815103] (req 811008->815103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.045350:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca4f65 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [811008->815103] (req 811008->815103) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531977.045370:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b338475a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754467724416:12345-10.240.43.64@tcp:4:fio.0 Request processed in 81677us (81712us total) trans 21474869472 rc 0/0
00000100:00100000:1.0:1651531977.045374:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250521
00010000:00010000:1.0:1651531977.045381:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca4f65 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [811008->815103] (req 811008->815103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.045384:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c8969b4f already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531977.045385:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca4f65 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [811008->815103] (req 811008->815103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.045388:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca4f65 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [811008->815103] (req 811008->815103) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.045393:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca4f65 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [811008->815103] (req 811008->815103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.045395:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca4f65 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [811008->815103] (req 811008->815103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531977.045716:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531977.045735:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467725952
00000100:00100000:1.0:1651531977.045748:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44820
00000100:00100000:1.0:1651531977.045750:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f7096c29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754467725952:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531977.045754:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531977.045757:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca4fab lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446ac3 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.045765:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca4fab lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446ac3 expref: 12 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531977.045770:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca4fab lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446ac3 expref: 12 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531977.045773:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f6135e30, rc 0)
00000100:00100000:1.0:1651531977.045784:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f7096c29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754467725952:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (68us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531977.045786:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44820
00000100:00100000:0.0:1651531977.071091:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531977.071104:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467726336
00000100:00100000:1.0:1651531977.071116:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250527
00000100:00100000:1.0:1651531977.071118:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004237e3f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754467726336:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531977.071125:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca4fb2 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.071129:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531977.071129:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531977.071131:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca4fb2 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [114688->118783] (req 114688->118783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.071134:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca4fb2 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [114688->118783] (req 114688->118783) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531977.108828:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869474 is committed
00010000:00010000:1.0:1651531977.108857:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca4fa4 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [139264->143359] (req 139264->143359) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.108862:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca4fa4 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [139264->143359] (req 139264->143359) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531977.108881:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca4f73 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [131072->135167] (req 131072->135167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531977.108885:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f99d9ea1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754467725824:12345-10.240.43.64@tcp:4:fio.0 Request processed in 72531us (72554us total) trans 21474869474 rc 0/0
00010000:00010000:0.0:1651531977.108886:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca4f73 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [131072->135167] (req 131072->135167) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531977.108888:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250526
00000100:00100000:0.0:1651531977.108901:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f05c0b82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467724800:12345-10.240.43.64@tcp:4:fio.0 Request processed in 75486us (75549us total) trans 21474869473 rc 0/0
00000100:00100000:0.0:1651531977.108905:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250522
00010000:00010000:0.0:1651531977.108912:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca4fa4 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [139264->143359] (req 139264->143359) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531977.108915:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d3014069 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531977.108916:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca4fa4 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [139264->143359] (req 139264->143359) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531977.108919:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca4fa4 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [139264->143359] (req 139264->143359) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531977.108937:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca4fa4 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [139264->143359] (req 139264->143359) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.108939:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca4f73 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [131072->135167] (req 131072->135167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531977.108940:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca4fa4 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [139264->143359] (req 139264->143359) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.108943:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f968d777 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531977.108944:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca4f73 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [131072->135167] (req 131072->135167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.108947:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca4f73 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [131072->135167] (req 131072->135167) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.108953:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca4f73 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [131072->135167] (req 131072->135167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.108956:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca4f73 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [131072->135167] (req 131072->135167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531977.109269:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531977.109282:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531977.109288:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467726528
00000100:00100000:0.0:1651531977.109291:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467726592
00000100:00100000:1.0:1651531977.109299:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44821
00000100:00100000:1.0:1651531977.109300:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bf4022bf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438149:x1731754467726528:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:0.0:1651531977.109301:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44822
00000100:00100000:0.0:1651531977.109303:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001e61ed2d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438146:x1731754467726592:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531977.109304:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531977.109308:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca4fb9 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446ad8 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531977.109308:0:206699:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531977.109311:0:206699:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4fc0 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446adf expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.109316:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca4fb9 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446ad8 expref: 11 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531977.109320:0:206699:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4fc0 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446adf expref: 11 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531977.109321:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca4fb9 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446ad8 expref: 11 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531977.109324:0:206699:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4fc0 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446adf expref: 11 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531977.109325:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c8969b4f, rc 0)
00010000:00010000:0.0:1651531977.109328:0:206699:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e2ec18e1, rc 0)
00000100:00100000:1.0:1651531977.109336:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bf4022bf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438149:x1731754467726528:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (68us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531977.109336:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001e61ed2d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438146:x1731754467726592:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (54us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531977.109339:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44821
00000100:00100000:0.0:1651531977.109340:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44822
00000100:00100000:0.0:1651531977.109707:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531977.109715:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467726848
00000100:00100000:0.0:1651531977.109731:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250528
00000100:00100000:0.0:1651531977.109733:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000043b0f16d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467726848:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531977.109740:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca4fc7 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531977.109744:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531977.109745:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531977.109746:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca4fc7 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [135168->139263] (req 135168->139263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531977.109750:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca4fc7 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [135168->139263] (req 135168->139263) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531977.109764:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca4fc7 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [135168->139263] (req 135168->139263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531977.109768:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca4fc7 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [135168->139263] (req 135168->139263) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531977.109788:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000043b0f16d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467726848:12345-10.240.43.64@tcp:3:fio.0 Request processed in 55us (81us total) trans 0 rc 4096/4096
00010000:00010000:1.0:1651531977.109790:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca4fc7 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [135168->139263] (req 135168->139263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531977.109791:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250528
00010000:00010000:1.0:1651531977.109795:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000014685f38 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531977.109796:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca4fc7 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [135168->139263] (req 135168->139263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.109799:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca4fc7 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [135168->139263] (req 135168->139263) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.109805:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca4fc7 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [135168->139263] (req 135168->139263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.109807:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca4fc7 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [135168->139263] (req 135168->139263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531977.110090:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531977.110098:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467727040
00000100:00100000:0.0:1651531977.110110:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44823
00000100:00100000:0.0:1651531977.110112:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000052cf3c08 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467727040:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531977.110115:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531977.110119:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca4fce lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446aed expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531977.110127:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca4fce lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446aed expref: 9 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531977.110131:0:166111:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca4fce lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446aed expref: 9 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531977.110135:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fab23815, rc 0)
00000100:00100000:0.0:1651531977.110148:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000052cf3c08 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467727040:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (58us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531977.110155:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44823
00000001:00080000:0.0:1651531977.133359:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869475 is committed
00010000:00010000:1.0:1651531977.133390:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca4fb2 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [114688->118783] (req 114688->118783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.133395:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca4fb2 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [114688->118783] (req 114688->118783) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531977.133415:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004237e3f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438149:x1731754467726336:12345-10.240.43.64@tcp:4:fio.0 Request processed in 62296us (62325us total) trans 21474869475 rc 0/0
00000100:00100000:1.0:1651531977.133419:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250527
00010000:00010000:0.0:1651531977.133419:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca4fb2 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [114688->118783] (req 114688->118783) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531977.133424:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f6135e30 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531977.133425:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca4fb2 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [114688->118783] (req 114688->118783) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531977.133428:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca4fb2 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [114688->118783] (req 114688->118783) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531977.133434:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca4fb2 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [114688->118783] (req 114688->118783) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531977.133436:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca4fb2 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [114688->118783] (req 114688->118783) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531977.133766:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531977.133774:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467727616
00000100:00100000:1.0:1651531977.133789:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250529
00000100:00100000:1.0:1651531977.133791:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000063869776 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438148:x1731754467727616:12345-10.240.43.64@tcp:4:fio.0
00002000:00010000:1.0:1651531977.133800:0:166118:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34545:0x0] initial LVB size: 6291456, mtime: 0x627060c9, atime: 0x627060b4, ctime: 0x627060c9, blocks: 0x3000
00010000:00010000:1.0:1651531977.133803:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca4fd5 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.133806:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531977.133807:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531977.133808:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca4fd5 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [847872->851967] (req 847872->851967) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.133812:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca4fd5 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [847872->851967] (req 847872->851967) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531977.183976:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869476 is committed
00010000:00010000:1.0:1651531977.184007:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca4fd5 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [847872->851967] (req 847872->851967) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.184011:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca4fd5 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [847872->851967] (req 847872->851967) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531977.184028:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000063869776 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438148:x1731754467727616:12345-10.240.43.64@tcp:4:fio.0 Request processed in 50236us (50262us total) trans 21474869476 rc 0/0
00000100:00100000:1.0:1651531977.184033:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250529
00010000:00010000:1.0:1651531977.184040:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca4fd5 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [847872->851967] (req 847872->851967) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.184043:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c8969b4f already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531977.184045:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca4fd5 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [847872->851967] (req 847872->851967) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.184047:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca4fd5 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [847872->851967] (req 847872->851967) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.184052:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca4fd5 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [847872->851967] (req 847872->851967) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.184055:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca4fd5 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [847872->851967] (req 847872->851967) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531977.184976:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531977.184984:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467727872
00000100:00100000:1.0:1651531977.184999:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250530
00000100:00100000:1.0:1651531977.185000:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cb694635 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438146:x1731754467727872:12345-10.240.43.64@tcp:4:fio.0
00002000:00010000:1.0:1651531977.185009:0:166118:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34545:0x0] initial LVB size: 6291456, mtime: 0x627060c9, atime: 0x627060b4, ctime: 0x627060c9, blocks: 0x3000
00010000:00010000:1.0:1651531977.185012:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca4fdc lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.185016:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531977.185016:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531977.185019:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca4fdc lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [581632->888831] (req 581632->888831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.185039:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca4fdc lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [581632->888831] (req 581632->888831) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531977.185069:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531977.185091:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467728064
00000100:00100000:0.0:1651531977.185103:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44824
00000100:00100000:0.0:1651531977.185105:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006a8dcc9d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438148:x1731754467728064:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531977.185108:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531977.185112:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca4fe3 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446afb expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531977.185120:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca4fe3 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446afb expref: 8 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531977.185126:0:166111:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca4fe3 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446afb expref: 8 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531977.185129:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fab23815, rc 0)
00000100:00100000:0.0:1651531977.185144:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006a8dcc9d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438148:x1731754467728064:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (76us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531977.185147:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44824
00000100:00100000:1.0:1651531977.185894:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531977.185912:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467728320
00000100:00100000:0.0:1651531977.185925:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44825
00000100:00100000:0.0:1651531977.185927:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b6b1b79d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438149:x1731754467728320:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531977.185930:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531977.185934:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4fea lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446b09 expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531977.185942:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4fea lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446b09 expref: 10 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531977.185946:0:166111:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca4fea lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446b09 expref: 10 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531977.185950:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e2ec18e1, rc 0)
00000100:00100000:0.0:1651531977.185964:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b6b1b79d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438149:x1731754467728320:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (71us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531977.185967:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44825
00000100:00100000:1.0:1651531977.186272:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531977.186290:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467728448
00000100:00100000:0.0:1651531977.186305:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250531
00000100:00100000:0.0:1651531977.186307:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008bb4a649 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754467728448:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531977.186315:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4ff1 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531977.186319:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531977.186319:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531977.186320:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4ff1 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [4096->8191] (req 4096->8191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531977.186325:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4ff1 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [4096->8191] (req 4096->8191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531977.186338:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4ff1 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [4096->8191] (req 4096->8191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531977.186341:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4ff1 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [4096->8191] (req 4096->8191) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.186359:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4ff1 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [4096->8191] (req 4096->8191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531977.186362:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008bb4a649 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754467728448:12345-10.240.43.64@tcp:3:fio.0 Request processed in 54us (91us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531977.186365:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250531
00010000:00010000:1.0:1651531977.186368:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000080362f27 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531977.186370:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4ff1 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [4096->8191] (req 4096->8191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.186373:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4ff1 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [4096->8191] (req 4096->8191) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.186378:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4ff1 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [4096->8191] (req 4096->8191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.186381:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca4ff1 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [4096->8191] (req 4096->8191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531977.186707:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531977.186719:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467728576
00000100:00100000:0.0:1651531977.186731:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44826
00000100:00100000:0.0:1651531977.186732:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009e786cd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438149:x1731754467728576:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531977.186735:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531977.186739:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4ff8 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446b17 expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531977.186750:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4ff8 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446b17 expref: 10 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531977.186755:0:166111:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca4ff8 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446b17 expref: 10 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531977.186758:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c1022d42, rc 0)
00000100:00100000:0.0:1651531977.186772:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009e786cd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438149:x1731754467728576:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (65us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531977.186775:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44826
00000100:00100000:1.0:1651531977.187090:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531977.187108:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467728704
00000100:00100000:0.0:1651531977.187122:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250532
00000100:00100000:0.0:1651531977.187124:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005ec1cbc3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754467728704:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531977.187130:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca4fff lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531977.187134:0:216321:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca4fdc lrc: 2/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [581632->888831] (req 581632->888831) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531977.187137:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531977.187138:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651531977.187139:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca4fff lrc: 4/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [827392->831487] (req 827392->831487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531977.187143:0:216321:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca4fdc lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [581632->888831] (req 581632->888831) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531977.187150:0:216321:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca4fff lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [827392->831487] (req 827392->831487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531977.222648:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869477 is committed
00010000:00010000:1.0:1651531977.222679:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca4fdc lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [581632->888831] (req 581632->888831) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.222688:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca4fdc lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [581632->888831] (req 581632->888831) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531977.222710:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca4fdc lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [581632->888831] (req 581632->888831) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531977.222711:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cb694635 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438146:x1731754467727872:12345-10.240.43.64@tcp:4:fio.0 Request processed in 37709us (37735us total) trans 21474869477 rc 0/0
00000100:00100000:1.0:1651531977.222714:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250530
00010000:00010000:0.0:1651531977.222715:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009c5faf65 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531977.222716:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca4fdc lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [581632->888831] (req 581632->888831) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531977.222719:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca4fdc lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [581632->888831] (req 581632->888831) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531977.222724:0:166105:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531977.222725:0:166105:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531977.222726:0:166105:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca4fff lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [827392->831487] (req 827392->831487) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531977.222729:0:166105:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca4fff lrc: 4/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [827392->831487] (req 827392->831487) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531977.222736:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca4fdc lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [581632->888831] (req 581632->888831) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531977.222739:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca4fdc lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [581632->888831] (req 581632->888831) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.222755:0:216321:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca4fff lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [827392->831487] (req 827392->831487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.222759:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca4fff lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [827392->831487] (req 827392->831487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.222773:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca4fff lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [827392->831487] (req 827392->831487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.222776:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca4fff lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [827392->831487] (req 827392->831487) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531977.222791:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005ec1cbc3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438148:x1731754467728704:12345-10.240.43.64@tcp:3:fio.0 Request processed in 35666us (35701us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531977.222794:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250532
00010000:00010000:1.0:1651531977.222800:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca4fff lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [827392->831487] (req 827392->831487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.222804:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fb2f6575 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531977.222805:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca4fff lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [827392->831487] (req 827392->831487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.222809:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca4fff lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [827392->831487] (req 827392->831487) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.222814:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca4fff lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [827392->831487] (req 827392->831487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.222817:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca4fff lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [827392->831487] (req 827392->831487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531977.223097:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531977.223106:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531977.223117:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467728960
00000100:00100000:1.0:1651531977.223118:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467728896
00000100:00100000:0.0:1651531977.223129:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44827
00000100:00100000:0.0:1651531977.223131:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b9b10d48 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438148:x1731754467728960:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531977.223134:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651531977.223135:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250533
00000100:00100000:1.0:1651531977.223137:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000033723645 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438147:x1731754467728896:12345-10.240.43.64@tcp:4:fio.0
00002000:00010000:1.0:1651531977.223146:0:216321:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34545:0x0] initial LVB size: 6291456, mtime: 0x627060c9, atime: 0x627060b4, ctime: 0x627060c9, blocks: 0x3000
00010000:00010000:0.0:1651531977.223146:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca5006 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446b25 expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.223149:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca500d lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531977.223152:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531977.223153:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531977.223154:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca5006 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446b25 expref: 7 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531977.223160:0:216321:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca5006 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446b25 expref: 7 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531977.223164:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531977.223164:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531977.223165:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca500d lrc: 4/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [946176->950271] (req 946176->950271) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531977.223170:0:166111:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca5006 lrc: 5/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446b25 expref: 7 pid: 166111 timeout: 22785 lvb_type: 1
00010000:00010000:0.0:1651531977.223174:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca5006 lrc: 5/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446b25 expref: 7 pid: 166111 timeout: 22785 lvb_type: 1
00010000:00010000:1.0:1651531977.223177:0:216321:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca5006 lrc: 5/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446b25 expref: 7 pid: 166111 timeout: 22785 lvb_type: 1
00010000:00010000:1.0:1651531977.223192:0:216321:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca5006 lrc: 5/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446b25 expref: 7 pid: 166111 timeout: 22785 lvb_type: 1
00010000:00010000:0.0:1651531977.223196:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c1022d42, rc 0)
00000100:00100000:1.0:1651531977.223197:0:216321:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a9fc5082 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997359808:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531977.223209:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b9b10d48 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438148:x1731754467728960:12345-10.240.43.64@tcp:101:fio.0 Request processed in 77us (103us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531977.223211:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44827
00000100:00100000:1.0:1651531977.223214:0:216321:0:(client.c:2492:ptlrpc_set_wait()) set 000000002ddea5d6 going to sleep for 6 seconds
00000100:00100000:1.0:1651531977.223274:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531977.223312:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467729088
00000100:00100000:1.0:1651531977.223325:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44828
00000100:00100000:1.0:1651531977.223327:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c62d1815 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438148:x1731754467729088:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531977.223330:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531977.223334:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca5014 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446b33 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.223339:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531977.223342:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca5014 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446b33 expref: 8 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531977.223346:0:166112:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca5014 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446b33 expref: 8 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531977.223350:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000eebd17a1, rc 0)
00000100:00100000:1.0:1651531977.223360:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c62d1815 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438148:x1731754467729088:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (87us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531977.223363:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44828
00000100:00100000:1.0:1651531977.223499:0:216321:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a9fc5082 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997359808:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651531977.223514:0:216321:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca500d lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [946176->950271] (req 946176->950271) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531977.223600:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531977.223614:0:166103:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467729152
00010000:00010000:0.0:1651531977.223620:0:166103:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca5006 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446b25 expref: 7 pid: 166111 timeout: 22785 lvb_type: 1
00000100:00100000:0.0:1651531977.223635:0:166103:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 271
00000100:00100000:0.0:1651531977.223637:0:166103:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a9fc5082 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438147:x1731754467729152:12345-10.240.43.64@tcp:103:ldlm_bl_02.0
00010000:00010000:0.0:1651531977.223640:0:166103:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531977.223644:0:166103:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca5006 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446b25 expref: 7 pid: 166111 timeout: 22785 lvb_type: 1
00010000:00010000:0.0:1651531977.223648:0:166103:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca5006 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446b25 expref: 7 pid: 166111 timeout: 22785 lvb_type: 1
00010000:00010000:0.0:1651531977.223654:0:166103:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca5006 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446b25 expref: 7 pid: 166111 timeout: 22785 lvb_type: 1
00010000:00010000:0.0:1651531977.223658:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531977.223658:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531977.223659:0:166103:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca500d lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [946176->950271] (req 946176->950271) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531977.223662:0:166103:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca500d lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [946176->950271] (req 946176->950271) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531977.223673:0:166103:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1651531977.223681:0:216321:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca500d lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [946176->950271] (req 946176->950271) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531977.223685:0:166103:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a9fc5082 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438147:x1731754467729152:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 47us (85us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531977.223687:0:166103:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 271
00010000:00010000:1.0:1651531977.223690:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca500d lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [946176->950271] (req 946176->950271) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531977.224488:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531977.224497:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531977.224509:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467729472
00000100:00100000:0.0:1651531977.224514:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467729600
00000100:00100000:1.0:1651531977.224520:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44829
00000100:00100000:1.0:1651531977.224522:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a23bcd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438149:x1731754467729472:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531977.224526:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651531977.224531:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44830
00000100:00100000:0.0:1651531977.224534:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003b40261e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438149:x1731754467729600:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531977.224535:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca501b lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446b41 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531977.224537:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531977.224541:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca5022 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446b4f expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.224543:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca501b lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446b41 expref: 10 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531977.224548:0:166112:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca501b lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446b41 expref: 11 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531977.224548:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca5022 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446b4f expref: 11 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531977.224551:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c806f265, rc 0)
00010000:00010000:0.0:1651531977.224552:0:166111:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca5022 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446b4f expref: 10 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531977.224556:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e2ec18e1, rc 0)
00000100:00100000:1.0:1651531977.224561:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a23bcd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438149:x1731754467729472:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (74us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531977.224564:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003b40261e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438149:x1731754467729600:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (67us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531977.224566:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44830
00000100:00100000:1.0:1651531977.224574:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44829
00000100:00100000:1.0:1651531977.225059:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531977.225067:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467729856
00000100:00100000:1.0:1651531977.225076:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250534
00000100:00100000:1.0:1651531977.225078:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029096870 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467729856:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531977.225085:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5029 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.225089:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531977.225089:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531977.225090:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5029 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [933888->937983] (req 933888->937983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.225094:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5029 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [933888->937983] (req 933888->937983) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.225105:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5029 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [933888->937983] (req 933888->937983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.225109:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5029 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [933888->937983] (req 933888->937983) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531977.225130:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029096870 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467729856:12345-10.240.43.64@tcp:3:fio.0 Request processed in 51us (71us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531977.225133:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250534
00010000:00010000:1.0:1651531977.225140:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5029 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [933888->937983] (req 933888->937983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.225148:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f6ecb7e5 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531977.225149:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5029 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [933888->937983] (req 933888->937983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.225152:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5029 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [933888->937983] (req 933888->937983) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.225156:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5029 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [933888->937983] (req 933888->937983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.225167:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5029 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [933888->937983] (req 933888->937983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531977.225518:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531977.225525:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467730048
00000100:00100000:1.0:1651531977.225539:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44831
00000100:00100000:1.0:1651531977.225540:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bedaf1f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467730048:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531977.225544:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531977.225547:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca5030 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446b5d expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.225554:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca5030 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446b5d expref: 9 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531977.225558:0:166112:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca5030 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446b5d expref: 9 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531977.225566:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f2af03c8, rc 0)
00000100:00100000:1.0:1651531977.225579:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bedaf1f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467730048:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (62us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531977.225582:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44831
00000100:00100000:1.0:1651531977.226396:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531977.226405:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467730368
00000100:00100000:1.0:1651531977.226414:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250535
00000100:00100000:1.0:1651531977.226416:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007a05c3e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467730368:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531977.226422:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca5037 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.226426:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531977.226427:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531977.226428:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca5037 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [372736->376831] (req 372736->376831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.226432:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca5037 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [372736->376831] (req 372736->376831) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531977.234974:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531977.234995:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467730496
00000100:00100000:1.0:1651531977.235008:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44832
00000100:00100000:1.0:1651531977.235010:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000f4bed26 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754467730496:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531977.235013:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531977.235017:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca503e lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446b6b expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.235028:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca503e lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446b6b expref: 12 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531977.235032:0:166112:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca503e lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446b6b expref: 12 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531977.235035:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f2af03c8, rc 0)
00000100:00100000:1.0:1651531977.235046:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000f4bed26 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754467730496:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (73us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531977.235049:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44832
00000001:00080000:0.0:1651531977.293624:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869479 is committed
00010000:00010000:1.0:1651531977.293656:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca5037 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [372736->376831] (req 372736->376831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.293661:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca5037 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [372736->376831] (req 372736->376831) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531977.293681:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007a05c3e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467730368:12345-10.240.43.64@tcp:4:fio.0 Request processed in 67264us (67285us total) trans 21474869479 rc 0/0
00010000:00010000:0.0:1651531977.293683:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca5037 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [372736->376831] (req 372736->376831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531977.293684:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250535
00010000:00010000:0.0:1651531977.293687:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008b0c325f already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531977.293688:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca5037 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [372736->376831] (req 372736->376831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531977.293692:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca5037 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [372736->376831] (req 372736->376831) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.293698:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca500d lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [946176->950271] (req 946176->950271) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531977.293698:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca5037 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [372736->376831] (req 372736->376831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.293701:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca500d lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [946176->950271] (req 946176->950271) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531977.293702:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca5037 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [372736->376831] (req 372736->376831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531977.293706:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca500d lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [946176->950271] (req 946176->950271) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531977.293708:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c8969b4f already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531977.293709:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca500d lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [946176->950271] (req 946176->950271) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531977.293712:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000033723645 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438147:x1731754467728896:12345-10.240.43.64@tcp:4:fio.0 Request processed in 70574us (70615us total) trans 21474869478 rc 0/0
00010000:00010000:0.0:1651531977.293712:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca500d lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [946176->950271] (req 946176->950271) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531977.293715:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250533
00010000:00010000:0.0:1651531977.293715:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca500d lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [946176->950271] (req 946176->950271) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531977.293718:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca500d lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [946176->950271] (req 946176->950271) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531977.294067:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531977.294069:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531977.294083:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467730944
00000100:00100000:1.0:1651531977.294085:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467731008
00000100:00100000:0.0:1651531977.294092:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44833
00000100:00100000:0.0:1651531977.294093:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000028779db6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438148:x1731754467730944:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651531977.294095:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250536
00000100:00100000:1.0:1651531977.294097:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007b76f7f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438146:x1731754467731008:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531977.294097:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531977.294101:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca5045 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446b79 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651531977.294105:0:216321:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34545:0x0] initial LVB size: 6291456, mtime: 0x627060c9, atime: 0x627060b4, ctime: 0x627060c9, blocks: 0x3000
00010000:00010000:1.0:1651531977.294107:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca504c lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531977.294110:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531977.294110:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531977.294112:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca5045 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446b79 expref: 7 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531977.294118:0:216321:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca5045 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446b79 expref: 7 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531977.294121:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531977.294122:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531977.294123:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca504c lrc: 4/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [950272->954367] (req 950272->954367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531977.294127:0:166112:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca5045 lrc: 5/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446b79 expref: 7 pid: 166112 timeout: 22785 lvb_type: 1
00010000:00010000:0.0:1651531977.294131:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca5045 lrc: 5/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446b79 expref: 7 pid: 166112 timeout: 22785 lvb_type: 1
00010000:00010000:1.0:1651531977.294135:0:216321:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca5045 lrc: 5/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446b79 expref: 7 pid: 166112 timeout: 22785 lvb_type: 1
00010000:00010000:1.0:1651531977.294138:0:216321:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca5045 lrc: 5/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446b79 expref: 7 pid: 166112 timeout: 22785 lvb_type: 1
00010000:00010000:0.0:1651531977.294142:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e2ec18e1, rc 0)
00000100:00100000:1.0:1651531977.294143:0:216321:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dccc50c6 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997359872:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531977.294152:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000028779db6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438148:x1731754467730944:12345-10.240.43.64@tcp:101:fio.0 Request processed in 58us (84us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531977.294153:0:216321:0:(client.c:2492:ptlrpc_set_wait()) set 000000002ddea5d6 going to sleep for 6 seconds
00000100:00100000:0.0:1651531977.294155:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44833
00000100:00100000:1.0:1651531977.294403:0:216321:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dccc50c6 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997359872:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651531977.294409:0:216321:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca504c lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [950272->954367] (req 950272->954367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531977.294467:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531977.294476:0:166103:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467731072
00010000:00010000:0.0:1651531977.294482:0:166103:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca5045 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446b79 expref: 7 pid: 166112 timeout: 22785 lvb_type: 1
00000100:00100000:0.0:1651531977.294492:0:166103:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 272
00000100:00100000:0.0:1651531977.294494:0:166103:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000b1a9136 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438146:x1731754467731072:12345-10.240.43.64@tcp:103:ldlm_bl_05.0
00010000:00010000:0.0:1651531977.294497:0:166103:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531977.294501:0:166103:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca5045 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446b79 expref: 7 pid: 166112 timeout: 22785 lvb_type: 1
00010000:00010000:0.0:1651531977.294518:0:166103:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca5045 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446b79 expref: 7 pid: 166112 timeout: 22785 lvb_type: 1
00010000:00010000:0.0:1651531977.294524:0:166103:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca5045 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446b79 expref: 7 pid: 166112 timeout: 22785 lvb_type: 1
00010000:00010000:0.0:1651531977.294528:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531977.294529:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531977.294529:0:166103:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca504c lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [950272->954367] (req 950272->954367) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531977.294533:0:166103:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca504c lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [950272->954367] (req 950272->954367) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531977.294541:0:166103:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1651531977.294547:0:216321:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca504c lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [950272->954367] (req 950272->954367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531977.294552:0:166103:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000b1a9136 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438146:x1731754467731072:12345-10.240.43.64@tcp:103:ldlm_bl_05.0 Request processed in 57us (86us total) trans 0 rc 0/0
00010000:00010000:1.0:1651531977.294555:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca504c lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [950272->954367] (req 950272->954367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531977.294555:0:166103:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 272
00000100:00100000:0.0:1651531977.294624:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531977.294633:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467731264
00000100:00100000:0.0:1651531977.294646:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44834
00000100:00100000:0.0:1651531977.294648:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001797bd5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467731264:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531977.294652:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531977.294655:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca5053 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446b87 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531977.294662:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca5053 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446b87 expref: 9 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531977.294675:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca5053 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446b87 expref: 9 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531977.294679:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c1022d42, rc 0)
00000100:00100000:0.0:1651531977.294691:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001797bd5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467731264:12345-10.240.43.64@tcp:101:fio.0 Request processed in 42us (67us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531977.294694:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44834
00000100:00100000:0.0:1651531977.295057:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531977.295080:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467731584
00000100:00100000:1.0:1651531977.295093:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250537
00000100:00100000:1.0:1651531977.295094:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bfdd313b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467731584:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531977.295102:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca505a lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.295106:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531977.295107:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531977.295108:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca505a lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [888832->892927] (req 888832->892927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.295112:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca505a lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [888832->892927] (req 888832->892927) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.295124:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca505a lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [888832->892927] (req 888832->892927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.295127:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca505a lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [888832->892927] (req 888832->892927) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531977.295145:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bfdd313b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467731584:12345-10.240.43.64@tcp:3:fio.0 Request processed in 50us (89us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531977.295148:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250537
00010000:00010000:1.0:1651531977.295155:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca505a lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [888832->892927] (req 888832->892927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.295158:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f6ecb7e5 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531977.295160:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca505a lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [888832->892927] (req 888832->892927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.295162:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca505a lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [888832->892927] (req 888832->892927) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.295167:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca505a lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [888832->892927] (req 888832->892927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.295169:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca505a lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [888832->892927] (req 888832->892927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531977.295496:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531977.295503:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467731904
00000100:00100000:0.0:1651531977.295510:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44835
00000100:00100000:0.0:1651531977.295512:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f817afea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467731904:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531977.295515:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531977.295519:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca5061 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446b95 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531977.295526:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca5061 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446b95 expref: 9 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531977.295530:0:166112:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca5061 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446b95 expref: 9 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531977.295533:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fab23815, rc 0)
00000100:00100000:0.0:1651531977.295547:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f817afea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467731904:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (52us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531977.295560:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44835
00000100:00100000:0.0:1651531977.295909:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531977.295927:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467732032
00000100:00100000:1.0:1651531977.295938:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250538
00000100:00100000:1.0:1651531977.295940:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ac545f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467732032:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531977.295947:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5068 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.295950:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531977.295952:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531977.295953:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5068 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [372736->376831] (req 372736->376831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.295957:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5068 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [372736->376831] (req 372736->376831) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.295967:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5068 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [372736->376831] (req 372736->376831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.295971:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5068 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [372736->376831] (req 372736->376831) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531977.295985:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ac545f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467732032:12345-10.240.43.64@tcp:3:fio.0 Request processed in 44us (76us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531977.295987:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250538
00010000:00010000:1.0:1651531977.295993:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5068 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [372736->376831] (req 372736->376831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.295996:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c806f265 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531977.295997:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5068 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [372736->376831] (req 372736->376831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.296000:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5068 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [372736->376831] (req 372736->376831) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.296004:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5068 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [372736->376831] (req 372736->376831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.296007:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5068 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [372736->376831] (req 372736->376831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531977.296310:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531977.296317:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467732160
00000100:00100000:0.0:1651531977.296324:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44836
00000100:00100000:0.0:1651531977.296325:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000054ed0749 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467732160:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531977.296329:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531977.296332:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca506f lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446ba3 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531977.296339:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca506f lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446ba3 expref: 9 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531977.296343:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca506f lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446ba3 expref: 9 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531977.296347:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f765708a, rc 0)
00000100:00100000:0.0:1651531977.296361:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000054ed0749 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467732160:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (52us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531977.296363:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44836
00000100:00100000:0.0:1651531977.296662:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531977.296679:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467732288
00000100:00100000:1.0:1651531977.296690:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250539
00000100:00100000:1.0:1651531977.296691:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009acffcb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467732288:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531977.296698:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca5076 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.296702:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531977.296703:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531977.296704:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca5076 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [610304->614399] (req 610304->614399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.296707:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca5076 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [610304->614399] (req 610304->614399) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.296718:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca5076 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [610304->614399] (req 610304->614399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.296721:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca5076 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [610304->614399] (req 610304->614399) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531977.296741:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca5076 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [610304->614399] (req 610304->614399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531977.296742:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009acffcb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467732288:12345-10.240.43.64@tcp:3:fio.0 Request processed in 49us (80us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531977.296745:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250539
00010000:00010000:0.0:1651531977.296745:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000eebd17a1 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531977.296746:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca5076 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [610304->614399] (req 610304->614399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531977.296758:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca5076 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [610304->614399] (req 610304->614399) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531977.296764:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca5076 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [610304->614399] (req 610304->614399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531977.296767:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca5076 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [610304->614399] (req 610304->614399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531977.297032:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531977.297039:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467732416
00000100:00100000:0.0:1651531977.297047:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44837
00000100:00100000:0.0:1651531977.297048:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467732416:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531977.297051:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531977.297054:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca507d lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446bb1 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531977.297061:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca507d lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446bb1 expref: 9 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531977.297065:0:166112:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca507d lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446bb1 expref: 9 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531977.297069:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000820577fb, rc 0)
00000100:00100000:0.0:1651531977.297083:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467732416:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (51us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531977.297095:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44837
00000100:00100000:0.0:1651531977.297821:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531977.297828:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467732672
00000100:00100000:0.0:1651531977.297835:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44838
00000100:00100000:0.0:1651531977.297836:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a899ddab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467732672:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531977.297839:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531977.297843:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca5084 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446bbf expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531977.297850:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca5084 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446bbf expref: 9 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531977.297854:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca5084 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446bbf expref: 9 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531977.297857:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000775318ab, rc 0)
00000100:00100000:0.0:1651531977.297872:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a899ddab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467732672:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (52us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531977.297875:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44838
00000100:00100000:0.0:1651531977.298167:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531977.298185:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467732800
00000100:00100000:1.0:1651531977.298195:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250540
00000100:00100000:1.0:1651531977.298197:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008b42dfe9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467732800:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531977.298206:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca508b lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.298210:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531977.298211:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531977.298212:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca508b lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [741376->745471] (req 741376->745471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.298247:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca508b lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [741376->745471] (req 741376->745471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.298259:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca508b lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [741376->745471] (req 741376->745471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.298262:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca508b lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [741376->745471] (req 741376->745471) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531977.298276:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008b42dfe9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467732800:12345-10.240.43.64@tcp:3:fio.0 Request processed in 79us (109us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531977.298279:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250540
00010000:00010000:1.0:1651531977.298287:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca508b lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [741376->745471] (req 741376->745471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.298291:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000060a6272d already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531977.298292:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca508b lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [741376->745471] (req 741376->745471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.298295:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca508b lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [741376->745471] (req 741376->745471) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.298303:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca508b lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [741376->745471] (req 741376->745471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.298306:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca508b lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [741376->745471] (req 741376->745471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531977.298582:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531977.298598:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467732928
00000100:00100000:1.0:1651531977.298608:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250541
00000100:00100000:1.0:1651531977.298610:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b10bc064 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467732928:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531977.298616:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5092 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.298620:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531977.298621:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531977.298621:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5092 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [151552->155647] (req 151552->155647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.298625:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5092 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [151552->155647] (req 151552->155647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531977.361419:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869481 is committed
00000100:00100000:1.0:1651531977.361440:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651531977.361461:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5092 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [151552->155647] (req 151552->155647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531977.361461:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467733120
00010000:00010000:1.0:1651531977.361465:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5092 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [151552->155647] (req 151552->155647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531977.361470:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44839
00000100:00100000:0.0:1651531977.361472:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dccc50c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438148:x1731754467733120:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531977.361479:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651531977.361483:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b10bc064 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438147:x1731754467732928:12345-10.240.43.64@tcp:4:fio.0 Request processed in 62872us (62901us total) trans 21474869481 rc 0/0
00000100:00100000:1.0:1651531977.361487:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250541
00010000:00010000:0.0:1651531977.361488:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca5099 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446bcd expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.361495:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5092 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [151552->155647] (req 151552->155647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531977.361496:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca5099 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446bcd expref: 7 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531977.361498:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000000bb25cc already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531977.361499:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5092 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [151552->155647] (req 151552->155647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531977.361500:0:166112:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca5099 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446bcd expref: 7 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531977.361502:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5092 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [151552->155647] (req 151552->155647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531977.361504:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000775318ab, rc 0)
00010000:00010000:1.0:1651531977.361507:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5092 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [151552->155647] (req 151552->155647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.361510:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5092 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [151552->155647] (req 151552->155647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531977.361513:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dccc50c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438148:x1731754467733120:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (73us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531977.361515:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44839
00010000:00010000:1.0:1651531977.361519:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca504c lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [950272->954367] (req 950272->954367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.361523:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca504c lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [950272->954367] (req 950272->954367) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531977.361537:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007b76f7f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438146:x1731754467731008:12345-10.240.43.64@tcp:4:fio.0 Request processed in 67440us (67471us total) trans 21474869480 rc 0/0
00000100:00100000:1.0:1651531977.361540:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250536
00010000:00010000:1.0:1651531977.361551:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca504c lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [950272->954367] (req 950272->954367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.361572:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f2af03c8 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531977.361573:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca504c lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [950272->954367] (req 950272->954367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.361576:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca504c lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [950272->954367] (req 950272->954367) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.361581:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca504c lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [950272->954367] (req 950272->954367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.361583:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca504c lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [950272->954367] (req 950272->954367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531977.361975:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531977.361983:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467733504
00000100:00100000:1.0:1651531977.361993:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250542
00000100:00100000:1.0:1651531977.361994:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e4e3ecb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438147:x1731754467733504:12345-10.240.43.64@tcp:4:fio.0
00002000:00010000:1.0:1651531977.362002:0:216321:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34545:0x0] initial LVB size: 6291456, mtime: 0x627060c9, atime: 0x627060b4, ctime: 0x627060c9, blocks: 0x3000
00010000:00010000:1.0:1651531977.362005:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca50a0 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.362008:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531977.362009:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531977.362010:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca50a0 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [720896->724991] (req 720896->724991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.362014:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca50a0 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [720896->724991] (req 720896->724991) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531977.362356:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531977.362366:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467733760
00000100:00100000:1.0:1651531977.362377:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250543
00000100:00100000:1.0:1651531977.362379:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000427633c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467733760:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531977.362385:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca50a7 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.362389:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531977.362390:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531977.362391:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca50a7 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [1036288->1040383] (req 1036288->1040383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.362395:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca50a7 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [1036288->1040383] (req 1036288->1040383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531977.402417:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869483 is committed
00010000:00010000:1.0:1651531977.402451:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca50a7 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [1036288->1040383] (req 1036288->1040383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.402456:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca50a7 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [1036288->1040383] (req 1036288->1040383) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531977.402473:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000427633c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467733760:12345-10.240.43.64@tcp:4:fio.0 Request processed in 40093us (40117us total) trans 21474869483 rc 0/0
00000100:00100000:1.0:1651531977.402476:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250543
00010000:00010000:1.0:1651531977.402483:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca50a7 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [1036288->1040383] (req 1036288->1040383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.402486:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c806f265 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531977.402489:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca50a7 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [1036288->1040383] (req 1036288->1040383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.402491:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca50a7 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [1036288->1040383] (req 1036288->1040383) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.402496:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca50a7 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [1036288->1040383] (req 1036288->1040383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.402499:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca50a7 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [1036288->1040383] (req 1036288->1040383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.402541:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca50a0 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [720896->724991] (req 720896->724991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.402545:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca50a0 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [720896->724991] (req 720896->724991) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531977.402565:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e4e3ecb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438147:x1731754467733504:12345-10.240.43.64@tcp:4:fio.0 Request processed in 40569us (40590us total) trans 21474869482 rc 0/0
00000100:00100000:1.0:1651531977.402568:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250542
00010000:00010000:1.0:1651531977.402574:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca50a0 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [720896->724991] (req 720896->724991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.402577:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000060a6272d already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531977.402579:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca50a0 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [720896->724991] (req 720896->724991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.402581:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca50a0 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [720896->724991] (req 720896->724991) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.402587:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca50a0 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [720896->724991] (req 720896->724991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.402590:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca50a0 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [720896->724991] (req 720896->724991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531977.402894:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531977.402905:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531977.402917:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467733888
00000100:00100000:0.0:1651531977.402926:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467734016
00000100:00100000:0.0:1651531977.402930:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44840
00000100:00100000:0.0:1651531977.402932:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002d3e5ae4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438148:x1731754467733888:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531977.402936:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531977.402940:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca50ae lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446bdb expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00002000:00010000:0.0:1651531977.402945:0:166113:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34545:0x0] initial LVB size: 6291456, mtime: 0x627060c9, atime: 0x627060b4, ctime: 0x627060c9, blocks: 0x3000
00010000:00010000:0.0:1651531977.402949:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531977.402951:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531977.402953:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca50ae lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446bdb expref: 7 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531977.402958:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca50ae lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446bdb expref: 7 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531977.402962:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000775318ab, rc 0)
00000100:00100000:0.0:1651531977.402973:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002d3e5ae4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438148:x1731754467733888:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (79us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531977.402976:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44840
00000100:00100000:0.0:1651531977.402980:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44841
00000100:00100000:0.0:1651531977.402982:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000071f9ee43 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438146:x1731754467734016:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531977.402984:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531977.402987:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca50b5 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446be9 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531977.402991:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531977.402992:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531977.402993:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca50b5 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446be9 expref: 7 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531977.402997:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca50b5 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446be9 expref: 7 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531977.403000:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000820577fb, rc 0)
00000100:00100000:0.0:1651531977.403005:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000071f9ee43 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438146:x1731754467734016:12345-10.240.43.64@tcp:101:fio.0 Request processed in 23us (100us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531977.403010:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44841
00000100:00100000:1.0:1651531977.403075:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531977.403086:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531977.403094:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467734144
00000100:00100000:0.0:1651531977.403101:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467734272
00000100:00100000:0.0:1651531977.403105:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44842
00000100:00100000:0.0:1651531977.403106:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009078ca7d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467734144:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531977.403110:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531977.403113:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca50bc lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446bf7 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531977.403119:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531977.403119:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531977.403121:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca50bc lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446bf7 expref: 9 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531977.403125:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca50bc lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446bf7 expref: 9 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531977.403129:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f765708a, rc 0)
00000100:00100000:0.0:1651531977.403138:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009078ca7d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754467734144:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (64us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531977.403141:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44842
00000100:00100000:0.0:1651531977.403145:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44843
00000100:00100000:0.0:1651531977.403147:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000be290c70 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467734272:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531977.403149:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531977.403151:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca50c3 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446c05 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531977.403159:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531977.403160:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531977.403161:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca50c3 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446c05 expref: 9 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531977.403165:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca50c3 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446c05 expref: 9 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531977.403168:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fab23815, rc 0)
00000100:00100000:0.0:1651531977.403173:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000be290c70 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438146:x1731754467734272:12345-10.240.43.64@tcp:101:fio.0 Request processed in 26us (87us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531977.403175:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44843
00000100:00100000:1.0:1651531977.403557:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531977.403564:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467734528
00000100:00100000:1.0:1651531977.403574:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250544
00000100:00100000:1.0:1651531977.403576:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fb90eb28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438149:x1731754467734528:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531977.403583:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca50ca lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.403587:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531977.403588:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531977.403589:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca50ca lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.403592:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca50ca lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.403604:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca50ca lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.403611:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca50ca lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531977.403632:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fb90eb28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438149:x1731754467734528:12345-10.240.43.64@tcp:3:fio.0 Request processed in 55us (75us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531977.403635:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250544
00010000:00010000:1.0:1651531977.403641:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca50ca lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.403645:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f2af03c8 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531977.403646:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca50ca lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.403648:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca50ca lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.403653:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca50ca lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.403655:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca50ca lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531977.404423:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531977.404431:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467735104
00000100:00100000:1.0:1651531977.404439:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250545
00000100:00100000:1.0:1651531977.404441:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dce6a2c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438147:x1731754467735104:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531977.404448:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca50d1 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.404453:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531977.404454:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531977.404455:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca50d1 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [585728->589823] (req 585728->589823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.404459:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca50d1 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [585728->589823] (req 585728->589823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.404469:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca50d1 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [585728->589823] (req 585728->589823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.404472:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca50d1 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [585728->589823] (req 585728->589823) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531977.404501:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dce6a2c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438147:x1731754467735104:12345-10.240.43.64@tcp:3:fio.0 Request processed in 59us (78us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531977.404504:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250545
00010000:00010000:1.0:1651531977.404511:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca50d1 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [585728->589823] (req 585728->589823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.404514:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000000bb25cc already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531977.404515:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca50d1 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [585728->589823] (req 585728->589823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.404518:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca50d1 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [585728->589823] (req 585728->589823) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.404523:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca50d1 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [585728->589823] (req 585728->589823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.404527:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca50d1 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [585728->589823] (req 585728->589823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531977.406166:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531977.406174:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467736192
00000100:00100000:1.0:1651531977.406183:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250546
00000100:00100000:1.0:1651531977.406184:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000028779db6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438147:x1731754467736192:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531977.406191:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca50d8 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.406195:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531977.406195:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531977.406196:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca50d8 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [270336->274431] (req 270336->274431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.406200:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca50d8 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [270336->274431] (req 270336->274431) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.406210:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca50d8 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [270336->274431] (req 270336->274431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.406213:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca50d8 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [270336->274431] (req 270336->274431) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531977.406254:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000028779db6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438147:x1731754467736192:12345-10.240.43.64@tcp:3:fio.0 Request processed in 69us (88us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531977.406257:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250546
00010000:00010000:1.0:1651531977.406265:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca50d8 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [270336->274431] (req 270336->274431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.406268:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f6ecb7e5 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531977.406269:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca50d8 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [270336->274431] (req 270336->274431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.406272:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca50d8 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [270336->274431] (req 270336->274431) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.406277:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca50d8 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [270336->274431] (req 270336->274431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.406280:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca50d8 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [270336->274431] (req 270336->274431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531977.406540:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531977.406548:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467736320
00000100:00100000:1.0:1651531977.406560:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250547
00000100:00100000:1.0:1651531977.406562:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dccc50c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438146:x1731754467736320:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531977.406569:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca50df lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.406574:0:216321:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca50ae lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446bdb expref: 9 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531977.406577:0:216321:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca50b5 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446be9 expref: 9 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531977.406584:0:216321:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca50bc lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446bf7 expref: 9 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531977.406587:0:216321:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca50c3 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446c05 expref: 9 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531977.406590:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531977.406590:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531977.406591:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca50df lrc: 7/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [831488->835583] (req 831488->835583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.406598:0:216321:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca50c3 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446c05 expref: 9 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531977.406602:0:216321:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca50c3 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446c05 expref: 9 pid: 166112 timeout: 22786 lvb_type: 1
00000100:00100000:1.0:1651531977.406606:0:216321:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002d3e5ae4 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997359936:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651531977.406633:0:216321:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca50bc lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446bf7 expref: 9 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531977.406637:0:216321:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca50bc lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446bf7 expref: 9 pid: 166112 timeout: 22786 lvb_type: 1
00000100:00100000:1.0:1651531977.406641:0:216321:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000071f9ee43 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997360000:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651531977.406657:0:216321:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca50b5 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446be9 expref: 9 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531977.406682:0:216321:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca50b5 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446be9 expref: 9 pid: 166113 timeout: 22786 lvb_type: 1
00000100:00100000:1.0:1651531977.406691:0:216321:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009078ca7d pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997360064:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651531977.406705:0:216321:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca50ae lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446bdb expref: 9 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531977.406708:0:216321:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca50ae lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446bdb expref: 9 pid: 166113 timeout: 22786 lvb_type: 1
00000100:00100000:1.0:1651531977.406712:0:216321:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003a5ac9b4 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997360128:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531977.406717:0:216321:0:(client.c:2492:ptlrpc_set_wait()) set 000000002ddea5d6 going to sleep for 6 seconds
00000100:00100000:0.0:1651531977.406987:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531977.406996:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531977.406998:0:216321:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002d3e5ae4 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997359936:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531977.407006:0:166103:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467736384
00000100:00100000:1.0:1651531977.407007:0:216321:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000071f9ee43 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997360000:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651531977.407012:0:166103:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca50c3 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446c05 expref: 10 pid: 166112 timeout: 22786 lvb_type: 1
00000100:00100000:1.0:1651531977.407013:0:169267:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467736448
00010000:00010000:1.0:1651531977.407018:0:169267:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca50bc lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446bf7 expref: 11 pid: 166112 timeout: 22786 lvb_type: 1
00000100:00100000:0.0:1651531977.407021:0:166103:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 273
00000100:00100000:0.0:1651531977.407022:0:166103:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a899ddab pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438147:x1731754467736384:12345-10.240.43.64@tcp:103:ldlm_bl_01.0
00000100:00100000:1.0:1651531977.407030:0:169267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 274
00010000:00010000:0.0:1651531977.407031:0:166103:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00000100:00100000:1.0:1651531977.407032:0:169267:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000778843eb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438147:x1731754467736448:12345-10.240.43.64@tcp:103:ldlm_bl_01.0
00010000:00010000:1.0:1651531977.407036:0:169267:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531977.407036:0:166103:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca50c3 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446c05 expref: 11 pid: 166112 timeout: 22786 lvb_type: 1
00010000:00010000:0.0:1651531977.407040:0:166103:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca50c3 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446c05 expref: 11 pid: 166112 timeout: 22786 lvb_type: 1
00010000:00010000:1.0:1651531977.407046:0:169267:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca50bc lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446bf7 expref: 11 pid: 166112 timeout: 22786 lvb_type: 1
00010000:00010000:0.0:1651531977.407047:0:166103:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca50c3 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446c05 expref: 11 pid: 166112 timeout: 22786 lvb_type: 1
00010000:00010000:1.0:1651531977.407050:0:169267:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca50bc lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446bf7 expref: 11 pid: 166112 timeout: 22786 lvb_type: 1
00010000:00010000:0.0:1651531977.407056:0:166103:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1651531977.407058:0:169267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca50bc lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446bf7 expref: 10 pid: 166112 timeout: 22786 lvb_type: 1
00010000:00010000:1.0:1651531977.407063:0:169267:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651531977.407068:0:166103:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a899ddab pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438147:x1731754467736384:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 45us (82us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531977.407071:0:166103:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 273
00000100:00100000:1.0:1651531977.407077:0:169267:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000778843eb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467736448:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 44us (80us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531977.407079:0:169267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 274
00000100:00100000:1.0:1651531977.407176:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531977.407185:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531977.407196:0:169267:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467736576
00010000:00010000:1.0:1651531977.407201:0:169267:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca50b5 lrc: 5/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446be9 expref: 8 pid: 166113 timeout: 22786 lvb_type: 1
00000100:00100000:0.0:1651531977.407202:0:166104:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467736512
00000100:00100000:1.0:1651531977.407211:0:169267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 275
00000100:00100000:1.0:1651531977.407213:0:169267:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000530f55ca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438146:x1731754467736576:12345-10.240.43.64@tcp:103:ldlm_bl_02.0
00010000:00010000:0.0:1651531977.407213:0:166104:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca50ae lrc: 5/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446bdb expref: 9 pid: 166113 timeout: 22786 lvb_type: 1
00010000:00010000:1.0:1651531977.407237:0:169267:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1651531977.407241:0:169267:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca50b5 lrc: 5/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446be9 expref: 9 pid: 166113 timeout: 22786 lvb_type: 1
00000100:00100000:0.0:1651531977.407241:0:166104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 276
00000100:00100000:0.0:1651531977.407243:0:166104:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000880cd1d7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438146:x1731754467736512:12345-10.240.43.64@tcp:103:ldlm_bl_02.0
00010000:00010000:1.0:1651531977.407246:0:169267:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca50b5 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446be9 expref: 9 pid: 166113 timeout: 22786 lvb_type: 1
00010000:00010000:0.0:1651531977.407246:0:166104:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531977.407254:0:166104:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca50ae lrc: 5/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446bdb expref: 9 pid: 166113 timeout: 22786 lvb_type: 1
00010000:00010000:1.0:1651531977.407256:0:169267:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1651531977.407258:0:166104:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca50ae lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446bdb expref: 9 pid: 166113 timeout: 22786 lvb_type: 1
00010000:00010000:0.0:1651531977.407264:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:1.0:1651531977.407267:0:169267:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000530f55ca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438146:x1731754467736576:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 53us (91us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531977.407270:0:169267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 275
00010000:00010000:0.0:1651531977.407270:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531977.407271:0:166104:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca50df lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [831488->835583] (req 831488->835583) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531977.407274:0:166104:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca50df lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [831488->835583] (req 831488->835583) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531977.407281:0:166104:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1651531977.407283:0:216321:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca50b5 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446be9 expref: 8 pid: 166113 timeout: 22786 lvb_type: 1
00000100:00100000:1.0:1651531977.407288:0:216321:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009078ca7d pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997360064:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531977.407289:0:166104:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000880cd1d7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438146:x1731754467736512:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 46us (104us total) trans 0 rc 0/0
00010000:00010000:1.0:1651531977.407290:0:216321:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca50ae lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446bdb expref: 7 pid: 166113 timeout: 22786 lvb_type: 1
00000100:00100000:0.0:1651531977.407292:0:166104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 276
00000100:00100000:1.0:1651531977.407294:0:216321:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003a5ac9b4 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997360128:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651531977.407299:0:216321:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca50df lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [831488->835583] (req 831488->835583) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.407302:0:216321:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca50df lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [831488->835583] (req 831488->835583) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.407305:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca50df lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [831488->835583] (req 831488->835583) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531977.474398:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869484 is committed
00010000:00010000:1.0:1651531977.474430:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca50df lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [831488->835583] (req 831488->835583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.474435:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca50df lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [831488->835583] (req 831488->835583) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531977.474453:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dccc50c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438146:x1731754467736320:12345-10.240.43.64@tcp:4:fio.0 Request processed in 67890us (67913us total) trans 21474869484 rc 0/0
00000100:00100000:1.0:1651531977.474457:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250547
00010000:00010000:1.0:1651531977.474464:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca50df lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [831488->835583] (req 831488->835583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.474467:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001cf49bf2 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531977.474468:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca50df lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [831488->835583] (req 831488->835583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.474471:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca50df lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [831488->835583] (req 831488->835583) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.474476:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca50df lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [831488->835583] (req 831488->835583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.474479:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca50df lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [831488->835583] (req 831488->835583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531977.474508:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531977.474518:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531977.474530:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467736896
00000100:00100000:0.0:1651531977.474540:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467736704
00000100:00100000:0.0:1651531977.474548:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44844
00000100:00100000:0.0:1651531977.474550:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003a5ac9b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438148:x1731754467736704:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651531977.474555:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250548
00000100:00100000:1.0:1651531977.474556:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000099b6616a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438147:x1731754467736896:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531977.474559:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00002000:00010000:1.0:1651531977.474565:0:216321:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34545:0x0] initial LVB size: 6291456, mtime: 0x627060c9, atime: 0x627060b4, ctime: 0x627060c9, blocks: 0x3000
00010000:00010000:0.0:1651531977.474565:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca50ed lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446c13 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.474567:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca50e6 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531977.474570:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531977.474571:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531977.474572:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca50ed lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446c13 expref: 7 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531977.474580:0:216321:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca50ed lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446c13 expref: 7 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531977.474583:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531977.474584:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531977.474584:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca50e6 lrc: 4/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [790528->794623] (req 790528->794623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531977.474589:0:166113:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca50ed lrc: 5/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446c13 expref: 7 pid: 166113 timeout: 22786 lvb_type: 1
00010000:00010000:0.0:1651531977.474593:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca50ed lrc: 5/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446c13 expref: 7 pid: 166113 timeout: 22786 lvb_type: 1
00010000:00010000:1.0:1651531977.474596:0:216321:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca50ed lrc: 5/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446c13 expref: 7 pid: 166113 timeout: 22786 lvb_type: 1
00010000:00010000:1.0:1651531977.474600:0:216321:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca50ed lrc: 5/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446c13 expref: 7 pid: 166113 timeout: 22786 lvb_type: 1
00010000:00010000:0.0:1651531977.474603:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fab23815, rc 0)
00000100:00100000:1.0:1651531977.474604:0:216321:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000da31c48f pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997360192:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531977.474613:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003a5ac9b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438148:x1731754467736704:12345-10.240.43.64@tcp:101:fio.0 Request processed in 62us (101us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531977.474614:0:216321:0:(client.c:2492:ptlrpc_set_wait()) set 000000002ddea5d6 going to sleep for 6 seconds
00000100:00100000:0.0:1651531977.474617:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44844
00000100:00100000:1.0:1651531977.474962:0:216321:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000da31c48f pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997360192:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651531977.474967:0:216321:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca50e6 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [790528->794623] (req 790528->794623) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531977.475108:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531977.475132:0:166103:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467737216
00010000:00010000:0.0:1651531977.475138:0:166103:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca50ed lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446c13 expref: 7 pid: 166113 timeout: 22786 lvb_type: 1
00000100:00100000:0.0:1651531977.475146:0:166103:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 277
00000100:00100000:0.0:1651531977.475148:0:166103:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000da31c48f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438149:x1731754467737216:12345-10.240.43.64@tcp:103:ldlm_bl_06.0
00010000:00010000:0.0:1651531977.475151:0:166103:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531977.475154:0:166103:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca50ed lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446c13 expref: 7 pid: 166113 timeout: 22786 lvb_type: 1
00010000:00010000:0.0:1651531977.475158:0:166103:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca50ed lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446c13 expref: 7 pid: 166113 timeout: 22786 lvb_type: 1
00010000:00010000:0.0:1651531977.475164:0:166103:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca50ed lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446c13 expref: 7 pid: 166113 timeout: 22786 lvb_type: 1
00010000:00010000:0.0:1651531977.475168:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531977.475168:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531977.475169:0:166103:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca50e6 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [790528->794623] (req 790528->794623) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531977.475172:0:166103:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca50e6 lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [790528->794623] (req 790528->794623) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531977.475185:0:166103:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1651531977.475193:0:216321:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca50e6 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [790528->794623] (req 790528->794623) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531977.475194:0:166103:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000da31c48f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467737216:12345-10.240.43.64@tcp:103:ldlm_bl_06.0 Request processed in 46us (86us total) trans 0 rc 0/0
00010000:00010000:1.0:1651531977.475197:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca50e6 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [790528->794623] (req 790528->794623) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531977.475199:0:166103:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 277
00000001:00080000:0.0:1651531977.511281:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869485 is committed
00010000:00010000:1.0:1651531977.511312:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca50e6 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [790528->794623] (req 790528->794623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.511317:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca50e6 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [790528->794623] (req 790528->794623) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531977.511333:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000099b6616a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438147:x1731754467736896:12345-10.240.43.64@tcp:4:fio.0 Request processed in 36776us (36826us total) trans 21474869485 rc 0/0
00000100:00100000:1.0:1651531977.511336:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250548
00010000:00010000:1.0:1651531977.511343:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca50e6 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [790528->794623] (req 790528->794623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.511347:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f6ecb7e5 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531977.511348:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca50e6 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [790528->794623] (req 790528->794623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.511351:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca50e6 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [790528->794623] (req 790528->794623) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.511355:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca50e6 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [790528->794623] (req 790528->794623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.511358:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca50e6 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [790528->794623] (req 790528->794623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531977.511691:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531977.511708:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467737600
00000100:00100000:1.0:1651531977.511723:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250549
00000100:00100000:1.0:1651531977.511733:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002ae2aeac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438146:x1731754467737600:12345-10.240.43.64@tcp:4:fio.0
00002000:00010000:1.0:1651531977.511742:0:216321:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34545:0x0] initial LVB size: 6291456, mtime: 0x627060c9, atime: 0x627060b4, ctime: 0x627060c9, blocks: 0x3000
00010000:00010000:1.0:1651531977.511744:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca50f4 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.511748:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531977.511749:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531977.511749:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca50f4 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [524288->528383] (req 524288->528383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.511753:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca50f4 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [524288->528383] (req 524288->528383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531977.524335:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531977.524357:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467737728
00000100:00100000:0.0:1651531977.524366:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44845
00000100:00100000:0.0:1651531977.524368:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001eda4376 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467737728:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531977.524372:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531977.524376:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca50fb lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446c21 expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531977.524384:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca50fb lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446c21 expref: 9 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531977.524388:0:166111:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca50fb lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446c21 expref: 9 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531977.524391:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fab23815, rc 0)
00000100:00100000:0.0:1651531977.524402:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001eda4376 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467737728:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (67us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531977.524404:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44845
00000100:00100000:1.0:1651531977.525144:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531977.525161:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467738112
00000100:00100000:0.0:1651531977.525169:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44846
00000100:00100000:0.0:1651531977.525170:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e15376c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467738112:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531977.525174:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531977.525186:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca5102 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446c2f expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531977.525194:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca5102 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446c2f expref: 9 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531977.525199:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca5102 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446c2f expref: 9 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531977.525202:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c1022d42, rc 0)
00000100:00100000:0.0:1651531977.525213:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e15376c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467738112:12345-10.240.43.64@tcp:101:fio.0 Request processed in 42us (69us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531977.525244:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44846
00000001:00080000:0.0:1651531977.537292:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869486 is committed
00010000:00010000:1.0:1651531977.537323:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca50f4 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [524288->528383] (req 524288->528383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.537328:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca50f4 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [524288->528383] (req 524288->528383) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531977.537344:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002ae2aeac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438146:x1731754467737600:12345-10.240.43.64@tcp:4:fio.0 Request processed in 25611us (25654us total) trans 21474869486 rc 0/0
00000100:00100000:1.0:1651531977.537347:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250549
00010000:00010000:1.0:1651531977.537354:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca50f4 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [524288->528383] (req 524288->528383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.537357:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001cf49bf2 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531977.537369:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca50f4 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [524288->528383] (req 524288->528383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.537372:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca50f4 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [524288->528383] (req 524288->528383) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.537378:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca50f4 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [524288->528383] (req 524288->528383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.537380:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca50f4 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [524288->528383] (req 524288->528383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531977.537691:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531977.537710:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467738496
00000100:00100000:1.0:1651531977.537722:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44847
00000100:00100000:1.0:1651531977.537724:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b97e3b28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438147:x1731754467738496:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531977.537727:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531977.537731:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5109 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446c3d expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651531977.537737:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34545:0x0] initial LVB size: 6291456, mtime: 0x627060c9, atime: 0x627060b4, ctime: 0x627060c9, blocks: 0x3000
00010000:00010000:1.0:1651531977.537741:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531977.537742:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531977.537744:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5109 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446c3d expref: 6 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531977.537748:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5109 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446c3d expref: 6 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531977.537763:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f6ecb7e5, rc 0)
00000100:00100000:1.0:1651531977.537775:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b97e3b28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438147:x1731754467738496:12345-10.240.43.64@tcp:101:fio.0 Request processed in 50us (84us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531977.537778:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44847
00000100:00100000:0.0:1651531977.538509:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531977.538526:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467738752
00000100:00100000:1.0:1651531977.538542:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250550
00000100:00100000:1.0:1651531977.538544:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a20162bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438146:x1731754467738752:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531977.538552:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5110 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.538556:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531977.538556:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531977.538557:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5110 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [258048->262143] (req 258048->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.538561:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5110 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [258048->262143] (req 258048->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.538573:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5110 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [258048->262143] (req 258048->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.538576:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5110 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [258048->262143] (req 258048->262143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531977.538591:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a20162bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438146:x1731754467738752:12345-10.240.43.64@tcp:3:fio.0 Request processed in 46us (82us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531977.538596:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250550
00010000:00010000:1.0:1651531977.538602:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5110 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [258048->262143] (req 258048->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.538605:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000000bb25cc already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531977.538606:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5110 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [258048->262143] (req 258048->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.538609:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5110 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [258048->262143] (req 258048->262143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.538613:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5110 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [258048->262143] (req 258048->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.538616:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5110 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [258048->262143] (req 258048->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531977.625017:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531977.625042:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467740288
00000100:00100000:1.0:1651531977.625059:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250551
00000100:00100000:1.0:1651531977.625061:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d76314b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467740288:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531977.625069:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5117 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.625073:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531977.625074:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531977.625075:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5117 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [606208->610303] (req 606208->610303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.625083:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5117 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [606208->610303] (req 606208->610303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.625095:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5117 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [606208->610303] (req 606208->610303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.625098:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5117 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [606208->610303] (req 606208->610303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531977.625114:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d76314b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467740288:12345-10.240.43.64@tcp:3:fio.0 Request processed in 52us (97us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531977.625117:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250551
00010000:00010000:1.0:1651531977.625123:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5117 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [606208->610303] (req 606208->610303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.625126:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000000bb25cc already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531977.625127:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5117 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [606208->610303] (req 606208->610303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.625130:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5117 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [606208->610303] (req 606208->610303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.625134:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5117 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [606208->610303] (req 606208->610303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.625137:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5117 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [606208->610303] (req 606208->610303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531977.675794:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531977.675817:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467741056
00000100:00100000:1.0:1651531977.675831:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250552
00000100:00100000:1.0:1651531977.675833:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000033696ffa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467741056:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531977.675840:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca511e lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.675844:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531977.675844:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531977.675845:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca511e lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [610304->614399] (req 610304->614399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.675849:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca511e lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [610304->614399] (req 610304->614399) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.675860:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca511e lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [610304->614399] (req 610304->614399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.675863:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca511e lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [610304->614399] (req 610304->614399) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531977.675878:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000033696ffa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467741056:12345-10.240.43.64@tcp:3:fio.0 Request processed in 44us (85us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531977.675880:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250552
00010000:00010000:1.0:1651531977.675887:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca511e lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [610304->614399] (req 610304->614399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.675890:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000000bb25cc already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531977.675892:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca511e lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [610304->614399] (req 610304->614399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.675895:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca511e lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [610304->614399] (req 610304->614399) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.675899:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca511e lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [610304->614399] (req 610304->614399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.675902:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca511e lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [610304->614399] (req 610304->614399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531977.676971:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531977.676988:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467741568
00000100:00100000:1.0:1651531977.677003:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250553
00000100:00100000:1.0:1651531977.677004:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000329eeeee pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467741568:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531977.677012:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca5125 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.677015:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531977.677016:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531977.677017:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca5125 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [614400->618495] (req 614400->618495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.677021:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca5125 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [614400->618495] (req 614400->618495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.677032:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca5125 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [614400->618495] (req 614400->618495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.677035:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca5125 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [614400->618495] (req 614400->618495) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531977.677050:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000329eeeee pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467741568:12345-10.240.43.64@tcp:3:fio.0 Request processed in 45us (80us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531977.677053:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250553
00010000:00010000:1.0:1651531977.677059:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca5125 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [614400->618495] (req 614400->618495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.677062:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001cf49bf2 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531977.677063:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca5125 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [614400->618495] (req 614400->618495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.677066:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca5125 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [614400->618495] (req 614400->618495) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.677070:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca5125 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [614400->618495] (req 614400->618495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.677073:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca5125 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [614400->618495] (req 614400->618495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531977.677706:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531977.677726:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467741824
00000100:00100000:1.0:1651531977.677740:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250554
00000100:00100000:1.0:1651531977.677742:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f3a0807 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438148:x1731754467741824:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531977.677749:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca512c lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.677753:0:216321:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5109 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446c3d expref: 6 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531977.677758:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531977.677759:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531977.677759:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca512c lrc: 4/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [622592->626687] (req 622592->626687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.677766:0:216321:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5109 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446c3d expref: 6 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531977.677770:0:216321:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5109 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446c3d expref: 6 pid: 166111 timeout: 22786 lvb_type: 1
00000100:00100000:1.0:1651531977.677774:0:216321:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c4db449c pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997360256:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531977.677787:0:216321:0:(client.c:2492:ptlrpc_set_wait()) set 000000002ddea5d6 going to sleep for 6 seconds
00000100:00100000:0.0:1651531977.678015:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531977.678023:0:216321:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c4db449c pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997360256:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531977.678023:0:166102:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467741888
00010000:00010000:1.0:1651531977.678028:0:216321:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca512c lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [622592->626687] (req 622592->626687) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531977.678029:0:166102:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5109 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446c3d expref: 7 pid: 166111 timeout: 22786 lvb_type: 1
00000100:00100000:0.0:1651531977.678038:0:166102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 278
00000100:00100000:0.0:1651531977.678040:0:166102:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a899ddab pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438146:x1731754467741888:12345-10.240.43.64@tcp:103:ldlm_bl_04.0
00010000:00010000:0.0:1651531977.678043:0:166102:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531977.678048:0:166102:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5109 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446c3d expref: 7 pid: 166111 timeout: 22786 lvb_type: 1
00010000:00010000:0.0:1651531977.678052:0:166102:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5109 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446c3d expref: 7 pid: 166111 timeout: 22786 lvb_type: 1
00010000:00010000:0.0:1651531977.678058:0:166102:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5109 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446c3d expref: 7 pid: 166111 timeout: 22786 lvb_type: 1
00010000:00010000:0.0:1651531977.678062:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531977.678063:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531977.678064:0:166102:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca512c lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [622592->626687] (req 622592->626687) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531977.678067:0:166102:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca512c lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [622592->626687] (req 622592->626687) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531977.678079:0:166102:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1651531977.678087:0:216321:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca512c lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [622592->626687] (req 622592->626687) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531977.678091:0:166102:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a899ddab pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438146:x1731754467741888:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 50us (76us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531977.678094:0:166102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 278
00010000:00010000:1.0:1651531977.678095:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca512c lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [622592->626687] (req 622592->626687) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531977.754006:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869487 is committed
00010000:00010000:1.0:1651531977.754039:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca512c lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [622592->626687] (req 622592->626687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.754048:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca512c lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [622592->626687] (req 622592->626687) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531977.754070:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f3a0807 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438148:x1731754467741824:12345-10.240.43.64@tcp:4:fio.0 Request processed in 76327us (76364us total) trans 21474869487 rc 0/0
00000100:00100000:1.0:1651531977.754073:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250554
00010000:00010000:1.0:1651531977.754081:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca512c lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [622592->626687] (req 622592->626687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.754084:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f2af03c8 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531977.754085:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca512c lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [622592->626687] (req 622592->626687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.754088:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca512c lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [622592->626687] (req 622592->626687) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.754093:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca512c lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [622592->626687] (req 622592->626687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.754096:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca512c lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [622592->626687] (req 622592->626687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531977.755267:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531977.755277:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531977.755290:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467742208
00000100:00100000:1.0:1651531977.755299:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467742272
00000100:00100000:1.0:1651531977.755306:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44848
00000100:00100000:1.0:1651531977.755309:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c4db449c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467742208:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531977.755312:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651531977.755312:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44849
00000100:00100000:0.0:1651531977.755315:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000137fd3d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438146:x1731754467742272:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531977.755316:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca5133 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446c52 expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531977.755319:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00002000:00010000:1.0:1651531977.755321:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34545:0x0] initial LVB size: 6291456, mtime: 0x627060c9, atime: 0x627060b4, ctime: 0x627060c9, blocks: 0x3000
00010000:00010000:0.0:1651531977.755324:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca513a lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446c59 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.755326:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531977.755327:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531977.755328:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca5133 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446c52 expref: 7 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531977.755333:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca5133 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446c52 expref: 8 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531977.755334:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531977.755334:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531977.755337:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca513a lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446c59 expref: 8 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531977.755341:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001cf49bf2, rc 0)
00010000:00010000:0.0:1651531977.755341:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca513a lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446c59 expref: 8 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531977.755345:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c1022d42, rc 0)
00000100:00100000:1.0:1651531977.755353:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c4db449c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467742208:12345-10.240.43.64@tcp:101:fio.0 Request processed in 44us (86us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531977.755356:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44848
00000100:00100000:0.0:1651531977.755361:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000137fd3d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438146:x1731754467742272:12345-10.240.43.64@tcp:101:fio.0 Request processed in 45us (84us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531977.755364:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44849
00000100:00100000:1.0:1651531977.755736:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531977.755744:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467742656
00000100:00100000:1.0:1651531977.755759:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250555
00000100:00100000:1.0:1651531977.755761:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009078ca7d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438147:x1731754467742656:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531977.755768:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5141 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.755772:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531977.755773:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531977.755775:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5141 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [1007616->1011711] (req 1007616->1011711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.755779:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5141 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [1007616->1011711] (req 1007616->1011711) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.755791:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5141 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [1007616->1011711] (req 1007616->1011711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.755794:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5141 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [1007616->1011711] (req 1007616->1011711) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531977.755808:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009078ca7d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438147:x1731754467742656:12345-10.240.43.64@tcp:3:fio.0 Request processed in 46us (73us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531977.755811:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250555
00010000:00010000:1.0:1651531977.755817:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5141 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [1007616->1011711] (req 1007616->1011711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.755820:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000000bb25cc already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531977.755821:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5141 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [1007616->1011711] (req 1007616->1011711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.755824:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5141 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [1007616->1011711] (req 1007616->1011711) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.755828:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5141 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [1007616->1011711] (req 1007616->1011711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.755830:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5141 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [1007616->1011711] (req 1007616->1011711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531977.756586:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531977.756594:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467743040
00000100:00100000:1.0:1651531977.756609:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250556
00000100:00100000:1.0:1651531977.756611:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000071f9ee43 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438147:x1731754467743040:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531977.756618:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca5148 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.756622:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531977.756623:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531977.756624:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca5148 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [909312->913407] (req 909312->913407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.756627:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca5148 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [909312->913407] (req 909312->913407) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.756638:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca5148 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [909312->913407] (req 909312->913407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.756641:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca5148 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [909312->913407] (req 909312->913407) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531977.756655:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000071f9ee43 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438147:x1731754467743040:12345-10.240.43.64@tcp:3:fio.0 Request processed in 44us (69us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531977.756657:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250556
00010000:00010000:1.0:1651531977.756663:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca5148 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [909312->913407] (req 909312->913407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.756670:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000060a6272d already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531977.756671:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca5148 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [909312->913407] (req 909312->913407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.756674:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca5148 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [909312->913407] (req 909312->913407) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.756678:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca5148 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [909312->913407] (req 909312->913407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.756681:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca5148 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [909312->913407] (req 909312->913407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531977.797045:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531977.797053:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467743680
00000100:00100000:1.0:1651531977.797067:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250557
00000100:00100000:1.0:1651531977.797069:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002d3e5ae4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438149:x1731754467743680:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531977.797076:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca514f lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.797080:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531977.797080:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531977.797081:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca514f lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [487424->491519] (req 487424->491519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.797085:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca514f lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [487424->491519] (req 487424->491519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.797099:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca514f lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [487424->491519] (req 487424->491519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.797103:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca514f lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [487424->491519] (req 487424->491519) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531977.797116:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002d3e5ae4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438149:x1731754467743680:12345-10.240.43.64@tcp:3:fio.0 Request processed in 47us (71us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531977.797119:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250557
00010000:00010000:1.0:1651531977.797124:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca514f lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [487424->491519] (req 487424->491519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.797127:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000060a6272d already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531977.797128:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca514f lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [487424->491519] (req 487424->491519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.797131:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca514f lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [487424->491519] (req 487424->491519) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.797135:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca514f lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [487424->491519] (req 487424->491519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.797138:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca514f lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [487424->491519] (req 487424->491519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531977.797425:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531977.797433:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467744064
00000100:00100000:1.0:1651531977.797447:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250558
00000100:00100000:1.0:1651531977.797449:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006a8dcc9d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438146:x1731754467744064:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531977.797456:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5156 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.797460:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531977.797460:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531977.797461:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5156 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [942080->946175] (req 942080->946175) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.797465:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5156 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [942080->946175] (req 942080->946175) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.797475:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5156 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [942080->946175] (req 942080->946175) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.797479:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5156 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [942080->946175] (req 942080->946175) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531977.797492:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006a8dcc9d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438146:x1731754467744064:12345-10.240.43.64@tcp:3:fio.0 Request processed in 43us (68us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531977.797495:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250558
00010000:00010000:1.0:1651531977.797501:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5156 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [942080->946175] (req 942080->946175) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.797504:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000000bb25cc already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531977.797505:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5156 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [942080->946175] (req 942080->946175) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.797513:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5156 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [942080->946175] (req 942080->946175) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.797517:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5156 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [942080->946175] (req 942080->946175) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.797519:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5156 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [942080->946175] (req 942080->946175) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531977.797699:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531977.797707:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467744320
00000100:00100000:1.0:1651531977.797719:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250559
00000100:00100000:1.0:1651531977.797721:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b6b1b79d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438146:x1731754467744320:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531977.797728:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca515d lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.797731:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531977.797732:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531977.797733:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca515d lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [200704->204799] (req 200704->204799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.797736:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca515d lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [200704->204799] (req 200704->204799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.797747:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca515d lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [200704->204799] (req 200704->204799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.797750:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca515d lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [200704->204799] (req 200704->204799) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531977.797764:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b6b1b79d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438146:x1731754467744320:12345-10.240.43.64@tcp:3:fio.0 Request processed in 43us (66us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531977.797767:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250559
00010000:00010000:1.0:1651531977.797772:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca515d lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [200704->204799] (req 200704->204799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.797776:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f2af03c8 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531977.797777:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca515d lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [200704->204799] (req 200704->204799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.797779:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca515d lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [200704->204799] (req 200704->204799) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.797784:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca515d lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [200704->204799] (req 200704->204799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.797786:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca515d lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [200704->204799] (req 200704->204799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531977.798044:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531977.798052:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467744576
00000100:00100000:1.0:1651531977.798067:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250560
00000100:00100000:1.0:1651531977.798068:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009e786cd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438146:x1731754467744576:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531977.798075:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5164 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.798079:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531977.798081:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531977.798082:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5164 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [835584->839679] (req 835584->839679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.798085:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5164 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [835584->839679] (req 835584->839679) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.798096:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5164 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [835584->839679] (req 835584->839679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.798099:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5164 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [835584->839679] (req 835584->839679) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531977.798112:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009e786cd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438146:x1731754467744576:12345-10.240.43.64@tcp:3:fio.0 Request processed in 43us (68us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531977.798115:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250560
00010000:00010000:1.0:1651531977.798121:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5164 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [835584->839679] (req 835584->839679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.798124:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c806f265 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531977.798125:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5164 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [835584->839679] (req 835584->839679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.798128:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5164 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [835584->839679] (req 835584->839679) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.798132:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5164 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [835584->839679] (req 835584->839679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.798134:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5164 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [835584->839679] (req 835584->839679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531977.798362:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531977.798370:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467744832
00000100:00100000:1.0:1651531977.798382:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250561
00000100:00100000:1.0:1651531977.798384:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a9fc5082 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438146:x1731754467744832:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531977.798391:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca516b lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.798395:0:216321:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca5133 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446c52 expref: 7 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531977.798399:0:216321:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca513a lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446c59 expref: 7 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531977.798401:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531977.798402:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531977.798403:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca516b lrc: 5/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [364544->368639] (req 364544->368639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.798410:0:216321:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca513a lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446c59 expref: 7 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531977.798414:0:216321:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca513a lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446c59 expref: 7 pid: 166113 timeout: 22786 lvb_type: 1
00000100:00100000:1.0:1651531977.798418:0:216321:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b9b10d48 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997360320:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651531977.798432:0:216321:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca5133 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446c52 expref: 7 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531977.798436:0:216321:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca5133 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446c52 expref: 7 pid: 166111 timeout: 22786 lvb_type: 1
00000100:00100000:1.0:1651531977.798440:0:216321:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c62d1815 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997360384:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531977.798445:0:216321:0:(client.c:2492:ptlrpc_set_wait()) set 00000000b0ded350 going to sleep for 6 seconds
00000100:00100000:1.0:1651531977.798621:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531977.798648:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467744960
00000100:00100000:0.0:1651531977.798663:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250562
00000100:00100000:0.0:1651531977.798665:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a23bcd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467744960:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531977.798673:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca5172 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531977.798675:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651531977.798677:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531977.798678:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531977.798679:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca5172 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [299008->303103] (req 299008->303103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531977.798683:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467745088
00010000:00010000:0.0:1651531977.798683:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca5172 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [299008->303103] (req 299008->303103) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531977.798692:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250563
00000100:00100000:1.0:1651531977.798694:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003b40261e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438146:x1731754467745088:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531977.798699:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca5172 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [299008->303103] (req 299008->303103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.798700:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca5179 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531977.798703:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca5172 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [299008->303103] (req 299008->303103) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.798710:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531977.798715:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531977.798716:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca5179 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [94208->98303] (req 94208->98303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.798720:0:166118:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca5179 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [94208->98303] (req 94208->98303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531977.798724:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a23bcd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438147:x1731754467744960:12345-10.240.43.64@tcp:3:fio.0 Request processed in 58us (103us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531977.798727:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250562
00010000:00010000:1.0:1651531977.798731:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca5172 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [299008->303103] (req 299008->303103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.798734:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fab23815 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531977.798735:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca5172 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [299008->303103] (req 299008->303103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.798740:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca5172 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [299008->303103] (req 299008->303103) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.798745:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca5172 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [299008->303103] (req 299008->303103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.798748:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca5172 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [299008->303103] (req 299008->303103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531977.798858:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531977.798869:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531977.798880:0:216321:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b9b10d48 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997360320:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531977.798880:0:166103:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467745216
00000100:00100000:1.0:1651531977.798883:0:216321:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c62d1815 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997360384:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651531977.798886:0:166103:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca5133 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446c52 expref: 9 pid: 166111 timeout: 22786 lvb_type: 1
00010000:00010000:1.0:1651531977.798888:0:216321:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca516b lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [364544->368639] (req 364544->368639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531977.798893:0:166103:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467745152
00010000:00010000:0.0:1651531977.798896:0:166103:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca513a lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446c59 expref: 10 pid: 166113 timeout: 22786 lvb_type: 1
00000100:00100000:0.0:1651531977.798904:0:166103:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 279
00000100:00100000:0.0:1651531977.798906:0:166103:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bedaf1f1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438147:x1731754467745216:12345-10.240.43.64@tcp:103:ldlm_bl_02.0
00000100:00100000:1.0:1651531977.798909:0:169267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 280
00010000:00010000:0.0:1651531977.798909:0:166103:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00000100:00100000:1.0:1651531977.798911:0:169267:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000b1a9136 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438147:x1731754467745152:12345-10.240.43.64@tcp:103:ldlm_bl_02.0
00010000:00010000:0.0:1651531977.798913:0:166103:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca5133 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446c52 expref: 10 pid: 166111 timeout: 22786 lvb_type: 1
00010000:00010000:1.0:1651531977.798914:0:169267:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531977.798917:0:166103:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca5133 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446c52 expref: 10 pid: 166111 timeout: 22786 lvb_type: 1
00010000:00010000:1.0:1651531977.798921:0:169267:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca513a lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446c59 expref: 10 pid: 166113 timeout: 22786 lvb_type: 1
00010000:00010000:0.0:1651531977.798922:0:166103:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca5133 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446c52 expref: 10 pid: 166111 timeout: 22786 lvb_type: 1
00010000:00010000:1.0:1651531977.798925:0:169267:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca513a lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446c59 expref: 10 pid: 166113 timeout: 22786 lvb_type: 1
00010000:00010000:0.0:1651531977.798934:0:166103:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1651531977.798937:0:169267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca513a lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446c59 expref: 9 pid: 166113 timeout: 22786 lvb_type: 1
00010000:00010000:1.0:1651531977.798940:0:169267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531977.798941:0:169267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531977.798942:0:169267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca516b lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [364544->368639] (req 364544->368639) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531977.798946:0:166103:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bedaf1f1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467745216:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 39us (88us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531977.798949:0:166103:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 279
00010000:00010000:1.0:1651531977.798952:0:169267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca516b lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [364544->368639] (req 364544->368639) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.798955:0:169267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531977.798956:0:169267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531977.798957:0:169267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca5179 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [94208->98303] (req 94208->98303) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.798959:0:169267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca5179 lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [94208->98303] (req 94208->98303) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.798966:0:169267:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1651531977.798973:0:169267:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000b1a9136 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438147:x1731754467745152:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 62us (104us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531977.798976:0:169267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 280
00010000:00010000:1.0:1651531977.798989:0:166118:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca5179 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [94208->98303] (req 94208->98303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.798993:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca5179 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [94208->98303] (req 94208->98303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531977.799066:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531977.799076:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467745344
00000100:00100000:0.0:1651531977.799086:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44850
00000100:00100000:0.0:1651531977.799088:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f7096c29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438146:x1731754467745344:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531977.799091:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531977.799095:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca5180 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446c67 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531977.799102:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca5180 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446c67 expref: 10 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531977.799106:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca5180 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446c67 expref: 10 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531977.799109:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e2ec18e1, rc 0)
00000100:00100000:0.0:1651531977.799123:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f7096c29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438146:x1731754467745344:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (58us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531977.799125:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44850
00010000:00010000:1.0:1651531977.799150:0:216321:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca516b lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [364544->368639] (req 364544->368639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.799154:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca516b lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [364544->368639] (req 364544->368639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531977.838959:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869489 is committed
00010000:00010000:1.0:1651531977.838990:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca5179 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [94208->98303] (req 94208->98303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.838995:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca5179 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [94208->98303] (req 94208->98303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531977.839011:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003b40261e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438146:x1731754467745088:12345-10.240.43.64@tcp:4:fio.0 Request processed in 40316us (40336us total) trans 21474869488 rc 0/0
00000100:00100000:1.0:1651531977.839014:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250563
00010000:00010000:1.0:1651531977.839022:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca5179 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [94208->98303] (req 94208->98303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.839025:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000eebd17a1 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531977.839026:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca5179 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [94208->98303] (req 94208->98303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.839029:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca5179 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [94208->98303] (req 94208->98303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.839034:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca5179 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [94208->98303] (req 94208->98303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.839038:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca5179 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [94208->98303] (req 94208->98303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.839079:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca516b lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [364544->368639] (req 364544->368639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.839083:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca516b lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [364544->368639] (req 364544->368639) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531977.839096:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a9fc5082 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438146:x1731754467744832:12345-10.240.43.64@tcp:4:fio.0 Request processed in 40712us (40735us total) trans 21474869489 rc 0/0
00000100:00100000:1.0:1651531977.839099:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250561
00010000:00010000:1.0:1651531977.839105:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca516b lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [364544->368639] (req 364544->368639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.839108:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f6ecb7e5 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531977.839109:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca516b lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [364544->368639] (req 364544->368639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.839112:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca516b lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [364544->368639] (req 364544->368639) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.839116:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca516b lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [364544->368639] (req 364544->368639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.839119:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca516b lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [364544->368639] (req 364544->368639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531977.839629:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531977.839651:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467745984
00000100:00100000:0.0:1651531977.839664:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44851
00000100:00100000:0.0:1651531977.839666:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bf4022bf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438148:x1731754467745984:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531977.839671:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531977.839675:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca5187 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446c75 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00002000:00010000:0.0:1651531977.839680:0:166113:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34545:0x0] initial LVB size: 6291456, mtime: 0x627060c9, atime: 0x627060b4, ctime: 0x627060c9, blocks: 0x3000
00010000:00010000:0.0:1651531977.839684:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531977.839685:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531977.839687:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca5187 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446c75 expref: 6 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531977.839691:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca5187 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446c75 expref: 6 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531977.839695:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e2ec18e1, rc 0)
00000100:00100000:0.0:1651531977.839711:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bf4022bf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438148:x1731754467745984:12345-10.240.43.64@tcp:101:fio.0 Request processed in 44us (83us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531977.839714:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44851
00000100:00100000:1.0:1651531977.840541:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531977.840548:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467746368
00000100:00100000:1.0:1651531977.840558:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250564
00000100:00100000:1.0:1651531977.840560:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001e61ed2d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467746368:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531977.840570:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca518e lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.840574:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531977.840574:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531977.840575:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca518e lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [626688->630783] (req 626688->630783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.840579:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca518e lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [626688->630783] (req 626688->630783) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.840591:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca518e lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [626688->630783] (req 626688->630783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.840594:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca518e lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [626688->630783] (req 626688->630783) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531977.840608:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001e61ed2d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467746368:12345-10.240.43.64@tcp:3:fio.0 Request processed in 47us (68us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531977.840610:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250564
00010000:00010000:1.0:1651531977.840616:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca518e lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [626688->630783] (req 626688->630783) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.840623:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c806f265 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531977.840624:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca518e lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [626688->630783] (req 626688->630783) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.840627:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca518e lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [626688->630783] (req 626688->630783) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.840631:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca518e lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [626688->630783] (req 626688->630783) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.840633:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca518e lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [626688->630783] (req 626688->630783) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531977.881161:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531977.881169:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467746688
00000100:00100000:1.0:1651531977.881180:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250565
00000100:00100000:1.0:1651531977.881182:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000052cf3c08 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438148:x1731754467746688:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531977.881189:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5195 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.881194:0:166118:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca5187 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446c75 expref: 6 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531977.881197:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531977.881198:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531977.881199:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5195 lrc: 4/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [839680->843775] (req 839680->843775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.881244:0:166118:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca5187 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446c75 expref: 6 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531977.881249:0:166118:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca5187 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446c75 expref: 6 pid: 166113 timeout: 22786 lvb_type: 1
00000100:00100000:1.0:1651531977.881254:0:166118:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000f4bed26 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:166118:1731745997360448:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531977.881274:0:166118:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fc7d2635 going to sleep for 6 seconds
00000100:00100000:1.0:1651531977.881753:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531977.881775:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467747072
00000100:00100000:0.0:1651531977.881787:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250566
00000100:00100000:0.0:1651531977.881789:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c62d1815 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438146:x1731754467747072:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531977.881796:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca519c lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531977.881801:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531977.881801:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531977.881802:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca519c lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [303104->307199] (req 303104->307199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531977.881809:0:216321:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca519c lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [303104->307199] (req 303104->307199) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531977.881889:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531977.881905:0:169267:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467747328
00010000:00010000:1.0:1651531977.881911:0:169267:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca5187 lrc: 5/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446c75 expref: 8 pid: 166113 timeout: 22786 lvb_type: 1
00000100:00100000:1.0:1651531977.881924:0:169267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 281
00000100:00100000:1.0:1651531977.881926:0:169267:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000babfdba pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467747328:12345-10.240.43.64@tcp:103:ldlm_bl_05.0
00010000:00010000:1.0:1651531977.881929:0:169267:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1651531977.881934:0:169267:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca5187 lrc: 5/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446c75 expref: 8 pid: 166113 timeout: 22786 lvb_type: 1
00010000:00010000:1.0:1651531977.881938:0:169267:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca5187 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446c75 expref: 8 pid: 166113 timeout: 22786 lvb_type: 1
00010000:00010000:1.0:1651531977.881944:0:169267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531977.881944:0:169267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531977.881946:0:166118:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca5187 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446c75 expref: 8 pid: 166113 timeout: 22786 lvb_type: 1
00000100:00100000:0.0:1651531977.881951:0:166118:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000f4bed26 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:166118:1731745997360448:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651531977.881954:0:169267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5195 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [839680->843775] (req 839680->843775) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.881957:0:169267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5195 lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [839680->843775] (req 839680->843775) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.881961:0:169267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531977.881961:0:169267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531977.881962:0:169267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca519c lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [303104->307199] (req 303104->307199) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.881964:0:169267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca519c lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [303104->307199] (req 303104->307199) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531977.881968:0:166118:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5195 lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [839680->843775] (req 839680->843775) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531977.881977:0:166118:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5195 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [839680->843775] (req 839680->843775) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.881978:0:169267:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1651531977.881981:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5195 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [839680->843775] (req 839680->843775) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531977.881988:0:169267:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000babfdba pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438146:x1731754467747328:12345-10.240.43.64@tcp:103:ldlm_bl_05.0 Request processed in 61us (100us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531977.881991:0:169267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 281
00010000:00010000:0.0:1651531977.882043:0:216321:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca519c lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [303104->307199] (req 303104->307199) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531977.882047:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca519c lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [303104->307199] (req 303104->307199) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531977.918313:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531977.918338:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467747648
00000100:00100000:0.0:1651531977.918352:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44852
00000100:00100000:0.0:1651531977.918354:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b9b10d48 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438147:x1731754467747648:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531977.918358:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531977.918365:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca51a3 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446c83 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531977.918374:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca51a3 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446c83 expref: 12 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531977.918378:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca51a3 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446c83 expref: 12 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531977.918381:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e2ec18e1, rc 0)
00000100:00100000:0.0:1651531977.918396:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b9b10d48 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438147:x1731754467747648:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (84us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531977.918409:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44852
00000100:00100000:1.0:1651531977.919331:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531977.919350:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467748096
00000100:00100000:0.0:1651531977.919365:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250567
00000100:00100000:0.0:1651531977.919367:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000530f55ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438146:x1731754467748096:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531977.919374:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca51aa lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531977.919378:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531977.919379:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531977.919380:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca51aa lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [716800->720895] (req 716800->720895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531977.919384:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca51aa lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [716800->720895] (req 716800->720895) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531977.943086:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869491 is committed
00010000:00010000:0.0:1651531977.943132:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5195 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [839680->843775] (req 839680->843775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531977.943137:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5195 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [839680->843775] (req 839680->843775) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531977.943157:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000052cf3c08 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754467746688:12345-10.240.43.64@tcp:4:fio.0 Request processed in 61974us (61997us total) trans 21474869490 rc 0/0
00000100:00100000:0.0:1651531977.943160:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250565
00010000:00010000:1.0:1651531977.943162:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5195 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [839680->843775] (req 839680->843775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.943167:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c806f265 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531977.943168:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5195 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [839680->843775] (req 839680->843775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.943171:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5195 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [839680->843775] (req 839680->843775) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531977.943172:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca519c lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [303104->307199] (req 303104->307199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531977.943176:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca519c lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [303104->307199] (req 303104->307199) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531977.943189:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c62d1815 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467747072:12345-10.240.43.64@tcp:4:fio.0 Request processed in 61399us (61437us total) trans 21474869491 rc 0/0
00010000:00010000:1.0:1651531977.943201:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5195 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [839680->843775] (req 839680->843775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.943204:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5195 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [839680->843775] (req 839680->843775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531977.943205:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250566
00010000:00010000:1.0:1651531977.943207:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca519c lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [303104->307199] (req 303104->307199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.943210:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c1022d42 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531977.943211:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca519c lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [303104->307199] (req 303104->307199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.943214:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca519c lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [303104->307199] (req 303104->307199) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.943243:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca519c lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [303104->307199] (req 303104->307199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.943246:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca519c lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [303104->307199] (req 303104->307199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531977.943584:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531977.943607:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467748288
00000100:00100000:0.0:1651531977.943620:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44853
00000100:00100000:0.0:1651531977.943621:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000880cd1d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467748288:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531977.943625:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531977.943629:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca51b1 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446c91 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531977.943637:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca51b1 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446c91 expref: 9 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531977.943645:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca51b1 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446c91 expref: 9 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531977.943649:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e2ec18e1, rc 0)
00000100:00100000:0.0:1651531977.943664:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000880cd1d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467748288:12345-10.240.43.64@tcp:101:fio.0 Request processed in 42us (81us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531977.943667:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44853
00000100:00100000:1.0:1651531977.956243:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531977.956265:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467748736
00000100:00100000:0.0:1651531977.956277:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44854
00000100:00100000:0.0:1651531977.956279:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000da31c48f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467748736:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531977.956282:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531977.956286:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca51b8 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446c9f expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531977.956294:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca51b8 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446c9f expref: 9 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531977.956298:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca51b8 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446c9f expref: 9 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531977.956301:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e2ec18e1, rc 0)
00000100:00100000:0.0:1651531977.956316:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000da31c48f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467748736:12345-10.240.43.64@tcp:101:fio.0 Request processed in 36us (74us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531977.956318:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44854
00000100:00100000:1.0:1651531977.957066:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531977.957083:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467748992
00000100:00100000:0.0:1651531977.957095:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44855
00000100:00100000:0.0:1651531977.957097:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bedaf1f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467748992:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531977.957100:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531977.957104:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca51bf lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446cad expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531977.957110:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca51bf lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446cad expref: 9 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531977.957114:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca51bf lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446cad expref: 9 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531977.957118:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000775318ab, rc 0)
00000100:00100000:0.0:1651531977.957131:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bedaf1f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467748992:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (66us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531977.957134:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44855
00000100:00100000:1.0:1651531977.957875:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531977.957893:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467749248
00000100:00100000:0.0:1651531977.957903:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250568
00000100:00100000:0.0:1651531977.957904:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001797bd5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467749248:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531977.957911:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca51c6 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531977.957915:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531977.957916:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531977.957917:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca51c6 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [8192->12287] (req 8192->12287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531977.957925:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca51c6 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [8192->12287] (req 8192->12287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531977.980439:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869492 is committed
00010000:00010000:0.0:1651531977.980481:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca51aa lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [716800->720895] (req 716800->720895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531977.980486:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca51aa lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [716800->720895] (req 716800->720895) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531977.980505:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000530f55ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467748096:12345-10.240.43.64@tcp:4:fio.0 Request processed in 61137us (61174us total) trans 21474869492 rc 0/0
00000100:00100000:0.0:1651531977.980508:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250567
00010000:00010000:1.0:1651531977.980511:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca51aa lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [716800->720895] (req 716800->720895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.980535:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fab23815 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531977.980536:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca51aa lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [716800->720895] (req 716800->720895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.980540:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca51aa lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [716800->720895] (req 716800->720895) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.980552:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca51aa lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [716800->720895] (req 716800->720895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531977.980555:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca51aa lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [716800->720895] (req 716800->720895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531978.017684:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531978.017707:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467749504
00000100:00100000:1.0:1651531978.017710:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531978.017729:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467749632
00000100:00100000:0.0:1651531978.017736:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44856
00000100:00100000:0.0:1651531978.017738:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f817afea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438147:x1731754467749504:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531978.017742:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651531978.017743:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44857
00000100:00100000:1.0:1651531978.017745:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000054ed0749 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754467749632:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531978.017746:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca51cd lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446cc2 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.017750:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531978.017754:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca51d4 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446cc9 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.017754:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca51cd lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446cc2 expref: 10 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531978.017758:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca51cd lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446cc2 expref: 11 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531978.017763:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca51d4 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446cc9 expref: 11 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531978.017766:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000775318ab, rc 0)
00010000:00010000:1.0:1651531978.017767:0:166112:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca51d4 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446cc9 expref: 10 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531978.017776:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c806f265, rc 0)
00000100:00100000:0.0:1651531978.017777:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f817afea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438147:x1731754467749504:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (93us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531978.017780:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44856
00000100:00100000:1.0:1651531978.017785:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000054ed0749 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467749632:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (75us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531978.017788:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44857
00000100:00100000:1.0:1651531978.018150:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531978.018168:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467749760
00000100:00100000:0.0:1651531978.018201:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250569
00000100:00100000:0.0:1651531978.018203:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467749760:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531978.018212:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca51db lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.018244:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531978.018245:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531978.018246:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca51db lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.018250:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca51db lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.018265:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca51db lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.018268:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca51db lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.018279:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca51db lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.018284:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e2ec18e1 already unused, calling callback (0000000049fddea7)
00000100:00100000:0.0:1651531978.018287:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467749760:12345-10.240.43.64@tcp:3:fio.0 Request processed in 84us (137us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531978.018293:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250569
00010000:00010000:1.0:1651531978.018294:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca51db lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.018298:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca51db lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.018304:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca51db lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.018306:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca51db lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531978.018310:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531978.018317:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467749888
00000100:00100000:0.0:1651531978.018328:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250570
00000100:00100000:0.0:1651531978.018330:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a899ddab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467749888:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531978.018337:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca51e2 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.018341:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531978.018341:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531978.018342:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca51e2 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [634880->638975] (req 634880->638975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.018346:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca51e2 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [634880->638975] (req 634880->638975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.018356:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca51e2 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [634880->638975] (req 634880->638975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.018359:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca51e2 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [634880->638975] (req 634880->638975) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.018370:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca51e2 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [634880->638975] (req 634880->638975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.018374:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f765708a already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531978.018375:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca51e2 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [634880->638975] (req 634880->638975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531978.018375:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a899ddab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467749888:12345-10.240.43.64@tcp:3:fio.0 Request processed in 45us (65us total) trans 0 rc 4096/4096
00010000:00010000:1.0:1651531978.018379:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca51e2 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [634880->638975] (req 634880->638975) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.018384:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca51e2 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [634880->638975] (req 634880->638975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.018387:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca51e2 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [634880->638975] (req 634880->638975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531978.018396:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250570
00000100:00100000:1.0:1651531978.018659:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531978.018667:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467750016
00000100:00100000:1.0:1651531978.018675:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44858
00000100:00100000:1.0:1651531978.018677:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000863110f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467750016:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531978.018681:0:206699:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531978.018684:0:206699:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca51e9 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446cd7 expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.018692:0:206699:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca51e9 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446cd7 expref: 9 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531978.018696:0:206699:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca51e9 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446cd7 expref: 9 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531978.018700:0:206699:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f6ecb7e5, rc 0)
00000100:00100000:1.0:1651531978.018716:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000863110f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467750016:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (57us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531978.018721:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44858
00000100:00100000:1.0:1651531978.019126:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531978.019144:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467750272
00000100:00100000:0.0:1651531978.019159:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250571
00000100:00100000:0.0:1651531978.019160:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ec616e94 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467750272:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531978.019169:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca51f0 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.019173:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531978.019173:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531978.019174:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca51f0 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [376832->380927] (req 376832->380927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.019178:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca51f0 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [376832->380927] (req 376832->380927) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.019189:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca51f0 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [376832->380927] (req 376832->380927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.019192:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca51f0 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [376832->380927] (req 376832->380927) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.019209:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca51f0 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [376832->380927] (req 376832->380927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531978.019211:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ec616e94 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467750272:12345-10.240.43.64@tcp:3:fio.0 Request processed in 50us (85us total) trans 0 rc 4096/4096
00010000:00010000:1.0:1651531978.019213:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fb2f6575 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531978.019214:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca51f0 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [376832->380927] (req 376832->380927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531978.019214:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250571
00010000:00010000:1.0:1651531978.019236:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca51f0 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [376832->380927] (req 376832->380927) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.019242:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca51f0 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [376832->380927] (req 376832->380927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.019244:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca51f0 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [376832->380927] (req 376832->380927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531978.019536:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531978.019543:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467750400
00000100:00100000:1.0:1651531978.019551:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44859
00000100:00100000:1.0:1651531978.019552:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ca77a195 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467750400:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531978.019556:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531978.019559:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca51f7 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446ce5 expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.019566:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca51f7 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446ce5 expref: 9 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531978.019571:0:166111:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca51f7 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446ce5 expref: 9 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531978.019575:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000eebd17a1, rc 0)
00000100:00100000:1.0:1651531978.019590:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ca77a195 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467750400:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (54us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531978.019593:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44859
00000100:00100000:1.0:1651531978.020358:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531978.020376:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467750656
00000100:00100000:0.0:1651531978.020391:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250572
00000100:00100000:0.0:1651531978.020392:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004c512052 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467750656:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531978.020400:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca51fe lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.020404:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531978.020404:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531978.020407:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca51fe lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [380928->385023] (req 380928->385023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.020411:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca51fe lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [380928->385023] (req 380928->385023) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531978.030580:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869493 is committed
00002000:00010000:0.0:1651531978.030591:0:216321:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x34545:0x0] updating lvb mtime from disk: 1651531977 -> 1651531978
00002000:00010000:0.0:1651531978.030592:0:216321:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x34545:0x0] updating lvb ctime from disk: 1651531977 -> 1651531978
00010000:00010000:0.0:1651531978.030595:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca51c6 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [8192->12287] (req 8192->12287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.030598:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca51c6 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [8192->12287] (req 8192->12287) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531978.030619:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001797bd5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467749248:12345-10.240.43.64@tcp:4:fio.0 Request processed in 72714us (72744us total) trans 21474869493 rc 0/0
00010000:00010000:1.0:1651531978.030621:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca51c6 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [8192->12287] (req 8192->12287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531978.030622:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250568
00010000:00010000:1.0:1651531978.030625:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000820577fb already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531978.030626:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca51c6 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [8192->12287] (req 8192->12287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.030630:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca51c6 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [8192->12287] (req 8192->12287) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.030635:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca51c6 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [8192->12287] (req 8192->12287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.030637:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca51c6 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [8192->12287] (req 8192->12287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531978.030947:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531978.030954:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467750784
00000100:00100000:1.0:1651531978.030963:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44860
00000100:00100000:1.0:1651531978.030965:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000aeca6f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467750784:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531978.030968:0:206699:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531978.030980:0:206699:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca5205 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446cf3 expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.030988:0:206699:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca5205 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446cf3 expref: 9 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531978.030992:0:206699:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca5205 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446cf3 expref: 9 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531978.030996:0:206699:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000eebd17a1, rc 0)
00000100:00100000:1.0:1651531978.031010:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000aeca6f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467750784:12345-10.240.43.64@tcp:101:fio.0 Request processed in 45us (64us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531978.031013:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44860
00000100:00100000:1.0:1651531978.031911:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531978.031932:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467751040
00000100:00100000:0.0:1651531978.031947:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250573
00000100:00100000:0.0:1651531978.031949:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f69c7290 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467751040:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531978.031956:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca520c lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.031960:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531978.031960:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531978.031961:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca520c lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [421888->425983] (req 421888->425983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.031969:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca520c lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [421888->425983] (req 421888->425983) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531978.094153:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531978.094180:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467751296
00000100:00100000:1.0:1651531978.094191:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44861
00000100:00100000:1.0:1651531978.094193:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000b1a9136 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754467751296:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531978.094197:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531978.094201:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca5213 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446d01 expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.094209:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca5213 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446d01 expref: 12 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531978.094244:0:166111:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca5213 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446d01 expref: 12 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531978.094248:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000eebd17a1, rc 0)
00000100:00100000:1.0:1651531978.094261:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000b1a9136 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754467751296:12345-10.240.43.64@tcp:101:fio.0 Request processed in 67us (109us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531978.094264:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44861
00000100:00100000:0.0:1651531978.095002:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531978.095021:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467751552
00000100:00100000:1.0:1651531978.095034:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44862
00000100:00100000:1.0:1651531978.095036:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000f4bed26 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754467751552:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531978.095039:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531978.095042:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca521a lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446d0f expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.095050:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca521a lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446d0f expref: 12 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531978.095054:0:166111:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca521a lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446d0f expref: 12 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531978.095057:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f6ecb7e5, rc 0)
00000100:00100000:1.0:1651531978.095067:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000f4bed26 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754467751552:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (66us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531978.095070:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44862
00000001:00080000:0.0:1651531978.106545:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869495 is committed
00010000:00010000:0.0:1651531978.106559:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca51fe lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [380928->385023] (req 380928->385023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.106563:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca51fe lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [380928->385023] (req 380928->385023) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531978.106584:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004c512052 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438147:x1731754467750656:12345-10.240.43.64@tcp:4:fio.0 Request processed in 86190us (86225us total) trans 21474869494 rc 0/0
00010000:00010000:1.0:1651531978.106587:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca51fe lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [380928->385023] (req 380928->385023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531978.106587:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250572
00010000:00010000:1.0:1651531978.106591:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000080362f27 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531978.106592:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca51fe lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [380928->385023] (req 380928->385023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.106596:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca51fe lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [380928->385023] (req 380928->385023) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.106601:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca51fe lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [380928->385023] (req 380928->385023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.106604:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca51fe lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [380928->385023] (req 380928->385023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.106631:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca520c lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [421888->425983] (req 421888->425983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.106634:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca520c lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [421888->425983] (req 421888->425983) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531978.106650:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f69c7290 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438146:x1731754467751040:12345-10.240.43.64@tcp:4:fio.0 Request processed in 74700us (74739us total) trans 21474869495 rc 0/0
00000100:00100000:1.0:1651531978.106653:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250573
00010000:00010000:1.0:1651531978.106660:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca520c lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [421888->425983] (req 421888->425983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.106663:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000775318ab already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531978.106665:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca520c lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [421888->425983] (req 421888->425983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.106668:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca520c lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [421888->425983] (req 421888->425983) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.106673:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca520c lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [421888->425983] (req 421888->425983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.106675:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca520c lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [421888->425983] (req 421888->425983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531978.107026:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531978.107043:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467751936
00000100:00100000:1.0:1651531978.107059:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250574
00000100:00100000:1.0:1651531978.107061:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bcdb3319 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438146:x1731754467751936:12345-10.240.43.64@tcp:4:fio.0
00002000:00010000:1.0:1651531978.107070:0:216321:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34545:0x0] initial LVB size: 6291456, mtime: 0x627060ca, atime: 0x627060b4, ctime: 0x627060ca, blocks: 0x3000
00010000:00010000:1.0:1651531978.107072:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5221 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.107076:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531978.107077:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531978.107078:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5221 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [843776->847871] (req 843776->847871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.107082:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5221 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [843776->847871] (req 843776->847871) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531978.146145:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869496 is committed
00010000:00010000:1.0:1651531978.146178:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5221 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [843776->847871] (req 843776->847871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.146187:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5221 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [843776->847871] (req 843776->847871) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531978.146204:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bcdb3319 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438146:x1731754467751936:12345-10.240.43.64@tcp:4:fio.0 Request processed in 39142us (39178us total) trans 21474869496 rc 0/0
00000100:00100000:1.0:1651531978.146207:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250574
00010000:00010000:1.0:1651531978.146214:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5221 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [843776->847871] (req 843776->847871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.146242:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f6ecb7e5 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531978.146243:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5221 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [843776->847871] (req 843776->847871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.146246:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5221 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [843776->847871] (req 843776->847871) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.146251:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5221 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [843776->847871] (req 843776->847871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.146254:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5221 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [843776->847871] (req 843776->847871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531978.146585:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531978.146603:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467752320
00000100:00100000:1.0:1651531978.146617:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250575
00000100:00100000:1.0:1651531978.146619:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000065be21ea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438147:x1731754467752320:12345-10.240.43.64@tcp:4:fio.0
00002000:00010000:1.0:1651531978.146628:0:216321:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34545:0x0] initial LVB size: 6291456, mtime: 0x627060ca, atime: 0x627060b4, ctime: 0x627060ca, blocks: 0x3000
00010000:00010000:1.0:1651531978.146632:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca5228 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.146636:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531978.146636:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531978.146637:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca5228 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [385024->389119] (req 385024->389119) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.146641:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca5228 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [385024->389119] (req 385024->389119) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531978.159157:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531978.159167:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531978.159180:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467752512
00000100:00100000:1.0:1651531978.159188:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467752576
00000100:00100000:0.0:1651531978.159191:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44863
00000100:00100000:0.0:1651531978.159194:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a8d7612 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438147:x1731754467752512:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651531978.159199:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44864
00000100:00100000:1.0:1651531978.159201:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005c3dfe19 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754467752576:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531978.159203:0:206699:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531978.159204:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531978.159208:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5236 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446d2b expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.159208:0:206699:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca522f lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446d24 expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.159240:0:206699:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca522f lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446d24 expref: 11 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531978.159241:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5236 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446d2b expref: 11 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531978.159246:0:166111:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5236 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446d2b expref: 11 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531978.159249:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f6ecb7e5, rc 0)
00010000:00010000:0.0:1651531978.159249:0:206699:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca522f lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446d24 expref: 10 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531978.159253:0:206699:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000014685f38, rc 0)
00000100:00100000:1.0:1651531978.159264:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005c3dfe19 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754467752576:12345-10.240.43.64@tcp:101:fio.0 Request processed in 63us (97us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531978.159267:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44864
00000100:00100000:0.0:1651531978.159270:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a8d7612 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438147:x1731754467752512:12345-10.240.43.64@tcp:101:fio.0 Request processed in 75us (113us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531978.159273:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44863
00000100:00100000:1.0:1651531978.159679:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531978.159697:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467752832
00000100:00100000:0.0:1651531978.159713:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250576
00000100:00100000:0.0:1651531978.159715:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c1c918a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467752832:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531978.159723:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca523d lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.159732:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531978.159733:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531978.159734:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca523d lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [638976->643071] (req 638976->643071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.159738:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca523d lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [638976->643071] (req 638976->643071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.159751:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca523d lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [638976->643071] (req 638976->643071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.159754:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca523d lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [638976->643071] (req 638976->643071) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.159776:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca523d lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [638976->643071] (req 638976->643071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531978.159778:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c1c918a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467752832:12345-10.240.43.64@tcp:3:fio.0 Request processed in 62us (100us total) trans 0 rc 4096/4096
00010000:00010000:1.0:1651531978.159780:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f968d777 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531978.159781:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca523d lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [638976->643071] (req 638976->643071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531978.159781:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250576
00010000:00010000:1.0:1651531978.159784:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca523d lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [638976->643071] (req 638976->643071) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.159789:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca523d lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [638976->643071] (req 638976->643071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.159792:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca523d lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [638976->643071] (req 638976->643071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531978.172239:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869497 is committed
00010000:00010000:1.0:1651531978.172270:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca5228 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [385024->389119] (req 385024->389119) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.172275:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca5228 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [385024->389119] (req 385024->389119) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531978.172291:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000065be21ea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438147:x1731754467752320:12345-10.240.43.64@tcp:4:fio.0 Request processed in 25671us (25706us total) trans 21474869497 rc 0/0
00000100:00100000:1.0:1651531978.172294:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250575
00010000:00010000:1.0:1651531978.172302:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca5228 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [385024->389119] (req 385024->389119) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.172305:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000eebd17a1 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531978.172306:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca5228 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [385024->389119] (req 385024->389119) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.172309:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca5228 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [385024->389119] (req 385024->389119) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.172314:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca5228 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [385024->389119] (req 385024->389119) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.172316:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca5228 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [385024->389119] (req 385024->389119) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531978.172610:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531978.172630:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467753152
00000100:00100000:1.0:1651531978.172644:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44865
00000100:00100000:1.0:1651531978.172645:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002bf85ab5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438146:x1731754467753152:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531978.172649:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531978.172653:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5244 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446d39 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651531978.172658:0:166113:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34545:0x0] initial LVB size: 6291456, mtime: 0x627060ca, atime: 0x627060b4, ctime: 0x627060ca, blocks: 0x3000
00010000:00010000:1.0:1651531978.172662:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531978.172663:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531978.172664:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5244 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446d39 expref: 6 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531978.172673:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5244 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446d39 expref: 6 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531978.172677:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f6ecb7e5, rc 0)
00000100:00100000:1.0:1651531978.172688:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002bf85ab5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438146:x1731754467753152:12345-10.240.43.64@tcp:101:fio.0 Request processed in 42us (78us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531978.172690:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44865
00000100:00100000:0.0:1651531978.173001:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531978.173019:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467753280
00000100:00100000:1.0:1651531978.173035:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250577
00000100:00100000:1.0:1651531978.173037:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cc11a3b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438147:x1731754467753280:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531978.173044:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca524b lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.173048:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531978.173048:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531978.173049:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca524b lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [491520->495615] (req 491520->495615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.173053:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca524b lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [491520->495615] (req 491520->495615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.173065:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca524b lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [491520->495615] (req 491520->495615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.173068:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca524b lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [491520->495615] (req 491520->495615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531978.173087:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cc11a3b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438147:x1731754467753280:12345-10.240.43.64@tcp:3:fio.0 Request processed in 49us (87us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531978.173090:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250577
00010000:00010000:1.0:1651531978.173096:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca524b lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [491520->495615] (req 491520->495615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.173099:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c806f265 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531978.173100:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca524b lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [491520->495615] (req 491520->495615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.173103:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca524b lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [491520->495615] (req 491520->495615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.173107:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca524b lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [491520->495615] (req 491520->495615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.173110:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca524b lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [491520->495615] (req 491520->495615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531978.173468:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531978.173485:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467753408
00000100:00100000:1.0:1651531978.173499:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250578
00000100:00100000:1.0:1651531978.173500:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000000615301 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438147:x1731754467753408:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531978.173507:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca5252 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.173511:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531978.173513:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531978.173514:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca5252 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [495616->499711] (req 495616->499711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.173518:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca5252 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [495616->499711] (req 495616->499711) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.173529:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca5252 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [495616->499711] (req 495616->499711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.173533:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca5252 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [495616->499711] (req 495616->499711) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531978.173547:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000000615301 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438147:x1731754467753408:12345-10.240.43.64@tcp:3:fio.0 Request processed in 46us (80us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531978.173550:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250578
00010000:00010000:1.0:1651531978.173555:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca5252 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [495616->499711] (req 495616->499711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.173559:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f2af03c8 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531978.173560:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca5252 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [495616->499711] (req 495616->499711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.173563:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca5252 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [495616->499711] (req 495616->499711) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.173567:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca5252 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [495616->499711] (req 495616->499711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.173569:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca5252 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [495616->499711] (req 495616->499711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531978.173860:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531978.173878:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467753536
00000100:00100000:1.0:1651531978.173891:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250579
00000100:00100000:1.0:1651531978.173892:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000053de45f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438146:x1731754467753536:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531978.173899:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5259 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.173903:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531978.173903:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531978.173904:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5259 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [847872->851967] (req 847872->851967) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.173908:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5259 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [847872->851967] (req 847872->851967) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.173919:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5259 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [847872->851967] (req 847872->851967) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.173922:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5259 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [847872->851967] (req 847872->851967) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531978.173936:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000053de45f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438146:x1731754467753536:12345-10.240.43.64@tcp:3:fio.0 Request processed in 43us (76us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531978.173938:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250579
00010000:00010000:1.0:1651531978.173944:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5259 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [847872->851967] (req 847872->851967) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.173947:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000000bb25cc already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531978.173950:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5259 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [847872->851967] (req 847872->851967) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.173953:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5259 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [847872->851967] (req 847872->851967) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.173957:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5259 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [847872->851967] (req 847872->851967) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.173959:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5259 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [847872->851967] (req 847872->851967) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531978.174246:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531978.174266:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467753664
00000100:00100000:1.0:1651531978.174279:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250580
00000100:00100000:1.0:1651531978.174281:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000009c4c564 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438147:x1731754467753664:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531978.174287:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca5260 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.174291:0:216321:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5244 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446d39 expref: 6 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531978.174295:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531978.174295:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531978.174296:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca5260 lrc: 4/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [503808->507903] (req 503808->507903) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.174303:0:216321:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5244 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446d39 expref: 6 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531978.174310:0:216321:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5244 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446d39 expref: 6 pid: 166113 timeout: 22786 lvb_type: 1
00000100:00100000:1.0:1651531978.174315:0:216321:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002dca0b15 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997360512:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531978.174328:0:216321:0:(client.c:2492:ptlrpc_set_wait()) set 0000000073aaa033 going to sleep for 6 seconds
00000100:00100000:1.0:1651531978.174512:0:216321:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002dca0b15 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997360512:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651531978.174517:0:216321:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca5260 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [503808->507903] (req 503808->507903) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531978.174592:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531978.174601:0:169267:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467753728
00010000:00010000:1.0:1651531978.174606:0:169267:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5244 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446d39 expref: 7 pid: 166113 timeout: 22786 lvb_type: 1
00000100:00100000:1.0:1651531978.174617:0:169267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 282
00000100:00100000:1.0:1651531978.174618:0:169267:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002dca0b15 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438149:x1731754467753728:12345-10.240.43.64@tcp:103:ldlm_bl_06.0
00010000:00010000:1.0:1651531978.174621:0:169267:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1651531978.174625:0:169267:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5244 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446d39 expref: 7 pid: 166113 timeout: 22786 lvb_type: 1
00010000:00010000:1.0:1651531978.174629:0:169267:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5244 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446d39 expref: 7 pid: 166113 timeout: 22786 lvb_type: 1
00010000:00010000:1.0:1651531978.174635:0:169267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5244 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446d39 expref: 7 pid: 166113 timeout: 22786 lvb_type: 1
00010000:00010000:1.0:1651531978.174640:0:169267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531978.174641:0:169267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531978.174642:0:169267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca5260 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [503808->507903] (req 503808->507903) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.174645:0:169267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca5260 lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [503808->507903] (req 503808->507903) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.174652:0:169267:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1651531978.174663:0:169267:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002dca0b15 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467753728:12345-10.240.43.64@tcp:103:ldlm_bl_06.0 Request processed in 43us (71us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531978.174665:0:169267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 282
00010000:00010000:1.0:1651531978.174672:0:216321:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca5260 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [503808->507903] (req 503808->507903) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.174676:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca5260 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [503808->507903] (req 503808->507903) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531978.197188:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531978.197197:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467753856
00000100:00100000:1.0:1651531978.197210:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44866
00000100:00100000:1.0:1651531978.197211:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c68ada5f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467753856:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531978.197215:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531978.197239:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5267 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446d47 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.197247:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5267 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446d47 expref: 9 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531978.197253:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5267 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446d47 expref: 9 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531978.197256:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f6ecb7e5, rc 0)
00000100:00100000:1.0:1651531978.197270:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c68ada5f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467753856:12345-10.240.43.64@tcp:101:fio.0 Request processed in 58us (83us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531978.197273:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44866
00000100:00100000:1.0:1651531978.198020:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531978.198027:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467754112
00000100:00100000:1.0:1651531978.198040:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44867
00000100:00100000:1.0:1651531978.198041:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c400d88f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467754112:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531978.198045:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531978.198048:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca526e lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446d55 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.198056:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca526e lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446d55 expref: 9 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531978.198060:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca526e lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446d55 expref: 9 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531978.198063:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000000bb25cc, rc 0)
00000100:00100000:1.0:1651531978.198076:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c400d88f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467754112:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (56us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531978.198078:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44867
00000001:00080000:0.0:1651531978.233619:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869498 is committed
00010000:00010000:1.0:1651531978.233651:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca5260 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [503808->507903] (req 503808->507903) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.233655:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca5260 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [503808->507903] (req 503808->507903) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531978.233672:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000009c4c564 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438147:x1731754467753664:12345-10.240.43.64@tcp:4:fio.0 Request processed in 59391us (59426us total) trans 21474869498 rc 0/0
00000100:00100000:1.0:1651531978.233675:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250580
00010000:00010000:1.0:1651531978.233682:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca5260 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [503808->507903] (req 503808->507903) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.233686:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000060a6272d already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531978.233687:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca5260 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [503808->507903] (req 503808->507903) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.233690:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca5260 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [503808->507903] (req 503808->507903) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.233694:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca5260 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [503808->507903] (req 503808->507903) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.233697:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca5260 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [503808->507903] (req 503808->507903) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531978.234717:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531978.234735:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467754496
00000100:00100000:1.0:1651531978.234748:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44868
00000100:00100000:1.0:1651531978.234750:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003d9ef3c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438146:x1731754467754496:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531978.234756:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531978.234760:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5275 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446d63 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651531978.234765:0:166113:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34545:0x0] initial LVB size: 6291456, mtime: 0x627060ca, atime: 0x627060b4, ctime: 0x627060ca, blocks: 0x3000
00010000:00010000:1.0:1651531978.234769:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531978.234770:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531978.234772:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5275 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446d63 expref: 6 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531978.234776:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5275 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446d63 expref: 6 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531978.234780:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000000bb25cc, rc 0)
00000100:00100000:1.0:1651531978.234791:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003d9ef3c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438146:x1731754467754496:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (75us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531978.234794:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44868
00000100:00100000:0.0:1651531978.235565:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531978.235581:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467755008
00000100:00100000:1.0:1651531978.235597:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250581
00000100:00100000:1.0:1651531978.235599:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a925fbf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438147:x1731754467755008:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531978.235607:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca527c lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.235611:0:216321:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5275 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446d63 expref: 6 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531978.235615:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531978.235616:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531978.235617:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca527c lrc: 4/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [471040->475135] (req 471040->475135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.235624:0:216321:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5275 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446d63 expref: 6 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531978.235628:0:216321:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5275 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446d63 expref: 6 pid: 166113 timeout: 22786 lvb_type: 1
00000100:00100000:1.0:1651531978.235633:0:216321:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c9d21511 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997360576:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531978.235645:0:216321:0:(client.c:2492:ptlrpc_set_wait()) set 0000000073aaa033 going to sleep for 6 seconds
00000100:00100000:1.0:1651531978.235901:0:216321:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c9d21511 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997360576:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651531978.235906:0:216321:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca527c lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [471040->475135] (req 471040->475135) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531978.235944:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531978.235952:0:169267:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467755072
00010000:00010000:1.0:1651531978.235958:0:169267:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5275 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446d63 expref: 7 pid: 166113 timeout: 22786 lvb_type: 1
00000100:00100000:1.0:1651531978.235972:0:169267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 283
00000100:00100000:1.0:1651531978.235974:0:169267:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c9d21511 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438147:x1731754467755072:12345-10.240.43.64@tcp:103:ldlm_bl_04.0
00010000:00010000:1.0:1651531978.235977:0:169267:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1651531978.235981:0:169267:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5275 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446d63 expref: 7 pid: 166113 timeout: 22786 lvb_type: 1
00010000:00010000:1.0:1651531978.235989:0:169267:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5275 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446d63 expref: 7 pid: 166113 timeout: 22786 lvb_type: 1
00010000:00010000:1.0:1651531978.235994:0:169267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5275 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446d63 expref: 7 pid: 166113 timeout: 22786 lvb_type: 1
00010000:00010000:1.0:1651531978.235998:0:169267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531978.235998:0:169267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531978.235999:0:169267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca527c lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [471040->475135] (req 471040->475135) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.236002:0:169267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca527c lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [471040->475135] (req 471040->475135) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.236010:0:169267:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1651531978.236021:0:169267:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c9d21511 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438147:x1731754467755072:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 46us (77us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531978.236024:0:169267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 283
00010000:00010000:1.0:1651531978.236030:0:216321:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca527c lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [471040->475135] (req 471040->475135) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.236034:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca527c lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [471040->475135] (req 471040->475135) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531978.271528:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869499 is committed
00010000:00010000:1.0:1651531978.271559:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca527c lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [471040->475135] (req 471040->475135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.271568:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca527c lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [471040->475135] (req 471040->475135) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531978.271584:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a925fbf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438147:x1731754467755008:12345-10.240.43.64@tcp:4:fio.0 Request processed in 35984us (36020us total) trans 21474869499 rc 0/0
00000100:00100000:1.0:1651531978.271588:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250581
00010000:00010000:1.0:1651531978.271594:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca527c lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [471040->475135] (req 471040->475135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.271598:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f6ecb7e5 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531978.271599:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca527c lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [471040->475135] (req 471040->475135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.271602:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca527c lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [471040->475135] (req 471040->475135) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.271607:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca527c lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [471040->475135] (req 471040->475135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.271609:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca527c lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [471040->475135] (req 471040->475135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531978.285181:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531978.285203:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467755328
00000100:00100000:1.0:1651531978.285233:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44869
00000100:00100000:1.0:1651531978.285235:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c0b460ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438148:x1731754467755328:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531978.285239:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531978.285244:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5283 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446d71 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651531978.285249:0:166113:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34545:0x0] initial LVB size: 6291456, mtime: 0x627060ca, atime: 0x627060b4, ctime: 0x627060ca, blocks: 0x3000
00010000:00010000:1.0:1651531978.285254:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531978.285254:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531978.285256:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5283 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446d71 expref: 6 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531978.285261:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5283 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446d71 expref: 6 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531978.285265:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f6ecb7e5, rc 0)
00000100:00100000:1.0:1651531978.285276:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c0b460ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438148:x1731754467755328:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (96us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531978.285279:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44869
00000100:00100000:0.0:1651531978.285348:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531978.285362:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467755456
00000100:00100000:1.0:1651531978.285375:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250582
00000100:00100000:1.0:1651531978.285377:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000052213cb9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467755456:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531978.285384:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca528a lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.285389:0:216321:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5283 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446d71 expref: 6 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531978.285392:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531978.285393:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531978.285393:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca528a lrc: 4/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [24576->28671] (req 24576->28671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.285402:0:216321:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5283 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446d71 expref: 6 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531978.285406:0:216321:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5283 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446d71 expref: 6 pid: 166113 timeout: 22786 lvb_type: 1
00000100:00100000:1.0:1651531978.285410:0:216321:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000028bdd7b3 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997360640:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531978.285423:0:216321:0:(client.c:2492:ptlrpc_set_wait()) set 0000000073aaa033 going to sleep for 6 seconds
00000100:00100000:0.0:1651531978.285538:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531978.285547:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467755584
00000100:00100000:0.0:1651531978.285563:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250583
00000100:00100000:0.0:1651531978.285565:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000be87d738 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438147:x1731754467755584:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531978.285573:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca5291 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.285579:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531978.285579:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531978.285580:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca5291 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [856064->860159] (req 856064->860159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.285588:0:192753:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca5291 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [856064->860159] (req 856064->860159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531978.285634:0:216321:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000028bdd7b3 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997360640:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651531978.285639:0:216321:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca528a lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [24576->28671] (req 24576->28671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531978.285665:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531978.285678:0:169267:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467755648
00010000:00010000:1.0:1651531978.285684:0:169267:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5283 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446d71 expref: 8 pid: 166113 timeout: 22786 lvb_type: 1
00000100:00100000:1.0:1651531978.285695:0:169267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 284
00000100:00100000:1.0:1651531978.285696:0:169267:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d710c5fd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467755648:12345-10.240.43.64@tcp:103:ldlm_bl_02.0
00010000:00010000:1.0:1651531978.285699:0:169267:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1651531978.285703:0:169267:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5283 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446d71 expref: 8 pid: 166113 timeout: 22786 lvb_type: 1
00010000:00010000:1.0:1651531978.285707:0:169267:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5283 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446d71 expref: 8 pid: 166113 timeout: 22786 lvb_type: 1
00010000:00010000:1.0:1651531978.285716:0:169267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5283 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446d71 expref: 8 pid: 166113 timeout: 22786 lvb_type: 1
00010000:00010000:1.0:1651531978.285720:0:169267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531978.285721:0:169267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531978.285722:0:169267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca528a lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [24576->28671] (req 24576->28671) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.285725:0:169267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca528a lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [24576->28671] (req 24576->28671) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.285728:0:169267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531978.285729:0:169267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531978.285729:0:169267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca5291 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [856064->860159] (req 856064->860159) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.285732:0:169267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca5291 lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [856064->860159] (req 856064->860159) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.285742:0:169267:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1651531978.285746:0:192753:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca5291 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [856064->860159] (req 856064->860159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.285750:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca5291 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [856064->860159] (req 856064->860159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531978.285751:0:169267:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d710c5fd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438146:x1731754467755648:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 54us (87us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531978.285754:0:169267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 284
00010000:00010000:1.0:1651531978.285790:0:216321:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca528a lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [24576->28671] (req 24576->28671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.285794:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca528a lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [24576->28671] (req 24576->28671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531978.286151:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531978.286170:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467755904
00000100:00100000:1.0:1651531978.286184:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44870
00000100:00100000:1.0:1651531978.286186:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ffcdece2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754467755904:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531978.286190:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531978.286193:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca5298 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446d7f expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.286201:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca5298 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446d7f expref: 12 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531978.286205:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca5298 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446d7f expref: 12 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531978.286209:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000060a6272d, rc 0)
00000100:00100000:1.0:1651531978.286248:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ffcdece2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754467755904:12345-10.240.43.64@tcp:101:fio.0 Request processed in 61us (97us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531978.286251:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44870
00000100:00100000:0.0:1651531978.286911:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531978.286929:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467756160
00000100:00100000:1.0:1651531978.286942:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44871
00000100:00100000:1.0:1651531978.286943:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000942b56fd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754467756160:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531978.286947:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531978.286950:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca529f lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446d8d expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.286957:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca529f lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446d8d expref: 12 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531978.286963:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca529f lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446d8d expref: 12 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531978.286966:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f2af03c8, rc 0)
00000100:00100000:1.0:1651531978.286976:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000942b56fd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754467756160:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (66us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531978.286978:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44871
00000100:00100000:0.0:1651531978.287668:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531978.287684:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467756416
00000100:00100000:1.0:1651531978.287695:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250584
00000100:00100000:1.0:1651531978.287697:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007d76765b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754467756416:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531978.287704:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca52a6 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.287708:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531978.287709:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531978.287710:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca52a6 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [143360->147455] (req 143360->147455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.287713:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca52a6 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [143360->147455] (req 143360->147455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531978.322559:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531978.322569:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467756544
00000100:00100000:1.0:1651531978.322579:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250585
00000100:00100000:1.0:1651531978.322581:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000028bdd7b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754467756544:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531978.322591:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca52ad lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.322595:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531978.322596:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531978.322597:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca52ad lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [913408->917503] (req 913408->917503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.322601:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca52ad lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [913408->917503] (req 913408->917503) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531978.335489:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869502 is committed
00010000:00010000:0.0:1651531978.335510:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca5291 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [856064->860159] (req 856064->860159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.335514:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca5291 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [856064->860159] (req 856064->860159) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.335520:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca52a6 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [143360->147455] (req 143360->147455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.335530:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca52a6 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [143360->147455] (req 143360->147455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531978.335533:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000be87d738 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438147:x1731754467755584:12345-10.240.43.64@tcp:4:fio.0 Request processed in 49967us (49995us total) trans 21474869500 rc 0/0
00000100:00100000:0.0:1651531978.335537:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250583
00000100:00100000:1.0:1651531978.335545:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007d76765b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438149:x1731754467756416:12345-10.240.43.64@tcp:4:fio.0 Request processed in 47847us (47878us total) trans 21474869502 rc 0/0
00000100:00100000:1.0:1651531978.335548:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250584
00010000:00010000:1.0:1651531978.335556:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca5291 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [856064->860159] (req 856064->860159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.335559:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000014685f38 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531978.335560:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca5291 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [856064->860159] (req 856064->860159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.335563:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca5291 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [856064->860159] (req 856064->860159) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.335578:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca528a lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [24576->28671] (req 24576->28671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.335583:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca528a lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [24576->28671] (req 24576->28671) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.335590:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca5291 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [856064->860159] (req 856064->860159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.335598:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca5291 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [856064->860159] (req 856064->860159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531978.335603:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000052213cb9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467755456:12345-10.240.43.64@tcp:4:fio.0 Request processed in 50225us (50256us total) trans 21474869501 rc 0/0
00010000:00010000:1.0:1651531978.335606:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca52a6 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [143360->147455] (req 143360->147455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531978.335606:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250582
00010000:00010000:1.0:1651531978.335609:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c806f265 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531978.335610:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca52a6 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [143360->147455] (req 143360->147455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.335612:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca52a6 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [143360->147455] (req 143360->147455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.335616:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca52a6 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [143360->147455] (req 143360->147455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.335617:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca528a lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [24576->28671] (req 24576->28671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.335619:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca52a6 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [143360->147455] (req 143360->147455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.335621:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000000bb25cc already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531978.335622:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca528a lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [24576->28671] (req 24576->28671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.335625:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca528a lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [24576->28671] (req 24576->28671) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.335630:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca528a lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [24576->28671] (req 24576->28671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.335633:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca528a lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [24576->28671] (req 24576->28671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531978.335867:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531978.335887:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467756736
00000100:00100000:1.0:1651531978.335899:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44872
00000100:00100000:1.0:1651531978.335900:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007f998d3c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467756736:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531978.335904:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531978.335907:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca52b4 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446d9b expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.335916:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca52b4 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446d9b expref: 9 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531978.335920:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca52b4 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446d9b expref: 9 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531978.335923:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000060a6272d, rc 0)
00000100:00100000:1.0:1651531978.335934:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007f998d3c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467756736:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (67us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531978.335936:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44872
00000100:00100000:0.0:1651531978.336498:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531978.336505:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467757120
00000100:00100000:0.0:1651531978.336523:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250586
00000100:00100000:0.0:1651531978.336525:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000053497d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467757120:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531978.336535:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca52bb lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.336542:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531978.336543:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531978.336544:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca52bb lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [880640->884735] (req 880640->884735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.336548:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca52bb lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [880640->884735] (req 880640->884735) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.336559:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca52bb lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [880640->884735] (req 880640->884735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.336562:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca52bb lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [880640->884735] (req 880640->884735) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.336580:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca52bb lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [880640->884735] (req 880640->884735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531978.336583:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000053497d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467757120:12345-10.240.43.64@tcp:3:fio.0 Request processed in 58us (86us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531978.336586:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250586
00010000:00010000:1.0:1651531978.336589:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f5657138 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531978.336590:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca52bb lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [880640->884735] (req 880640->884735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.336594:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca52bb lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [880640->884735] (req 880640->884735) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.336599:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca52bb lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [880640->884735] (req 880640->884735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.336601:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca52bb lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [880640->884735] (req 880640->884735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531978.336954:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531978.336963:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467757248
00000100:00100000:0.0:1651531978.336977:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250587
00000100:00100000:0.0:1651531978.336979:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dab3699b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467757248:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531978.336986:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca52c2 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.336990:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531978.336991:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531978.336992:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca52c2 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [937984->942079] (req 937984->942079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.337001:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca52c2 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [937984->942079] (req 937984->942079) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531978.376842:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869504 is committed
00010000:00010000:0.0:1651531978.376862:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca52c2 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [937984->942079] (req 937984->942079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.376866:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca52c2 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [937984->942079] (req 937984->942079) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.376877:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca52ad lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [913408->917503] (req 913408->917503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531978.376882:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dab3699b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438148:x1731754467757248:12345-10.240.43.64@tcp:4:fio.0 Request processed in 39902us (39928us total) trans 21474869504 rc 0/0
00010000:00010000:1.0:1651531978.376883:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca52ad lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [913408->917503] (req 913408->917503) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531978.376885:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250587
00010000:00010000:0.0:1651531978.376898:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca52c2 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [937984->942079] (req 937984->942079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531978.376901:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000028bdd7b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438146:x1731754467756544:12345-10.240.43.64@tcp:4:fio.0 Request processed in 54319us (54342us total) trans 21474869503 rc 0/0
00010000:00010000:0.0:1651531978.376902:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000075a78972 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531978.376903:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca52c2 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [937984->942079] (req 937984->942079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531978.376904:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250585
00010000:00010000:0.0:1651531978.376906:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca52c2 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [937984->942079] (req 937984->942079) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.376912:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca52c2 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [937984->942079] (req 937984->942079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.376914:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca52c2 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [937984->942079] (req 937984->942079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.376919:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca52ad lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [913408->917503] (req 913408->917503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.376922:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f2af03c8 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531978.376923:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca52ad lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [913408->917503] (req 913408->917503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.376925:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca52ad lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [913408->917503] (req 913408->917503) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.376929:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca52ad lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [913408->917503] (req 913408->917503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.376931:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca52ad lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [913408->917503] (req 913408->917503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531978.377083:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531978.377106:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467757440
00000100:00100000:1.0:1651531978.377119:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44873
00000100:00100000:1.0:1651531978.377121:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000df1eb0d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438149:x1731754467757440:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531978.377124:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531978.377128:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca52c9 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446da9 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651531978.377133:0:166113:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34545:0x0] initial LVB size: 6291456, mtime: 0x627060ca, atime: 0x627060b4, ctime: 0x627060ca, blocks: 0x3000
00010000:00010000:1.0:1651531978.377138:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531978.377138:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531978.377140:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca52c9 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446da9 expref: 6 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531978.377145:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca52c9 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446da9 expref: 6 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531978.377149:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000060a6272d, rc 0)
00000100:00100000:1.0:1651531978.377164:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000df1eb0d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467757440:12345-10.240.43.64@tcp:101:fio.0 Request processed in 42us (81us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531978.377167:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44873
00000100:00100000:0.0:1651531978.377242:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531978.377264:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467757632
00000100:00100000:1.0:1651531978.377274:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44874
00000100:00100000:1.0:1651531978.377275:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009c93d7f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438148:x1731754467757632:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531978.377279:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531978.377282:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca52d0 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446db7 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.377287:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531978.377288:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531978.377290:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca52d0 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446db7 expref: 7 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531978.377294:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca52d0 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446db7 expref: 7 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531978.377298:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c806f265, rc 0)
00000100:00100000:1.0:1651531978.377318:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009c93d7f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438148:x1731754467757632:12345-10.240.43.64@tcp:101:fio.0 Request processed in 42us (77us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531978.377321:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44874
00000100:00100000:0.0:1651531978.377324:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531978.377338:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467757760
00000100:00100000:1.0:1651531978.377347:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44875
00000100:00100000:1.0:1651531978.377355:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007d76765b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438147:x1731754467757760:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531978.377358:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531978.377360:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca52d7 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446dc5 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.377365:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531978.377367:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531978.377369:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca52d7 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446dc5 expref: 8 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531978.377373:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca52d7 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446dc5 expref: 8 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531978.377376:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f6ecb7e5, rc 0)
00000100:00100000:1.0:1651531978.377388:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007d76765b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467757760:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (65us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531978.377391:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44875
00000100:00100000:0.0:1651531978.377854:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531978.377877:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467757952
00000100:00100000:1.0:1651531978.377891:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250588
00000100:00100000:1.0:1651531978.377893:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000053497d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467757952:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531978.377900:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca52de lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.377903:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531978.377904:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531978.377905:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca52de lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [163840->249855] (req 163840->249855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.377909:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca52de lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [163840->249855] (req 163840->249855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531978.377967:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531978.377995:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467758144
00000100:00100000:0.0:1651531978.378009:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250589
00000100:00100000:0.0:1651531978.378011:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c43262d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754467758144:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531978.378019:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca52e5 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.378027:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531978.378028:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531978.378029:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca52e5 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [942080->946175] (req 942080->946175) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.378033:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca52e5 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [942080->946175] (req 942080->946175) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.378044:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca52e5 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [942080->946175] (req 942080->946175) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.378047:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca52e5 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [942080->946175] (req 942080->946175) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531978.378068:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c43262d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754467758144:12345-10.240.43.64@tcp:3:fio.0 Request processed in 56us (101us total) trans 0 rc 4096/4096
00010000:00010000:1.0:1651531978.378069:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca52e5 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [942080->946175] (req 942080->946175) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531978.378071:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250589
00010000:00010000:1.0:1651531978.378073:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000032ee36ee already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531978.378076:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca52e5 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [942080->946175] (req 942080->946175) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.378079:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca52e5 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [942080->946175] (req 942080->946175) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.378084:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca52e5 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [942080->946175] (req 942080->946175) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.378087:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca52e5 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [942080->946175] (req 942080->946175) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.378176:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca52de lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [163840->249855] (req 163840->249855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.378180:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca52de lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [163840->249855] (req 163840->249855) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.378191:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca52de lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [163840->249855] (req 163840->249855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.378196:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000eebd17a1 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531978.378197:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca52de lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [163840->249855] (req 163840->249855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531978.378200:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000053497d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467757952:12345-10.240.43.64@tcp:3:fio.0 Request processed in 306us (346us total) trans 0 rc 8192/8192
00000100:00100000:1.0:1651531978.378203:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250588
00010000:00010000:0.0:1651531978.378205:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca52de lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [163840->249855] (req 163840->249855) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.378211:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca52de lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [163840->249855] (req 163840->249855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.378215:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca52de lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [163840->249855] (req 163840->249855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531978.378506:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531978.378523:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467758400
00000100:00100000:1.0:1651531978.378536:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250590
00000100:00100000:1.0:1651531978.378537:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d9e74b4c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467758400:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531978.378544:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca52ec lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.378548:0:192754:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca52c9 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446da9 expref: 8 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531978.378556:0:192754:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca52d0 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446db7 expref: 8 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531978.378559:0:192754:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca52d7 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446dc5 expref: 8 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531978.378561:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531978.378562:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531978.378563:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca52ec lrc: 6/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [950272->954367] (req 950272->954367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531978.378564:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651531978.378576:0:192754:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca52d7 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446dc5 expref: 8 pid: 166113 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651531978.378576:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467758528
00010000:00010000:1.0:1651531978.378580:0:192754:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca52d7 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446dc5 expref: 9 pid: 166113 timeout: 22787 lvb_type: 1
00000100:00100000:1.0:1651531978.378584:0:192754:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ec616e94 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_005:lustre-OST0001_UUID:192754:1731745997360704:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531978.378587:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250591
00000100:00100000:0.0:1651531978.378588:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003ffbc5dc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438147:x1731754467758528:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531978.378595:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca52f3 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.378603:0:192754:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca52d0 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446db7 expref: 9 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531978.378606:0:192754:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca52d0 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446db7 expref: 9 pid: 166113 timeout: 22787 lvb_type: 1
00000100:00100000:1.0:1651531978.378610:0:192754:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004c512052 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_005:lustre-OST0001_UUID:192754:1731745997360768:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651531978.378611:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531978.378612:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531978.378613:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca52f3 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [81920->868351] (req 81920->868351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.378617:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca52f3 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [81920->868351] (req 81920->868351) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.378618:0:192754:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca52c9 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446da9 expref: 9 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531978.378622:0:192754:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca52c9 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446da9 expref: 9 pid: 166113 timeout: 22787 lvb_type: 1
00000100:00100000:1.0:1651531978.378625:0:192754:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f69c7290 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_005:lustre-OST0001_UUID:192754:1731745997360832:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531978.378630:0:192754:0:(client.c:2492:ptlrpc_set_wait()) set 0000000073aaa033 going to sleep for 6 seconds
00010000:00010000:0.0:1651531978.378818:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca52f3 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [81920->868351] (req 81920->868351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.378822:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca52f3 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [81920->868351] (req 81920->868351) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531978.378836:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003ffbc5dc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438147:x1731754467758528:12345-10.240.43.64@tcp:3:fio.0 Request processed in 246us (272us total) trans 0 rc 8192/8192
00000100:00100000:0.0:1651531978.378841:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250591
00010000:00010000:0.0:1651531978.378848:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca52f3 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [81920->868351] (req 81920->868351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.378851:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002c5e01dd already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531978.378852:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca52f3 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [81920->868351] (req 81920->868351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.378855:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca52f3 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [81920->868351] (req 81920->868351) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.378860:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca52f3 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [81920->868351] (req 81920->868351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.378863:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca52f3 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [81920->868351] (req 81920->868351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531978.379081:0:192754:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ec616e94 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_005:lustre-OST0001_UUID:192754:1731745997360704:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531978.379084:0:192754:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004c512052 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_005:lustre-OST0001_UUID:192754:1731745997360768:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531978.379086:0:192754:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f69c7290 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_005:lustre-OST0001_UUID:192754:1731745997360832:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651531978.379091:0:192754:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca52ec lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [950272->954367] (req 950272->954367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531978.379114:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531978.379123:0:169267:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467758656
00000100:00100000:0.0:1651531978.379123:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651531978.379129:0:169267:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca52d7 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446dc5 expref: 9 pid: 166113 timeout: 22787 lvb_type: 1
00000100:00100000:0.0:1651531978.379131:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531978.379139:0:169267:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467758784
00010000:00010000:1.0:1651531978.379142:0:169267:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca52c9 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446da9 expref: 10 pid: 166113 timeout: 22787 lvb_type: 1
00000100:00100000:0.0:1651531978.379145:0:166102:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467758720
00000100:00100000:1.0:1651531978.379147:0:169267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 285
00000100:00100000:1.0:1651531978.379149:0:169267:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ffcc974c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438146:x1731754467758656:12345-10.240.43.64@tcp:103:ldlm_bl_02.0
00010000:00010000:0.0:1651531978.379151:0:166102:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca52d0 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446db7 expref: 11 pid: 166113 timeout: 22787 lvb_type: 1
00010000:00010000:1.0:1651531978.379152:0:169267:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1651531978.379157:0:169267:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca52d7 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446dc5 expref: 11 pid: 166113 timeout: 22787 lvb_type: 1
00000100:00100000:0.0:1651531978.379159:0:166102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 286
00010000:00010000:1.0:1651531978.379160:0:169267:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca52d7 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446dc5 expref: 11 pid: 166113 timeout: 22787 lvb_type: 1
00000100:00100000:0.0:1651531978.379160:0:166102:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000567318ba pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438146:x1731754467758784:12345-10.240.43.64@tcp:103:ldlm_bl_02.0
00010000:00010000:0.0:1651531978.379164:0:166102:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1651531978.379165:0:169267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca52d7 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446dc5 expref: 11 pid: 166113 timeout: 22787 lvb_type: 1
00010000:00010000:0.0:1651531978.379169:0:166102:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca52c9 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446da9 expref: 10 pid: 166113 timeout: 22787 lvb_type: 1
00010000:00010000:1.0:1651531978.379170:0:169267:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1651531978.379173:0:166102:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca52c9 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446da9 expref: 10 pid: 166113 timeout: 22787 lvb_type: 1
00010000:00010000:0.0:1651531978.379178:0:166102:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca52c9 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446da9 expref: 10 pid: 166113 timeout: 22787 lvb_type: 1
00000100:00100000:1.0:1651531978.379182:0:169267:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ffcc974c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438146:x1731754467758656:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 32us (68us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531978.379184:0:169267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 285
00010000:00010000:0.0:1651531978.379189:0:166102:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1651531978.379190:0:169267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 287
00000100:00100000:1.0:1651531978.379191:0:169267:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009acffcb8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467758720:12345-10.240.43.64@tcp:103:ldlm_bl_02.0
00010000:00010000:1.0:1651531978.379194:0:169267:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1651531978.379196:0:169267:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca52d0 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446db7 expref: 8 pid: 166113 timeout: 22787 lvb_type: 1
00000100:00100000:0.0:1651531978.379197:0:166102:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000567318ba pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467758784:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 36us (73us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531978.379200:0:166102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 286
00010000:00010000:1.0:1651531978.379201:0:169267:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca52d0 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446db7 expref: 8 pid: 166113 timeout: 22787 lvb_type: 1
00010000:00010000:1.0:1651531978.379205:0:169267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca52d0 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446db7 expref: 7 pid: 166113 timeout: 22787 lvb_type: 1
00010000:00010000:1.0:1651531978.379208:0:169267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531978.379209:0:169267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531978.379211:0:169267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca52ec lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [950272->954367] (req 950272->954367) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.379214:0:169267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca52ec lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [950272->954367] (req 950272->954367) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.379244:0:169267:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1651531978.379252:0:169267:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009acffcb8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438146:x1731754467758720:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 60us (121us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531978.379255:0:169267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 287
00010000:00010000:1.0:1651531978.379289:0:192754:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca52ec lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [950272->954367] (req 950272->954367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.379293:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca52ec lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [950272->954367] (req 950272->954367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531978.379368:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531978.379388:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467759040
00000100:00100000:0.0:1651531978.379405:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44876
00000100:00100000:0.0:1651531978.379407:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467759040:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531978.379411:0:206699:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531978.379415:0:206699:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca52fa lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446dd3 expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.379423:0:206699:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca52fa lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446dd3 expref: 9 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531978.379427:0:206699:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca52fa lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446dd3 expref: 9 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531978.379431:0:206699:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f5657138, rc 0)
00000100:00100000:0.0:1651531978.379441:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467759040:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (74us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531978.379444:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44876
00000100:00100000:0.0:1651531978.380257:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531978.380264:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467759296
00000100:00100000:0.0:1651531978.380278:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44877
00000100:00100000:0.0:1651531978.380279:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008b42dfe9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467759296:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531978.380283:0:206699:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531978.380294:0:206699:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca5301 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446de1 expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.380302:0:206699:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca5301 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446de1 expref: 9 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531978.380306:0:206699:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca5301 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446de1 expref: 9 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531978.380309:0:206699:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000075a78972, rc 0)
00000100:00100000:0.0:1651531978.380320:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008b42dfe9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467759296:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (64us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531978.380322:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44877
00000100:00100000:0.0:1651531978.380626:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531978.380633:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467759424
00000100:00100000:0.0:1651531978.380643:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250592
00000100:00100000:0.0:1651531978.380644:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b10bc064 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467759424:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531978.380651:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca5308 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.380656:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531978.380657:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531978.380658:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca5308 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [1011712->1015807] (req 1011712->1015807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.380662:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca5308 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [1011712->1015807] (req 1011712->1015807) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.380673:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca5308 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [1011712->1015807] (req 1011712->1015807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.380677:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca5308 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [1011712->1015807] (req 1011712->1015807) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.380696:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca5308 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [1011712->1015807] (req 1011712->1015807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531978.380699:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b10bc064 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467759424:12345-10.240.43.64@tcp:3:fio.0 Request processed in 53us (73us total) trans 0 rc 4096/4096
00010000:00010000:1.0:1651531978.380700:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000014685f38 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531978.380702:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca5308 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [1011712->1015807] (req 1011712->1015807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531978.380702:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250592
00010000:00010000:1.0:1651531978.380705:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca5308 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [1011712->1015807] (req 1011712->1015807) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.380710:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca5308 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [1011712->1015807] (req 1011712->1015807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.380717:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca5308 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [1011712->1015807] (req 1011712->1015807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531978.415168:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531978.415176:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467759680
00000100:00100000:0.0:1651531978.415189:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44878
00000100:00100000:0.0:1651531978.415191:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000427633c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467759680:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531978.415195:0:206699:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531978.415198:0:206699:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca530f lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446def expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.415206:0:206699:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca530f lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446def expref: 9 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531978.415215:0:206699:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca530f lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446def expref: 9 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531978.415239:0:206699:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000075a78972, rc 0)
00000100:00100000:0.0:1651531978.415249:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000427633c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467759680:12345-10.240.43.64@tcp:101:fio.0 Request processed in 58us (82us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531978.415252:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44878
00000100:00100000:0.0:1651531978.416009:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531978.416016:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467759936
00000100:00100000:0.0:1651531978.416030:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44879
00000100:00100000:0.0:1651531978.416032:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000099b6616a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467759936:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531978.416035:0:206699:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531978.416039:0:206699:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca5316 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446dfd expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.416046:0:206699:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca5316 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446dfd expref: 9 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531978.416050:0:206699:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca5316 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446dfd expref: 9 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531978.416053:0:206699:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f5657138, rc 0)
00000100:00100000:0.0:1651531978.416064:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000099b6616a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467759936:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (55us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531978.416066:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44879
00000100:00100000:0.0:1651531978.416388:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531978.416396:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467760064
00000100:00100000:0.0:1651531978.416405:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250593
00000100:00100000:0.0:1651531978.416407:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002ae2aeac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467760064:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531978.416414:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca531d lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.416418:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531978.416418:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531978.416419:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca531d lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [729088->733183] (req 729088->733183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.416423:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca531d lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [729088->733183] (req 729088->733183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.416436:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca531d lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [729088->733183] (req 729088->733183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.416439:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca531d lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [729088->733183] (req 729088->733183) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531978.416453:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002ae2aeac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467760064:12345-10.240.43.64@tcp:3:fio.0 Request processed in 46us (66us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531978.416456:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250593
00010000:00010000:0.0:1651531978.416462:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca531d lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [729088->733183] (req 729088->733183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.416465:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002c5e01dd already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531978.416466:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca531d lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [729088->733183] (req 729088->733183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.416471:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca531d lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [729088->733183] (req 729088->733183) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.416475:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca531d lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [729088->733183] (req 729088->733183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.416478:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca531d lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [729088->733183] (req 729088->733183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531978.451570:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869505 is committed
00010000:00010000:1.0:1651531978.451602:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca52ec lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [950272->954367] (req 950272->954367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.451606:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca52ec lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [950272->954367] (req 950272->954367) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531978.451626:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d9e74b4c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438148:x1731754467758400:12345-10.240.43.64@tcp:4:fio.0 Request processed in 73088us (73120us total) trans 21474869505 rc 0/0
00000100:00100000:1.0:1651531978.451629:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250590
00010000:00010000:0.0:1651531978.451629:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca52ec lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [950272->954367] (req 950272->954367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.451634:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c8969b4f already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531978.451635:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca52ec lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [950272->954367] (req 950272->954367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.451638:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca52ec lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [950272->954367] (req 950272->954367) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.451643:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca52ec lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [950272->954367] (req 950272->954367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.451646:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca52ec lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [950272->954367] (req 950272->954367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531978.451998:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531978.452016:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467760320
00000100:00100000:1.0:1651531978.452031:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250594
00000100:00100000:1.0:1651531978.452033:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a20162bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438149:x1731754467760320:12345-10.240.43.64@tcp:4:fio.0
00002000:00010000:1.0:1651531978.452042:0:192754:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34545:0x0] initial LVB size: 6291456, mtime: 0x627060ca, atime: 0x627060b4, ctime: 0x627060ca, blocks: 0x3000
00010000:00010000:1.0:1651531978.452044:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5324 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.452048:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531978.452049:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531978.452050:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5324 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [954368->958463] (req 954368->958463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.452054:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5324 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [954368->958463] (req 954368->958463) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531978.452818:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531978.452820:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531978.452834:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467760576
00000100:00100000:0.0:1651531978.452848:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44880
00000100:00100000:0.0:1651531978.452849:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d76314b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467760576:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531978.452853:0:206699:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531978.452857:0:206699:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca532b lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446e0b expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531978.452864:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467760512
00010000:00010000:0.0:1651531978.452864:0:206699:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca532b lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446e0b expref: 9 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531978.452869:0:206699:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca532b lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446e0b expref: 10 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531978.452872:0:206699:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002c5e01dd, rc 0)
00000100:00100000:1.0:1651531978.452877:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250595
00000100:00100000:1.0:1651531978.452879:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f69c7290 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438149:x1731754467760512:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531978.452886:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5332 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531978.452888:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d76314b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438147:x1731754467760576:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (71us total) trans 0 rc 301/301
00010000:00010000:1.0:1651531978.452890:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531978.452891:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:0.0:1651531978.452891:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44880
00010000:00010000:1.0:1651531978.452892:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5332 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [53248->57343] (req 53248->57343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.452896:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5332 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [53248->57343] (req 53248->57343) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531978.477951:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869506 is committed
00010000:00010000:1.0:1651531978.477979:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5324 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [954368->958463] (req 954368->958463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.477983:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5324 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [954368->958463] (req 954368->958463) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.477996:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5324 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [954368->958463] (req 954368->958463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531978.478000:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a20162bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467760320:12345-10.240.43.64@tcp:4:fio.0 Request processed in 25966us (26002us total) trans 21474869506 rc 0/0
00010000:00010000:0.0:1651531978.478000:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c806f265 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531978.478001:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5324 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [954368->958463] (req 954368->958463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531978.478004:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250594
00010000:00010000:0.0:1651531978.478004:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5324 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [954368->958463] (req 954368->958463) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.478013:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5324 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [954368->958463] (req 954368->958463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.478016:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5324 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [954368->958463] (req 954368->958463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531978.503286:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869507 is committed
00010000:00010000:0.0:1651531978.503300:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5332 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [53248->57343] (req 53248->57343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.503304:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5332 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [53248->57343] (req 53248->57343) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531978.503320:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f69c7290 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438149:x1731754467760512:12345-10.240.43.64@tcp:4:fio.0 Request processed in 50440us (50500us total) trans 21474869507 rc 0/0
00000100:00100000:0.0:1651531978.503323:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250595
00010000:00010000:0.0:1651531978.503329:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5332 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [53248->57343] (req 53248->57343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.503333:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f6ecb7e5 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531978.503334:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5332 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [53248->57343] (req 53248->57343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.503337:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5332 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [53248->57343] (req 53248->57343) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.503341:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5332 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [53248->57343] (req 53248->57343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.503345:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5332 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [53248->57343] (req 53248->57343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531978.503709:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531978.503727:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467761216
00000100:00100000:0.0:1651531978.503740:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44881
00000100:00100000:0.0:1651531978.503742:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004c512052 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438148:x1731754467761216:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531978.503745:0:206699:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531978.503749:0:206699:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca5339 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446e19 expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00002000:00010000:0.0:1651531978.503754:0:206699:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34545:0x0] initial LVB size: 6291456, mtime: 0x627060ca, atime: 0x627060b4, ctime: 0x627060ca, blocks: 0x3000
00010000:00010000:0.0:1651531978.503758:0:206699:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531978.503759:0:206699:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531978.503761:0:206699:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca5339 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446e19 expref: 6 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531978.503766:0:206699:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca5339 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446e19 expref: 6 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531978.503770:0:206699:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002c5e01dd, rc 0)
00000100:00100000:0.0:1651531978.503781:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004c512052 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438148:x1731754467761216:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (73us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531978.503783:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44881
00000100:00100000:1.0:1651531978.504540:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531978.504557:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467761600
00000100:00100000:0.0:1651531978.504573:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250596
00000100:00100000:0.0:1651531978.504575:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ec616e94 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467761600:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531978.504583:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca5340 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.504587:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531978.504587:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531978.504588:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca5340 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [790528->794623] (req 790528->794623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.504592:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca5340 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [790528->794623] (req 790528->794623) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.504604:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca5340 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [790528->794623] (req 790528->794623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.504607:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca5340 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [790528->794623] (req 790528->794623) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531978.504622:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ec616e94 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467761600:12345-10.240.43.64@tcp:3:fio.0 Request processed in 46us (82us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531978.504624:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250596
00010000:00010000:0.0:1651531978.504630:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca5340 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [790528->794623] (req 790528->794623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.504634:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f5657138 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531978.504635:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca5340 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [790528->794623] (req 790528->794623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.504638:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca5340 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [790528->794623] (req 790528->794623) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.504647:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca5340 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [790528->794623] (req 790528->794623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.504650:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca5340 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [790528->794623] (req 790528->794623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531978.504993:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531978.505005:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467761728
00000100:00100000:0.0:1651531978.505020:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250597
00000100:00100000:0.0:1651531978.505021:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c1c918a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438148:x1731754467761728:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531978.505028:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca5347 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.505033:0:216321:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca5339 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446e19 expref: 6 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531978.505036:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531978.505037:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531978.505037:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca5347 lrc: 4/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [155648->159743] (req 155648->159743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.505044:0:216321:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca5339 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446e19 expref: 6 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531978.505048:0:216321:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca5339 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446e19 expref: 6 pid: 206699 timeout: 22787 lvb_type: 1
00000100:00100000:0.0:1651531978.505053:0:216321:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000033696ffa pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997360896:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531978.505067:0:216321:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a4532c78 going to sleep for 6 seconds
00000100:00100000:1.0:1651531978.505323:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531978.505325:0:216321:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000033696ffa pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997360896:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651531978.505330:0:216321:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca5347 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [155648->159743] (req 155648->159743) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531978.505331:0:169267:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467761792
00010000:00010000:1.0:1651531978.505337:0:169267:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca5339 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446e19 expref: 7 pid: 206699 timeout: 22787 lvb_type: 1
00000100:00100000:1.0:1651531978.505348:0:169267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 288
00000100:00100000:1.0:1651531978.505350:0:169267:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004ac30c21 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438147:x1731754467761792:12345-10.240.43.64@tcp:103:ldlm_bl_05.0
00010000:00010000:1.0:1651531978.505353:0:169267:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1651531978.505357:0:169267:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca5339 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446e19 expref: 7 pid: 206699 timeout: 22787 lvb_type: 1
00010000:00010000:1.0:1651531978.505361:0:169267:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca5339 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446e19 expref: 7 pid: 206699 timeout: 22787 lvb_type: 1
00010000:00010000:1.0:1651531978.505367:0:169267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca5339 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446e19 expref: 7 pid: 206699 timeout: 22787 lvb_type: 1
00010000:00010000:1.0:1651531978.505371:0:169267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531978.505372:0:169267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531978.505373:0:169267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca5347 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [155648->159743] (req 155648->159743) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.505376:0:169267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca5347 lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [155648->159743] (req 155648->159743) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.505385:0:169267:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1651531978.505386:0:216321:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca5347 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [155648->159743] (req 155648->159743) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.505390:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca5347 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [155648->159743] (req 155648->159743) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531978.505396:0:169267:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004ac30c21 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438147:x1731754467761792:12345-10.240.43.64@tcp:103:ldlm_bl_05.0 Request processed in 45us (73us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531978.505401:0:169267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 288
00000100:00100000:1.0:1651531978.553876:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531978.553899:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467761920
00000100:00100000:0.0:1651531978.553912:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44882
00000100:00100000:0.0:1651531978.553914:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002dca0b15 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467761920:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531978.553917:0:206699:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531978.553921:0:206699:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca534e lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446e27 expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.553929:0:206699:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca534e lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446e27 expref: 9 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531978.553933:0:206699:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca534e lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446e27 expref: 9 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531978.553937:0:206699:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f5657138, rc 0)
00000100:00100000:0.0:1651531978.553948:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002dca0b15 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467761920:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (73us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531978.553954:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44882
00000001:00080000:0.0:1651531978.564902:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869508 is committed
00010000:00010000:0.0:1651531978.564917:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca5347 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [155648->159743] (req 155648->159743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.564920:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca5347 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [155648->159743] (req 155648->159743) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531978.564940:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c1c918a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438148:x1731754467761728:12345-10.240.43.64@tcp:4:fio.0 Request processed in 59918us (59947us total) trans 21474869508 rc 0/0
00000100:00100000:0.0:1651531978.564943:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250597
00010000:00010000:0.0:1651531978.564950:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca5347 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [155648->159743] (req 155648->159743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.564954:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000075a78972 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531978.564955:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca5347 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [155648->159743] (req 155648->159743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.564958:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca5347 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [155648->159743] (req 155648->159743) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.564962:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca5347 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [155648->159743] (req 155648->159743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.564965:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca5347 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [155648->159743] (req 155648->159743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531978.565299:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531978.565309:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467762432
00000100:00100000:0.0:1651531978.565324:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250598
00000100:00100000:0.0:1651531978.565326:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000033696ffa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438149:x1731754467762432:12345-10.240.43.64@tcp:4:fio.0
00002000:00010000:0.0:1651531978.565335:0:216321:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34545:0x0] initial LVB size: 6291456, mtime: 0x627060ca, atime: 0x627060b4, ctime: 0x627060ca, blocks: 0x3000
00010000:00010000:0.0:1651531978.565337:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca5355 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.565341:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531978.565341:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531978.565342:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca5355 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [565248->569343] (req 565248->569343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.565346:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca5355 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [565248->569343] (req 565248->569343) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531978.579890:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531978.579912:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467762560
00000100:00100000:0.0:1651531978.579925:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44883
00000100:00100000:0.0:1651531978.579927:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c9d21511 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467762560:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531978.579930:0:206699:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531978.579934:0:206699:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca535c lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446e35 expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.579942:0:206699:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca535c lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446e35 expref: 9 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531978.579946:0:206699:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca535c lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446e35 expref: 9 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531978.579953:0:206699:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000075a78972, rc 0)
00000100:00100000:0.0:1651531978.579965:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c9d21511 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467762560:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (76us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531978.579967:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44883
00000001:00080000:0.0:1651531978.591260:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869509 is committed
00010000:00010000:0.0:1651531978.591273:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca5355 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [565248->569343] (req 565248->569343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.591277:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca5355 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [565248->569343] (req 565248->569343) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531978.591297:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000033696ffa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438149:x1731754467762432:12345-10.240.43.64@tcp:4:fio.0 Request processed in 25971us (25998us total) trans 21474869509 rc 0/0
00000100:00100000:0.0:1651531978.591301:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250598
00010000:00010000:0.0:1651531978.591307:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca5355 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [565248->569343] (req 565248->569343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.591311:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f5657138 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531978.591312:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca5355 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [565248->569343] (req 565248->569343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.591315:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca5355 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [565248->569343] (req 565248->569343) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.591320:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca5355 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [565248->569343] (req 565248->569343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.591326:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca5355 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [565248->569343] (req 565248->569343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531978.591665:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531978.591673:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467762944
00000100:00100000:0.0:1651531978.591687:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44884
00000100:00100000:0.0:1651531978.591689:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000329eeeee pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438149:x1731754467762944:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531978.591692:0:206699:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531978.591696:0:206699:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca5363 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446e43 expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00002000:00010000:0.0:1651531978.591701:0:206699:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34545:0x0] initial LVB size: 6291456, mtime: 0x627060ca, atime: 0x627060b4, ctime: 0x627060ca, blocks: 0x3000
00010000:00010000:0.0:1651531978.591705:0:206699:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531978.591706:0:206699:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531978.591707:0:206699:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca5363 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446e43 expref: 6 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531978.591712:0:206699:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca5363 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446e43 expref: 6 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531978.591716:0:206699:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000075a78972, rc 0)
00000100:00100000:0.0:1651531978.591730:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000329eeeee pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467762944:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (66us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531978.591733:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44884
00000100:00100000:0.0:1651531978.592435:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531978.592443:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467763200
00000100:00100000:0.0:1651531978.592460:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250599
00000100:00100000:0.0:1651531978.592462:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f3a0807 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438148:x1731754467763200:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531978.592469:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca536a lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.592473:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531978.592474:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531978.592475:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca536a lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [274432->278527] (req 274432->278527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.592478:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca536a lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [274432->278527] (req 274432->278527) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.592490:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca536a lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [274432->278527] (req 274432->278527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.592493:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca536a lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [274432->278527] (req 274432->278527) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531978.592513:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f3a0807 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438148:x1731754467763200:12345-10.240.43.64@tcp:3:fio.0 Request processed in 50us (78us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531978.592516:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250599
00010000:00010000:0.0:1651531978.592523:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca536a lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [274432->278527] (req 274432->278527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.592526:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f968d777 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531978.592527:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca536a lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [274432->278527] (req 274432->278527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.592534:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca536a lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [274432->278527] (req 274432->278527) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.592538:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca536a lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [274432->278527] (req 274432->278527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.592541:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca536a lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [274432->278527] (req 274432->278527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531978.592820:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531978.592828:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467763328
00000100:00100000:0.0:1651531978.592842:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250600
00000100:00100000:0.0:1651531978.592843:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a899ddab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467763328:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531978.592850:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca5371 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.592855:0:216321:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca5363 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446e43 expref: 6 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531978.592858:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531978.592859:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531978.592859:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca5371 lrc: 4/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.592867:0:216321:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca5363 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446e43 expref: 6 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531978.592874:0:216321:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca5363 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446e43 expref: 6 pid: 206699 timeout: 22787 lvb_type: 1
00000100:00100000:0.0:1651531978.592879:0:216321:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b462545d pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997360960:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531978.592895:0:216321:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a4532c78 going to sleep for 6 seconds
00000100:00100000:0.0:1651531978.593079:0:216321:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b462545d pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997360960:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651531978.593103:0:216321:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca5371 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531978.593156:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531978.593166:0:169267:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467763392
00010000:00010000:1.0:1651531978.593172:0:169267:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca5363 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446e43 expref: 7 pid: 206699 timeout: 22787 lvb_type: 1
00000100:00100000:1.0:1651531978.593185:0:169267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 289
00000100:00100000:1.0:1651531978.593187:0:169267:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000028bdd7b3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438148:x1731754467763392:12345-10.240.43.64@tcp:103:ldlm_bl_06.0
00010000:00010000:1.0:1651531978.593190:0:169267:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1651531978.593194:0:169267:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca5363 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446e43 expref: 7 pid: 206699 timeout: 22787 lvb_type: 1
00010000:00010000:1.0:1651531978.593199:0:169267:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca5363 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446e43 expref: 7 pid: 206699 timeout: 22787 lvb_type: 1
00010000:00010000:1.0:1651531978.593205:0:169267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca5363 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446e43 expref: 7 pid: 206699 timeout: 22787 lvb_type: 1
00010000:00010000:1.0:1651531978.593209:0:169267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531978.593209:0:169267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531978.593210:0:169267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca5371 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.593214:0:169267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca5371 lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.593247:0:169267:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1651531978.593250:0:216321:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca5371 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.593254:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca5371 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531978.593260:0:169267:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000028bdd7b3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438148:x1731754467763392:12345-10.240.43.64@tcp:103:ldlm_bl_06.0 Request processed in 72us (111us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531978.593263:0:169267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 289
00000100:00100000:0.0:1651531978.616613:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531978.616621:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467763584
00000100:00100000:1.0:1651531978.616627:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531978.616632:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44885
00000100:00100000:0.0:1651531978.616634:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b462545d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467763584:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531978.616638:0:206699:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531978.616641:0:206699:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca5378 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446e51 expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531978.616644:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467763648
00010000:00010000:0.0:1651531978.616649:0:206699:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca5378 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446e51 expref: 10 pid: 206699 timeout: 0 lvb_type: 1
00000100:00100000:1.0:1651531978.616659:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250601
00000100:00100000:1.0:1651531978.616660:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ffcc974c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754467763648:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531978.616664:0:206699:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca5378 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446e51 expref: 10 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531978.616668:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca537f lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.616668:0:206699:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f968d777, rc 0)
00010000:00010000:1.0:1651531978.616672:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531978.616673:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531978.616674:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca537f lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [925696->929791] (req 925696->929791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.616678:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca537f lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [925696->929791] (req 925696->929791) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531978.616678:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b462545d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438149:x1731754467763584:12345-10.240.43.64@tcp:101:fio.0 Request processed in 44us (66us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531978.616681:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44885
00000100:00100000:1.0:1651531978.617039:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531978.617057:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467763776
00000100:00100000:0.0:1651531978.617072:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250602
00000100:00100000:0.0:1651531978.617074:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000567318ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754467763776:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531978.617081:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca5386 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.617085:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531978.617086:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531978.617087:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca5386 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [966656->970751] (req 966656->970751) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.617091:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca5386 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [966656->970751] (req 966656->970751) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.617104:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca5386 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [966656->970751] (req 966656->970751) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.617107:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca5386 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [966656->970751] (req 966656->970751) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531978.617125:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000567318ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754467763776:12345-10.240.43.64@tcp:3:fio.0 Request processed in 50us (87us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531978.617128:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250602
00010000:00010000:0.0:1651531978.617134:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca5386 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [966656->970751] (req 966656->970751) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.617138:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f5657138 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531978.617139:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca5386 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [966656->970751] (req 966656->970751) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.617142:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca5386 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [966656->970751] (req 966656->970751) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.617146:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca5386 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [966656->970751] (req 966656->970751) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.617149:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca5386 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [966656->970751] (req 966656->970751) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531978.652898:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869510 is committed
00010000:00010000:1.0:1651531978.652937:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca5371 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.652943:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca5371 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531978.652967:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a899ddab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467763328:12345-10.240.43.64@tcp:4:fio.0 Request processed in 60122us (60147us total) trans 21474869510 rc 0/0
00010000:00010000:0.0:1651531978.652968:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca5371 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531978.652973:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250600
00010000:00010000:0.0:1651531978.652973:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000775318ab already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531978.652974:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca5371 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.652981:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca5371 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.652986:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca5371 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.652989:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca5371 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531978.679467:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869511 is committed
00010000:00010000:1.0:1651531978.679498:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca537f lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [925696->929791] (req 925696->929791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.679503:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca537f lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [925696->929791] (req 925696->929791) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531978.679524:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ffcc974c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438149:x1731754467763648:12345-10.240.43.64@tcp:4:fio.0 Request processed in 62862us (62898us total) trans 21474869511 rc 0/0
00000100:00100000:1.0:1651531978.679527:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250601
00010000:00010000:0.0:1651531978.679527:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca537f lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [925696->929791] (req 925696->929791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.679531:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008b0c325f already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531978.679532:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca537f lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [925696->929791] (req 925696->929791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.679535:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca537f lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [925696->929791] (req 925696->929791) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.679540:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca537f lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [925696->929791] (req 925696->929791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.679543:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca537f lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [925696->929791] (req 925696->929791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531978.692498:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531978.692515:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531978.692522:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467764480
00000100:00100000:1.0:1651531978.692524:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467764544
00000100:00100000:0.0:1651531978.692534:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44886
00000100:00100000:0.0:1651531978.692537:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009acffcb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438148:x1731754467764480:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531978.692540:0:206699:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651531978.692542:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250603
00000100:00100000:1.0:1651531978.692543:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c65d6bc4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438148:x1731754467764544:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531978.692544:0:206699:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca538d lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446e5f expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00002000:00010000:0.0:1651531978.692549:0:206699:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34545:0x0] initial LVB size: 6291456, mtime: 0x627060ca, atime: 0x627060b4, ctime: 0x627060ca, blocks: 0x3000
00010000:00010000:1.0:1651531978.692551:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca5394 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.692553:0:206699:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531978.692554:0:206699:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531978.692556:0:206699:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca538d lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446e5f expref: 7 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531978.692562:0:192754:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca538d lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446e5f expref: 7 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531978.692566:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531978.692566:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531978.692567:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca5394 lrc: 4/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [278528->282623] (req 278528->282623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.692572:0:206699:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca538d lrc: 5/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446e5f expref: 7 pid: 206699 timeout: 22787 lvb_type: 1
00010000:00010000:0.0:1651531978.692576:0:206699:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca538d lrc: 5/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446e5f expref: 7 pid: 206699 timeout: 22787 lvb_type: 1
00010000:00010000:1.0:1651531978.692580:0:192754:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca538d lrc: 5/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446e5f expref: 7 pid: 206699 timeout: 22787 lvb_type: 1
00010000:00010000:1.0:1651531978.692593:0:192754:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca538d lrc: 5/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446e5f expref: 7 pid: 206699 timeout: 22787 lvb_type: 1
00010000:00010000:0.0:1651531978.692597:0:206699:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000775318ab, rc 0)
00000100:00100000:1.0:1651531978.692598:0:192754:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ecb6b3b7 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_005:lustre-OST0001_UUID:192754:1731745997361024:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531978.692610:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009acffcb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438148:x1731754467764480:12345-10.240.43.64@tcp:101:fio.0 Request processed in 73us (113us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531978.692613:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44886
00000100:00100000:1.0:1651531978.692616:0:192754:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ef5806fb going to sleep for 6 seconds
00000100:00100000:0.0:1651531978.692925:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531978.692935:0:169267:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467764672
00010000:00010000:1.0:1651531978.692942:0:169267:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca538d lrc: 5/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446e5f expref: 7 pid: 206699 timeout: 22787 lvb_type: 1
00000100:00100000:1.0:1651531978.692955:0:169267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 290
00000100:00100000:1.0:1651531978.692957:0:169267:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003b5b354a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438147:x1731754467764672:12345-10.240.43.64@tcp:103:ldlm_bl_01.0
00010000:00010000:1.0:1651531978.692960:0:169267:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1651531978.692964:0:169267:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca538d lrc: 5/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446e5f expref: 7 pid: 206699 timeout: 22787 lvb_type: 1
00010000:00010000:1.0:1651531978.692968:0:169267:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca538d lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446e5f expref: 7 pid: 206699 timeout: 22787 lvb_type: 1
00010000:00010000:1.0:1651531978.692974:0:169267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531978.692975:0:169267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531978.692976:0:169267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca5394 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [278528->282623] (req 278528->282623) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.692979:0:169267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca5394 lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [278528->282623] (req 278528->282623) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.692996:0:169267:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1651531978.693007:0:169267:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003b5b354a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438147:x1731754467764672:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 50us (83us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531978.693010:0:169267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 290
00010000:00010000:1.0:1651531978.693021:0:192754:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca538d lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446e5f expref: 6 pid: 206699 timeout: 22787 lvb_type: 1
00000100:00100000:1.0:1651531978.693026:0:192754:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ecb6b3b7 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_005:lustre-OST0001_UUID:192754:1731745997361024:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651531978.693029:0:192754:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca5394 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [278528->282623] (req 278528->282623) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.693033:0:192754:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca5394 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [278528->282623] (req 278528->282623) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.693035:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca5394 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [278528->282623] (req 278528->282623) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531978.693324:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531978.693332:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467764864
00000100:00100000:0.0:1651531978.693342:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250604
00000100:00100000:0.0:1651531978.693344:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004d72f458 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467764864:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531978.693353:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca539b lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.693357:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531978.693358:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531978.693359:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca539b lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [970752->974847] (req 970752->974847) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.693362:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca539b lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [970752->974847] (req 970752->974847) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531978.741367:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869512 is committed
00010000:00010000:1.0:1651531978.741399:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca5394 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [278528->282623] (req 278528->282623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.741403:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca5394 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [278528->282623] (req 278528->282623) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.741418:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca5394 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [278528->282623] (req 278528->282623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531978.741420:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c65d6bc4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467764544:12345-10.240.43.64@tcp:4:fio.0 Request processed in 48876us (48904us total) trans 21474869512 rc 0/0
00010000:00010000:0.0:1651531978.741422:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009c5faf65 already unused, calling callback (0000000049fddea7)
00000100:00100000:1.0:1651531978.741423:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250603
00010000:00010000:0.0:1651531978.741423:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca5394 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [278528->282623] (req 278528->282623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.741427:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca5394 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [278528->282623] (req 278528->282623) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.741432:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca5394 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [278528->282623] (req 278528->282623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.741435:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca5394 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [278528->282623] (req 278528->282623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531978.741766:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531978.741791:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467764992
00000100:00100000:1.0:1651531978.741802:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44887
00000100:00100000:1.0:1651531978.741804:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000091075bf7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467764992:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531978.741808:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531978.741812:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca53a2 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446e6d expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.741820:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca53a2 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446e6d expref: 9 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531978.741824:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca53a2 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446e6d expref: 9 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531978.741828:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f6135e30, rc 0)
00000100:00100000:1.0:1651531978.741838:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000091075bf7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467764992:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (74us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531978.741841:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44887
00000001:00080000:0.0:1651531978.766739:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869513 is committed
00010000:00010000:0.0:1651531978.766753:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca539b lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [970752->974847] (req 970752->974847) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.766757:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca539b lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [970752->974847] (req 970752->974847) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531978.766772:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004d72f458 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438149:x1731754467764864:12345-10.240.43.64@tcp:4:fio.0 Request processed in 73427us (73449us total) trans 21474869513 rc 0/0
00000100:00100000:0.0:1651531978.766775:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250604
00010000:00010000:0.0:1651531978.766781:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca539b lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [970752->974847] (req 970752->974847) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.766784:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f5657138 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531978.766785:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca539b lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [970752->974847] (req 970752->974847) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.766788:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca539b lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [970752->974847] (req 970752->974847) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.766793:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca539b lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [970752->974847] (req 970752->974847) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.766796:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca539b lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [970752->974847] (req 970752->974847) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531978.767138:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531978.767156:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467765568
00000100:00100000:0.0:1651531978.767172:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250605
00000100:00100000:0.0:1651531978.767174:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ecb6b3b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438148:x1731754467765568:12345-10.240.43.64@tcp:4:fio.0
00002000:00010000:0.0:1651531978.767194:0:216321:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34545:0x0] initial LVB size: 6291456, mtime: 0x627060ca, atime: 0x627060b4, ctime: 0x627060ca, blocks: 0x3000
00010000:00010000:0.0:1651531978.767196:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca53a9 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.767200:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531978.767200:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531978.767201:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca53a9 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [1019904->1023999] (req 1019904->1023999) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.767205:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca53a9 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [1019904->1023999] (req 1019904->1023999) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531978.825664:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869514 is committed
00010000:00010000:0.0:1651531978.825677:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca53a9 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [1019904->1023999] (req 1019904->1023999) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.825681:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca53a9 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [1019904->1023999] (req 1019904->1023999) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531978.825696:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ecb6b3b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438148:x1731754467765568:12345-10.240.43.64@tcp:4:fio.0 Request processed in 58521us (58559us total) trans 21474869514 rc 0/0
00000100:00100000:0.0:1651531978.825699:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250605
00010000:00010000:0.0:1651531978.825706:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca53a9 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [1019904->1023999] (req 1019904->1023999) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.825709:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f968d777 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531978.825710:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca53a9 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [1019904->1023999] (req 1019904->1023999) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.825726:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca53a9 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [1019904->1023999] (req 1019904->1023999) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.825731:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca53a9 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [1019904->1023999] (req 1019904->1023999) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.825734:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca53a9 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [1019904->1023999] (req 1019904->1023999) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531978.826084:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531978.826092:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467765696
00000100:00100000:1.0:1651531978.826105:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44888
00000100:00100000:1.0:1651531978.826107:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f47fde78 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438149:x1731754467765696:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531978.826111:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531978.826115:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca53b0 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446e7b expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651531978.826120:0:166113:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34545:0x0] initial LVB size: 6291456, mtime: 0x627060ca, atime: 0x627060b4, ctime: 0x627060ca, blocks: 0x3000
00010000:00010000:1.0:1651531978.826134:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531978.826135:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531978.826137:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca53b0 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446e7b expref: 6 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531978.826142:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca53b0 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446e7b expref: 6 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531978.826146:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f6135e30, rc 0)
00000100:00100000:1.0:1651531978.826161:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f47fde78 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467765696:12345-10.240.43.64@tcp:101:fio.0 Request processed in 53us (77us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531978.826163:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44888
00000100:00100000:0.0:1651531978.826721:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531978.826728:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467765952
00000100:00100000:0.0:1651531978.826742:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250606
00000100:00100000:0.0:1651531978.826744:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bfdd313b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438148:x1731754467765952:12345-10.240.43.64@tcp:3:fio.0
00000100:00100000:1.0:1651531978.826749:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651531978.826751:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca53b7 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.826761:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00000100:00100000:1.0:1651531978.826762:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467765888
00010000:00010000:0.0:1651531978.826762:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531978.826763:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca53b7 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [1040384->1044479] (req 1040384->1044479) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.826767:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca53b7 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [1040384->1044479] (req 1040384->1044479) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531978.826772:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250607
00000100:00100000:1.0:1651531978.826774:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bcdb3319 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438148:x1731754467765888:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531978.826779:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca53b7 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [1040384->1044479] (req 1040384->1044479) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.826781:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca53be lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.826782:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca53b7 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [1040384->1044479] (req 1040384->1044479) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.826797:0:192754:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca53b0 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446e7b expref: 7 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531978.826800:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531978.826801:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531978.826801:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca53be lrc: 4/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [376832->380927] (req 376832->380927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531978.826808:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bfdd313b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438148:x1731754467765952:12345-10.240.43.64@tcp:3:fio.0 Request processed in 63us (88us total) trans 0 rc 4096/4096
00010000:00010000:1.0:1651531978.826809:0:192754:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca53b0 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446e7b expref: 7 pid: 166113 timeout: 0 lvb_type: 1
00000100:00100000:0.0:1651531978.826811:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250606
00010000:00010000:1.0:1651531978.826815:0:192754:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca53b0 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446e7b expref: 6 pid: 166113 timeout: 22787 lvb_type: 1
00000100:00100000:1.0:1651531978.826819:0:192754:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000065be21ea pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_005:lustre-OST0001_UUID:192754:1731745997361088:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651531978.826819:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca53b7 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [1040384->1044479] (req 1040384->1044479) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.826822:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f5657138 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531978.826823:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca53b7 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [1040384->1044479] (req 1040384->1044479) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.826826:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca53b7 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [1040384->1044479] (req 1040384->1044479) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531978.826831:0:192754:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ef5806fb going to sleep for 6 seconds
00010000:00010000:0.0:1651531978.826831:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca53b7 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [1040384->1044479] (req 1040384->1044479) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.826834:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca53b7 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [1040384->1044479] (req 1040384->1044479) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531978.827107:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531978.827116:0:169267:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467766272
00010000:00010000:1.0:1651531978.827123:0:169267:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca53b0 lrc: 5/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446e7b expref: 7 pid: 166113 timeout: 22787 lvb_type: 1
00000100:00100000:1.0:1651531978.827133:0:169267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 291
00000100:00100000:1.0:1651531978.827135:0:169267:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ac545f3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438147:x1731754467766272:12345-10.240.43.64@tcp:103:ldlm_bl_04.0
00010000:00010000:1.0:1651531978.827138:0:169267:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1651531978.827142:0:169267:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca53b0 lrc: 5/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446e7b expref: 7 pid: 166113 timeout: 22787 lvb_type: 1
00010000:00010000:1.0:1651531978.827146:0:169267:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca53b0 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446e7b expref: 7 pid: 166113 timeout: 22787 lvb_type: 1
00010000:00010000:1.0:1651531978.827152:0:169267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531978.827152:0:169267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531978.827153:0:169267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca53be lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [376832->380927] (req 376832->380927) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.827156:0:169267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca53be lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [376832->380927] (req 376832->380927) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.827165:0:169267:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1651531978.827175:0:169267:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ac545f3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438147:x1731754467766272:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 40us (69us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531978.827178:0:169267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 291
00010000:00010000:1.0:1651531978.827189:0:192754:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca53b0 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446e7b expref: 6 pid: 166113 timeout: 22787 lvb_type: 1
00000100:00100000:1.0:1651531978.827193:0:192754:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000065be21ea pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_005:lustre-OST0001_UUID:192754:1731745997361088:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651531978.827196:0:192754:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca53be lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [376832->380927] (req 376832->380927) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.827200:0:192754:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca53be lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [376832->380927] (req 376832->380927) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.827202:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca53be lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [376832->380927] (req 376832->380927) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531978.879661:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869515 is committed
00010000:00010000:1.0:1651531978.879692:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca53be lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [376832->380927] (req 376832->380927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.879697:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca53be lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [376832->380927] (req 376832->380927) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531978.879717:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bcdb3319 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438148:x1731754467765888:12345-10.240.43.64@tcp:4:fio.0 Request processed in 52942us (52968us total) trans 21474869515 rc 0/0
00010000:00010000:0.0:1651531978.879719:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca53be lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [376832->380927] (req 376832->380927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531978.879720:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250607
00010000:00010000:0.0:1651531978.879724:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d3014069 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531978.879725:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca53be lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [376832->380927] (req 376832->380927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.879732:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca53be lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [376832->380927] (req 376832->380927) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.879738:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca53be lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [376832->380927] (req 376832->380927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.879740:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca53be lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [376832->380927] (req 376832->380927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531978.880884:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531978.880893:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531978.880910:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467766656
00000100:00100000:1.0:1651531978.880913:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531978.880922:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467766784
00000100:00100000:0.0:1651531978.880928:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467766912
00000100:00100000:0.0:1651531978.880935:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44889
00000100:00100000:0.0:1651531978.880937:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000065be21ea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438149:x1731754467766656:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651531978.880940:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44890
00010000:00010000:0.0:1651531978.880941:0:206699:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651531978.880943:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001acc9aee pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438149:x1731754467766784:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531978.880945:0:206699:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca53c5 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446e89 expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.880947:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00002000:00010000:0.0:1651531978.880950:0:206699:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34545:0x0] initial LVB size: 6291456, mtime: 0x627060ca, atime: 0x627060b4, ctime: 0x627060ca, blocks: 0x3000
00010000:00010000:1.0:1651531978.880951:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca53cc lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446e97 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.880955:0:206699:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531978.880955:0:206699:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531978.880958:0:206699:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca53c5 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446e89 expref: 9 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531978.880962:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531978.880963:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531978.880965:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca53cc lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446e97 expref: 9 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531978.880970:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca53cc lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446e97 expref: 9 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531978.880970:0:206699:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca53c5 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446e89 expref: 9 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531978.880974:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f6135e30, rc 0)
00010000:00010000:0.0:1651531978.880978:0:206699:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f5657138, rc 0)
00000100:00100000:1.0:1651531978.880984:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001acc9aee pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438149:x1731754467766784:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (91us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531978.880987:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44890
00000100:00100000:0.0:1651531978.880988:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000065be21ea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438149:x1731754467766656:12345-10.240.43.64@tcp:101:fio.0 Request processed in 51us (105us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531978.880991:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44889
00000100:00100000:1.0:1651531978.880993:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44891
00000100:00100000:1.0:1651531978.880995:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000e33e11e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438149:x1731754467766912:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531978.880997:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531978.881000:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca53d3 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446ea5 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.881008:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531978.881008:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531978.881010:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca53d3 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446ea5 expref: 8 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531978.881013:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca53d3 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446ea5 expref: 8 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531978.881017:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f58aeba9, rc 0)
00000100:00100000:1.0:1651531978.881022:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000e33e11e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467766912:12345-10.240.43.64@tcp:101:fio.0 Request processed in 28us (109us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531978.881025:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44891
00000100:00100000:1.0:1651531978.922405:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531978.922415:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467767424
00000100:00100000:1.0:1651531978.922426:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250608
00000100:00100000:1.0:1651531978.922427:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006c46ca95 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467767424:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531978.922435:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca53da lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.922439:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531978.922440:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531978.922441:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca53da lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [733184->737279] (req 733184->737279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.922445:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca53da lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [733184->737279] (req 733184->737279) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.922461:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca53da lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [733184->737279] (req 733184->737279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.922465:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca53da lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [733184->737279] (req 733184->737279) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.922484:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca53da lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [733184->737279] (req 733184->737279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531978.922486:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006c46ca95 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467767424:12345-10.240.43.64@tcp:3:fio.0 Request processed in 58us (81us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531978.922489:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250608
00010000:00010000:0.0:1651531978.922489:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000022b2104e already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531978.922490:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca53da lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [733184->737279] (req 733184->737279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.922493:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca53da lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [733184->737279] (req 733184->737279) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.922499:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca53da lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [733184->737279] (req 733184->737279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.922501:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca53da lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [733184->737279] (req 733184->737279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531978.923075:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531978.923084:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467767936
00000100:00100000:1.0:1651531978.923093:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250609
00000100:00100000:1.0:1651531978.923095:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000021f31110 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467767936:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531978.923102:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca53e1 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.923107:0:166118:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca53c5 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446e89 expref: 8 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531978.923110:0:166118:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca53cc lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446e97 expref: 8 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531978.923113:0:166118:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca53d3 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446ea5 expref: 8 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531978.923116:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531978.923117:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531978.923118:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca53e1 lrc: 6/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [12288->16383] (req 12288->16383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.923125:0:166118:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca53d3 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446ea5 expref: 8 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531978.923130:0:166118:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca53d3 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446ea5 expref: 8 pid: 166112 timeout: 22787 lvb_type: 1
00000100:00100000:1.0:1651531978.923134:0:166118:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000aa58c961 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:166118:1731745997361152:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651531978.923148:0:166118:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca53cc lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446e97 expref: 8 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531978.923151:0:166118:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca53cc lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446e97 expref: 8 pid: 166112 timeout: 22787 lvb_type: 1
00000100:00100000:1.0:1651531978.923155:0:166118:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003158b8a7 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:166118:1731745997361216:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651531978.923161:0:166118:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca53c5 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446e89 expref: 8 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531978.923165:0:166118:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca53c5 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446e89 expref: 8 pid: 206699 timeout: 22787 lvb_type: 1
00000100:00100000:1.0:1651531978.923168:0:166118:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cc11a3b9 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:166118:1731745997361280:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531978.923183:0:166118:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ef5806fb going to sleep for 6 seconds
00000100:00100000:1.0:1651531978.923532:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531978.923538:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531978.923551:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531978.923563:0:166118:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000aa58c961 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:166118:1731745997361152:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531978.923563:0:166103:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467768320
00000100:00100000:1.0:1651531978.923567:0:166118:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003158b8a7 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:166118:1731745997361216:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531978.923569:0:166118:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cc11a3b9 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:166118:1731745997361280:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651531978.923570:0:166103:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca53d3 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446ea5 expref: 9 pid: 166112 timeout: 22787 lvb_type: 1
00010000:00010000:1.0:1651531978.923574:0:166118:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca53e1 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [12288->16383] (req 12288->16383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531978.923577:0:166103:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 292
00000100:00100000:0.0:1651531978.923579:0:166103:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000000615301 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438149:x1731754467768320:12345-10.240.43.64@tcp:103:ldlm_bl_03.0
00000100:00100000:1.0:1651531978.923581:0:169267:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467768384
00010000:00010000:0.0:1651531978.923583:0:166103:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1651531978.923586:0:169267:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca53cc lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446e97 expref: 10 pid: 166112 timeout: 22787 lvb_type: 1
00010000:00010000:0.0:1651531978.923587:0:166103:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca53d3 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446ea5 expref: 10 pid: 166112 timeout: 22787 lvb_type: 1
00000100:00100000:1.0:1651531978.923592:0:169267:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467768448
00010000:00010000:0.0:1651531978.923592:0:166103:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca53d3 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446ea5 expref: 10 pid: 166112 timeout: 22787 lvb_type: 1
00010000:00010000:1.0:1651531978.923594:0:169267:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca53c5 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446e89 expref: 11 pid: 206699 timeout: 22787 lvb_type: 1
00010000:00010000:0.0:1651531978.923597:0:166103:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca53d3 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446ea5 expref: 11 pid: 166112 timeout: 22787 lvb_type: 1
00000100:00100000:1.0:1651531978.923599:0:169267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 293
00000100:00100000:1.0:1651531978.923601:0:169267:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000053de45f6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754467768384:12345-10.240.43.64@tcp:103:ldlm_bl_03.0
00010000:00010000:0.0:1651531978.923601:0:166103:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1651531978.923603:0:169267:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1651531978.923607:0:169267:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca53cc lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446e97 expref: 10 pid: 166112 timeout: 22787 lvb_type: 1
00010000:00010000:1.0:1651531978.923611:0:169267:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca53cc lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446e97 expref: 10 pid: 166112 timeout: 22787 lvb_type: 1
00000100:00100000:0.0:1651531978.923616:0:166103:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000000615301 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754467768320:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 36us (85us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531978.923619:0:166103:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 292
00000100:00100000:0.0:1651531978.923625:0:166103:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 294
00000100:00100000:0.0:1651531978.923626:0:166103:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003d9ef3c1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438147:x1731754467768448:12345-10.240.43.64@tcp:103:ldlm_bl_05.0
00010000:00010000:1.0:1651531978.923628:0:169267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca53cc lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446e97 expref: 9 pid: 166112 timeout: 22787 lvb_type: 1
00010000:00010000:0.0:1651531978.923629:0:166103:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531978.923632:0:166103:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca53c5 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446e89 expref: 8 pid: 206699 timeout: 22787 lvb_type: 1
00010000:00010000:1.0:1651531978.923633:0:169267:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1651531978.923636:0:166103:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca53c5 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446e89 expref: 8 pid: 206699 timeout: 22787 lvb_type: 1
00000100:00100000:1.0:1651531978.923640:0:169267:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000053de45f6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467768384:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 39us (102us total) trans 0 rc 0/0
00010000:00010000:0.0:1651531978.923641:0:166103:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca53c5 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446e89 expref: 8 pid: 206699 timeout: 22787 lvb_type: 1
00000100:00100000:1.0:1651531978.923643:0:169267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 293
00010000:00010000:0.0:1651531978.923648:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531978.923649:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531978.923650:0:166103:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca53e1 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [12288->16383] (req 12288->16383) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.923653:0:166103:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca53e1 lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [12288->16383] (req 12288->16383) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.923662:0:166103:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651531978.923669:0:166103:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003d9ef3c1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438147:x1731754467768448:12345-10.240.43.64@tcp:103:ldlm_bl_05.0 Request processed in 42us (117us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531978.923671:0:166103:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 294
00010000:00010000:1.0:1651531978.923701:0:166118:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca53e1 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [12288->16383] (req 12288->16383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.923705:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca53e1 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [12288->16383] (req 12288->16383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531978.923853:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531978.923864:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467768576
00000100:00100000:0.0:1651531978.923875:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44892
00000100:00100000:0.0:1651531978.923877:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c0b460ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467768576:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531978.923880:0:167632:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531978.923884:0:167632:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca53e8 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446eb3 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.923891:0:167632:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca53e8 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446eb3 expref: 9 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531978.923896:0:167632:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca53e8 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446eb3 expref: 9 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531978.923899:0:167632:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f968d777, rc 0)
00000100:00100000:0.0:1651531978.923916:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c0b460ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467768576:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (64us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531978.923919:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44892
00000001:00080000:0.0:1651531978.972444:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869516 is committed
00010000:00010000:1.0:1651531978.972476:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca53e1 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [12288->16383] (req 12288->16383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.972480:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca53e1 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [12288->16383] (req 12288->16383) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531978.972502:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000021f31110 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438148:x1731754467767936:12345-10.240.43.64@tcp:4:fio.0 Request processed in 49406us (49427us total) trans 21474869516 rc 0/0
00010000:00010000:0.0:1651531978.972502:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca53e1 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [12288->16383] (req 12288->16383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531978.972505:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250609
00010000:00010000:0.0:1651531978.972506:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d3014069 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531978.972507:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca53e1 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [12288->16383] (req 12288->16383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.972511:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca53e1 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [12288->16383] (req 12288->16383) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.972516:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca53e1 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [12288->16383] (req 12288->16383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.972519:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca53e1 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [12288->16383] (req 12288->16383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531978.972888:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531978.972896:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467768960
00000100:00100000:1.0:1651531978.972907:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250610
00000100:00100000:1.0:1651531978.972908:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006e255cae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438149:x1731754467768960:12345-10.240.43.64@tcp:4:fio.0
00002000:00010000:1.0:1651531978.972927:0:166118:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34545:0x0] initial LVB size: 6291456, mtime: 0x627060ca, atime: 0x627060b4, ctime: 0x627060ca, blocks: 0x3000
00010000:00010000:1.0:1651531978.972929:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca53ef lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.972933:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531978.972934:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531978.972935:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca53ef lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [86016->90111] (req 86016->90111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.972939:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca53ef lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [86016->90111] (req 86016->90111) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531978.973136:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531978.973155:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467769216
00000100:00100000:1.0:1651531978.973164:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44893
00000100:00100000:1.0:1651531978.973166:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c4ea889e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467769216:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531978.973169:0:167632:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531978.973173:0:167632:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca53f6 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446ecf expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.973181:0:167632:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca53f6 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446ecf expref: 9 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531978.973185:0:167632:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca53f6 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446ecf expref: 9 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531978.973189:0:167632:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009c5faf65, rc 0)
00000100:00100000:1.0:1651531978.973201:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c4ea889e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467769216:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (66us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531978.973204:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44893
00000100:00100000:1.0:1651531978.973256:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531978.973294:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467769152
00000100:00100000:1.0:1651531978.973307:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44894
00000100:00100000:1.0:1651531978.973308:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000059e5b3a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467769152:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531978.973312:0:167632:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531978.973315:0:167632:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca53fd lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446ec8 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.973323:0:167632:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca53fd lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446ec8 expref: 9 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531978.973327:0:167632:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca53fd lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446ec8 expref: 9 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531978.973330:0:167632:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008b0c325f, rc 0)
00000100:00100000:1.0:1651531978.973340:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000059e5b3a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467769152:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (85us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531978.973342:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44894
00000100:00100000:1.0:1651531978.973723:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531978.973731:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467769536
00000100:00100000:1.0:1651531978.973746:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250611
00000100:00100000:1.0:1651531978.973748:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003562cf4d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467769536:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531978.973762:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5404 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.973768:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531978.973769:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531978.973769:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5404 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [802816->806911] (req 802816->806911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.973774:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5404 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [802816->806911] (req 802816->806911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.973786:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5404 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [802816->806911] (req 802816->806911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.973789:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5404 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [802816->806911] (req 802816->806911) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.973807:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5404 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [802816->806911] (req 802816->806911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531978.973808:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003562cf4d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467769536:12345-10.240.43.64@tcp:3:fio.0 Request processed in 60us (85us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531978.973811:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250611
00010000:00010000:0.0:1651531978.973811:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f6ecb7e5 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531978.973812:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5404 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [802816->806911] (req 802816->806911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.973815:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5404 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [802816->806911] (req 802816->806911) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.973824:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5404 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [802816->806911] (req 802816->806911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531978.973827:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5404 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [802816->806911] (req 802816->806911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531978.974165:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531978.974181:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467769856
00000100:00100000:1.0:1651531978.974192:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44895
00000100:00100000:1.0:1651531978.974194:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f7006631 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467769856:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531978.974197:0:167632:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531978.974201:0:167632:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca540b lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446edd expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531978.974208:0:167632:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca540b lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446edd expref: 9 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531978.974237:0:167632:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca540b lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446edd expref: 9 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531978.974241:0:167632:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c806f265, rc 0)
00000100:00100000:1.0:1651531978.974251:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f7006631 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467769856:12345-10.240.43.64@tcp:101:fio.0 Request processed in 57us (87us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531978.974254:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44895
00000001:00080000:0.0:1651531979.009305:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869517 is committed
00010000:00010000:1.0:1651531979.009335:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca53ef lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [86016->90111] (req 86016->90111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.009340:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca53ef lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [86016->90111] (req 86016->90111) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531979.009360:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006e255cae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438149:x1731754467768960:12345-10.240.43.64@tcp:4:fio.0 Request processed in 36450us (36471us total) trans 21474869517 rc 0/0
00010000:00010000:0.0:1651531979.009361:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca53ef lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [86016->90111] (req 86016->90111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531979.009363:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250610
00010000:00010000:0.0:1651531979.009366:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f6135e30 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531979.009367:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca53ef lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [86016->90111] (req 86016->90111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.009370:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca53ef lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [86016->90111] (req 86016->90111) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.009375:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca53ef lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [86016->90111] (req 86016->90111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.009378:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca53ef lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [86016->90111] (req 86016->90111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531979.009709:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531979.009717:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467770240
00000100:00100000:1.0:1651531979.009729:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44896
00000100:00100000:1.0:1651531979.009731:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c683c211 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438148:x1731754467770240:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531979.009734:0:167632:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531979.009739:0:167632:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5412 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446eeb expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651531979.009744:0:167632:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34545:0x0] initial LVB size: 6291456, mtime: 0x627060ca, atime: 0x627060b4, ctime: 0x627060ca, blocks: 0x3000
00010000:00010000:1.0:1651531979.009749:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531979.009750:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531979.009752:0:167632:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5412 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446eeb expref: 6 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531979.009756:0:167632:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5412 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446eeb expref: 6 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531979.009760:0:167632:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c806f265, rc 0)
00000100:00100000:1.0:1651531979.009770:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c683c211 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438148:x1731754467770240:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (62us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531979.009773:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44896
00000100:00100000:1.0:1651531979.010158:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531979.010166:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467770368
00000100:00100000:1.0:1651531979.010175:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250612
00000100:00100000:1.0:1651531979.010177:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000009c4c564 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467770368:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531979.010184:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca5419 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.010188:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531979.010189:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531979.010190:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca5419 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [90112->94207] (req 90112->94207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.010194:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca5419 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [90112->94207] (req 90112->94207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.010205:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca5419 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [90112->94207] (req 90112->94207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.010243:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca5419 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [90112->94207] (req 90112->94207) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.010254:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca5419 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [90112->94207] (req 90112->94207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.010258:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008b0c325f already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531979.010260:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca5419 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [90112->94207] (req 90112->94207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531979.010261:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000009c4c564 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467770368:12345-10.240.43.64@tcp:3:fio.0 Request processed in 82us (103us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531979.010264:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250612
00010000:00010000:0.0:1651531979.010264:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca5419 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [90112->94207] (req 90112->94207) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.010269:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca5419 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [90112->94207] (req 90112->94207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.010272:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca5419 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [90112->94207] (req 90112->94207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531979.022983:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531979.022991:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467770816
00000100:00100000:1.0:1651531979.023006:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250613
00000100:00100000:1.0:1651531979.023007:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a925fbf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438147:x1731754467770816:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531979.023015:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca5420 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.023019:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531979.023019:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531979.023020:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca5420 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.023024:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca5420 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.023035:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca5420 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.023038:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca5420 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.023067:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca5420 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531979.023069:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a925fbf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438147:x1731754467770816:12345-10.240.43.64@tcp:3:fio.0 Request processed in 61us (86us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531979.023072:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250613
00010000:00010000:0.0:1651531979.023072:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009c5faf65 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531979.023073:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca5420 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.023076:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca5420 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.023081:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca5420 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.023084:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca5420 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531979.107043:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531979.107051:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467772352
00000100:00100000:1.0:1651531979.107066:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250614
00000100:00100000:1.0:1651531979.107067:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cc11a3b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438148:x1731754467772352:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531979.107074:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca5427 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.107079:0:166118:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5412 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446eeb expref: 6 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531979.107082:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531979.107083:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531979.107084:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca5427 lrc: 4/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [737280->741375] (req 737280->741375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.107090:0:166118:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5412 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446eeb expref: 6 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531979.107094:0:166118:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5412 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446eeb expref: 6 pid: 167632 timeout: 22787 lvb_type: 1
00000100:00100000:1.0:1651531979.107099:0:166118:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003158b8a7 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:166118:1731745997361344:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531979.107111:0:166118:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ef5806fb going to sleep for 6 seconds
00000100:00100000:1.0:1651531979.107137:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531979.107158:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467772480
00000100:00100000:0.0:1651531979.107172:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250615
00000100:00100000:0.0:1651531979.107174:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aa58c961 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438149:x1731754467772480:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531979.107183:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca542e lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.107188:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531979.107189:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531979.107190:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca542e lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [430080->434175] (req 430080->434175) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.107194:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca542e lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [430080->434175] (req 430080->434175) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.107208:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca542e lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [430080->434175] (req 430080->434175) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.107211:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca542e lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [430080->434175] (req 430080->434175) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531979.107254:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aa58c961 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438149:x1731754467772480:12345-10.240.43.64@tcp:3:fio.0 Request processed in 79us (117us total) trans 0 rc 4096/4096
00010000:00010000:1.0:1651531979.107258:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca542e lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [430080->434175] (req 430080->434175) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531979.107258:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250615
00010000:00010000:1.0:1651531979.107262:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f968d777 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531979.107263:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca542e lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [430080->434175] (req 430080->434175) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.107267:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca542e lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [430080->434175] (req 430080->434175) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.107273:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca542e lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [430080->434175] (req 430080->434175) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.107276:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca542e lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [430080->434175] (req 430080->434175) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531979.107396:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531979.107408:0:166118:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003158b8a7 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:166118:1731745997361344:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531979.107410:0:166102:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467772544
00010000:00010000:1.0:1651531979.107413:0:166118:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca5427 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [737280->741375] (req 737280->741375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.107417:0:166102:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5412 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446eeb expref: 7 pid: 167632 timeout: 22787 lvb_type: 1
00000100:00100000:0.0:1651531979.107425:0:166102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 295
00000100:00100000:0.0:1651531979.107427:0:166102:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005f0747aa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438147:x1731754467772544:12345-10.240.43.64@tcp:103:ldlm_bl_01.0
00010000:00010000:0.0:1651531979.107430:0:166102:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531979.107434:0:166102:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5412 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446eeb expref: 7 pid: 167632 timeout: 22787 lvb_type: 1
00010000:00010000:0.0:1651531979.107439:0:166102:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5412 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446eeb expref: 7 pid: 167632 timeout: 22787 lvb_type: 1
00010000:00010000:0.0:1651531979.107445:0:166102:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5412 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446eeb expref: 7 pid: 167632 timeout: 22787 lvb_type: 1
00010000:00010000:0.0:1651531979.107449:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531979.107449:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531979.107450:0:166102:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca5427 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [737280->741375] (req 737280->741375) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.107453:0:166102:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca5427 lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [737280->741375] (req 737280->741375) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.107465:0:166102:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1651531979.107474:0:166118:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca5427 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [737280->741375] (req 737280->741375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531979.107477:0:166102:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005f0747aa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438147:x1731754467772544:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 49us (81us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531979.107480:0:166102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 295
00010000:00010000:1.0:1651531979.107482:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca5427 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [737280->741375] (req 737280->741375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531979.107582:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531979.107608:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467772672
00000100:00100000:1.0:1651531979.107627:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44897
00000100:00100000:1.0:1651531979.107630:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003158b8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467772672:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531979.107635:0:167632:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531979.107641:0:167632:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca5435 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446ef9 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.107660:0:167632:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca5435 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446ef9 expref: 9 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531979.107665:0:167632:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca5435 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446ef9 expref: 9 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531979.107668:0:167632:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000060a6272d, rc 0)
00000100:00100000:1.0:1651531979.107679:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003158b8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467772672:12345-10.240.43.64@tcp:101:fio.0 Request processed in 49us (98us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531979.107682:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44897
00000100:00100000:1.0:1651531979.107996:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531979.108008:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467772800
00000100:00100000:0.0:1651531979.108023:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250616
00000100:00100000:0.0:1651531979.108025:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000000615301 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467772800:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531979.108033:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca543c lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.108037:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531979.108038:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531979.108039:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca543c lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [94208->98303] (req 94208->98303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.108044:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca543c lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [94208->98303] (req 94208->98303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.108056:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca543c lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [94208->98303] (req 94208->98303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.108060:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca543c lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [94208->98303] (req 94208->98303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531979.108081:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000000615301 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467772800:12345-10.240.43.64@tcp:3:fio.0 Request processed in 54us (85us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531979.108084:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250616
00010000:00010000:0.0:1651531979.108091:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca543c lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [94208->98303] (req 94208->98303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.108094:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f5657138 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531979.108095:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca543c lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [94208->98303] (req 94208->98303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.108098:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca543c lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [94208->98303] (req 94208->98303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.108102:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca543c lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [94208->98303] (req 94208->98303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.108105:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca543c lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [94208->98303] (req 94208->98303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531979.108380:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531979.108387:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467772928
00000100:00100000:1.0:1651531979.108398:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44898
00000100:00100000:1.0:1651531979.108399:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000053de45f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467772928:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531979.108403:0:167632:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531979.108406:0:167632:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca5443 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446f07 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.108414:0:167632:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca5443 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446f07 expref: 9 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531979.108419:0:167632:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca5443 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446f07 expref: 9 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531979.108422:0:167632:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000eebd17a1, rc 0)
00000100:00100000:1.0:1651531979.108432:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000053de45f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467772928:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (53us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531979.108434:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44898
00000100:00100000:1.0:1651531979.109108:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531979.109115:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467773184
00000100:00100000:1.0:1651531979.109127:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44899
00000100:00100000:1.0:1651531979.109129:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d710c5fd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467773184:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531979.109132:0:167632:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531979.109136:0:167632:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca544a lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446f15 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.109143:0:167632:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca544a lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446f15 expref: 9 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531979.109147:0:167632:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca544a lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446f15 expref: 9 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531979.109150:0:167632:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f2af03c8, rc 0)
00000100:00100000:1.0:1651531979.109159:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d710c5fd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467773184:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (52us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531979.109161:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44899
00000100:00100000:1.0:1651531979.109469:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531979.109479:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467773312
00000100:00100000:0.0:1651531979.109493:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250617
00000100:00100000:0.0:1651531979.109495:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002512e905 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467773312:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531979.109502:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca5451 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.109506:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531979.109507:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531979.109508:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca5451 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [475136->479231] (req 475136->479231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.109511:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca5451 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [475136->479231] (req 475136->479231) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.109522:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca5451 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [475136->479231] (req 475136->479231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.109525:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca5451 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [475136->479231] (req 475136->479231) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531979.109546:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002512e905 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467773312:12345-10.240.43.64@tcp:3:fio.0 Request processed in 49us (77us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531979.109548:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250617
00010000:00010000:0.0:1651531979.109555:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca5451 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [475136->479231] (req 475136->479231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.109558:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000080362f27 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531979.109561:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca5451 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [475136->479231] (req 475136->479231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.109564:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca5451 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [475136->479231] (req 475136->479231) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.109568:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca5451 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [475136->479231] (req 475136->479231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.109571:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca5451 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [475136->479231] (req 475136->479231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531979.143932:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869518 is committed
00002000:00010000:1.0:1651531979.143960:0:166118:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x34545:0x0] updating lvb mtime from disk: 1651531978 -> 1651531979
00002000:00010000:1.0:1651531979.143962:0:166118:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x34545:0x0] updating lvb ctime from disk: 1651531978 -> 1651531979
00010000:00010000:1.0:1651531979.143965:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca5427 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [737280->741375] (req 737280->741375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.143969:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca5427 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [737280->741375] (req 737280->741375) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531979.143985:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cc11a3b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438148:x1731754467772352:12345-10.240.43.64@tcp:4:fio.0 Request processed in 36916us (36942us total) trans 21474869518 rc 0/0
00000100:00100000:1.0:1651531979.143988:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250614
00010000:00010000:1.0:1651531979.143995:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca5427 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [737280->741375] (req 737280->741375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.143998:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c8969b4f already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531979.143999:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca5427 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [737280->741375] (req 737280->741375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.144002:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca5427 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [737280->741375] (req 737280->741375) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.144007:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca5427 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [737280->741375] (req 737280->741375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.144010:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca5427 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [737280->741375] (req 737280->741375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531979.144357:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531979.144365:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467773568
00000100:00100000:1.0:1651531979.144378:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44900
00000100:00100000:1.0:1651531979.144380:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000374facb9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438149:x1731754467773568:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531979.144384:0:167632:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531979.144388:0:167632:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca5458 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446f23 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651531979.144393:0:167632:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34545:0x0] initial LVB size: 6291456, mtime: 0x627060cb, atime: 0x627060b4, ctime: 0x627060cb, blocks: 0x3000
00010000:00010000:1.0:1651531979.144397:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531979.144398:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531979.144399:0:167632:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca5458 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446f23 expref: 6 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531979.144404:0:167632:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca5458 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446f23 expref: 6 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531979.144408:0:167632:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f2af03c8, rc 0)
00000100:00100000:1.0:1651531979.144418:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000374facb9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467773568:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (62us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531979.144421:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44900
00000100:00100000:1.0:1651531979.156434:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531979.156442:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467773824
00000100:00100000:1.0:1651531979.156456:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250618
00000100:00100000:1.0:1651531979.156458:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009b569a7a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467773824:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531979.156465:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca545f lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.156473:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531979.156473:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531979.156474:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca545f lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [741376->745471] (req 741376->745471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.156478:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca545f lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [741376->745471] (req 741376->745471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.156497:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca545f lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [741376->745471] (req 741376->745471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.156501:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca545f lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [741376->745471] (req 741376->745471) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531979.156520:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009b569a7a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467773824:12345-10.240.43.64@tcp:3:fio.0 Request processed in 61us (86us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531979.156523:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250618
00010000:00010000:0.0:1651531979.156524:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca545f lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [741376->745471] (req 741376->745471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.156528:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c8969b4f already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531979.156529:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca545f lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [741376->745471] (req 741376->745471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.156533:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca545f lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [741376->745471] (req 741376->745471) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.156538:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca545f lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [741376->745471] (req 741376->745471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.156541:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca545f lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [741376->745471] (req 741376->745471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531979.156557:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531979.156589:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467774208
00000100:00100000:1.0:1651531979.156603:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250619
00000100:00100000:1.0:1651531979.156605:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002ef35a72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438148:x1731754467774208:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531979.156612:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca5466 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.156616:0:166118:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca5458 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446f23 expref: 6 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531979.156623:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531979.156624:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531979.156625:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca5466 lrc: 4/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [106496->110591] (req 106496->110591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.156631:0:166118:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca5458 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446f23 expref: 6 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531979.156635:0:166118:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca5458 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446f23 expref: 6 pid: 167632 timeout: 22787 lvb_type: 1
00000100:00100000:1.0:1651531979.156640:0:166118:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000063869776 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:166118:1731745997361408:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531979.156652:0:166118:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ef5806fb going to sleep for 6 seconds
00000100:00100000:1.0:1651531979.156941:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531979.156956:0:166118:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000063869776 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:166118:1731745997361408:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531979.156959:0:166104:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467774336
00010000:00010000:1.0:1651531979.156960:0:166118:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca5466 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [106496->110591] (req 106496->110591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.156968:0:166104:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca5458 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446f23 expref: 7 pid: 167632 timeout: 22787 lvb_type: 1
00000100:00100000:0.0:1651531979.156977:0:166104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 296
00000100:00100000:0.0:1651531979.156978:0:166104:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000be87d738 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438147:x1731754467774336:12345-10.240.43.64@tcp:103:ldlm_bl_02.0
00010000:00010000:0.0:1651531979.156982:0:166104:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531979.156986:0:166104:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca5458 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446f23 expref: 7 pid: 167632 timeout: 22787 lvb_type: 1
00010000:00010000:0.0:1651531979.156990:0:166104:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca5458 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446f23 expref: 7 pid: 167632 timeout: 22787 lvb_type: 1
00010000:00010000:0.0:1651531979.156996:0:166104:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca5458 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446f23 expref: 7 pid: 167632 timeout: 22787 lvb_type: 1
00010000:00010000:0.0:1651531979.156999:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531979.157000:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531979.157001:0:166104:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca5466 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [106496->110591] (req 106496->110591) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.157004:0:166104:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca5466 lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [106496->110591] (req 106496->110591) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.157017:0:166104:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651531979.157027:0:166104:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000be87d738 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438147:x1731754467774336:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 48us (87us total) trans 0 rc 0/0
00010000:00010000:1.0:1651531979.157030:0:166118:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca5466 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [106496->110591] (req 106496->110591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531979.157030:0:166104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 296
00010000:00010000:1.0:1651531979.157034:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca5466 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [106496->110591] (req 106496->110591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531979.157151:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531979.157159:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467774528
00000100:00100000:1.0:1651531979.157174:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44901
00000100:00100000:1.0:1651531979.157176:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000063869776 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467774528:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531979.157188:0:167632:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531979.157192:0:167632:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca546d lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446f31 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.157201:0:167632:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca546d lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446f31 expref: 9 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531979.157205:0:167632:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca546d lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446f31 expref: 9 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531979.157208:0:167632:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000060a6272d, rc 0)
00000100:00100000:1.0:1651531979.157240:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000063869776 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467774528:12345-10.240.43.64@tcp:101:fio.0 Request processed in 63us (89us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531979.157242:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44901
00000100:00100000:1.0:1651531979.157441:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531979.157448:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467774656
00000100:00100000:1.0:1651531979.157459:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44902
00000100:00100000:1.0:1651531979.157460:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000052213cb9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467774656:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531979.157464:0:167632:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531979.157467:0:167632:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5474 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446f3f expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.157475:0:167632:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5474 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446f3f expref: 9 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531979.157483:0:167632:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5474 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446f3f expref: 9 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531979.157486:0:167632:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000000bb25cc, rc 0)
00000100:00100000:1.0:1651531979.157496:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000052213cb9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467774656:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (55us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531979.157498:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44902
00000100:00100000:1.0:1651531979.158104:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531979.158112:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467775040
00000100:00100000:1.0:1651531979.158124:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44903
00000100:00100000:1.0:1651531979.158125:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005dd15341 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467775040:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531979.158129:0:167632:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531979.158132:0:167632:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca547b lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446f4d expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.158140:0:167632:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca547b lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446f4d expref: 9 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531979.158144:0:167632:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca547b lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446f4d expref: 9 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531979.158147:0:167632:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001cf49bf2, rc 0)
00000100:00100000:1.0:1651531979.158156:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005dd15341 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467775040:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (53us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531979.158159:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44903
00000100:00100000:1.0:1651531979.158397:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531979.158409:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467775168
00000100:00100000:0.0:1651531979.158424:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250620
00000100:00100000:0.0:1651531979.158426:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007a05c3e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467775168:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531979.158433:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca5482 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.158437:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531979.158438:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531979.158439:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca5482 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [757760->761855] (req 757760->761855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.158443:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca5482 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [757760->761855] (req 757760->761855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531979.158933:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531979.158939:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467775424
00000100:00100000:1.0:1651531979.158952:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44904
00000100:00100000:1.0:1651531979.158953:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000670433b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754467775424:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531979.158957:0:167632:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531979.158961:0:167632:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5489 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446f5b expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.158968:0:167632:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5489 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446f5b expref: 12 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531979.158972:0:167632:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5489 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446f5b expref: 12 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531979.158975:0:167632:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c806f265, rc 0)
00000100:00100000:1.0:1651531979.158985:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000670433b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754467775424:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (52us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531979.158987:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44904
00000001:00080000:0.0:1651531979.194572:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869519 is committed
00010000:00010000:1.0:1651531979.194605:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca5466 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [106496->110591] (req 106496->110591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.194609:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca5466 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [106496->110591] (req 106496->110591) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.194630:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca5466 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [106496->110591] (req 106496->110591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531979.194633:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002ef35a72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467774208:12345-10.240.43.64@tcp:4:fio.0 Request processed in 38027us (38076us total) trans 21474869519 rc 0/0
00010000:00010000:0.0:1651531979.194635:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000eebd17a1 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531979.194636:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca5466 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [106496->110591] (req 106496->110591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531979.194639:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250619
00010000:00010000:0.0:1651531979.194639:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca5466 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [106496->110591] (req 106496->110591) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.194644:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca5466 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [106496->110591] (req 106496->110591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.194647:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca5466 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [106496->110591] (req 106496->110591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531979.195011:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531979.195019:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467775808
00000100:00100000:1.0:1651531979.195029:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250621
00000100:00100000:1.0:1651531979.195031:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000add44b2e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467775808:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531979.195038:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5490 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.195042:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531979.195042:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531979.195043:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5490 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [925696->929791] (req 925696->929791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.195048:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5490 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [925696->929791] (req 925696->929791) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531979.207716:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531979.207726:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531979.207739:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467776000
00000100:00100000:0.0:1651531979.207743:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467776064
00000100:00100000:1.0:1651531979.207751:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44905
00000100:00100000:1.0:1651531979.207753:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b67ad021 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754467776000:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531979.207757:0:167632:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:0.0:1651531979.207758:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44906
00000100:00100000:0.0:1651531979.207760:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e4e3ecb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754467776064:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531979.207762:0:167632:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca5497 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446f70 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.207764:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531979.207768:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca549e lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446f77 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.207772:0:167632:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca5497 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446f70 expref: 14 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531979.207776:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca549e lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446f77 expref: 14 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531979.207781:0:167632:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca5497 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446f70 expref: 14 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531979.207781:0:166112:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca549e lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446f77 expref: 14 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531979.207784:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f5657138, rc 0)
00010000:00010000:1.0:1651531979.207785:0:167632:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001cf49bf2, rc 0)
00000100:00100000:0.0:1651531979.207800:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e4e3ecb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754467776064:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (74us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531979.207803:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44906
00000100:00100000:1.0:1651531979.207804:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b67ad021 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754467776000:12345-10.240.43.64@tcp:101:fio.0 Request processed in 51us (90us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531979.207808:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44905
00000001:00080000:0.0:1651531979.231915:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869520 is committed
00010000:00010000:1.0:1651531979.231951:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca5482 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [757760->761855] (req 757760->761855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.231956:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca5482 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [757760->761855] (req 757760->761855) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531979.231973:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007a05c3e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467775168:12345-10.240.43.64@tcp:4:fio.0 Request processed in 73546us (73576us total) trans 21474869520 rc 0/0
00000100:00100000:1.0:1651531979.231976:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250620
00010000:00010000:1.0:1651531979.231983:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca5482 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [757760->761855] (req 757760->761855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.231986:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000080362f27 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531979.231988:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca5482 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [757760->761855] (req 757760->761855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.231991:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca5482 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [757760->761855] (req 757760->761855) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.231999:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca5482 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [757760->761855] (req 757760->761855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.232003:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca5482 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [757760->761855] (req 757760->761855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531979.232377:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531979.232396:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467776704
00000100:00100000:1.0:1651531979.232408:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44907
00000100:00100000:1.0:1651531979.232410:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003b5b354a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467776704:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531979.232413:0:167632:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531979.232417:0:167632:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca54a5 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446f85 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.232425:0:167632:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca54a5 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446f85 expref: 9 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531979.232430:0:167632:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca54a5 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446f85 expref: 9 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531979.232433:0:167632:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001cf49bf2, rc 0)
00000100:00100000:1.0:1651531979.232444:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003b5b354a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467776704:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (67us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531979.232446:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44907
00000100:00100000:0.0:1651531979.269106:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531979.269128:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467777216
00000100:00100000:1.0:1651531979.269141:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44908
00000100:00100000:1.0:1651531979.269143:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ac545f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467777216:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531979.269148:0:167632:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531979.269152:0:167632:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca54ac lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446f93 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.269159:0:167632:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca54ac lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446f93 expref: 9 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531979.269164:0:167632:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca54ac lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446f93 expref: 9 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531979.269167:0:167632:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001cf49bf2, rc 0)
00000100:00100000:1.0:1651531979.269178:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ac545f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467777216:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (73us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531979.269181:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44908
00000100:00100000:0.0:1651531979.269581:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531979.269600:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467777344
00000100:00100000:1.0:1651531979.269611:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250622
00000100:00100000:1.0:1651531979.269613:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f817afea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467777344:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531979.269620:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca54b3 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.269624:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531979.269625:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531979.269626:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca54b3 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [724992->729087] (req 724992->729087) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.269630:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca54b3 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [724992->729087] (req 724992->729087) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.269646:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca54b3 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [724992->729087] (req 724992->729087) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.269650:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca54b3 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [724992->729087] (req 724992->729087) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531979.269671:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f817afea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467777344:12345-10.240.43.64@tcp:3:fio.0 Request processed in 57us (91us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531979.269674:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250622
00010000:00010000:0.0:1651531979.269674:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca54b3 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [724992->729087] (req 724992->729087) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.269678:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000000bb25cc already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531979.269679:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca54b3 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [724992->729087] (req 724992->729087) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.269684:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca54b3 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [724992->729087] (req 724992->729087) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.269690:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca54b3 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [724992->729087] (req 724992->729087) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.269692:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca54b3 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [724992->729087] (req 724992->729087) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531979.282507:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869521 is committed
00010000:00010000:1.0:1651531979.282536:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5490 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [925696->929791] (req 925696->929791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.282540:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5490 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [925696->929791] (req 925696->929791) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531979.282558:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000add44b2e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438149:x1731754467775808:12345-10.240.43.64@tcp:4:fio.0 Request processed in 87526us (87548us total) trans 21474869521 rc 0/0
00000100:00100000:1.0:1651531979.282561:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250621
00010000:00010000:0.0:1651531979.282562:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5490 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [925696->929791] (req 925696->929791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.282566:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c806f265 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531979.282567:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5490 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [925696->929791] (req 925696->929791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.282571:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5490 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [925696->929791] (req 925696->929791) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.282576:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5490 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [925696->929791] (req 925696->929791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.282578:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5490 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [925696->929791] (req 925696->929791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531979.282932:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531979.282940:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467777600
00000100:00100000:1.0:1651531979.282952:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44909
00000100:00100000:1.0:1651531979.282954:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fb90eb28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438148:x1731754467777600:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531979.282958:0:167632:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531979.282962:0:167632:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca54ba lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446fa1 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651531979.282970:0:167632:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34545:0x0] initial LVB size: 6291456, mtime: 0x627060cb, atime: 0x627060b4, ctime: 0x627060cb, blocks: 0x3000
00010000:00010000:1.0:1651531979.282975:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531979.282975:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531979.282977:0:167632:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca54ba lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446fa1 expref: 6 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531979.282982:0:167632:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca54ba lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446fa1 expref: 6 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531979.282986:0:167632:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001cf49bf2, rc 0)
00000100:00100000:1.0:1651531979.282996:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fb90eb28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438148:x1731754467777600:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (64us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531979.282998:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44909
00000100:00100000:1.0:1651531979.283425:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531979.283433:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467777728
00000100:00100000:1.0:1651531979.283442:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250623
00000100:00100000:1.0:1651531979.283444:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dce6a2c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467777728:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531979.283450:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca54c1 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.283454:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531979.283455:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531979.283456:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca54c1 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [172032->176127] (req 172032->176127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.283460:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca54c1 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [172032->176127] (req 172032->176127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.283473:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca54c1 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [172032->176127] (req 172032->176127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.283476:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca54c1 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [172032->176127] (req 172032->176127) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531979.283489:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dce6a2c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467777728:12345-10.240.43.64@tcp:3:fio.0 Request processed in 45us (65us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531979.283492:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250623
00010000:00010000:1.0:1651531979.283498:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca54c1 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [172032->176127] (req 172032->176127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.283502:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000060a6272d already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531979.283503:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca54c1 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [172032->176127] (req 172032->176127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.283506:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca54c1 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [172032->176127] (req 172032->176127) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.283510:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca54c1 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [172032->176127] (req 172032->176127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.283513:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca54c1 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [172032->176127] (req 172032->176127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531979.283851:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531979.283858:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467777856
00000100:00100000:1.0:1651531979.283868:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250624
00000100:00100000:1.0:1651531979.283870:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000028779db6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467777856:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531979.283876:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca54c8 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.283880:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531979.283881:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531979.283882:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca54c8 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [479232->483327] (req 479232->483327) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.283885:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca54c8 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [479232->483327] (req 479232->483327) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.283896:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca54c8 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [479232->483327] (req 479232->483327) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.283899:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca54c8 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [479232->483327] (req 479232->483327) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.283919:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca54c8 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [479232->483327] (req 479232->483327) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531979.283920:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000028779db6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467777856:12345-10.240.43.64@tcp:3:fio.0 Request processed in 49us (70us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531979.283923:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250624
00010000:00010000:0.0:1651531979.283927:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009c5faf65 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531979.283928:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca54c8 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [479232->483327] (req 479232->483327) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.283931:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca54c8 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [479232->483327] (req 479232->483327) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.283936:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca54c8 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [479232->483327] (req 479232->483327) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.283938:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca54c8 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [479232->483327] (req 479232->483327) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531979.284267:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531979.284275:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467777984
00000100:00100000:1.0:1651531979.284284:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250625
00000100:00100000:1.0:1651531979.284286:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dccc50c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467777984:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531979.284292:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca54cf lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.284301:0:166118:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca54ba lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446fa1 expref: 6 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531979.284304:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531979.284304:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531979.284305:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca54cf lrc: 4/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [184320->188415] (req 184320->188415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.284312:0:166118:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca54ba lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446fa1 expref: 6 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531979.284316:0:166118:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca54ba lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446fa1 expref: 6 pid: 167632 timeout: 22787 lvb_type: 1
00000100:00100000:1.0:1651531979.284320:0:166118:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009078ca7d pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:166118:1731745997361472:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531979.284332:0:166118:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ef5806fb going to sleep for 6 seconds
00000100:00100000:1.0:1651531979.284525:0:166118:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009078ca7d pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:166118:1731745997361472:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651531979.284529:0:166118:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca54cf lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [184320->188415] (req 184320->188415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531979.284570:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531979.284589:0:166102:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467778048
00010000:00010000:0.0:1651531979.284596:0:166102:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca54ba lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446fa1 expref: 7 pid: 167632 timeout: 22787 lvb_type: 1
00000100:00100000:0.0:1651531979.284604:0:166102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 297
00000100:00100000:0.0:1651531979.284606:0:166102:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009078ca7d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438148:x1731754467778048:12345-10.240.43.64@tcp:103:ldlm_bl_06.0
00010000:00010000:0.0:1651531979.284609:0:166102:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531979.284613:0:166102:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca54ba lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446fa1 expref: 7 pid: 167632 timeout: 22787 lvb_type: 1
00010000:00010000:0.0:1651531979.284617:0:166102:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca54ba lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446fa1 expref: 7 pid: 167632 timeout: 22787 lvb_type: 1
00010000:00010000:0.0:1651531979.284627:0:166102:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca54ba lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446fa1 expref: 7 pid: 167632 timeout: 22787 lvb_type: 1
00010000:00010000:0.0:1651531979.284631:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531979.284631:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531979.284632:0:166102:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca54cf lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [184320->188415] (req 184320->188415) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.284635:0:166102:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca54cf lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [184320->188415] (req 184320->188415) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.284648:0:166102:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1651531979.284656:0:166118:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca54cf lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [184320->188415] (req 184320->188415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531979.284661:0:166102:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009078ca7d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438148:x1731754467778048:12345-10.240.43.64@tcp:103:ldlm_bl_06.0 Request processed in 55us (91us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531979.284664:0:166102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 297
00010000:00010000:1.0:1651531979.284665:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca54cf lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [184320->188415] (req 184320->188415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531979.308260:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531979.308268:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467778176
00000100:00100000:1.0:1651531979.308281:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44910
00000100:00100000:1.0:1651531979.308283:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000071f9ee43 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467778176:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531979.308287:0:167632:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531979.308291:0:167632:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca54d6 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446faf expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.308298:0:167632:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca54d6 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446faf expref: 9 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531979.308303:0:167632:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca54d6 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446faf expref: 9 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531979.308306:0:167632:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000060a6272d, rc 0)
00000100:00100000:1.0:1651531979.308316:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000071f9ee43 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467778176:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (57us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531979.308319:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44910
00000100:00100000:1.0:1651531979.309078:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531979.309085:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467778432
00000100:00100000:1.0:1651531979.309097:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44911
00000100:00100000:1.0:1651531979.309099:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002d3e5ae4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467778432:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531979.309102:0:167632:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531979.309106:0:167632:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca54dd lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446fbd expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.309117:0:167632:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca54dd lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446fbd expref: 9 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531979.309121:0:167632:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca54dd lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446fbd expref: 9 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531979.309124:0:167632:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f6135e30, rc 0)
00000100:00100000:1.0:1651531979.309134:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002d3e5ae4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467778432:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (57us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531979.309136:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44911
00000001:00080000:0.0:1651531979.344684:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869522 is committed
00010000:00010000:1.0:1651531979.344712:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca54cf lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [184320->188415] (req 184320->188415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.344716:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca54cf lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [184320->188415] (req 184320->188415) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531979.344736:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dccc50c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438149:x1731754467777984:12345-10.240.43.64@tcp:4:fio.0 Request processed in 60449us (60468us total) trans 21474869522 rc 0/0
00010000:00010000:0.0:1651531979.344738:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca54cf lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [184320->188415] (req 184320->188415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531979.344739:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250625
00010000:00010000:0.0:1651531979.344743:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008b0c325f already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531979.344744:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca54cf lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [184320->188415] (req 184320->188415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.344747:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca54cf lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [184320->188415] (req 184320->188415) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.344753:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca54cf lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [184320->188415] (req 184320->188415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.344757:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca54cf lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [184320->188415] (req 184320->188415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531979.345125:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531979.345133:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467778816
00000100:00100000:1.0:1651531979.345142:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250626
00000100:00100000:1.0:1651531979.345144:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008bb4a649 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438148:x1731754467778816:12345-10.240.43.64@tcp:4:fio.0
00002000:00010000:1.0:1651531979.345152:0:166118:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34545:0x0] initial LVB size: 6291456, mtime: 0x627060cb, atime: 0x627060b4, ctime: 0x627060cb, blocks: 0x3000
00010000:00010000:1.0:1651531979.345154:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca54e4 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.345159:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531979.345160:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531979.345161:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca54e4 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [176128->180223] (req 176128->180223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.345165:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca54e4 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [176128->180223] (req 176128->180223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531979.371054:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869523 is committed
00010000:00010000:1.0:1651531979.371083:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca54e4 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [176128->180223] (req 176128->180223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.371088:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca54e4 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [176128->180223] (req 176128->180223) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531979.371104:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008bb4a649 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438148:x1731754467778816:12345-10.240.43.64@tcp:4:fio.0 Request processed in 25959us (25979us total) trans 21474869523 rc 0/0
00000100:00100000:1.0:1651531979.371107:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250626
00010000:00010000:1.0:1651531979.371113:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca54e4 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [176128->180223] (req 176128->180223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.371117:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f6135e30 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531979.371118:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca54e4 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [176128->180223] (req 176128->180223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.371121:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca54e4 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [176128->180223] (req 176128->180223) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.371126:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca54e4 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [176128->180223] (req 176128->180223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.371130:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca54e4 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [176128->180223] (req 176128->180223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531979.371470:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531979.371478:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467779136
00000100:00100000:1.0:1651531979.371491:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44912
00000100:00100000:1.0:1651531979.371493:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cb694635 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438149:x1731754467779136:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531979.371496:0:167632:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531979.371500:0:167632:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca54eb lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446fcb expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651531979.371505:0:167632:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34545:0x0] initial LVB size: 6291456, mtime: 0x627060cb, atime: 0x627060b4, ctime: 0x627060cb, blocks: 0x3000
00010000:00010000:1.0:1651531979.371509:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531979.371510:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531979.371512:0:167632:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca54eb lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446fcb expref: 6 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531979.371516:0:167632:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca54eb lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446fcb expref: 6 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531979.371520:0:167632:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000060a6272d, rc 0)
00000100:00100000:1.0:1651531979.371530:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cb694635 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467779136:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (61us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531979.371533:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44912
00000100:00100000:1.0:1651531979.371959:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531979.371966:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467779392
00000100:00100000:1.0:1651531979.371976:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250627
00000100:00100000:1.0:1651531979.371978:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006a8dcc9d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438148:x1731754467779392:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531979.371985:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca54f2 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.371989:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531979.371989:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531979.371990:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca54f2 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [196608->200703] (req 196608->200703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.371994:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca54f2 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [196608->200703] (req 196608->200703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.372005:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca54f2 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [196608->200703] (req 196608->200703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.372008:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca54f2 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [196608->200703] (req 196608->200703) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531979.372030:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006a8dcc9d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438148:x1731754467779392:12345-10.240.43.64@tcp:3:fio.0 Request processed in 51us (72us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531979.372033:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250627
00010000:00010000:0.0:1651531979.372033:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca54f2 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [196608->200703] (req 196608->200703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.372037:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f6ecb7e5 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531979.372038:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca54f2 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [196608->200703] (req 196608->200703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.372041:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca54f2 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [196608->200703] (req 196608->200703) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.372047:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca54f2 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [196608->200703] (req 196608->200703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.372049:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca54f2 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [196608->200703] (req 196608->200703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531979.372365:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531979.372373:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467779520
00000100:00100000:1.0:1651531979.372382:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250628
00000100:00100000:1.0:1651531979.372384:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b6b1b79d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438148:x1731754467779520:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531979.372390:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca54f9 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.372399:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531979.372399:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531979.372400:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca54f9 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.372404:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca54f9 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.372415:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca54f9 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.372418:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca54f9 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.372438:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca54f9 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531979.372439:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b6b1b79d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438148:x1731754467779520:12345-10.240.43.64@tcp:3:fio.0 Request processed in 55us (74us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531979.372442:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250628
00010000:00010000:0.0:1651531979.372442:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d3014069 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531979.372443:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca54f9 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.372446:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca54f9 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.372452:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca54f9 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.372455:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca54f9 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531979.372738:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531979.372746:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467779648
00000100:00100000:1.0:1651531979.372754:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250629
00000100:00100000:1.0:1651531979.372756:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009e786cd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467779648:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531979.372772:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca5500 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.372777:0:166118:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca54eb lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446fcb expref: 6 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531979.372784:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531979.372784:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531979.372785:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca5500 lrc: 4/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [208896->212991] (req 208896->212991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.372793:0:166118:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca54eb lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446fcb expref: 6 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531979.372797:0:166118:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca54eb lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446fcb expref: 6 pid: 167632 timeout: 22788 lvb_type: 1
00000100:00100000:1.0:1651531979.372801:0:166118:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bedaf1f1 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:166118:1731745997361536:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531979.372813:0:166118:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ef5806fb going to sleep for 6 seconds
00000100:00100000:1.0:1651531979.373035:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531979.373050:0:166118:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bedaf1f1 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:166118:1731745997361536:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531979.373054:0:166104:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467779712
00010000:00010000:1.0:1651531979.373055:0:166118:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca5500 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [208896->212991] (req 208896->212991) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.373060:0:166104:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca54eb lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446fcb expref: 7 pid: 167632 timeout: 22788 lvb_type: 1
00000100:00100000:0.0:1651531979.373069:0:166104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 298
00000100:00100000:0.0:1651531979.373071:0:166104:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dfff0362 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438146:x1731754467779712:12345-10.240.43.64@tcp:103:ldlm_bl_05.0
00010000:00010000:0.0:1651531979.373074:0:166104:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531979.373077:0:166104:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca54eb lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446fcb expref: 7 pid: 167632 timeout: 22788 lvb_type: 1
00010000:00010000:0.0:1651531979.373081:0:166104:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca54eb lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446fcb expref: 7 pid: 167632 timeout: 22788 lvb_type: 1
00010000:00010000:0.0:1651531979.373087:0:166104:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca54eb lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446fcb expref: 7 pid: 167632 timeout: 22788 lvb_type: 1
00010000:00010000:0.0:1651531979.373091:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531979.373092:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531979.373093:0:166104:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca5500 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [208896->212991] (req 208896->212991) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.373099:0:166104:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca5500 lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [208896->212991] (req 208896->212991) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.373112:0:166104:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1651531979.373120:0:166118:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca5500 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [208896->212991] (req 208896->212991) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531979.373125:0:166104:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dfff0362 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438146:x1731754467779712:12345-10.240.43.64@tcp:103:ldlm_bl_05.0 Request processed in 54us (90us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531979.373128:0:166104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 298
00010000:00010000:1.0:1651531979.373129:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca5500 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [208896->212991] (req 208896->212991) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531979.421595:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531979.421604:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531979.421617:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467779904
00000100:00100000:1.0:1651531979.421624:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467779968
00000100:00100000:0.0:1651531979.421633:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44913
00000100:00100000:1.0:1651531979.421636:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44914
00000100:00100000:0.0:1651531979.421636:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bedaf1f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438146:x1731754467779904:12345-10.240.43.64@tcp:101:fio.0
00000100:00100000:1.0:1651531979.421638:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029096870 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438149:x1731754467779968:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:0.0:1651531979.421640:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531979.421641:0:167632:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651531979.421645:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca5507 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446fe0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.421646:0:167632:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca550e lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446fe7 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.421654:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca5507 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446fe0 expref: 11 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531979.421655:0:167632:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca550e lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446fe7 expref: 11 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531979.421658:0:166111:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca5507 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446fe0 expref: 11 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531979.421659:0:167632:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca550e lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446fe7 expref: 11 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531979.421662:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f5657138, rc 0)
00010000:00010000:1.0:1651531979.421663:0:167632:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f6135e30, rc 0)
00000100:00100000:0.0:1651531979.421677:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bedaf1f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438146:x1731754467779904:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (83us total) trans 0 rc 301/301
00000100:00100000:0.0:1651531979.421680:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44913
00000100:00100000:1.0:1651531979.421683:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029096870 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438149:x1731754467779968:12345-10.240.43.64@tcp:101:fio.0 Request processed in 44us (79us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531979.421685:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44914
00000100:00100000:1.0:1651531979.422666:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531979.422675:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467780352
00000100:00100000:1.0:1651531979.422683:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250630
00000100:00100000:1.0:1651531979.422685:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003b40261e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467780352:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531979.422691:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca5515 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.422695:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531979.422696:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531979.422698:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca5515 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [815104->819199] (req 815104->819199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.422702:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca5515 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [815104->819199] (req 815104->819199) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531979.458000:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869524 is committed
00010000:00010000:1.0:1651531979.458031:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca5500 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [208896->212991] (req 208896->212991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.458035:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca5500 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [208896->212991] (req 208896->212991) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531979.458051:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009e786cd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467779648:12345-10.240.43.64@tcp:4:fio.0 Request processed in 85294us (85313us total) trans 21474869524 rc 0/0
00000100:00100000:1.0:1651531979.458054:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250629
00010000:00010000:1.0:1651531979.458061:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca5500 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [208896->212991] (req 208896->212991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.458064:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f58aeba9 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531979.458066:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca5500 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [208896->212991] (req 208896->212991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.458068:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca5500 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [208896->212991] (req 208896->212991) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.458073:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca5500 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [208896->212991] (req 208896->212991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.458076:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca5500 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [208896->212991] (req 208896->212991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531979.508676:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869525 is committed
00010000:00010000:1.0:1651531979.508709:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca5515 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [815104->819199] (req 815104->819199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.508713:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca5515 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [815104->819199] (req 815104->819199) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.508731:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca5515 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [815104->819199] (req 815104->819199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531979.508733:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003b40261e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438148:x1731754467780352:12345-10.240.43.64@tcp:4:fio.0 Request processed in 86048us (86067us total) trans 21474869525 rc 0/0
00010000:00010000:0.0:1651531979.508736:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000022b2104e already unused, calling callback (0000000049fddea7)
00000100:00100000:1.0:1651531979.508737:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250630
00010000:00010000:0.0:1651531979.508737:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca5515 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [815104->819199] (req 815104->819199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.508740:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca5515 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [815104->819199] (req 815104->819199) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.508746:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca5515 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [815104->819199] (req 815104->819199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.508749:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca5515 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [815104->819199] (req 815104->819199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531979.509102:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531979.509110:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467780800
00000100:00100000:1.0:1651531979.509123:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44915
00000100:00100000:1.0:1651531979.509125:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f7096c29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438148:x1731754467780800:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531979.509128:0:167632:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531979.509132:0:167632:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca551c lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db446ff5 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651531979.509137:0:167632:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34545:0x0] initial LVB size: 6291456, mtime: 0x627060cb, atime: 0x627060b4, ctime: 0x627060cb, blocks: 0x3000
00010000:00010000:1.0:1651531979.509142:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531979.509142:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531979.509144:0:167632:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca551c lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446ff5 expref: 6 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531979.509149:0:167632:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca551c lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446ff5 expref: 6 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531979.509157:0:167632:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f58aeba9, rc 0)
00000100:00100000:1.0:1651531979.509167:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f7096c29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438148:x1731754467780800:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (66us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531979.509169:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44915
00000100:00100000:1.0:1651531979.509531:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531979.509539:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467780928
00000100:00100000:1.0:1651531979.509549:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250631
00000100:00100000:1.0:1651531979.509550:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bf4022bf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467780928:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531979.509558:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca5523 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.509561:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531979.509562:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531979.509563:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca5523 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [868352->872447] (req 868352->872447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.509567:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca5523 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [868352->872447] (req 868352->872447) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.509578:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca5523 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [868352->872447] (req 868352->872447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.509582:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca5523 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [868352->872447] (req 868352->872447) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.509601:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca5523 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [868352->872447] (req 868352->872447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531979.509602:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bf4022bf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467780928:12345-10.240.43.64@tcp:3:fio.0 Request processed in 51us (71us total) trans 0 rc 4096/4096
00010000:00010000:0.0:1651531979.509605:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f6135e30 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531979.509606:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca5523 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [868352->872447] (req 868352->872447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531979.509608:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250631
00010000:00010000:0.0:1651531979.509609:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca5523 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [868352->872447] (req 868352->872447) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.509614:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca5523 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [868352->872447] (req 868352->872447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.509616:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca5523 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [868352->872447] (req 868352->872447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531979.535705:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531979.535713:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467781632
00000100:00100000:1.0:1651531979.535722:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250632
00000100:00100000:1.0:1651531979.535724:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000b1a9136 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438146:x1731754467781632:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531979.535731:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca552a lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.535735:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531979.535736:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531979.535737:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca552a lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [8192->12287] (req 8192->12287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.535741:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca552a lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [8192->12287] (req 8192->12287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.535751:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca552a lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [8192->12287] (req 8192->12287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.535754:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca552a lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [8192->12287] (req 8192->12287) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531979.535768:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000b1a9136 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438146:x1731754467781632:12345-10.240.43.64@tcp:3:fio.0 Request processed in 43us (63us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531979.535770:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250632
00010000:00010000:1.0:1651531979.535776:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca552a lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [8192->12287] (req 8192->12287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.535783:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f6135e30 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531979.535784:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca552a lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [8192->12287] (req 8192->12287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.535787:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca552a lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [8192->12287] (req 8192->12287) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.535792:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca552a lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [8192->12287] (req 8192->12287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.535794:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca552a lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [8192->12287] (req 8192->12287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531979.561175:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531979.561183:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467782400
00000100:00100000:1.0:1651531979.561192:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250633
00000100:00100000:1.0:1651531979.561194:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000f4bed26 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467782400:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531979.561201:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca5531 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.561205:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531979.561205:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531979.561206:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca5531 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [212992->217087] (req 212992->217087) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.561210:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca5531 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [212992->217087] (req 212992->217087) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.561252:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca5531 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [212992->217087] (req 212992->217087) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.561256:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca5531 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [212992->217087] (req 212992->217087) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.561266:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca5531 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [212992->217087] (req 212992->217087) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531979.561270:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000f4bed26 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467782400:12345-10.240.43.64@tcp:3:fio.0 Request processed in 75us (96us total) trans 0 rc 4096/4096
00010000:00010000:0.0:1651531979.561271:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f6135e30 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531979.561272:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca5531 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [212992->217087] (req 212992->217087) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531979.561273:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250633
00010000:00010000:0.0:1651531979.561275:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca5531 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [212992->217087] (req 212992->217087) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.561280:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca5531 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [212992->217087] (req 212992->217087) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.561283:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca5531 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [212992->217087] (req 212992->217087) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531979.561612:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531979.561619:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467782528
00000100:00100000:1.0:1651531979.561634:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250634
00000100:00100000:1.0:1651531979.561636:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000008e0501d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438148:x1731754467782528:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531979.561642:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca5538 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.561647:0:192753:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca551c lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db446ff5 expref: 6 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531979.561650:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531979.561651:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531979.561651:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca5538 lrc: 4/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [581632->585727] (req 581632->585727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.561659:0:192753:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca551c lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446ff5 expref: 6 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531979.561666:0:192753:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca551c lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446ff5 expref: 6 pid: 167632 timeout: 22788 lvb_type: 1
00000100:00100000:1.0:1651531979.561671:0:192753:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f99d9ea1 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:192753:1731745997361600:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531979.561682:0:192753:0:(client.c:2492:ptlrpc_set_wait()) set 000000008a160606 going to sleep for 6 seconds
00000100:00100000:1.0:1651531979.561936:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531979.561950:0:192753:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f99d9ea1 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:192753:1731745997361600:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531979.561954:0:166102:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467782592
00010000:00010000:1.0:1651531979.561955:0:192753:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca5538 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [581632->585727] (req 581632->585727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.561962:0:166102:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca551c lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446ff5 expref: 7 pid: 167632 timeout: 22788 lvb_type: 1
00000100:00100000:0.0:1651531979.561970:0:166102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 299
00000100:00100000:0.0:1651531979.561972:0:166102:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000043b0f16d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438146:x1731754467782592:12345-10.240.43.64@tcp:103:ldlm_bl_01.0
00010000:00010000:0.0:1651531979.561975:0:166102:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531979.561979:0:166102:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca551c lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446ff5 expref: 7 pid: 167632 timeout: 22788 lvb_type: 1
00010000:00010000:0.0:1651531979.561987:0:166102:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca551c lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446ff5 expref: 7 pid: 167632 timeout: 22788 lvb_type: 1
00010000:00010000:0.0:1651531979.561993:0:166102:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca551c lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db446ff5 expref: 7 pid: 167632 timeout: 22788 lvb_type: 1
00010000:00010000:0.0:1651531979.561997:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531979.561998:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531979.561999:0:166102:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca5538 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [581632->585727] (req 581632->585727) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.562002:0:166102:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca5538 lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [581632->585727] (req 581632->585727) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.562015:0:166102:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651531979.562025:0:166102:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000043b0f16d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438146:x1731754467782592:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 52us (89us total) trans 0 rc 0/0
00010000:00010000:1.0:1651531979.562027:0:192753:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca5538 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [581632->585727] (req 581632->585727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531979.562027:0:166102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 299
00010000:00010000:1.0:1651531979.562031:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca5538 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [581632->585727] (req 581632->585727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531979.609540:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531979.609549:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467782720
00000100:00100000:1.0:1651531979.609562:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44916
00000100:00100000:1.0:1651531979.609564:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f99d9ea1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467782720:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531979.609568:0:167632:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531979.609572:0:167632:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca553f lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447003 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.609580:0:167632:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca553f lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447003 expref: 9 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531979.609585:0:167632:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca553f lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447003 expref: 9 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531979.609589:0:167632:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000060a6272d, rc 0)
00000100:00100000:1.0:1651531979.609599:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f99d9ea1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467782720:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (60us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531979.609602:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44916
00000100:00100000:1.0:1651531979.610379:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531979.610386:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467782976
00000100:00100000:1.0:1651531979.610398:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44917
00000100:00100000:1.0:1651531979.610400:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004237e3f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467782976:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531979.610404:0:167632:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531979.610407:0:167632:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca5546 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447011 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.610414:0:167632:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca5546 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447011 expref: 9 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531979.610418:0:167632:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca5546 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447011 expref: 9 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531979.610422:0:167632:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d3014069, rc 0)
00000100:00100000:1.0:1651531979.610431:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004237e3f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467782976:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (54us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531979.610434:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44917
00000100:00100000:1.0:1651531979.610738:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531979.610760:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467783104
00000100:00100000:0.0:1651531979.610776:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250635
00000100:00100000:0.0:1651531979.610778:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007b76f7f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467783104:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531979.610786:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca554d lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.610791:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531979.610791:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531979.610792:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca554d lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [172032->176127] (req 172032->176127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.610798:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca554d lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [172032->176127] (req 172032->176127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.610811:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca554d lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [172032->176127] (req 172032->176127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.610815:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca554d lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [172032->176127] (req 172032->176127) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531979.610836:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007b76f7f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467783104:12345-10.240.43.64@tcp:3:fio.0 Request processed in 57us (99us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531979.610839:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250635
00010000:00010000:0.0:1651531979.610846:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca554d lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [172032->176127] (req 172032->176127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.610850:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f5657138 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531979.610851:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca554d lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [172032->176127] (req 172032->176127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.610854:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca554d lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [172032->176127] (req 172032->176127) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.610858:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca554d lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [172032->176127] (req 172032->176127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.610861:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca554d lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [172032->176127] (req 172032->176127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531979.611146:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531979.611154:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467783232
00000100:00100000:1.0:1651531979.611164:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44918
00000100:00100000:1.0:1651531979.611166:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001e61ed2d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467783232:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531979.611169:0:167632:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531979.611173:0:167632:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5554 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44701f expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.611180:0:167632:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5554 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44701f expref: 9 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531979.611184:0:167632:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5554 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44701f expref: 9 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531979.611187:0:167632:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f6ecb7e5, rc 0)
00000100:00100000:1.0:1651531979.611196:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001e61ed2d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467783232:12345-10.240.43.64@tcp:101:fio.0 Request processed in 30us (51us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531979.611199:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44918
00000100:00100000:1.0:1651531979.611897:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531979.611915:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467783488
00000100:00100000:0.0:1651531979.611931:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250636
00000100:00100000:0.0:1651531979.611932:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000052cf3c08 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467783488:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531979.611939:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca555b lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.611943:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531979.611944:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531979.611945:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca555b lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [761856->765951] (req 761856->765951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.611948:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca555b lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [761856->765951] (req 761856->765951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531979.623626:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869526 is committed
00010000:00010000:1.0:1651531979.623657:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca5538 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [581632->585727] (req 581632->585727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.623661:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca5538 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [581632->585727] (req 581632->585727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531979.623676:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000008e0501d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467782528:12345-10.240.43.64@tcp:4:fio.0 Request processed in 62039us (62064us total) trans 21474869526 rc 0/0
00000100:00100000:1.0:1651531979.623681:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250634
00010000:00010000:1.0:1651531979.623688:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca5538 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [581632->585727] (req 581632->585727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.623691:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000022b2104e already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651531979.623692:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca5538 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [581632->585727] (req 581632->585727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.623695:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca5538 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [581632->585727] (req 581632->585727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.623700:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca5538 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [581632->585727] (req 581632->585727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.623703:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca5538 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [581632->585727] (req 581632->585727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531979.649108:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531979.649116:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467783872
00000100:00100000:1.0:1651531979.649128:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44919
00000100:00100000:1.0:1651531979.649130:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b9b10d48 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467783872:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531979.649133:0:167632:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531979.649137:0:167632:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca5562 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44702d expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.649144:0:167632:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca5562 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44702d expref: 9 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531979.649152:0:167632:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca5562 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44702d expref: 9 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531979.649155:0:167632:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000022b2104e, rc 0)
00000100:00100000:1.0:1651531979.649165:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b9b10d48 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467783872:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (58us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531979.649168:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44919
00000100:00100000:1.0:1651531979.649950:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531979.649958:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467784128
00000100:00100000:1.0:1651531979.649967:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250637
00000100:00100000:1.0:1651531979.649969:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000315bf4eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467784128:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531979.649976:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5569 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.649980:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531979.649980:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531979.649981:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5569 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [208896->212991] (req 208896->212991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.649985:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5569 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [208896->212991] (req 208896->212991) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531979.684325:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869527 is committed
00010000:00010000:1.0:1651531979.684360:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca555b lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [761856->765951] (req 761856->765951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.684365:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca555b lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [761856->765951] (req 761856->765951) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.684378:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca555b lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [761856->765951] (req 761856->765951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.684382:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000820577fb already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531979.684384:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca555b lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [761856->765951] (req 761856->765951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531979.684385:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000052cf3c08 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467783488:12345-10.240.43.64@tcp:4:fio.0 Request processed in 72451us (72488us total) trans 21474869527 rc 0/0
00010000:00010000:0.0:1651531979.684387:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca555b lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [761856->765951] (req 761856->765951) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531979.684388:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250636
00010000:00010000:0.0:1651531979.684392:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca555b lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [761856->765951] (req 761856->765951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.684396:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca555b lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [761856->765951] (req 761856->765951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531979.684698:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531979.684706:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467784256
00000100:00100000:1.0:1651531979.684716:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44920
00000100:00100000:1.0:1651531979.684718:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005ec1cbc3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467784256:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531979.684721:0:167632:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531979.684725:0:167632:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca5570 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44703b expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.684733:0:167632:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca5570 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44703b expref: 9 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531979.684737:0:167632:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca5570 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44703b expref: 9 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531979.684740:0:167632:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000022b2104e, rc 0)
00000100:00100000:1.0:1651531979.684750:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005ec1cbc3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467784256:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (52us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531979.684752:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44920
00000100:00100000:1.0:1651531979.685476:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531979.685483:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467784512
00000100:00100000:1.0:1651531979.685496:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44921
00000100:00100000:1.0:1651531979.685498:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000033723645 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467784512:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531979.685503:0:167632:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531979.685507:0:167632:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca5577 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447049 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.685514:0:167632:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca5577 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447049 expref: 9 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531979.685518:0:167632:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca5577 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447049 expref: 9 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531979.685521:0:167632:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d3014069, rc 0)
00000100:00100000:1.0:1651531979.685531:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000033723645 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467784512:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (56us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531979.685533:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44921
00000100:00100000:1.0:1651531979.686216:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531979.686250:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467784768
00000100:00100000:1.0:1651531979.686259:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250638
00000100:00100000:1.0:1651531979.686261:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a23bcd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754467784768:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531979.686267:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca557e lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.686271:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531979.686272:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531979.686273:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca557e lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [770048->774143] (req 770048->774143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.686277:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca557e lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [770048->774143] (req 770048->774143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531979.696805:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531979.696813:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467784896
00000100:00100000:1.0:1651531979.696826:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44922
00000100:00100000:1.0:1651531979.696828:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a9fc5082 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754467784896:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531979.696831:0:167632:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531979.696835:0:167632:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca5585 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447057 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.696843:0:167632:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca5585 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447057 expref: 12 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531979.696847:0:167632:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca5585 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447057 expref: 12 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531979.696850:0:167632:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d3014069, rc 0)
00000100:00100000:1.0:1651531979.696860:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a9fc5082 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754467784896:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (56us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531979.696863:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44922
00000100:00100000:1.0:1651531979.697253:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531979.697260:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467785024
00000100:00100000:1.0:1651531979.697272:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250639
00000100:00100000:1.0:1651531979.697274:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c62d1815 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754467785024:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531979.697281:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca558c lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.697289:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531979.697289:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531979.697290:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca558c lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [794624->798719] (req 794624->798719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.697294:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca558c lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [794624->798719] (req 794624->798719) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.697306:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca558c lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [794624->798719] (req 794624->798719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.697309:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca558c lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [794624->798719] (req 794624->798719) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531979.697328:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c62d1815 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754467785024:12345-10.240.43.64@tcp:3:fio.0 Request processed in 54us (76us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531979.697331:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250639
00010000:00010000:0.0:1651531979.697331:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca558c lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [794624->798719] (req 794624->798719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.697335:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000022b2104e already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531979.697336:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca558c lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [794624->798719] (req 794624->798719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.697339:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca558c lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [794624->798719] (req 794624->798719) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.697345:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca558c lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [794624->798719] (req 794624->798719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.697347:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca558c lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [794624->798719] (req 794624->798719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531979.697661:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531979.697670:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467785152
00000100:00100000:1.0:1651531979.697682:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250640
00000100:00100000:1.0:1651531979.697684:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003a5ac9b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754467785152:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531979.697690:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca5593 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.697694:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531979.697695:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531979.697696:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca5593 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [946176->950271] (req 946176->950271) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.697703:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca5593 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [946176->950271] (req 946176->950271) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531979.740412:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869528 is committed
00010000:00010000:1.0:1651531979.740443:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5569 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [208896->212991] (req 208896->212991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.740447:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5569 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [208896->212991] (req 208896->212991) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.740458:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5569 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [208896->212991] (req 208896->212991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.740463:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f6ecb7e5 already unused, calling callback (0000000049fddea7)
00000100:00100000:1.0:1651531979.740464:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000315bf4eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754467784128:12345-10.240.43.64@tcp:4:fio.0 Request processed in 90494us (90514us total) trans 21474869528 rc 0/0
00010000:00010000:0.0:1651531979.740464:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5569 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [208896->212991] (req 208896->212991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531979.740467:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250637
00010000:00010000:0.0:1651531979.740467:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5569 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [208896->212991] (req 208896->212991) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.740475:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5569 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [208896->212991] (req 208896->212991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.740478:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5569 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [208896->212991] (req 208896->212991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531979.740834:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531979.740851:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467785280
00000100:00100000:1.0:1651531979.740863:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44923
00000100:00100000:1.0:1651531979.740865:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001eda4376 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754467785280:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531979.740868:0:167632:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531979.740872:0:167632:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca559a lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447065 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.740880:0:167632:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca559a lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447065 expref: 12 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531979.740884:0:167632:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca559a lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447065 expref: 12 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531979.740891:0:167632:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d3014069, rc 0)
00000100:00100000:1.0:1651531979.740901:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001eda4376 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754467785280:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (68us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531979.740903:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44923
00000001:00080000:0.0:1651531979.777055:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869530 is committed
00010000:00010000:0.0:1651531979.777071:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca5593 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [946176->950271] (req 946176->950271) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.777075:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca5593 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [946176->950271] (req 946176->950271) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531979.777097:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003a5ac9b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438148:x1731754467785152:12345-10.240.43.64@tcp:4:fio.0 Request processed in 79412us (79435us total) trans 21474869530 rc 0/0
00000100:00100000:0.0:1651531979.777100:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250640
00010000:00010000:0.0:1651531979.777108:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca5593 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [946176->950271] (req 946176->950271) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.777112:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008b0c325f already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531979.777113:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca5593 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [946176->950271] (req 946176->950271) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.777116:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca5593 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [946176->950271] (req 946176->950271) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.777121:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca5593 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [946176->950271] (req 946176->950271) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.777125:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca5593 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [946176->950271] (req 946176->950271) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.777135:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca557e lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [770048->774143] (req 770048->774143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.777138:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca557e lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [770048->774143] (req 770048->774143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531979.777155:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a23bcd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438146:x1731754467784768:12345-10.240.43.64@tcp:4:fio.0 Request processed in 90893us (90939us total) trans 21474869529 rc 0/0
00000100:00100000:0.0:1651531979.777158:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250638
00010000:00010000:0.0:1651531979.777164:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca557e lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [770048->774143] (req 770048->774143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.777167:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000060a6272d already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531979.777168:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca557e lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [770048->774143] (req 770048->774143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.777170:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca557e lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [770048->774143] (req 770048->774143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.777175:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca557e lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [770048->774143] (req 770048->774143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.777177:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca557e lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [770048->774143] (req 770048->774143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531979.777497:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531979.777516:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467785792
00000100:00100000:0.0:1651531979.777528:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250641
00000100:00100000:0.0:1651531979.777530:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e15376c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438149:x1731754467785792:12345-10.240.43.64@tcp:4:fio.0
00002000:00010000:0.0:1651531979.777539:0:166118:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34545:0x0] initial LVB size: 6291456, mtime: 0x627060cb, atime: 0x627060b4, ctime: 0x627060cb, blocks: 0x3000
00010000:00010000:0.0:1651531979.777541:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca55a1 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.777545:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531979.777545:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531979.777546:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca55a1 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.777550:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca55a1 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531979.826137:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869531 is committed
00010000:00010000:0.0:1651531979.826150:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca55a1 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.826153:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca55a1 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531979.826174:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e15376c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438149:x1731754467785792:12345-10.240.43.64@tcp:4:fio.0 Request processed in 48643us (48677us total) trans 21474869531 rc 0/0
00000100:00100000:0.0:1651531979.826177:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250641
00010000:00010000:0.0:1651531979.826184:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca55a1 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.826189:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000820577fb already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531979.826190:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca55a1 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.826193:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca55a1 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.826198:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca55a1 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.826201:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca55a1 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531979.826535:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531979.826543:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467786048
00000100:00100000:1.0:1651531979.826556:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44924
00000100:00100000:1.0:1651531979.826558:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c4db449c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438148:x1731754467786048:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531979.826562:0:167632:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531979.826566:0:167632:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca55a8 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447073 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651531979.826572:0:167632:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34545:0x0] initial LVB size: 6291456, mtime: 0x627060cb, atime: 0x627060b4, ctime: 0x627060cb, blocks: 0x3000
00010000:00010000:1.0:1651531979.826576:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531979.826577:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531979.826579:0:167632:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca55a8 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447073 expref: 6 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531979.826583:0:167632:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca55a8 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447073 expref: 6 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531979.826587:0:167632:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d3014069, rc 0)
00000100:00100000:1.0:1651531979.826598:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c4db449c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438148:x1731754467786048:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (64us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531979.826603:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44924
00000100:00100000:1.0:1651531979.826949:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531979.826966:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467786176
00000100:00100000:0.0:1651531979.826977:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250642
00000100:00100000:0.0:1651531979.826979:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000137fd3d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467786176:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531979.826986:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca55af lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.826990:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531979.826991:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531979.826992:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca55af lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.826995:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca55af lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.827007:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca55af lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.827011:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca55af lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531979.827033:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000137fd3d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467786176:12345-10.240.43.64@tcp:3:fio.0 Request processed in 53us (85us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531979.827036:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250642
00010000:00010000:0.0:1651531979.827043:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca55af lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.827046:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f5657138 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531979.827047:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca55af lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.827050:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca55af lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.827055:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca55af lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.827057:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca55af lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531979.827386:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531979.827397:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467786304
00000100:00100000:0.0:1651531979.827408:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250643
00000100:00100000:0.0:1651531979.827410:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000880cd1d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467786304:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531979.827417:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca55b6 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.827432:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531979.827432:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531979.827433:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca55b6 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [245760->249855] (req 245760->249855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.827437:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca55b6 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [245760->249855] (req 245760->249855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.827449:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca55b6 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [245760->249855] (req 245760->249855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.827452:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca55b6 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [245760->249855] (req 245760->249855) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531979.827472:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000880cd1d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467786304:12345-10.240.43.64@tcp:3:fio.0 Request processed in 61us (86us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531979.827475:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250643
00010000:00010000:0.0:1651531979.827482:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca55b6 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [245760->249855] (req 245760->249855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.827485:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fb2f6575 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531979.827486:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca55b6 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [245760->249855] (req 245760->249855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.827489:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca55b6 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [245760->249855] (req 245760->249855) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.827493:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca55b6 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [245760->249855] (req 245760->249855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.827505:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca55b6 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [245760->249855] (req 245760->249855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531979.827769:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531979.827780:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467786432
00000100:00100000:0.0:1651531979.827790:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250644
00000100:00100000:0.0:1651531979.827791:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000da31c48f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438148:x1731754467786432:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531979.827798:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca55bd lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.827802:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531979.827803:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531979.827804:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca55bd lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [249856->253951] (req 249856->253951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.827807:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca55bd lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [249856->253951] (req 249856->253951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.827817:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca55bd lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [249856->253951] (req 249856->253951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.827820:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca55bd lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [249856->253951] (req 249856->253951) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531979.827841:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000da31c48f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438148:x1731754467786432:12345-10.240.43.64@tcp:3:fio.0 Request processed in 49us (72us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531979.827844:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250644
00010000:00010000:0.0:1651531979.827851:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca55bd lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [249856->253951] (req 249856->253951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.827863:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f765708a already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531979.827864:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca55bd lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [249856->253951] (req 249856->253951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.827867:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca55bd lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [249856->253951] (req 249856->253951) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.827872:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca55bd lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [249856->253951] (req 249856->253951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.827875:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca55bd lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [249856->253951] (req 249856->253951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531979.828152:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531979.828162:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467786560
00000100:00100000:0.0:1651531979.828173:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250645
00000100:00100000:0.0:1651531979.828174:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006c903446 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467786560:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531979.828181:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca55c4 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.828186:0:192754:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca55a8 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447073 expref: 6 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531979.828189:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531979.828190:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531979.828190:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca55c4 lrc: 4/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [266240->270335] (req 266240->270335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.828210:0:192754:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca55a8 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db447073 expref: 6 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531979.828214:0:192754:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca55a8 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db447073 expref: 6 pid: 167632 timeout: 22788 lvb_type: 1
00000100:00100000:0.0:1651531979.828245:0:192754:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b462545d pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_005:lustre-OST0001_UUID:192754:1731745997361664:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531979.828260:0:192754:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a2b9dcac going to sleep for 6 seconds
00000100:00100000:1.0:1651531979.828496:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531979.828499:0:192754:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b462545d pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_005:lustre-OST0001_UUID:192754:1731745997361664:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651531979.828509:0:192754:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca55c4 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [266240->270335] (req 266240->270335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531979.828517:0:166104:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467786624
00010000:00010000:0.0:1651531979.828521:0:166104:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca55a8 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db447073 expref: 7 pid: 167632 timeout: 22788 lvb_type: 1
00000100:00100000:0.0:1651531979.828529:0:166104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 300
00000100:00100000:0.0:1651531979.828531:0:166104:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002bdf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438147:x1731754467786624:12345-10.240.43.64@tcp:103:ldlm_bl_02.0
00010000:00010000:0.0:1651531979.828534:0:166104:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531979.828537:0:166104:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca55a8 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db447073 expref: 7 pid: 167632 timeout: 22788 lvb_type: 1
00010000:00010000:0.0:1651531979.828541:0:166104:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca55a8 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db447073 expref: 7 pid: 167632 timeout: 22788 lvb_type: 1
00010000:00010000:0.0:1651531979.828560:0:166104:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca55a8 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db447073 expref: 7 pid: 167632 timeout: 22788 lvb_type: 1
00010000:00010000:0.0:1651531979.828564:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531979.828565:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531979.828566:0:166104:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca55c4 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [266240->270335] (req 266240->270335) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.828569:0:166104:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca55c4 lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [266240->270335] (req 266240->270335) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.828575:0:166104:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651531979.828590:0:166104:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002bdf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438147:x1731754467786624:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 58us (94us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531979.828593:0:166104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 300
00010000:00010000:0.0:1651531979.828600:0:192754:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca55c4 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [266240->270335] (req 266240->270335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.828604:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca55c4 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [266240->270335] (req 266240->270335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531979.887298:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869532 is committed
00010000:00010000:0.0:1651531979.887313:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca55c4 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [266240->270335] (req 266240->270335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.887316:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca55c4 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [266240->270335] (req 266240->270335) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531979.887350:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006c903446 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438149:x1731754467786560:12345-10.240.43.64@tcp:4:fio.0 Request processed in 59174us (59198us total) trans 21474869532 rc 0/0
00000100:00100000:0.0:1651531979.887353:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250645
00010000:00010000:0.0:1651531979.887361:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca55c4 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [266240->270335] (req 266240->270335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.887365:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e2ec18e1 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531979.887366:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca55c4 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [266240->270335] (req 266240->270335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.887369:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca55c4 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [266240->270335] (req 266240->270335) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.887373:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca55c4 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [266240->270335] (req 266240->270335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.887376:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca55c4 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [266240->270335] (req 266240->270335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531979.936332:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531979.936340:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467787456
00000100:00100000:1.0:1651531979.936353:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44925
00000100:00100000:1.0:1651531979.936355:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b5b5b4c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438148:x1731754467787456:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531979.936358:0:167632:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531979.936362:0:167632:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca55cb lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447081 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651531979.936367:0:167632:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34545:0x0] initial LVB size: 6291456, mtime: 0x627060cb, atime: 0x627060b4, ctime: 0x627060cb, blocks: 0x3000
00010000:00010000:1.0:1651531979.936372:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531979.936372:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531979.936374:0:167632:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca55cb lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447081 expref: 6 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531979.936379:0:167632:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca55cb lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447081 expref: 6 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531979.936383:0:167632:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001cf49bf2, rc 0)
00000100:00100000:1.0:1651531979.936393:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b5b5b4c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438148:x1731754467787456:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (62us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531979.936398:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44925
00000100:00100000:1.0:1651531979.936736:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531979.936754:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467787584
00000100:00100000:0.0:1651531979.936768:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250646
00000100:00100000:0.0:1651531979.936769:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b338475a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467787584:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531979.936778:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca55d2 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.936782:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531979.936793:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531979.936794:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca55d2 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [749568->753663] (req 749568->753663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.936799:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca55d2 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [749568->753663] (req 749568->753663) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.936812:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca55d2 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [749568->753663] (req 749568->753663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.936815:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca55d2 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [749568->753663] (req 749568->753663) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531979.936838:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b338475a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467787584:12345-10.240.43.64@tcp:3:fio.0 Request processed in 67us (102us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531979.936841:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250646
00010000:00010000:0.0:1651531979.936848:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca55d2 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [749568->753663] (req 749568->753663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.936852:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e2ec18e1 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531979.936853:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca55d2 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [749568->753663] (req 749568->753663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.936856:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca55d2 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [749568->753663] (req 749568->753663) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.936860:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca55d2 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [749568->753663] (req 749568->753663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.936863:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca55d2 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [749568->753663] (req 749568->753663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531979.937510:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531979.937518:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467787840
00000100:00100000:1.0:1651531979.937533:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250647
00000100:00100000:1.0:1651531979.937535:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f05c0b82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467787840:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531979.937542:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca55d9 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.937546:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531979.937547:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531979.937548:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca55d9 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [270336->274431] (req 270336->274431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.937552:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca55d9 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [270336->274431] (req 270336->274431) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.937564:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca55d9 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [270336->274431] (req 270336->274431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.937567:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca55d9 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [270336->274431] (req 270336->274431) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.937584:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca55d9 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [270336->274431] (req 270336->274431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531979.937586:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f05c0b82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467787840:12345-10.240.43.64@tcp:3:fio.0 Request processed in 51us (76us total) trans 0 rc 4096/4096
00010000:00010000:0.0:1651531979.937588:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009c5faf65 already unused, calling callback (0000000049fddea7)
00000100:00100000:1.0:1651531979.937589:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250647
00010000:00010000:0.0:1651531979.937590:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca55d9 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [270336->274431] (req 270336->274431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.937593:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca55d9 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [270336->274431] (req 270336->274431) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.937598:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca55d9 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [270336->274431] (req 270336->274431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.937600:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca55d9 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [270336->274431] (req 270336->274431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531979.938241:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531979.938249:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467788096
00000100:00100000:1.0:1651531979.938264:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250648
00000100:00100000:1.0:1651531979.938266:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000530f55ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467788096:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531979.938273:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca55e0 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.938277:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531979.938277:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531979.938278:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca55e0 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [528384->532479] (req 528384->532479) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.938282:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca55e0 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [528384->532479] (req 528384->532479) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.938292:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca55e0 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [528384->532479] (req 528384->532479) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.938296:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca55e0 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [528384->532479] (req 528384->532479) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.938312:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca55e0 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [528384->532479] (req 528384->532479) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531979.938314:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000530f55ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467788096:12345-10.240.43.64@tcp:3:fio.0 Request processed in 47us (73us total) trans 0 rc 4096/4096
00010000:00010000:0.0:1651531979.938316:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c806f265 already unused, calling callback (0000000049fddea7)
00000100:00100000:1.0:1651531979.938317:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250648
00010000:00010000:0.0:1651531979.938317:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca55e0 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [528384->532479] (req 528384->532479) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.938320:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca55e0 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [528384->532479] (req 528384->532479) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.938325:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca55e0 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [528384->532479] (req 528384->532479) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.938329:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca55e0 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [528384->532479] (req 528384->532479) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531979.938639:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531979.938647:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467788224
00000100:00100000:1.0:1651531979.938658:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250649
00000100:00100000:1.0:1651531979.938660:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085f82b51 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438148:x1731754467788224:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531979.938667:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca55e7 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.938675:0:166118:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca55cb lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447081 expref: 6 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531979.938678:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531979.938679:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531979.938680:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca55e7 lrc: 4/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [573440->577535] (req 573440->577535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.938687:0:166118:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca55cb lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db447081 expref: 6 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531979.938691:0:166118:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca55cb lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db447081 expref: 6 pid: 167632 timeout: 22788 lvb_type: 1
00000100:00100000:1.0:1651531979.938695:0:166118:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000588d3697 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:166118:1731745997361728:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531979.938707:0:166118:0:(client.c:2492:ptlrpc_set_wait()) set 000000000d54aa61 going to sleep for 6 seconds
00000100:00100000:1.0:1651531979.938954:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531979.938967:0:166118:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000588d3697 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:166118:1731745997361728:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531979.938971:0:166102:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467788288
00010000:00010000:1.0:1651531979.938972:0:166118:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca55e7 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [573440->577535] (req 573440->577535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.938978:0:166102:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca55cb lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db447081 expref: 7 pid: 167632 timeout: 22788 lvb_type: 1
00000100:00100000:0.0:1651531979.938986:0:166102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 301
00000100:00100000:0.0:1651531979.938988:0:166102:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005f5a393c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438147:x1731754467788288:12345-10.240.43.64@tcp:103:ldlm_bl_04.0
00010000:00010000:0.0:1651531979.938991:0:166102:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531979.938995:0:166102:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca55cb lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db447081 expref: 7 pid: 167632 timeout: 22788 lvb_type: 1
00010000:00010000:0.0:1651531979.938999:0:166102:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca55cb lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db447081 expref: 7 pid: 167632 timeout: 22788 lvb_type: 1
00010000:00010000:0.0:1651531979.939005:0:166102:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca55cb lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db447081 expref: 7 pid: 167632 timeout: 22788 lvb_type: 1
00010000:00010000:0.0:1651531979.939009:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531979.939009:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531979.939010:0:166102:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca55e7 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [573440->577535] (req 573440->577535) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.939013:0:166102:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca55e7 lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [573440->577535] (req 573440->577535) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.939030:0:166102:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651531979.939040:0:166102:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005f5a393c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438147:x1731754467788288:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 51us (86us total) trans 0 rc 0/0
00010000:00010000:1.0:1651531979.939043:0:166118:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca55e7 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [573440->577535] (req 573440->577535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531979.939043:0:166102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 301
00010000:00010000:1.0:1651531979.939047:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca55e7 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [573440->577535] (req 573440->577535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531979.972476:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531979.972500:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467788480
00000100:00100000:0.0:1651531979.972516:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250650
00000100:00100000:0.0:1651531979.972517:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000588d3697 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467788480:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:0.0:1651531979.972525:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca55ee lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.972529:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531979.972530:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531979.972531:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca55ee lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [774144->778239] (req 774144->778239) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.972535:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca55ee lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [774144->778239] (req 774144->778239) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531979.984201:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869533 is committed
00010000:00010000:1.0:1651531979.984248:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca55e7 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [573440->577535] (req 573440->577535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.984252:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca55e7 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [573440->577535] (req 573440->577535) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531979.984273:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085f82b51 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467788224:12345-10.240.43.64@tcp:4:fio.0 Request processed in 45612us (45634us total) trans 21474869533 rc 0/0
00010000:00010000:0.0:1651531979.984275:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca55e7 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [573440->577535] (req 573440->577535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531979.984276:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250649
00010000:00010000:0.0:1651531979.984279:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000000bb25cc already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531979.984280:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca55e7 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [573440->577535] (req 573440->577535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.984283:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca55e7 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [573440->577535] (req 573440->577535) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.984292:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca55e7 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [573440->577535] (req 573440->577535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531979.984295:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca55e7 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [573440->577535] (req 573440->577535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531979.984635:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531979.984643:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467788672
00000100:00100000:1.0:1651531979.984655:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44926
00000100:00100000:1.0:1651531979.984656:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000369eaefe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467788672:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531979.984660:0:167632:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531979.984664:0:167632:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca55f5 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44708f expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.984672:0:167632:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca55f5 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44708f expref: 9 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531979.984676:0:167632:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca55f5 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44708f expref: 9 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531979.984680:0:167632:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000eebd17a1, rc 0)
00000100:00100000:1.0:1651531979.984689:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000369eaefe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467788672:12345-10.240.43.64@tcp:101:fio.0 Request processed in 32us (55us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531979.984693:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44926
00000100:00100000:1.0:1651531979.985431:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531979.985438:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467788928
00000100:00100000:1.0:1651531979.985448:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250651
00000100:00100000:1.0:1651531979.985449:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004c7cb322 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467788928:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531979.985456:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca55fc lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.985460:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531979.985460:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531979.985461:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca55fc lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [753664->757759] (req 753664->757759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.985465:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca55fc lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [753664->757759] (req 753664->757759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531979.996950:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531979.996958:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467789056
00000100:00100000:1.0:1651531979.996970:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44927
00000100:00100000:1.0:1651531979.996972:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000056da8167 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754467789056:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531979.996976:0:167632:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531979.996987:0:167632:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca5603 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44709d expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531979.996995:0:167632:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca5603 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44709d expref: 12 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531979.997003:0:167632:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca5603 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44709d expref: 12 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531979.997007:0:167632:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000eebd17a1, rc 0)
00000100:00100000:1.0:1651531979.997017:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000056da8167 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754467789056:12345-10.240.43.64@tcp:101:fio.0 Request processed in 44us (68us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531979.997020:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44927
00000100:00100000:1.0:1651531980.044769:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531980.044780:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467789632
00000100:00100000:1.0:1651531980.044794:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44928
00000100:00100000:1.0:1651531980.044796:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000bd28b3f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754467789632:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531980.044801:0:167632:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531980.044817:0:167632:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca560a lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4470ab expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531980.044824:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869535 is committed
00010000:00010000:1.0:1651531980.044827:0:167632:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca560a lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4470ab expref: 11 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531980.044840:0:167632:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca560a lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4470ab expref: 8 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531980.044844:0:167632:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000eebd17a1, rc 0)
00010000:00010000:0.0:1651531980.044844:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca55ee lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 5 type: EXT [774144->778239] (req 774144->778239) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.044848:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca55ee lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [774144->778239] (req 774144->778239) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531980.044856:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000bd28b3f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438149:x1731754467789632:12345-10.240.43.64@tcp:101:fio.0 Request processed in 59us (88us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531980.044859:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44928
00000100:00100000:0.0:1651531980.044864:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000588d3697 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438147:x1731754467788480:12345-10.240.43.64@tcp:4:fio.0 Request processed in 72345us (72388us total) trans 21474869534 rc 0/0
00000100:00100000:0.0:1651531980.044867:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250650
00010000:00010000:0.0:1651531980.044874:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca55ee lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [774144->778239] (req 774144->778239) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531980.044875:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca55fc lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [753664->757759] (req 753664->757759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531980.044878:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca55fc lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [753664->757759] (req 753664->757759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.044883:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e2ec18e1 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531980.044884:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca55ee lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [774144->778239] (req 774144->778239) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.044893:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca55ee lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [774144->778239] (req 774144->778239) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531980.044896:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004c7cb322 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438148:x1731754467788928:12345-10.240.43.64@tcp:4:fio.0 Request processed in 59446us (59466us total) trans 21474869535 rc 0/0
00010000:00010000:0.0:1651531980.044898:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca55ee lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [774144->778239] (req 774144->778239) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531980.044899:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250651
00010000:00010000:0.0:1651531980.044902:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca55ee lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [774144->778239] (req 774144->778239) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.044906:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca55fc lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [753664->757759] (req 753664->757759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.044908:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f2af03c8 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531980.044909:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca55fc lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [753664->757759] (req 753664->757759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.044912:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca55fc lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [753664->757759] (req 753664->757759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.044915:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca55fc lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [753664->757759] (req 753664->757759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.044918:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca55fc lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [753664->757759] (req 753664->757759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531980.045414:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531980.045424:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467790016
00000100:00100000:1.0:1651531980.045438:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250652
00000100:00100000:1.0:1651531980.045440:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000780762a0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438148:x1731754467790016:12345-10.240.43.64@tcp:4:fio.0
00002000:00010000:1.0:1651531980.045449:0:166118:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34545:0x0] initial LVB size: 6291456, mtime: 0x627060cb, atime: 0x627060b4, ctime: 0x627060cb, blocks: 0x3000
00010000:00010000:1.0:1651531980.045452:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca5611 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531980.045456:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531980.045456:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531980.045457:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca5611 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [278528->282623] (req 278528->282623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531980.045462:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca5611 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [278528->282623] (req 278528->282623) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531980.045950:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531980.045958:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467790208
00000100:00100000:1.0:1651531980.045972:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44929
00000100:00100000:1.0:1651531980.045974:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000862392e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467790208:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531980.045979:0:167632:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531980.045983:0:167632:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5618 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4470b9 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531980.045991:0:167632:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5618 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4470b9 expref: 9 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531980.045996:0:167632:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5618 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4470b9 expref: 9 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531980.045999:0:167632:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000000bb25cc, rc 0)
00000100:00100000:1.0:1651531980.046010:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000862392e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467790208:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (61us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531980.046013:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44929
00000100:00100000:1.0:1651531980.046780:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531980.046788:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467790464
00000100:00100000:1.0:1651531980.046801:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44930
00000100:00100000:1.0:1651531980.046802:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000609b5f90 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467790464:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531980.046806:0:167632:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531980.046810:0:167632:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca561f lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4470c7 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531980.046817:0:167632:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca561f lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4470c7 expref: 9 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531980.046822:0:167632:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca561f lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4470c7 expref: 9 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531980.046826:0:167632:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001cf49bf2, rc 0)
00000100:00100000:1.0:1651531980.046836:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000609b5f90 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467790464:12345-10.240.43.64@tcp:101:fio.0 Request processed in 33us (57us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531980.046839:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44930
00000100:00100000:1.0:1651531980.047554:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531980.047561:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467790720
00000100:00100000:1.0:1651531980.047574:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44931
00000100:00100000:1.0:1651531980.047576:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005f06cf32 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467790720:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531980.047579:0:167632:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531980.047583:0:167632:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5626 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4470d5 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531980.047590:0:167632:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5626 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4470d5 expref: 9 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531980.047594:0:167632:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5626 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4470d5 expref: 9 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531980.047598:0:167632:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c806f265, rc 0)
00000100:00100000:1.0:1651531980.047607:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005f06cf32 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467790720:12345-10.240.43.64@tcp:101:fio.0 Request processed in 31us (54us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531980.047610:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44931
00000001:00080000:0.0:1651531980.080521:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869536 is committed
00002000:00010000:1.0:1651531980.080550:0:166118:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x34545:0x0] updating lvb mtime from disk: 1651531979 -> 1651531980
00002000:00010000:1.0:1651531980.080552:0:166118:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x34545:0x0] updating lvb ctime from disk: 1651531979 -> 1651531980
00010000:00010000:1.0:1651531980.080555:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca5611 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [278528->282623] (req 278528->282623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531980.080561:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca5611 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [278528->282623] (req 278528->282623) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531980.080582:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000780762a0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438148:x1731754467790016:12345-10.240.43.64@tcp:4:fio.0 Request processed in 35141us (35168us total) trans 21474869536 rc 0/0
00010000:00010000:0.0:1651531980.080583:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca5611 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [278528->282623] (req 278528->282623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531980.080585:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250652
00010000:00010000:0.0:1651531980.080588:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c8969b4f already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531980.080589:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca5611 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [278528->282623] (req 278528->282623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.080592:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca5611 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [278528->282623] (req 278528->282623) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.080599:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca5611 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [278528->282623] (req 278528->282623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.080601:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca5611 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [278528->282623] (req 278528->282623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531980.081037:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531980.081045:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467791104
00000100:00100000:1.0:1651531980.081059:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250653
00000100:00100000:1.0:1651531980.081060:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000015ad4671 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438149:x1731754467791104:12345-10.240.43.64@tcp:4:fio.0
00002000:00010000:1.0:1651531980.081069:0:166118:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34545:0x0] initial LVB size: 6291456, mtime: 0x627060cc, atime: 0x627060b4, ctime: 0x627060cc, blocks: 0x3000
00010000:00010000:1.0:1651531980.081072:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca562d lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531980.081076:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531980.081076:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531980.081077:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca562d lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [585728->589823] (req 585728->589823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531980.081081:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca562d lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [585728->589823] (req 585728->589823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531980.094328:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531980.094337:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467791232
00000100:00100000:1.0:1651531980.094349:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44932
00000100:00100000:1.0:1651531980.094351:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002ea4f499 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467791232:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531980.094357:0:167632:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531980.094361:0:167632:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca5634 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4470e3 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531980.094369:0:167632:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca5634 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4470e3 expref: 9 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531980.094373:0:167632:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca5634 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4470e3 expref: 9 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531980.094377:0:167632:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001cf49bf2, rc 0)
00000100:00100000:1.0:1651531980.094387:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002ea4f499 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754467791232:12345-10.240.43.64@tcp:101:fio.0 Request processed in 35us (60us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531980.094390:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44932
00000100:00100000:1.0:1651531980.094784:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531980.094806:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467791488
00000100:00100000:0.0:1651531980.094822:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250654
00000100:00100000:0.0:1651531980.094824:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004d9c5b96 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467791488:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:0.0:1651531980.094831:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca563b lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.094836:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531980.094836:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531980.094837:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca563b lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [286720->290815] (req 286720->290815) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.094841:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca563b lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [286720->290815] (req 286720->290815) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.094855:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca563b lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [286720->290815] (req 286720->290815) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.094858:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca563b lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [286720->290815] (req 286720->290815) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531980.094879:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004d9c5b96 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467791488:12345-10.240.43.64@tcp:3:fio.0 Request processed in 54us (95us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1651531980.094885:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250654
00010000:00010000:0.0:1651531980.094892:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca563b lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [286720->290815] (req 286720->290815) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.094896:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e2ec18e1 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531980.094897:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca563b lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [286720->290815] (req 286720->290815) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.094900:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca563b lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [286720->290815] (req 286720->290815) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.094904:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca563b lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [286720->290815] (req 286720->290815) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.094907:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca563b lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [286720->290815] (req 286720->290815) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531980.095195:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531980.095203:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467791680
00000100:00100000:1.0:1651531980.095214:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44933
00000100:00100000:1.0:1651531980.095215:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000190515a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467791680:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531980.095240:0:167632:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531980.095244:0:167632:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5642 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4470f1 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531980.095252:0:167632:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5642 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4470f1 expref: 9 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531980.095260:0:167632:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5642 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4470f1 expref: 9 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531980.095264:0:167632:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000000bb25cc, rc 0)
00000100:00100000:1.0:1651531980.095274:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000190515a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467791680:12345-10.240.43.64@tcp:101:fio.0 Request processed in 58us (80us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531980.095277:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44933
00000001:00080000:0.0:1651531980.125821:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869537 is committed
00010000:00010000:1.0:1651531980.125851:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca562d lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [585728->589823] (req 585728->589823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531980.125856:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca562d lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [585728->589823] (req 585728->589823) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531980.125875:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000015ad4671 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438149:x1731754467791104:12345-10.240.43.64@tcp:4:fio.0 Request processed in 44814us (44839us total) trans 21474869537 rc 0/0
00010000:00010000:0.0:1651531980.125878:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca562d lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [585728->589823] (req 585728->589823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531980.125879:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250653
00010000:00010000:0.0:1651531980.125883:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c806f265 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531980.125884:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca562d lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [585728->589823] (req 585728->589823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.125887:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca562d lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [585728->589823] (req 585728->589823) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.125896:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca562d lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [585728->589823] (req 585728->589823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.125899:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca562d lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [585728->589823] (req 585728->589823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531980.126202:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531980.126210:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467792064
00000100:00100000:1.0:1651531980.126241:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44934
00000100:00100000:1.0:1651531980.126243:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000537f4978 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438148:x1731754467792064:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531980.126246:0:167632:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531980.126251:0:167632:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5649 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db4470ff expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651531980.126256:0:167632:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34545:0x0] initial LVB size: 6291456, mtime: 0x627060cc, atime: 0x627060b4, ctime: 0x627060cc, blocks: 0x3000
00010000:00010000:1.0:1651531980.126261:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531980.126262:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531980.126263:0:167632:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5649 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4470ff expref: 6 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531980.126268:0:167632:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5649 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4470ff expref: 6 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531980.126272:0:167632:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000000bb25cc, rc 0)
00000100:00100000:1.0:1651531980.126282:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000537f4978 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438148:x1731754467792064:12345-10.240.43.64@tcp:101:fio.0 Request processed in 39us (81us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531980.126285:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44934
00000100:00100000:1.0:1651531980.126654:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531980.126662:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467792192
00000100:00100000:1.0:1651531980.126676:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250655
00000100:00100000:1.0:1651531980.126678:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006f7f590d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467792192:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531980.126686:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca5650 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531980.126690:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531980.126690:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531980.126691:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca5650 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [593920->598015] (req 593920->598015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531980.126695:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca5650 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [593920->598015] (req 593920->598015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531980.126708:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca5650 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [593920->598015] (req 593920->598015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531980.126712:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca5650 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [593920->598015] (req 593920->598015) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.126730:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca5650 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [593920->598015] (req 593920->598015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531980.126732:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006f7f590d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467792192:12345-10.240.43.64@tcp:3:fio.0 Request processed in 53us (78us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531980.126734:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250655
00010000:00010000:0.0:1651531980.126734:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001cf49bf2 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531980.126735:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca5650 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [593920->598015] (req 593920->598015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.126738:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca5650 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [593920->598015] (req 593920->598015) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.126743:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca5650 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [593920->598015] (req 593920->598015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.126746:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca5650 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [593920->598015] (req 593920->598015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531980.127068:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531980.127076:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467792320
00000100:00100000:1.0:1651531980.127089:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250656
00000100:00100000:1.0:1651531980.127090:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000245a07a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467792320:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531980.127097:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca5657 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531980.127102:0:166118:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5649 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db4470ff expref: 6 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531980.127105:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531980.127105:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531980.127106:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca5657 lrc: 4/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [598016->602111] (req 598016->602111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531980.127113:0:166118:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5649 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4470ff expref: 6 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531980.127117:0:166118:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5649 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4470ff expref: 6 pid: 167632 timeout: 22788 lvb_type: 1
00000100:00100000:1.0:1651531980.127126:0:166118:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cff0521d pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:166118:1731745997361792:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531980.127138:0:166118:0:(client.c:2492:ptlrpc_set_wait()) set 000000000d54aa61 going to sleep for 6 seconds
00000100:00100000:1.0:1651531980.127396:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531980.127407:0:166104:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467792384
00000100:00100000:1.0:1651531980.127408:0:166118:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cff0521d pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:166118:1731745997361792:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651531980.127412:0:166118:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca5657 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [598016->602111] (req 598016->602111) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.127414:0:166104:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5649 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4470ff expref: 7 pid: 167632 timeout: 22788 lvb_type: 1
00000100:00100000:0.0:1651531980.127422:0:166104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 302
00000100:00100000:0.0:1651531980.127424:0:166104:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000952f345f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438146:x1731754467792384:12345-10.240.43.64@tcp:103:ldlm_bl_01.0
00010000:00010000:0.0:1651531980.127429:0:166104:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531980.127433:0:166104:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5649 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4470ff expref: 7 pid: 167632 timeout: 22788 lvb_type: 1
00010000:00010000:0.0:1651531980.127437:0:166104:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5649 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4470ff expref: 7 pid: 167632 timeout: 22788 lvb_type: 1
00010000:00010000:0.0:1651531980.127443:0:166104:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5649 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db4470ff expref: 7 pid: 167632 timeout: 22788 lvb_type: 1
00010000:00010000:0.0:1651531980.127446:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531980.127447:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531980.127448:0:166104:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca5657 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [598016->602111] (req 598016->602111) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.127451:0:166104:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca5657 lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [598016->602111] (req 598016->602111) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.127464:0:166104:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651531980.127474:0:166104:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000952f345f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438146:x1731754467792384:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 49us (79us total) trans 0 rc 0/0
00010000:00010000:1.0:1651531980.127477:0:166118:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca5657 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [598016->602111] (req 598016->602111) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531980.127477:0:166104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 302
00010000:00010000:1.0:1651531980.127480:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca5657 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [598016->602111] (req 598016->602111) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531980.149977:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531980.149986:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467792512
00000100:00100000:1.0:1651531980.150007:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44935
00000100:00100000:1.0:1651531980.150009:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cff0521d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467792512:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531980.150012:0:167632:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531980.150016:0:167632:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca565e lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44710d expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531980.150024:0:167632:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca565e lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44710d expref: 9 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531980.150028:0:167632:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca565e lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44710d expref: 9 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531980.150033:0:167632:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009c5faf65, rc 0)
00000100:00100000:1.0:1651531980.150043:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cff0521d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467792512:12345-10.240.43.64@tcp:101:fio.0 Request processed in 34us (67us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531980.150046:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44935
00000001:00080000:0.0:1651531980.162450:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869538 is committed
00010000:00010000:1.0:1651531980.162480:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca5657 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [598016->602111] (req 598016->602111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531980.162484:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca5657 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [598016->602111] (req 598016->602111) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531980.162503:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000245a07a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438149:x1731754467792320:12345-10.240.43.64@tcp:4:fio.0 Request processed in 35412us (35436us total) trans 21474869538 rc 0/0
00000100:00100000:1.0:1651531980.162506:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250656
00010000:00010000:0.0:1651531980.162506:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca5657 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [598016->602111] (req 598016->602111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.162511:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000eebd17a1 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531980.162512:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca5657 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [598016->602111] (req 598016->602111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.162516:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca5657 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [598016->602111] (req 598016->602111) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.162522:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca5657 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [598016->602111] (req 598016->602111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.162524:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca5657 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [598016->602111] (req 598016->602111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531980.162844:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531980.162852:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467793088
00000100:00100000:1.0:1651531980.162862:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44936
00000100:00100000:1.0:1651531980.162863:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000064783351 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438148:x1731754467793088:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531980.162867:0:167632:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531980.162871:0:167632:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca5665 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44711b expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651531980.162876:0:167632:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34545:0x0] initial LVB size: 6291456, mtime: 0x627060cc, atime: 0x627060b4, ctime: 0x627060cc, blocks: 0x3000
00010000:00010000:1.0:1651531980.162880:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531980.162881:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531980.162883:0:167632:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca5665 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44711b expref: 6 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531980.162891:0:167632:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca5665 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44711b expref: 6 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531980.162895:0:167632:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009c5faf65, rc 0)
00000100:00100000:1.0:1651531980.162905:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000064783351 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438148:x1731754467793088:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (61us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531980.162907:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44936
00000100:00100000:1.0:1651531980.163244:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531980.163251:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467793216
00000100:00100000:1.0:1651531980.163266:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250657
00000100:00100000:1.0:1651531980.163267:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fc9f5484 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467793216:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531980.163274:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca566c lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531980.163278:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531980.163279:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531980.163280:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca566c lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [757760->761855] (req 757760->761855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531980.163284:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca566c lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [757760->761855] (req 757760->761855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531980.163296:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca566c lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [757760->761855] (req 757760->761855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531980.163299:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca566c lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [757760->761855] (req 757760->761855) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.163317:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca566c lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [757760->761855] (req 757760->761855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531980.163320:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fc9f5484 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467793216:12345-10.240.43.64@tcp:3:fio.0 Request processed in 51us (76us total) trans 0 rc 4096/4096
00010000:00010000:0.0:1651531980.163321:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d3014069 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531980.163322:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca566c lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [757760->761855] (req 757760->761855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531980.163323:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250657
00010000:00010000:0.0:1651531980.163325:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca566c lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [757760->761855] (req 757760->761855) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.163330:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca566c lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [757760->761855] (req 757760->761855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.163333:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca566c lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [757760->761855] (req 757760->761855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531980.163649:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531980.163657:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467793344
00000100:00100000:1.0:1651531980.163669:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250658
00000100:00100000:1.0:1651531980.163671:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003904d239 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467793344:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531980.163677:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca5673 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531980.163682:0:166118:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca5665 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44711b expref: 6 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531980.163685:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531980.163686:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531980.163687:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca5673 lrc: 4/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [602112->606207] (req 602112->606207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531980.163694:0:166118:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca5665 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44711b expref: 6 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531980.163698:0:166118:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca5665 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44711b expref: 6 pid: 167632 timeout: 22788 lvb_type: 1
00000100:00100000:1.0:1651531980.163702:0:166118:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e841da4a pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:166118:1731745997361856:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531980.163714:0:166118:0:(client.c:2492:ptlrpc_set_wait()) set 000000000d54aa61 going to sleep for 6 seconds
00000100:00100000:1.0:1651531980.163983:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531980.163998:0:166118:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e841da4a pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:166118:1731745997361856:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651531980.164002:0:166102:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467793408
00010000:00010000:1.0:1651531980.164003:0:166118:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca5673 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [602112->606207] (req 602112->606207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.164008:0:166102:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca5665 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44711b expref: 7 pid: 167632 timeout: 22788 lvb_type: 1
00000100:00100000:0.0:1651531980.164020:0:166102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 303
00000100:00100000:0.0:1651531980.164022:0:166102:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d3d59e23 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438146:x1731754467793408:12345-10.240.43.64@tcp:103:ldlm_bl_04.0
00010000:00010000:0.0:1651531980.164025:0:166102:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531980.164029:0:166102:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca5665 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44711b expref: 7 pid: 167632 timeout: 22788 lvb_type: 1
00010000:00010000:0.0:1651531980.164033:0:166102:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca5665 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44711b expref: 7 pid: 167632 timeout: 22788 lvb_type: 1
00010000:00010000:0.0:1651531980.164038:0:166102:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca5665 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44711b expref: 7 pid: 167632 timeout: 22788 lvb_type: 1
00010000:00010000:0.0:1651531980.164042:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531980.164043:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531980.164044:0:166102:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca5673 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [602112->606207] (req 602112->606207) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.164047:0:166102:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca5673 lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [602112->606207] (req 602112->606207) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.164060:0:166102:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651531980.164070:0:166102:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d3d59e23 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438146:x1731754467793408:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 47us (87us total) trans 0 rc 0/0
00010000:00010000:1.0:1651531980.164073:0:166118:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca5673 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [602112->606207] (req 602112->606207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531980.164073:0:166102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 303
00010000:00010000:1.0:1651531980.164077:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca5673 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [602112->606207] (req 602112->606207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531980.210173:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869539 is committed
00010000:00010000:1.0:1651531980.210204:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca5673 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [602112->606207] (req 602112->606207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531980.210209:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca5673 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [602112->606207] (req 602112->606207) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.210244:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca5673 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [602112->606207] (req 602112->606207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531980.210247:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003904d239 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438149:x1731754467793344:12345-10.240.43.64@tcp:4:fio.0 Request processed in 46575us (46598us total) trans 21474869539 rc 0/0
00000100:00100000:1.0:1651531980.210250:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250658
00010000:00010000:0.0:1651531980.210250:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000060a6272d already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531980.210251:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca5673 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [602112->606207] (req 602112->606207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.210254:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca5673 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [602112->606207] (req 602112->606207) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.210260:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca5673 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [602112->606207] (req 602112->606207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.210262:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca5673 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [602112->606207] (req 602112->606207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531980.210588:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531980.210595:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467793536
00000100:00100000:1.0:1651531980.210606:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44937
00000100:00100000:1.0:1651531980.210608:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fe87f326 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438148:x1731754467793536:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531980.210611:0:167632:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531980.210616:0:167632:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca567a lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447129 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651531980.210624:0:167632:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34545:0x0] initial LVB size: 6291456, mtime: 0x627060cc, atime: 0x627060b4, ctime: 0x627060cc, blocks: 0x3000
00010000:00010000:1.0:1651531980.210628:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531980.210629:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531980.210631:0:167632:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca567a lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447129 expref: 6 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531980.210635:0:167632:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca567a lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447129 expref: 6 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531980.210639:0:167632:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000008b0c325f, rc 0)
00000100:00100000:1.0:1651531980.210649:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fe87f326 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438148:x1731754467793536:12345-10.240.43.64@tcp:101:fio.0 Request processed in 41us (62us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531980.210652:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44937
00000100:00100000:1.0:1651531980.211027:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531980.211035:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467793664
00000100:00100000:1.0:1651531980.211050:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250659
00000100:00100000:1.0:1651531980.211052:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000190515a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467793664:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531980.211059:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5681 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531980.211063:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531980.211064:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531980.211065:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5681 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [765952->770047] (req 765952->770047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531980.211069:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5681 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [765952->770047] (req 765952->770047) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531980.211082:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5681 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [765952->770047] (req 765952->770047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531980.211086:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5681 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [765952->770047] (req 765952->770047) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.211103:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5681 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [765952->770047] (req 765952->770047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531980.211105:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000190515a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467793664:12345-10.240.43.64@tcp:3:fio.0 Request processed in 52us (78us total) trans 0 rc 4096/4096
00010000:00010000:0.0:1651531980.211107:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f6ecb7e5 already unused, calling callback (0000000049fddea7)
00000100:00100000:1.0:1651531980.211108:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250659
00010000:00010000:0.0:1651531980.211108:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5681 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [765952->770047] (req 765952->770047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.211111:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5681 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [765952->770047] (req 765952->770047) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.211115:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5681 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [765952->770047] (req 765952->770047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.211118:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5681 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [765952->770047] (req 765952->770047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531980.211211:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531980.211240:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467793856
00000100:00100000:1.0:1651531980.211252:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250660
00000100:00100000:1.0:1651531980.211253:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000537f4978 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467793856:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531980.211261:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca5688 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531980.211265:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531980.211265:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531980.211266:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca5688 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [872448->876543] (req 872448->876543) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531980.211270:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca5688 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [872448->876543] (req 872448->876543) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531980.211281:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca5688 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [872448->876543] (req 872448->876543) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531980.211288:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca5688 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [872448->876543] (req 872448->876543) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.211297:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca5688 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [872448->876543] (req 872448->876543) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.211301:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000022b2104e already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531980.211302:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca5688 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [872448->876543] (req 872448->876543) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531980.211304:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000537f4978 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467793856:12345-10.240.43.64@tcp:3:fio.0 Request processed in 50us (94us total) trans 0 rc 4096/4096
00010000:00010000:0.0:1651531980.211305:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca5688 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [872448->876543] (req 872448->876543) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531980.211307:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250660
00010000:00010000:0.0:1651531980.211310:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca5688 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [872448->876543] (req 872448->876543) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.211313:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca5688 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [872448->876543] (req 872448->876543) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531980.252541:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531980.252549:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467794688
00000100:00100000:1.0:1651531980.252562:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250661
00000100:00100000:1.0:1651531980.252564:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cff0521d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438146:x1731754467794688:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531980.252571:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca568f lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531980.252575:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531980.252576:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531980.252576:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca568f lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [802816->806911] (req 802816->806911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531980.252580:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca568f lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [802816->806911] (req 802816->806911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531980.252591:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca568f lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [802816->806911] (req 802816->806911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531980.252594:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca568f lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [802816->806911] (req 802816->806911) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531980.252616:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cff0521d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438146:x1731754467794688:12345-10.240.43.64@tcp:3:fio.0 Request processed in 51us (76us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531980.252619:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250661
00010000:00010000:0.0:1651531980.252619:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca568f lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [802816->806911] (req 802816->806911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.252623:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f58aeba9 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531980.252624:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca568f lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [802816->806911] (req 802816->806911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.252627:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca568f lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [802816->806911] (req 802816->806911) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.252632:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca568f lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [802816->806911] (req 802816->806911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.252636:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca568f lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [802816->806911] (req 802816->806911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531980.301285:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531980.301293:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467795072
00000100:00100000:1.0:1651531980.301307:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250662
00000100:00100000:1.0:1651531980.301308:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000064783351 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438146:x1731754467795072:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531980.301316:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca5696 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531980.301320:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531980.301321:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531980.301322:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca5696 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [847872->851967] (req 847872->851967) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531980.301325:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca5696 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [847872->851967] (req 847872->851967) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531980.301336:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca5696 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [847872->851967] (req 847872->851967) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531980.301339:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca5696 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [847872->851967] (req 847872->851967) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531980.301358:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000064783351 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438146:x1731754467795072:12345-10.240.43.64@tcp:3:fio.0 Request processed in 48us (73us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531980.301360:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250662
00010000:00010000:0.0:1651531980.301360:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca5696 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [847872->851967] (req 847872->851967) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.301364:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f6135e30 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531980.301365:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca5696 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [847872->851967] (req 847872->851967) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.301368:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca5696 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [847872->851967] (req 847872->851967) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.301373:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca5696 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [847872->851967] (req 847872->851967) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.301376:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca5696 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [847872->851967] (req 847872->851967) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531980.301708:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531980.301716:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467795328
00000100:00100000:1.0:1651531980.301731:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250663
00000100:00100000:1.0:1651531980.301732:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e841da4a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438147:x1731754467795328:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531980.301739:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca569d lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531980.301744:0:166118:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca567a lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447129 expref: 6 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531980.301747:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531980.301748:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531980.301749:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca569d lrc: 4/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [806912->811007] (req 806912->811007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531980.301756:0:166118:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca567a lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db447129 expref: 6 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531980.301760:0:166118:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca567a lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db447129 expref: 6 pid: 167632 timeout: 22788 lvb_type: 1
00000100:00100000:1.0:1651531980.301764:0:166118:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000993daf3f pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:166118:1731745997361920:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531980.301776:0:166118:0:(client.c:2492:ptlrpc_set_wait()) set 000000000d54aa61 going to sleep for 6 seconds
00000100:00100000:1.0:1651531980.301980:0:166118:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000993daf3f pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:166118:1731745997361920:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651531980.301985:0:166118:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca569d lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [806912->811007] (req 806912->811007) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531980.302033:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531980.302045:0:166104:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467795520
00010000:00010000:0.0:1651531980.302051:0:166104:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca567a lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db447129 expref: 7 pid: 167632 timeout: 22788 lvb_type: 1
00000100:00100000:0.0:1651531980.302060:0:166104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 304
00000100:00100000:0.0:1651531980.302062:0:166104:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000993daf3f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438149:x1731754467795520:12345-10.240.43.64@tcp:103:ldlm_bl_03.0
00010000:00010000:0.0:1651531980.302065:0:166104:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531980.302070:0:166104:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca567a lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db447129 expref: 7 pid: 167632 timeout: 22788 lvb_type: 1
00010000:00010000:0.0:1651531980.302074:0:166104:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca567a lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db447129 expref: 7 pid: 167632 timeout: 22788 lvb_type: 1
00010000:00010000:0.0:1651531980.302079:0:166104:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca567a lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db447129 expref: 7 pid: 167632 timeout: 22788 lvb_type: 1
00010000:00010000:0.0:1651531980.302083:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531980.302084:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531980.302085:0:166104:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca569d lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [806912->811007] (req 806912->811007) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.302088:0:166104:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca569d lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [806912->811007] (req 806912->811007) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.302101:0:166104:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651531980.302111:0:166104:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000993daf3f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467795520:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 49us (78us total) trans 0 rc 0/0
00010000:00010000:1.0:1651531980.302114:0:166118:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca569d lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [806912->811007] (req 806912->811007) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531980.302114:0:166104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 304
00010000:00010000:1.0:1651531980.302118:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca569d lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [806912->811007] (req 806912->811007) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531980.337047:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869540 is committed
00010000:00010000:1.0:1651531980.337076:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca569d lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [806912->811007] (req 806912->811007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531980.337080:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca569d lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [806912->811007] (req 806912->811007) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531980.337100:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e841da4a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438147:x1731754467795328:12345-10.240.43.64@tcp:4:fio.0 Request processed in 35366us (35392us total) trans 21474869540 rc 0/0
00000100:00100000:1.0:1651531980.337103:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250663
00010000:00010000:0.0:1651531980.337103:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca569d lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [806912->811007] (req 806912->811007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.337107:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f58aeba9 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531980.337108:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca569d lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [806912->811007] (req 806912->811007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.337115:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca569d lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [806912->811007] (req 806912->811007) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.337120:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca569d lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [806912->811007] (req 806912->811007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.337122:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca569d lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [806912->811007] (req 806912->811007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531980.390512:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531980.390521:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467796288
00000100:00100000:1.0:1651531980.390533:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44938
00000100:00100000:1.0:1651531980.390535:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a5d56f0c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438148:x1731754467796288:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531980.390539:0:167632:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531980.390543:0:167632:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca56a4 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447137 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651531980.390549:0:167632:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34545:0x0] initial LVB size: 6291456, mtime: 0x627060cc, atime: 0x627060b4, ctime: 0x627060cc, blocks: 0x3000
00010000:00010000:1.0:1651531980.390553:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531980.390554:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531980.390556:0:167632:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca56a4 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447137 expref: 6 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531980.390561:0:167632:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca56a4 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447137 expref: 6 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531980.390565:0:167632:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000022b2104e, rc 0)
00000100:00100000:1.0:1651531980.390576:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a5d56f0c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438148:x1731754467796288:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (65us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531980.390578:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44938
00000100:00100000:1.0:1651531980.391304:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531980.391312:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467796544
00000100:00100000:1.0:1651531980.391326:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250664
00000100:00100000:1.0:1651531980.391327:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000016e67391 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467796544:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531980.391335:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca56ab lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531980.391339:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531980.391339:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531980.391340:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca56ab lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [851968->856063] (req 851968->856063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531980.391344:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca56ab lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [851968->856063] (req 851968->856063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531980.391355:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca56ab lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [851968->856063] (req 851968->856063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531980.391362:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca56ab lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [851968->856063] (req 851968->856063) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531980.391381:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000016e67391 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467796544:12345-10.240.43.64@tcp:3:fio.0 Request processed in 53us (78us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531980.391384:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250664
00010000:00010000:0.0:1651531980.391384:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca56ab lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [851968->856063] (req 851968->856063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.391388:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f6ecb7e5 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531980.391389:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca56ab lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [851968->856063] (req 851968->856063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.391393:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca56ab lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [851968->856063] (req 851968->856063) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.391398:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca56ab lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [851968->856063] (req 851968->856063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.391400:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca56ab lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [851968->856063] (req 851968->856063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531980.391698:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531980.391706:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467796672
00000100:00100000:1.0:1651531980.391717:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250665
00000100:00100000:1.0:1651531980.391719:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000af1dcdef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467796672:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531980.391726:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca56b2 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531980.391730:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531980.391730:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531980.391731:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca56b2 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [856064->860159] (req 856064->860159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531980.391735:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca56b2 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [856064->860159] (req 856064->860159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531980.391746:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca56b2 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [856064->860159] (req 856064->860159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531980.391749:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca56b2 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [856064->860159] (req 856064->860159) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.391762:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca56b2 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [856064->860159] (req 856064->860159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531980.391769:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000af1dcdef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467796672:12345-10.240.43.64@tcp:3:fio.0 Request processed in 49us (71us total) trans 0 rc 4096/4096
00010000:00010000:0.0:1651531980.391770:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000060a6272d already unused, calling callback (0000000049fddea7)
00000100:00100000:1.0:1651531980.391771:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250665
00010000:00010000:0.0:1651531980.391771:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca56b2 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [856064->860159] (req 856064->860159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.391774:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca56b2 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [856064->860159] (req 856064->860159) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.391778:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca56b2 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [856064->860159] (req 856064->860159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.391781:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca56b2 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [856064->860159] (req 856064->860159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531980.392072:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531980.392080:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467796800
00000100:00100000:1.0:1651531980.392093:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250666
00000100:00100000:1.0:1651531980.392095:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000e33e11e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438148:x1731754467796800:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531980.392101:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca56b9 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531980.392106:0:166118:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca56a4 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447137 expref: 6 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531980.392109:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531980.392110:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531980.392110:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca56b9 lrc: 4/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [876544->880639] (req 876544->880639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531980.392117:0:166118:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca56a4 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db447137 expref: 6 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531980.392121:0:166118:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca56a4 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db447137 expref: 6 pid: 167632 timeout: 22789 lvb_type: 1
00000100:00100000:1.0:1651531980.392126:0:166118:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003158b8a7 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:166118:1731745997361984:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531980.392137:0:166118:0:(client.c:2492:ptlrpc_set_wait()) set 000000000d54aa61 going to sleep for 6 seconds
00000100:00100000:1.0:1651531980.392318:0:166118:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003158b8a7 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:166118:1731745997361984:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651531980.392323:0:166118:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca56b9 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [876544->880639] (req 876544->880639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531980.392356:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531980.392368:0:166102:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467796864
00010000:00010000:0.0:1651531980.392375:0:166102:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca56a4 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db447137 expref: 7 pid: 167632 timeout: 22789 lvb_type: 1
00000100:00100000:0.0:1651531980.392383:0:166102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 305
00000100:00100000:0.0:1651531980.392385:0:166102:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003158b8a7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438149:x1731754467796864:12345-10.240.43.64@tcp:103:ldlm_bl_06.0
00010000:00010000:0.0:1651531980.392389:0:166102:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531980.392393:0:166102:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca56a4 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db447137 expref: 7 pid: 167632 timeout: 22789 lvb_type: 1
00010000:00010000:0.0:1651531980.392397:0:166102:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca56a4 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db447137 expref: 7 pid: 167632 timeout: 22789 lvb_type: 1
00010000:00010000:0.0:1651531980.392406:0:166102:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca56a4 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db447137 expref: 7 pid: 167632 timeout: 22789 lvb_type: 1
00010000:00010000:0.0:1651531980.392410:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531980.392411:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531980.392412:0:166102:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca56b9 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [876544->880639] (req 876544->880639) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.392415:0:166102:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca56b9 lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [876544->880639] (req 876544->880639) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.392428:0:166102:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651531980.392438:0:166102:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003158b8a7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467796864:12345-10.240.43.64@tcp:103:ldlm_bl_06.0 Request processed in 52us (82us total) trans 0 rc 0/0
00010000:00010000:1.0:1651531980.392440:0:166118:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca56b9 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [876544->880639] (req 876544->880639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531980.392441:0:166102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 305
00010000:00010000:1.0:1651531980.392444:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca56b9 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [876544->880639] (req 876544->880639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531980.425975:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869541 is committed
00010000:00010000:1.0:1651531980.426005:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca56b9 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [876544->880639] (req 876544->880639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531980.426009:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca56b9 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [876544->880639] (req 876544->880639) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.426027:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca56b9 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [876544->880639] (req 876544->880639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531980.426029:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000e33e11e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438148:x1731754467796800:12345-10.240.43.64@tcp:4:fio.0 Request processed in 33934us (33957us total) trans 21474869541 rc 0/0
00010000:00010000:0.0:1651531980.426031:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009c5faf65 already unused, calling callback (0000000049fddea7)
00000100:00100000:1.0:1651531980.426032:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250666
00010000:00010000:0.0:1651531980.426032:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca56b9 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [876544->880639] (req 876544->880639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.426035:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca56b9 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [876544->880639] (req 876544->880639) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.426041:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca56b9 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [876544->880639] (req 876544->880639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.426055:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca56b9 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [876544->880639] (req 876544->880639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531980.426361:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531980.426369:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467796992
00000100:00100000:1.0:1651531980.426379:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44939
00000100:00100000:1.0:1651531980.426381:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000053de45f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438149:x1731754467796992:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531980.426384:0:167632:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531980.426389:0:167632:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca56c0 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447145 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651531980.426397:0:167632:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34545:0x0] initial LVB size: 6291456, mtime: 0x627060cc, atime: 0x627060b4, ctime: 0x627060cc, blocks: 0x3000
00010000:00010000:1.0:1651531980.426401:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531980.426402:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531980.426404:0:167632:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca56c0 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447145 expref: 6 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531980.426408:0:167632:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca56c0 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447145 expref: 6 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531980.426412:0:167632:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d3014069, rc 0)
00000100:00100000:1.0:1651531980.426422:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000053de45f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467796992:12345-10.240.43.64@tcp:101:fio.0 Request processed in 40us (62us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531980.426425:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44939
00000100:00100000:1.0:1651531980.427123:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531980.427131:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467797248
00000100:00100000:1.0:1651531980.427145:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250667
00000100:00100000:1.0:1651531980.427147:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005dd15341 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438148:x1731754467797248:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531980.427154:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca56c7 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531980.427158:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531980.427158:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531980.427159:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca56c7 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [880640->884735] (req 880640->884735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531980.427163:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca56c7 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [880640->884735] (req 880640->884735) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531980.427176:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca56c7 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [880640->884735] (req 880640->884735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531980.427179:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca56c7 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [880640->884735] (req 880640->884735) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.427196:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca56c7 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [880640->884735] (req 880640->884735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531980.427198:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005dd15341 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438148:x1731754467797248:12345-10.240.43.64@tcp:3:fio.0 Request processed in 50us (75us total) trans 0 rc 4096/4096
00010000:00010000:0.0:1651531980.427200:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000eebd17a1 already unused, calling callback (0000000049fddea7)
00000100:00100000:1.0:1651531980.427201:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250667
00010000:00010000:0.0:1651531980.427201:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca56c7 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [880640->884735] (req 880640->884735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.427204:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca56c7 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [880640->884735] (req 880640->884735) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.427209:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca56c7 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [880640->884735] (req 880640->884735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.427212:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca56c7 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [880640->884735] (req 880640->884735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531980.439369:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531980.439377:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467797632
00000100:00100000:1.0:1651531980.439391:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250668
00000100:00100000:1.0:1651531980.439393:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cb694635 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467797632:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531980.439399:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca56ce lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531980.439404:0:166118:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca56c0 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447145 expref: 6 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531980.439407:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531980.439408:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531980.439409:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca56ce lrc: 4/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [819200->823295] (req 819200->823295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531980.439416:0:166118:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca56c0 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db447145 expref: 6 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531980.439423:0:166118:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca56c0 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db447145 expref: 6 pid: 167632 timeout: 22789 lvb_type: 1
00000100:00100000:1.0:1651531980.439428:0:166118:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b9b10d48 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:166118:1731745997362048:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531980.439440:0:166118:0:(client.c:2492:ptlrpc_set_wait()) set 000000000d54aa61 going to sleep for 6 seconds
00000100:00100000:1.0:1651531980.439685:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531980.439699:0:166118:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b9b10d48 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:166118:1731745997362048:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651531980.439704:0:166118:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca56ce lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [819200->823295] (req 819200->823295) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531980.439708:0:166104:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467797696
00010000:00010000:0.0:1651531980.439714:0:166104:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca56c0 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db447145 expref: 7 pid: 167632 timeout: 22789 lvb_type: 1
00000100:00100000:0.0:1651531980.439723:0:166104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 306
00000100:00100000:0.0:1651531980.439725:0:166104:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005ec1cbc3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438147:x1731754467797696:12345-10.240.43.64@tcp:103:ldlm_bl_05.0
00010000:00010000:0.0:1651531980.439728:0:166104:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531980.439733:0:166104:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca56c0 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db447145 expref: 7 pid: 167632 timeout: 22789 lvb_type: 1
00010000:00010000:0.0:1651531980.439737:0:166104:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca56c0 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db447145 expref: 7 pid: 167632 timeout: 22789 lvb_type: 1
00010000:00010000:0.0:1651531980.439742:0:166104:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca56c0 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db447145 expref: 7 pid: 167632 timeout: 22789 lvb_type: 1
00010000:00010000:0.0:1651531980.439746:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531980.439747:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531980.439748:0:166104:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca56ce lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [819200->823295] (req 819200->823295) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.439751:0:166104:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca56ce lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [819200->823295] (req 819200->823295) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.439763:0:166104:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651531980.439772:0:166104:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005ec1cbc3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438147:x1731754467797696:12345-10.240.43.64@tcp:103:ldlm_bl_05.0 Request processed in 47us (88us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531980.439775:0:166104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 306
00010000:00010000:1.0:1651531980.439776:0:166118:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca56ce lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [819200->823295] (req 819200->823295) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531980.439780:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca56ce lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [819200->823295] (req 819200->823295) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531980.475086:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869542 is committed
00010000:00010000:1.0:1651531980.475116:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca56ce lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [819200->823295] (req 819200->823295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531980.475120:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca56ce lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [819200->823295] (req 819200->823295) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531980.475140:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cb694635 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438149:x1731754467797632:12345-10.240.43.64@tcp:4:fio.0 Request processed in 35746us (35771us total) trans 21474869542 rc 0/0
00010000:00010000:0.0:1651531980.475142:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca56ce lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [819200->823295] (req 819200->823295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531980.475143:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250668
00010000:00010000:0.0:1651531980.475147:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000000bb25cc already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531980.475148:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca56ce lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [819200->823295] (req 819200->823295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.475155:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca56ce lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [819200->823295] (req 819200->823295) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.475160:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca56ce lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [819200->823295] (req 819200->823295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.475162:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca56ce lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [819200->823295] (req 819200->823295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531980.475491:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531980.475499:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467797824
00000100:00100000:1.0:1651531980.475509:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44940
00000100:00100000:1.0:1651531980.475511:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b9b10d48 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438148:x1731754467797824:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531980.475515:0:167632:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531980.475519:0:167632:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca56d5 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447153 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651531980.475524:0:167632:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34545:0x0] initial LVB size: 6291456, mtime: 0x627060cc, atime: 0x627060b4, ctime: 0x627060cc, blocks: 0x3000
00010000:00010000:1.0:1651531980.475528:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531980.475529:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531980.475530:0:167632:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca56d5 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447153 expref: 6 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531980.475535:0:167632:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca56d5 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447153 expref: 6 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531980.475539:0:167632:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001cf49bf2, rc 0)
00000100:00100000:1.0:1651531980.475549:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b9b10d48 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438148:x1731754467797824:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (58us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531980.475552:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44940
00000100:00100000:1.0:1651531980.475892:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531980.475900:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467797952
00000100:00100000:1.0:1651531980.475914:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250669
00000100:00100000:1.0:1651531980.475916:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000033723645 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467797952:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531980.475923:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca56dc lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531980.475930:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531980.475931:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531980.475932:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca56dc lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [831488->835583] (req 831488->835583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531980.475936:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca56dc lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [831488->835583] (req 831488->835583) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531980.475947:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca56dc lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [831488->835583] (req 831488->835583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531980.475950:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca56dc lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [831488->835583] (req 831488->835583) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.475967:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca56dc lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [831488->835583] (req 831488->835583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531980.475969:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000033723645 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467797952:12345-10.240.43.64@tcp:3:fio.0 Request processed in 53us (78us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531980.475972:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250669
00010000:00010000:0.0:1651531980.475972:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c806f265 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531980.475973:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca56dc lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [831488->835583] (req 831488->835583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.475975:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca56dc lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [831488->835583] (req 831488->835583) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.475980:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca56dc lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [831488->835583] (req 831488->835583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.475983:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca56dc lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [831488->835583] (req 831488->835583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531980.476305:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531980.476312:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467798080
00000100:00100000:1.0:1651531980.476324:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250670
00000100:00100000:1.0:1651531980.476326:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a9fc5082 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467798080:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531980.476333:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca56e3 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531980.476337:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531980.476338:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531980.476339:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca56e3 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [954368->958463] (req 954368->958463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531980.476346:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca56e3 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [954368->958463] (req 954368->958463) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531980.476356:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca56e3 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [954368->958463] (req 954368->958463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531980.476359:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca56e3 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [954368->958463] (req 954368->958463) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.476369:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca56e3 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [954368->958463] (req 954368->958463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531980.476376:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a9fc5082 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467798080:12345-10.240.43.64@tcp:3:fio.0 Request processed in 49us (71us total) trans 0 rc 4096/4096
00010000:00010000:0.0:1651531980.476377:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c8969b4f already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531980.476378:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca56e3 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [954368->958463] (req 954368->958463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531980.476379:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250670
00010000:00010000:0.0:1651531980.476380:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca56e3 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [954368->958463] (req 954368->958463) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.476385:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca56e3 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [954368->958463] (req 954368->958463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.476388:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca56e3 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [954368->958463] (req 954368->958463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531980.476664:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531980.476672:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467798208
00000100:00100000:1.0:1651531980.476683:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250671
00000100:00100000:1.0:1651531980.476685:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000369eaefe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438148:x1731754467798208:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531980.476692:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca56ea lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531980.476696:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531980.476696:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531980.476697:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca56ea lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [958464->962559] (req 958464->962559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531980.476701:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca56ea lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [958464->962559] (req 958464->962559) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531980.476715:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca56ea lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [958464->962559] (req 958464->962559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531980.476718:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca56ea lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [958464->962559] (req 958464->962559) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.476727:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca56ea lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [958464->962559] (req 958464->962559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.476731:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f2af03c8 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531980.476732:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca56ea lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [958464->962559] (req 958464->962559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531980.476735:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000369eaefe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438148:x1731754467798208:12345-10.240.43.64@tcp:3:fio.0 Request processed in 49us (71us total) trans 0 rc 4096/4096
00010000:00010000:0.0:1651531980.476735:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca56ea lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [958464->962559] (req 958464->962559) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531980.476737:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250671
00010000:00010000:0.0:1651531980.476740:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca56ea lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [958464->962559] (req 958464->962559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.476742:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca56ea lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [958464->962559] (req 958464->962559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531980.477399:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531980.477406:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467798464
00000100:00100000:1.0:1651531980.477420:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250672
00000100:00100000:1.0:1651531980.477422:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000056da8167 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438148:x1731754467798464:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531980.477429:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca56f1 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531980.477433:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531980.477434:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531980.477435:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca56f1 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [999424->1003519] (req 999424->1003519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531980.477438:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca56f1 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [999424->1003519] (req 999424->1003519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531980.477448:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca56f1 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [999424->1003519] (req 999424->1003519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531980.477464:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca56f1 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [999424->1003519] (req 999424->1003519) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.477481:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca56f1 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [999424->1003519] (req 999424->1003519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531980.477483:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000056da8167 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438148:x1731754467798464:12345-10.240.43.64@tcp:3:fio.0 Request processed in 60us (85us total) trans 0 rc 4096/4096
00010000:00010000:0.0:1651531980.477485:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d3014069 already unused, calling callback (0000000049fddea7)
00000100:00100000:1.0:1651531980.477486:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250672
00010000:00010000:0.0:1651531980.477486:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca56f1 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [999424->1003519] (req 999424->1003519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.477489:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca56f1 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [999424->1003519] (req 999424->1003519) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.477493:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca56f1 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [999424->1003519] (req 999424->1003519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.477496:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca56f1 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [999424->1003519] (req 999424->1003519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531980.487084:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531980.487092:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467798848
00000100:00100000:1.0:1651531980.487106:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250673
00000100:00100000:1.0:1651531980.487107:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000bd28b3f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467798848:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531980.487117:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca56f8 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531980.487121:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531980.487122:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531980.487122:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca56f8 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [303104->307199] (req 303104->307199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531980.487126:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca56f8 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [303104->307199] (req 303104->307199) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531980.487136:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca56f8 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [303104->307199] (req 303104->307199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531980.487139:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca56f8 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [303104->307199] (req 303104->307199) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.487167:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca56f8 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [303104->307199] (req 303104->307199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531980.487169:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000bd28b3f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467798848:12345-10.240.43.64@tcp:3:fio.0 Request processed in 61us (85us total) trans 0 rc 4096/4096
00010000:00010000:0.0:1651531980.487171:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000eebd17a1 already unused, calling callback (0000000049fddea7)
00000100:00100000:1.0:1651531980.487172:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250673
00010000:00010000:0.0:1651531980.487172:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca56f8 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [303104->307199] (req 303104->307199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.487175:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca56f8 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [303104->307199] (req 303104->307199) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.487180:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca56f8 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [303104->307199] (req 303104->307199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.487184:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca56f8 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [303104->307199] (req 303104->307199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531980.487543:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531980.487550:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467799040
00000100:00100000:1.0:1651531980.487564:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250674
00000100:00100000:1.0:1651531980.487566:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000862392e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438148:x1731754467799040:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531980.487573:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca56ff lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531980.487577:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531980.487578:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531980.487579:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca56ff lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [32768->36863] (req 32768->36863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531980.487582:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca56ff lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [32768->36863] (req 32768->36863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531980.487593:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca56ff lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [32768->36863] (req 32768->36863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531980.487596:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca56ff lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [32768->36863] (req 32768->36863) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.487613:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca56ff lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [32768->36863] (req 32768->36863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531980.487614:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000862392e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438148:x1731754467799040:12345-10.240.43.64@tcp:3:fio.0 Request processed in 47us (72us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531980.487617:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250674
00010000:00010000:0.0:1651531980.487617:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009c5faf65 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531980.487618:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca56ff lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [32768->36863] (req 32768->36863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.487621:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca56ff lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [32768->36863] (req 32768->36863) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.487626:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca56ff lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [32768->36863] (req 32768->36863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.487628:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca56ff lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [32768->36863] (req 32768->36863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531980.537949:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531980.537958:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467800384
00000100:00100000:1.0:1651531980.537972:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250675
00000100:00100000:1.0:1651531980.537974:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000609b5f90 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467800384:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531980.537988:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca5706 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531980.537993:0:166118:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca56d5 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447153 expref: 6 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531980.537996:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531980.537997:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531980.537998:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca5706 lrc: 4/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [1015808->1019903] (req 1015808->1019903) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531980.538005:0:166118:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca56d5 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db447153 expref: 6 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531980.538009:0:166118:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca56d5 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db447153 expref: 6 pid: 167632 timeout: 22789 lvb_type: 1
00000100:00100000:1.0:1651531980.538013:0:166118:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005f06cf32 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:166118:1731745997362112:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531980.538026:0:166118:0:(client.c:2492:ptlrpc_set_wait()) set 000000000d54aa61 going to sleep for 6 seconds
00000100:00100000:1.0:1651531980.538288:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531980.538303:0:166118:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005f06cf32 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:166118:1731745997362112:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651531980.538307:0:166118:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca5706 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [1015808->1019903] (req 1015808->1019903) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531980.538311:0:166102:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467800448
00010000:00010000:0.0:1651531980.538318:0:166102:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca56d5 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db447153 expref: 7 pid: 167632 timeout: 22789 lvb_type: 1
00000100:00100000:0.0:1651531980.538326:0:166102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 307
00000100:00100000:0.0:1651531980.538328:0:166102:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002ea4f499 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438146:x1731754467800448:12345-10.240.43.64@tcp:103:ldlm_bl_01.0
00010000:00010000:0.0:1651531980.538332:0:166102:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531980.538335:0:166102:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca56d5 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db447153 expref: 7 pid: 167632 timeout: 22789 lvb_type: 1
00010000:00010000:0.0:1651531980.538341:0:166102:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca56d5 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db447153 expref: 7 pid: 167632 timeout: 22789 lvb_type: 1
00010000:00010000:0.0:1651531980.538346:0:166102:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca56d5 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db447153 expref: 7 pid: 167632 timeout: 22789 lvb_type: 1
00010000:00010000:0.0:1651531980.538350:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531980.538351:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531980.538352:0:166102:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca5706 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [1015808->1019903] (req 1015808->1019903) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.538355:0:166102:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca5706 lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [1015808->1019903] (req 1015808->1019903) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.538366:0:166102:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651531980.538376:0:166102:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002ea4f499 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438146:x1731754467800448:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 47us (88us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531980.538379:0:166102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 307
00010000:00010000:1.0:1651531980.538380:0:166118:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca5706 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [1015808->1019903] (req 1015808->1019903) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531980.538384:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca5706 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [1015808->1019903] (req 1015808->1019903) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651531980.572327:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869543 is committed
00010000:00010000:1.0:1651531980.572356:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca5706 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [1015808->1019903] (req 1015808->1019903) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531980.572361:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca5706 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [1015808->1019903] (req 1015808->1019903) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531980.572381:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000609b5f90 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438149:x1731754467800384:12345-10.240.43.64@tcp:4:fio.0 Request processed in 34406us (34432us total) trans 21474869543 rc 0/0
00010000:00010000:0.0:1651531980.572383:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca5706 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [1015808->1019903] (req 1015808->1019903) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531980.572384:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250675
00010000:00010000:0.0:1651531980.572387:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000022b2104e already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531980.572388:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca5706 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [1015808->1019903] (req 1015808->1019903) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.572391:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca5706 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [1015808->1019903] (req 1015808->1019903) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.572398:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca5706 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [1015808->1019903] (req 1015808->1019903) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.572401:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca5706 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [1015808->1019903] (req 1015808->1019903) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531980.585595:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531980.585603:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467800576
00000100:00100000:1.0:1651531980.585615:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44941
00000100:00100000:1.0:1651531980.585617:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005f06cf32 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438148:x1731754467800576:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531980.585621:0:167632:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531980.585625:0:167632:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca570d lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447161 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651531980.585630:0:167632:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34545:0x0] initial LVB size: 6291456, mtime: 0x627060cc, atime: 0x627060b4, ctime: 0x627060cc, blocks: 0x3000
00010000:00010000:1.0:1651531980.585634:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531980.585635:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531980.585637:0:167632:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca570d lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447161 expref: 6 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531980.585642:0:167632:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca570d lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447161 expref: 6 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531980.585646:0:167632:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000060a6272d, rc 0)
00000100:00100000:1.0:1651531980.585656:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005f06cf32 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438148:x1731754467800576:12345-10.240.43.64@tcp:101:fio.0 Request processed in 38us (61us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531980.585658:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44941
00000100:00100000:1.0:1651531980.626764:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531980.626772:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467801344
00000100:00100000:1.0:1651531980.626786:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250676
00000100:00100000:1.0:1651531980.626788:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005f5a393c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438146:x1731754467801344:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531980.626794:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5714 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531980.626799:0:166118:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca570d lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447161 expref: 6 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531980.626802:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531980.626803:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531980.626804:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5714 lrc: 4/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [1019904->1023999] (req 1019904->1023999) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531980.626811:0:166118:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca570d lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db447161 expref: 6 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531980.626819:0:166118:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca570d lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db447161 expref: 6 pid: 167632 timeout: 22789 lvb_type: 1
00000100:00100000:1.0:1651531980.626823:0:166118:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c0b460ab pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:166118:1731745997362176:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531980.626835:0:166118:0:(client.c:2492:ptlrpc_set_wait()) set 000000000d54aa61 going to sleep for 6 seconds
00000100:00100000:1.0:1651531980.627040:0:166118:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c0b460ab pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:166118:1731745997362176:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651531980.627044:0:166118:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5714 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [1019904->1023999] (req 1019904->1023999) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531980.627117:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531980.627135:0:166104:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467801536
00010000:00010000:0.0:1651531980.627142:0:166104:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca570d lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db447161 expref: 7 pid: 167632 timeout: 22789 lvb_type: 1
00000100:00100000:0.0:1651531980.627150:0:166104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 308
00000100:00100000:0.0:1651531980.627152:0:166104:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c0b460ab pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438149:x1731754467801536:12345-10.240.43.64@tcp:103:ldlm_bl_03.0
00010000:00010000:0.0:1651531980.627155:0:166104:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531980.627159:0:166104:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca570d lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db447161 expref: 7 pid: 167632 timeout: 22789 lvb_type: 1
00010000:00010000:0.0:1651531980.627163:0:166104:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca570d lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db447161 expref: 7 pid: 167632 timeout: 22789 lvb_type: 1
00010000:00010000:0.0:1651531980.627168:0:166104:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca570d lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db447161 expref: 7 pid: 167632 timeout: 22789 lvb_type: 1
00010000:00010000:0.0:1651531980.627172:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531980.627173:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531980.627174:0:166104:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5714 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [1019904->1023999] (req 1019904->1023999) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.627181:0:166104:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5714 lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [1019904->1023999] (req 1019904->1023999) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.627192:0:166104:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651531980.627202:0:166104:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c0b460ab pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467801536:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 50us (86us total) trans 0 rc 0/0
00010000:00010000:1.0:1651531980.627205:0:166118:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5714 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [1019904->1023999] (req 1019904->1023999) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531980.627205:0:166104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 308
00010000:00010000:1.0:1651531980.627209:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5714 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [1019904->1023999] (req 1019904->1023999) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531980.627348:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531980.627356:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467801664
00000100:00100000:1.0:1651531980.627368:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44942
00000100:00100000:1.0:1651531980.627369:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c4ea889e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467801664:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531980.627373:0:167632:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531980.627386:0:167632:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca571b lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44716f expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531980.627394:0:167632:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca571b lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44716f expref: 9 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531980.627400:0:167632:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca571b lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44716f expref: 9 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531980.627403:0:167632:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f58aeba9, rc 0)
00000100:00100000:1.0:1651531980.627413:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c4ea889e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754467801664:12345-10.240.43.64@tcp:101:fio.0 Request processed in 43us (66us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531980.627416:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44942
00000001:00080000:0.0:1651531980.650434:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869544 is committed
00010000:00010000:1.0:1651531980.650464:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5714 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [1019904->1023999] (req 1019904->1023999) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531980.650468:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5714 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [1019904->1023999] (req 1019904->1023999) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531980.650488:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005f5a393c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438146:x1731754467801344:12345-10.240.43.64@tcp:4:fio.0 Request processed in 23699us (23724us total) trans 21474869544 rc 0/0
00000100:00100000:1.0:1651531980.650491:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250676
00010000:00010000:0.0:1651531980.650491:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5714 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [1019904->1023999] (req 1019904->1023999) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.650495:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f6ecb7e5 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531980.650496:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5714 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [1019904->1023999] (req 1019904->1023999) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.650499:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5714 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [1019904->1023999] (req 1019904->1023999) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.650505:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5714 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [1019904->1023999] (req 1019904->1023999) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.650507:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5714 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [1019904->1023999] (req 1019904->1023999) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531980.674574:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531980.674581:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467802304
00000100:00100000:1.0:1651531980.674594:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44943
00000100:00100000:1.0:1651531980.674595:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000059e5b3a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438148:x1731754467802304:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531980.674599:0:167632:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531980.674603:0:167632:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca5722 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44717d expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651531980.674608:0:167632:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34545:0x0] initial LVB size: 6291456, mtime: 0x627060cc, atime: 0x627060b4, ctime: 0x627060cc, blocks: 0x3000
00010000:00010000:1.0:1651531980.674613:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531980.674613:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531980.674615:0:167632:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca5722 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44717d expref: 6 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531980.674620:0:167632:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca5722 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44717d expref: 6 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531980.674623:0:167632:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f58aeba9, rc 0)
00000100:00100000:1.0:1651531980.674633:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000059e5b3a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438148:x1731754467802304:12345-10.240.43.64@tcp:101:fio.0 Request processed in 37us (60us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531980.674636:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44943
00000100:00100000:1.0:1651531980.748634:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531980.748642:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467803776
00000100:00100000:1.0:1651531980.748656:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250677
00000100:00100000:1.0:1651531980.748658:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f7006631 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467803776:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531980.748665:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca5729 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531980.748669:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531980.748670:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531980.748671:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca5729 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [364544->368639] (req 364544->368639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531980.748675:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca5729 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [364544->368639] (req 364544->368639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531980.748686:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca5729 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [364544->368639] (req 364544->368639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531980.748690:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca5729 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [364544->368639] (req 364544->368639) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531980.748709:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f7006631 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467803776:12345-10.240.43.64@tcp:3:fio.0 Request processed in 50us (76us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1651531980.748712:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250677
00010000:00010000:0.0:1651531980.748712:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca5729 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [364544->368639] (req 364544->368639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.748720:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008b0c325f already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531980.748721:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca5729 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [364544->368639] (req 364544->368639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.748724:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca5729 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [364544->368639] (req 364544->368639) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.748728:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca5729 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [364544->368639] (req 364544->368639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.748731:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca5729 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [364544->368639] (req 364544->368639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531980.917363:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531980.917371:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467805952
00000100:00100000:1.0:1651531980.917386:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250678
00000100:00100000:1.0:1651531980.917388:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c683c211 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467805952:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531980.917395:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca5730 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531980.917399:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531980.917400:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531980.917401:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca5730 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531980.917405:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca5730 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531980.917416:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca5730 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531980.917419:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca5730 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.917437:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca5730 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531980.917438:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c683c211 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467805952:12345-10.240.43.64@tcp:3:fio.0 Request processed in 50us (76us total) trans 0 rc 4096/4096
00010000:00010000:0.0:1651531980.917441:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f6135e30 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531980.917442:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca5730 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531980.917443:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250678
00010000:00010000:0.0:1651531980.917446:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca5730 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.917451:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca5730 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.917453:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca5730 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531980.917778:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531980.917786:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467806080
00000100:00100000:1.0:1651531980.917797:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250679
00000100:00100000:1.0:1651531980.917799:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003d9ef3c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438148:x1731754467806080:12345-10.240.43.64@tcp:3:fio.0
00010000:00010000:1.0:1651531980.917808:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca5737 lrc: 3/1,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531980.917812:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531980.917813:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531980.917814:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca5737 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [12288->16383] (req 12288->16383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531980.917818:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca5737 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [12288->16383] (req 12288->16383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531980.917828:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca5737 lrc: 3/1,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [12288->16383] (req 12288->16383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531980.917831:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca5737 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [12288->16383] (req 12288->16383) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.917841:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca5737 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [12288->16383] (req 12288->16383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.917845:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008b0c325f already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531980.917846:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca5737 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [12288->16383] (req 12288->16383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531980.917848:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003d9ef3c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438148:x1731754467806080:12345-10.240.43.64@tcp:3:fio.0 Request processed in 48us (70us total) trans 0 rc 4096/4096
00010000:00010000:0.0:1651531980.917849:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca5737 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [12288->16383] (req 12288->16383) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531980.917851:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250679
00010000:00010000:0.0:1651531980.917854:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca5737 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [12288->16383] (req 12288->16383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.917857:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca5737 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [12288->16383] (req 12288->16383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531980.918174:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531980.918182:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467806208
00000100:00100000:1.0:1651531980.918193:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250680
00000100:00100000:1.0:1651531980.918196:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ffcdece2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754467806208:12345-10.240.43.64@tcp:4:fio.0
00010000:00010000:1.0:1651531980.918202:0:166118:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca573e lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531980.918207:0:166118:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca5722 lrc: 2/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44717d expref: 6 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531980.918210:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531980.918211:0:166118:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531980.918212:0:166118:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca573e lrc: 4/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [36864->40959] (req 36864->40959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531980.918241:0:166118:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca5722 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44717d expref: 6 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531980.918246:0:166118:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca5722 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44717d expref: 6 pid: 167632 timeout: 22789 lvb_type: 1
00000100:00100000:1.0:1651531980.918250:0:166118:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000942b56fd pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:166118:1731745997362240:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651531980.918263:0:166118:0:(client.c:2492:ptlrpc_set_wait()) set 000000000d54aa61 going to sleep for 6 seconds
00000100:00100000:1.0:1651531980.918467:0:166118:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000942b56fd pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:166118:1731745997362240:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651531980.918471:0:166118:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca573e lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [36864->40959] (req 36864->40959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531980.918537:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531980.918548:0:166102:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467806272
00010000:00010000:0.0:1651531980.918555:0:166102:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca5722 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44717d expref: 7 pid: 167632 timeout: 22789 lvb_type: 1
00000100:00100000:0.0:1651531980.918564:0:166102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 309
00000100:00100000:0.0:1651531980.918566:0:166102:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000013a044ac pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438148:x1731754467806272:12345-10.240.43.64@tcp:103:ldlm_bl_06.0
00010000:00010000:0.0:1651531980.918570:0:166102:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531980.918574:0:166102:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca5722 lrc: 4/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44717d expref: 7 pid: 167632 timeout: 22789 lvb_type: 1
00010000:00010000:0.0:1651531980.918578:0:166102:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca5722 lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44717d expref: 7 pid: 167632 timeout: 22789 lvb_type: 1
00010000:00010000:0.0:1651531980.918585:0:166102:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca5722 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44717d expref: 7 pid: 167632 timeout: 22789 lvb_type: 1
00010000:00010000:0.0:1651531980.918589:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531980.918590:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651531980.918591:0:166102:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca573e lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [36864->40959] (req 36864->40959) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.918593:0:166102:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca573e lrc: 4/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [36864->40959] (req 36864->40959) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.918607:0:166102:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651531980.918617:0:166102:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000013a044ac pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438148:x1731754467806272:12345-10.240.43.64@tcp:103:ldlm_bl_06.0 Request processed in 50us (80us total) trans 0 rc 0/0
00010000:00010000:1.0:1651531980.918619:0:166118:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca573e lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [36864->40959] (req 36864->40959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651531980.918620:0:166102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 309
00010000:00010000:1.0:1651531980.918627:0:166118:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca573e lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [36864->40959] (req 36864->40959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531980.966405:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531980.966413:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467806528
00000100:00100000:1.0:1651531980.966426:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44944
00000100:00100000:1.0:1651531980.966428:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000942b56fd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754467806528:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531980.966432:0:167632:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531980.966436:0:167632:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca5745 lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44718b expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531980.966454:0:167632:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca5745 lrc: 1/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44718b expref: 9 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531980.966458:0:167632:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca5745 lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44718b expref: 9 pid: 167632 timeout: 0 lvb_type: 1
00000001:00080000:0.0:1651531980.966459:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869545 is committed
00010000:00010000:1.0:1651531980.966462:0:167632:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000060a6272d, rc 0)
00000100:00100000:1.0:1651531980.966477:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000942b56fd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438147:x1731754467806528:12345-10.240.43.64@tcp:101:fio.0 Request processed in 48us (73us total) trans 0 rc 301/301
00000100:00100000:1.0:1651531980.966480:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44944
00010000:00010000:1.0:1651531980.966494:0:166118:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca573e lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [36864->40959] (req 36864->40959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531980.966497:0:166118:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca573e lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [36864->40959] (req 36864->40959) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531980.966518:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ffcdece2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438149:x1731754467806208:12345-10.240.43.64@tcp:4:fio.0 Request processed in 48321us (48345us total) trans 21474869545 rc 0/0
00010000:00010000:0.0:1651531980.966520:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca573e lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [36864->40959] (req 36864->40959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531980.966521:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250680
00010000:00010000:0.0:1651531980.966524:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f6ecb7e5 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531980.966525:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca573e lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [36864->40959] (req 36864->40959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.966529:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca573e lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [36864->40959] (req 36864->40959) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.966534:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca573e lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [36864->40959] (req 36864->40959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531980.966541:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca573e lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [36864->40959] (req 36864->40959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166118 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531980.967884:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651531980.967891:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467806784
00000100:00100000:1.0:1651531980.967904:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44945
00000100:00100000:1.0:1651531980.967906:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007f998d3c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438146:x1731754467806784:12345-10.240.43.64@tcp:101:fio.0
00010000:00010000:1.0:1651531980.967910:0:167632:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651531980.967913:0:167632:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca574c lrc: 2/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db447199 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651531980.967918:0:167632:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34545:0x0] initial LVB size: 6291456, mtime: 0x627060cc, atime: 0x627060b4, ctime: 0x627060cc, blocks: 0x3000
00010000:00010000:1.0:1651531980.967922:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531980.967923:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531980.967925:0:167632:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca574c lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447199 expref: 6 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531980.967929:0:167632:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca574c lrc: 3/0,0 mode: PR/PR res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447199 expref: 6 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651531980.967933:0:167632:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000022b2104e, rc 0)
00000100:00100000:1.0:1651531980.967953:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007f998d3c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438146:x1731754467806784:12345-10.240.43.64@tcp:101:fio.0 Request processed in 46us (69us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531980.967956:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44945
00000100:00100000:1.0:1651531982.048211:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651531982.048248:0:182071:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951227328
00000100:00100000:0.0:1651531982.048270:0:182071:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 467
00000100:00100000:0.0:1651531982.048272:0:182071:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000df1eb0d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951227328:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:0.0:1651531982.048286:0:182071:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 350512576 pending 0 free 81277214720 avail 77106360320
00000100:00100000:0.0:1651531982.048318:0:182071:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000df1eb0d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951227328:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 45us (110us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531982.048321:0:182071:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 467
00000400:00000080:0.0:1651531983.518208:0:231739:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648
00000001:02000400:0.0:1651531983.518211:0:231739:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 398c: run fio to test AIO ================= 22:53:02 (1651531982)
00000100:00100000:1.0:1651531983.977544:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651531983.977575:0:166104:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467812032
00000100:00100000:0.0:1651531983.977602:0:166104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 11100
00000100:00100000:0.0:1651531983.977605:0:166104:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009c93d7f2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:676921:x1731754467812032:12345-10.240.43.64@tcp:103:ldlm_bl_03.0
00010000:00010000:0.0:1651531983.977613:0:166104:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651531983.977636:0:166104:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca574c lrc: 0/0,0 mode: --/PR res: [0x34545:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db447199 expref: 6 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651531983.977645:0:166104:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651531983.977672:0:166104:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009c93d7f2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+5:676921:x1731754467812032:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 66us (130us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531983.977675:0:166104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 11100
00000100:00100000:1.0:1651531987.168210:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651531987.168247:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951227520
00000100:00100000:0.0:1651531987.168260:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 468
00000100:00100000:0.0:1651531987.168264:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007d76765b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951227520:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:0.0:1651531987.168277:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 350512576 pending 0 free 81277214720 avail 77106503680
00000100:00100000:0.0:1651531987.168299:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007d76765b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951227520:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 34us (90us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531987.168302:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 468
00000100:00100000:1.0:1651531987.228461:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651531987.228473:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951227712
00000100:00100000:1.0:1651531987.228490:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 44946
00000100:00100000:1.0:1651531987.228492:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000028bdd7b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951227712:12345-10.240.43.61@tcp:6:osp-syn-1-0.0
00002000:00080000:1.0:1651531987.228502:0:167632:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:214341 count 1
00002000:00010000:1.0:1651531987.228513:0:167632:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34545:0x0] initial LVB size: 6291456, mtime: 0x627060cc, atime: 0x627060b4, ctime: 0x627060cc, blocks: 0x3000
00010000:00010000:1.0:1651531987.228516:0:167632:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca5753 lrc: 3/0,1 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531987.228523:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531987.228524:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651531987.228526:0:167632:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca5753 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531987.228532:0:167632:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca5753 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531987.228536:0:167632:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca5753 lrc: 3/0,1 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651531987.228540:0:167632:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca5753 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531987.228563:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca5753 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531987.228568:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000060a6272d already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651531987.228570:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca5753 lrc: 2/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531987.228574:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca5753 lrc: 3/0,0 mode: PW/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531987.228581:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca5753 lrc: 1/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651531987.228584:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca5753 lrc: 0/0,0 mode: --/PW res: [0x34545:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651531987.229181:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000028bdd7b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745951227712:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 687us (720us total) trans 21474869546 rc 0/0
00000100:00100000:1.0:1651531987.229185:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 44946
00000100:00100000:1.0:1651531988.093304:0:39100:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ca77a195 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:39100:1731745997362368:10.240.43.61@tcp:400:kworker/u4:2.0
00000100:00100000:0.0:1651531988.093320:0:39099:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000863110f1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9063caa-b124-4cb6-99ef-d01a735595c3:39099:1731745997362304:10.240.43.61@tcp:400:kworker/u4:2.0
00000100:00100000:0.0:1651531988.093575:0:39099:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000863110f1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9063caa-b124-4cb6-99ef-d01a735595c3:39099:1731745997362304:10.240.43.61@tcp:400:kworker/u4:2.0
00000100:00100000:1.0:1651531988.093576:0:39100:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ca77a195 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:39100:1731745997362368:10.240.43.61@tcp:400:kworker/u4:2.0
00000100:00100000:1.0:1651531992.288152:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651531992.288181:0:182071:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951227840
00000100:00100000:0.0:1651531992.288193:0:182071:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 469
00000100:00100000:0.0:1651531992.288196:0:182071:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ca77a195 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745951227840:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:0.0:1651531992.288208:0:182071:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 350512576 pending 0 free 81283506176 avail 77112795136
00000100:00100000:0.0:1651531992.288263:0:182071:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ca77a195 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745951227840:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 66us (115us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531992.288266:0:182071:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 469
00000001:00080000:0.0:1651531993.269910:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869546 is committed
00000100:00100000:1.0:1651531996.896154:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651531996.896165:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951227904
00000100:00100000:1.0:1651531996.896181:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 62
00000100:00100000:1.0:1651531996.896184:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000aeca6f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951227904:12345-10.240.43.61@tcp:400:kworker/u4:0.0
00000100:00100000:1.0:1651531996.896201:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000aeca6f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951227904:12345-10.240.43.61@tcp:400:kworker/u4:0.0 Request processed in 17us (50us total) trans 0 rc 0/0
00000100:00100000:1.0:1651531996.896205:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 62
00000100:00100000:1.0:1651531997.408103:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651531997.408128:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951227968
00000100:00100000:0.0:1651531997.408140:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 470
00000100:00100000:0.0:1651531997.408142:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005c3dfe19 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951227968:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:0.0:1651531997.408150:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 350512576 pending 0 free 81283506176 avail 77112795136
00000100:00100000:0.0:1651531997.408169:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005c3dfe19 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951227968:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 26us (67us total) trans 0 rc 0/0
00000100:00100000:0.0:1651531997.408173:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 470
00000100:00100000:1.0:1651532002.528132:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651532002.528165:0:182071:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951228288
00000100:00100000:0.0:1651532002.528178:0:182071:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 471
00000100:00100000:0.0:1651532002.528180:0:182071:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a8d7612 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951228288:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:0.0:1651532002.528188:0:182071:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 350512576 pending 0 free 81283506176 avail 77112795136
00000100:00100000:0.0:1651532002.528207:0:182071:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a8d7612 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951228288:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 26us (76us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532002.528210:0:182071:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 471
00000100:00100000:1.0:1651532007.648127:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651532007.648153:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951228352
00000100:00100000:0.0:1651532007.648165:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 472
00000100:00100000:0.0:1651532007.648167:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c68ada5f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951228352:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:0.0:1651532007.648175:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 350512576 pending 0 free 81283506176 avail 77112795136
00000100:00100000:0.0:1651532007.648193:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c68ada5f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951228352:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 25us (68us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532007.648199:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 472
00000100:00100000:1.0:1651532009.664959:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532009.664969:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754467903232
00000100:00100000:1.0:1651532009.664985:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44947
00000100:00100000:1.0:1651532009.664987:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c400d88f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438145:x1731754467903232:12345-10.240.43.64@tcp:9:kworker/u4:0.0
00000020:00000080:1.0:1651532009.665005:0:167632:0:(genops.c:1442:class_disconnect()) disconnect: cookie 0x3234de053ca299b
00000100:00080000:1.0:1651532009.665017:0:167632:0:(import.c:85:import_set_state_nolock()) 0000000035d1f7a9 �������: changing import state from FULL to CLOSED
00000001:00000004:1.0:1651532009.665049:0:167632:0:(tgt_lastrcvd.c:701:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 5, last_transno is 21474869546
00000100:00100000:1.0:1651532009.665117:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c400d88f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+2:438145:x1731754467903232:12345-10.240.43.64@tcp:9:kworker/u4:0.0 Request processed in 129us (158us total) trans 0 rc 0/0
00000100:00100000:1.0:1651532009.665121:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44947
00000100:00100000:1.0:1651532012.768220:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651532012.768251:0:182071:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951228480
00000100:00100000:0.0:1651532012.768263:0:182071:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 473
00000100:00100000:0.0:1651532012.768266:0:182071:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004c512052 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951228480:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:0.0:1651532012.768273:0:182071:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140736 pending 0 free 81283506176 avail 77112795136
00000100:00100000:0.0:1651532012.768292:0:182071:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004c512052 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951228480:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 26us (73us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532012.768296:0:182071:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 473
00000100:00100000:1.0:1651532013.181289:0:39100:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c9d21511 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:39100:1731745997362496:10.240.43.61@tcp:400:kworker/u4:2.0
00000100:00100000:0.0:1651532013.181293:0:39099:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002dca0b15 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9063caa-b124-4cb6-99ef-d01a735595c3:39099:1731745997362432:10.240.43.61@tcp:400:kworker/u4:2.0
00000100:00100000:1.0:1651532013.181549:0:39100:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c9d21511 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:39100:1731745997362496:10.240.43.61@tcp:400:kworker/u4:2.0
00000100:00100000:0.0:1651532013.181552:0:39099:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002dca0b15 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9063caa-b124-4cb6-99ef-d01a735595c3:39099:1731745997362432:10.240.43.61@tcp:400:kworker/u4:2.0
00000001:00100000:0.0:1651532015.297726:0:166098:0:(tgt_lastrcvd.c:537:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0c703c47-a140-4387-a181-4e0a15e9b24e
00000020:00000080:0.0:1651532015.297728:0:166098:0:(genops.c:985:class_export_put()) final put 000000009dcd8a6d/0c703c47-a140-4387-a181-4e0a15e9b24e
00000020:00000080:1.0:1651532015.297751:0:231524:0:(genops.c:944:class_export_destroy()) destroying export 000000009dcd8a6d/0c703c47-a140-4387-a181-4e0a15e9b24e for lustre-OST0001
00000020:00000080:1.0:1651532015.297778:0:231524:0:(genops.c:1164:obd_zombie_import_free()) destroying import 0000000035d1f7a9 for lustre-OST0001
00000100:00100000:1.0:1651532017.888093:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651532017.888113:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951228608
00000100:00100000:0.0:1651532017.888125:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 474
00000100:00100000:0.0:1651532017.888127:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c9d21511 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951228608:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:0.0:1651532017.888135:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140736 pending 0 free 81283506176 avail 77112795136
00000100:00100000:0.0:1651532017.888154:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c9d21511 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951228608:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 26us (63us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532017.888158:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 474
00000100:00100000:1.0:1651532023.008139:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651532023.008162:0:182071:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951228736
00000100:00100000:0.0:1651532023.008175:0:182071:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 475
00000100:00100000:0.0:1651532023.008177:0:182071:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002dca0b15 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951228736:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:0.0:1651532023.008186:0:182071:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140736 pending 0 free 81283506176 avail 77112795136
00000100:00100000:0.0:1651532023.008206:0:182071:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002dca0b15 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951228736:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 28us (69us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532023.008210:0:182071:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 475
00000100:00100000:1.0:1651532028.128111:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651532028.128136:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951228992
00000100:00100000:0.0:1651532028.128147:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 476
00000100:00100000:0.0:1651532028.128149:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000863110f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951228992:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:0.0:1651532028.128156:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140736 pending 0 free 81283506176 avail 77112795136
00000100:00100000:0.0:1651532028.128175:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000863110f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951228992:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 25us (65us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532028.128178:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 476
00000100:00100000:1.0:1651532033.248100:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651532033.248124:0:182071:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951229184
00000100:00100000:0.0:1651532033.248135:0:182071:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 477
00000100:00100000:0.0:1651532033.248137:0:182071:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b97e3b28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951229184:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:0.0:1651532033.248144:0:182071:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140736 pending 0 free 81283506176 avail 77112795136
00000100:00100000:0.0:1651532033.248163:0:182071:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b97e3b28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951229184:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 24us (64us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532033.248166:0:182071:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 477
00000100:00100000:1.0:1651532038.269304:0:39100:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000427633c3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:39100:1731745997362624:10.240.43.61@tcp:400:kworker/u4:2.0
00000100:00100000:0.0:1651532038.269307:0:39099:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008b42dfe9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9063caa-b124-4cb6-99ef-d01a735595c3:39099:1731745997362560:10.240.43.61@tcp:400:kworker/u4:2.0
00000100:00100000:1.0:1651532038.269577:0:39100:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000427633c3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:39100:1731745997362624:10.240.43.61@tcp:400:kworker/u4:2.0
00000100:00100000:0.0:1651532038.269585:0:39099:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008b42dfe9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9063caa-b124-4cb6-99ef-d01a735595c3:39099:1731745997362560:10.240.43.61@tcp:400:kworker/u4:2.0
00000100:00100000:1.0:1651532038.368120:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651532038.368143:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951229312
00000100:00100000:0.0:1651532038.368154:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 478
00000100:00100000:0.0:1651532038.368156:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000427633c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951229312:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:0.0:1651532038.368163:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140736 pending 0 free 81283506176 avail 77112795136
00000100:00100000:0.0:1651532038.368180:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000427633c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951229312:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 24us (61us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532038.368194:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 478
00000100:00100000:1.0:1651532043.488086:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651532043.488111:0:182071:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951229440
00000100:00100000:0.0:1651532043.488122:0:182071:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 479
00000100:00100000:0.0:1651532043.488124:0:182071:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000099b6616a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951229440:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:0.0:1651532043.488131:0:182071:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140736 pending 0 free 81283506176 avail 77112795136
00000100:00100000:0.0:1651532043.488149:0:182071:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000099b6616a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951229440:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 24us (64us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532043.488153:0:182071:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 479
00000100:00100000:1.0:1651532048.608114:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651532048.608141:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951229632
00000100:00100000:0.0:1651532048.608153:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 480
00000100:00100000:0.0:1651532048.608155:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d76314b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951229632:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:0.0:1651532048.608163:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140736 pending 0 free 81283506176 avail 77112795136
00000100:00100000:0.0:1651532048.608181:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d76314b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951229632:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 26us (69us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532048.608185:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 480
00000100:00100000:1.0:1651532053.728165:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651532053.728189:0:182071:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951229824
00000100:00100000:0.0:1651532053.728201:0:182071:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 481
00000100:00100000:0.0:1651532053.728203:0:182071:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000329eeeee pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951229824:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:0.0:1651532053.728211:0:182071:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140736 pending 0 free 81283506176 avail 77112795136
00000100:00100000:0.0:1651532053.728243:0:182071:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000329eeeee pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951229824:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 38us (78us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532053.728246:0:182071:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 481
00000100:00100000:1.0:1651532058.848147:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651532058.848175:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951229952
00000100:00100000:0.0:1651532058.848192:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 482
00000100:00100000:0.0:1651532058.848194:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005649b5c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951229952:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:0.0:1651532058.848218:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140736 pending 0 free 81283506176 avail 77112795136
00000100:00100000:0.0:1651532058.848258:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005649b5c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951229952:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 63us (114us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532058.848262:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 482
00000100:00100000:1.0:1651532063.357283:0:39100:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009d9a9718 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:39100:1731745997362752:10.240.43.61@tcp:400:kworker/u4:2.0
00000100:00100000:0.0:1651532063.357288:0:39099:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000073d3f68d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9063caa-b124-4cb6-99ef-d01a735595c3:39099:1731745997362688:10.240.43.61@tcp:400:kworker/u4:2.0
00000100:00100000:1.0:1651532063.357572:0:39100:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009d9a9718 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:39100:1731745997362752:10.240.43.61@tcp:400:kworker/u4:2.0
00000100:00100000:0.0:1651532063.357582:0:39099:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000073d3f68d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9063caa-b124-4cb6-99ef-d01a735595c3:39099:1731745997362688:10.240.43.61@tcp:400:kworker/u4:2.0
00000100:00100000:1.0:1651532063.968132:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651532063.968158:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951230016
00000100:00100000:0.0:1651532063.968174:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 483
00000100:00100000:0.0:1651532063.968176:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009d9a9718 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951230016:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:0.0:1651532063.968184:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140736 pending 0 free 81283506176 avail 77112795136
00000100:00100000:0.0:1651532063.968200:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009d9a9718 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951230016:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 23us (69us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532063.968203:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 483
00000100:00100000:1.0:1651532069.088143:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651532069.088168:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951230144
00000100:00100000:0.0:1651532069.088183:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 484
00000100:00100000:0.0:1651532069.088186:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b97e3b28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951230144:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:0.0:1651532069.088193:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140736 pending 0 free 81283506176 avail 77112795136
00000100:00100000:0.0:1651532069.088210:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b97e3b28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951230144:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 23us (68us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532069.088213:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 484
00000100:00100000:1.0:1651532074.208115:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651532074.208139:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951230464
00000100:00100000:0.0:1651532074.208155:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 485
00000100:00100000:0.0:1651532074.208157:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000427633c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951230464:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:0.0:1651532074.208167:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140736 pending 0 free 81283506176 avail 77112795136
00000100:00100000:0.0:1651532074.208183:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000427633c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951230464:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 25us (70us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532074.208186:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 485
00000100:00100000:1.0:1651532079.328098:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651532079.328122:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951230592
00000100:00100000:0.0:1651532079.328137:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 486
00000100:00100000:0.0:1651532079.328140:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000099b6616a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951230592:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:0.0:1651532079.328147:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140736 pending 0 free 81283506176 avail 77112795136
00000100:00100000:0.0:1651532079.328163:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000099b6616a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951230592:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 23us (66us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532079.328166:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 486
00000100:00100000:1.0:1651532084.448111:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651532084.448135:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951230720
00000100:00100000:0.0:1651532084.448150:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 487
00000100:00100000:0.0:1651532084.448152:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d76314b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951230720:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:0.0:1651532084.448159:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140736 pending 0 free 81283506176 avail 77112795136
00000100:00100000:0.0:1651532084.448175:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d76314b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951230720:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 23us (65us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532084.448178:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 487
00000100:00100000:1.0:1651532088.445282:0:39100:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008b42dfe9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:39100:1731745997362880:10.240.43.61@tcp:400:kworker/u4:2.0
00000100:00100000:0.0:1651532088.445288:0:39099:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000329eeeee pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9063caa-b124-4cb6-99ef-d01a735595c3:39099:1731745997362816:10.240.43.61@tcp:400:kworker/u4:2.0
00000100:00100000:1.0:1651532088.445569:0:39100:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008b42dfe9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:39100:1731745997362880:10.240.43.61@tcp:400:kworker/u4:2.0
00000100:00100000:0.0:1651532088.445578:0:39099:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000329eeeee pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9063caa-b124-4cb6-99ef-d01a735595c3:39099:1731745997362816:10.240.43.61@tcp:400:kworker/u4:2.0
00000100:00100000:1.0:1651532089.568157:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651532089.568185:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951230848
00000100:00100000:0.0:1651532089.568201:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 488
00000100:00100000:0.0:1651532089.568203:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008b42dfe9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951230848:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:0.0:1651532089.568213:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140736 pending 0 free 81283506176 avail 77112795136
00000100:00100000:0.0:1651532089.568242:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008b42dfe9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951230848:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 38us (86us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532089.568246:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 488
00000100:00100000:1.0:1651532094.688133:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651532094.688160:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951231104
00000100:00100000:0.0:1651532094.688175:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 489
00000100:00100000:0.0:1651532094.688177:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000329eeeee pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951231104:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:0.0:1651532094.688185:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140736 pending 0 free 81283506176 avail 77112795136
00000100:00100000:0.0:1651532094.688201:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000329eeeee pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951231104:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 23us (69us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532094.688204:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 489
00000100:00100000:1.0:1651532099.808114:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651532099.808135:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951231360
00000100:00100000:0.0:1651532099.808152:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 490
00000100:00100000:0.0:1651532099.808154:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000073d3f68d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951231360:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:0.0:1651532099.808162:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140736 pending 0 free 81283506176 avail 77112795136
00000100:00100000:0.0:1651532099.808182:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000073d3f68d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951231360:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 27us (69us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532099.808186:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 490
00000100:00100000:1.0:1651532104.928105:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651532104.928130:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951231424
00000100:00100000:0.0:1651532104.928145:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 491
00000100:00100000:0.0:1651532104.928147:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a8bb9985 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951231424:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:0.0:1651532104.928155:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140736 pending 0 free 81283506176 avail 77112795136
00000100:00100000:0.0:1651532104.928178:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a8bb9985 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951231424:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 30us (74us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532104.928181:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 491
00000100:00100000:1.0:1651532110.048111:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651532110.048138:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951231552
00000100:00100000:0.0:1651532110.048153:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 492
00000100:00100000:0.0:1651532110.048156:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000035de0fa0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951231552:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:0.0:1651532110.048163:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140736 pending 0 free 81283506176 avail 77112795136
00000100:00100000:0.0:1651532110.048179:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000035de0fa0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951231552:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 23us (69us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532110.048183:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 492
00000100:00100000:1.0:1651532113.533294:0:39100:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d6486d55 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:39100:1731745997363008:10.240.43.61@tcp:400:kworker/u4:2.0
00000100:00100000:0.0:1651532113.533303:0:39099:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000054ed0749 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9063caa-b124-4cb6-99ef-d01a735595c3:39099:1731745997362944:10.240.43.61@tcp:400:kworker/u4:2.0
00000100:00100000:0.0:1651532113.533575:0:39099:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000054ed0749 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9063caa-b124-4cb6-99ef-d01a735595c3:39099:1731745997362944:10.240.43.61@tcp:400:kworker/u4:2.0
00000100:00100000:1.0:1651532113.533594:0:39100:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d6486d55 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:39100:1731745997363008:10.240.43.61@tcp:400:kworker/u4:2.0
00000100:00100000:1.0:1651532115.168171:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651532115.168196:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951231744
00000100:00100000:0.0:1651532115.168211:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 493
00000100:00100000:0.0:1651532115.168213:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951231744:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:0.0:1651532115.168221:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140736 pending 0 free 81283506176 avail 77112795136
00000100:00100000:0.0:1651532115.168246:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6486d55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951231744:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 32us (76us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532115.168249:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 493
00000100:00100000:1.0:1651532120.288123:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651532120.288149:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951232000
00000100:00100000:0.0:1651532120.288164:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 494
00000100:00100000:0.0:1651532120.288166:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009acffcb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951232000:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:0.0:1651532120.288173:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140736 pending 0 free 81283506176 avail 77112795136
00000100:00100000:0.0:1651532120.288190:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009acffcb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951232000:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 23us (68us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532120.288193:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 494
00000100:00100000:1.0:1651532125.408116:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651532125.408143:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951232064
00000100:00100000:0.0:1651532125.408160:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 495
00000100:00100000:0.0:1651532125.408162:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000054ed0749 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951232064:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:0.0:1651532125.408170:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140736 pending 0 free 81283506176 avail 77112795136
00000100:00100000:0.0:1651532125.408186:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000054ed0749 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951232064:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 23us (71us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532125.408189:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 495
00000100:00100000:1.0:1651532130.528102:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651532130.528122:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951232256
00000100:00100000:0.0:1651532130.528138:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 496
00000100:00100000:0.0:1651532130.528140:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b15861ad pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951232256:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:0.0:1651532130.528148:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140736 pending 0 free 81283506176 avail 77112795136
00000100:00100000:0.0:1651532130.528163:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b15861ad pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951232256:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 23us (62us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532130.528167:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 496
00000100:00100000:1.0:1651532135.648143:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651532135.648167:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951232512
00000100:00100000:0.0:1651532135.648182:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 497
00000100:00100000:0.0:1651532135.648184:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d09aeb66 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951232512:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:0.0:1651532135.648192:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140736 pending 0 free 81283506176 avail 77112795136
00000100:00100000:0.0:1651532135.648207:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d09aeb66 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951232512:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 22us (66us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532135.648211:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 497
00000100:00100000:1.0:1651532138.621268:0:39100:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cfeac242 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:39100:1731745997363136:10.240.43.61@tcp:400:kworker/u4:2.0
00000100:00100000:0.0:1651532138.621275:0:39099:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000380124f4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9063caa-b124-4cb6-99ef-d01a735595c3:39099:1731745997363072:10.240.43.61@tcp:400:kworker/u4:2.0
00000100:00100000:1.0:1651532138.621534:0:39100:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cfeac242 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:39100:1731745997363136:10.240.43.61@tcp:400:kworker/u4:2.0
00000100:00100000:0.0:1651532138.621544:0:39099:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000380124f4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9063caa-b124-4cb6-99ef-d01a735595c3:39099:1731745997363072:10.240.43.61@tcp:400:kworker/u4:2.0
00000100:00100000:1.0:1651532140.768140:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651532140.768166:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951232576
00000100:00100000:0.0:1651532140.768181:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 498
00000100:00100000:0.0:1651532140.768185:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cfeac242 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951232576:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:0.0:1651532140.768192:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140736 pending 0 free 81283506176 avail 77112795136
00000100:00100000:0.0:1651532140.768208:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cfeac242 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951232576:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 23us (70us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532140.768212:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 498
00000100:00100000:1.0:1651532145.888101:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651532145.888125:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951232768
00000100:00100000:0.0:1651532145.888141:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 499
00000100:00100000:0.0:1651532145.888143:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d44b0d9f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951232768:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:0.0:1651532145.888151:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140736 pending 0 free 81283506176 avail 77112795136
00000100:00100000:0.0:1651532145.888167:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d44b0d9f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951232768:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 23us (67us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532145.888170:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 499
00000100:00100000:1.0:1651532151.008128:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651532151.008153:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951232896
00000100:00100000:0.0:1651532151.008169:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 500
00000100:00100000:0.0:1651532151.008171:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002bf85ab5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951232896:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:0.0:1651532151.008178:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140736 pending 0 free 81283506176 avail 77112795136
00000100:00100000:0.0:1651532151.008195:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002bf85ab5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951232896:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 23us (68us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532151.008198:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 500
00000100:00100000:1.0:1651532156.128131:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651532156.128156:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951233024
00000100:00100000:0.0:1651532156.128172:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 501
00000100:00100000:0.0:1651532156.128174:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f47fde78 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951233024:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:0.0:1651532156.128182:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140736 pending 0 free 81283506176 avail 77112795136
00000100:00100000:0.0:1651532156.128198:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f47fde78 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951233024:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 23us (68us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532156.128205:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 501
00000100:00100000:1.0:1651532161.248158:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651532161.248183:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951233280
00000100:00100000:0.0:1651532161.248198:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 502
00000100:00100000:0.0:1651532161.248201:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000065be21ea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951233280:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:0.0:1651532161.248208:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140736 pending 0 free 81283506176 avail 77112795136
00000100:00100000:0.0:1651532161.248237:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000065be21ea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951233280:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 35us (79us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532161.248240:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 502
00000100:00100000:1.0:1651532163.709302:0:39100:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002ea4f499 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:39100:1731745997363264:10.240.43.61@tcp:400:kworker/u4:2.0
00000100:00100000:0.0:1651532163.709306:0:39099:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000380124f4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9063caa-b124-4cb6-99ef-d01a735595c3:39099:1731745997363200:10.240.43.61@tcp:400:kworker/u4:2.0
00000100:00100000:1.0:1651532163.709580:0:39100:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002ea4f499 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:39100:1731745997363264:10.240.43.61@tcp:400:kworker/u4:2.0
00000100:00100000:0.0:1651532163.709583:0:39099:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000380124f4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9063caa-b124-4cb6-99ef-d01a735595c3:39099:1731745997363200:10.240.43.61@tcp:400:kworker/u4:2.0
00000100:00100000:1.0:1651532166.368120:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651532166.368145:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951233408
00000100:00100000:0.0:1651532166.368160:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 503
00000100:00100000:0.0:1651532166.368162:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002ea4f499 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951233408:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:0.0:1651532166.368170:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140736 pending 0 free 81283506176 avail 77112795136
00000100:00100000:0.0:1651532166.368185:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002ea4f499 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951233408:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 22us (67us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532166.368188:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 503
00000100:00100000:1.0:1651532171.488139:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651532171.488165:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951233536
00000100:00100000:0.0:1651532171.488180:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 504
00000100:00100000:0.0:1651532171.488182:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007ee473ef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951233536:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:0.0:1651532171.488189:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140736 pending 0 free 81283506176 avail 77112795136
00000100:00100000:0.0:1651532171.488205:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007ee473ef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951233536:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 23us (68us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532171.488212:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 504
00000100:00100000:1.0:1651532176.608160:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651532176.608189:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951233600
00000100:00100000:0.0:1651532176.608208:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 505
00000100:00100000:0.0:1651532176.608210:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f99b3c22 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951233600:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:0.0:1651532176.608218:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140736 pending 0 free 81283506176 avail 77112795136
00000100:00100000:0.0:1651532176.608254:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f99b3c22 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951233600:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 43us (95us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532176.608258:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 505
00000100:00100000:1.0:1651532181.728154:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651532181.728179:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951233792
00000100:00100000:0.0:1651532181.728194:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 506
00000100:00100000:0.0:1651532181.728196:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c0b460ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951233792:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:0.0:1651532181.728204:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140736 pending 0 free 81283506176 avail 77112795136
00000100:00100000:0.0:1651532181.728220:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c0b460ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951233792:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 23us (67us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532181.728235:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 506
00000100:00100000:1.0:1651532186.848139:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651532186.848166:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951233984
00000100:00100000:0.0:1651532186.848182:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 507
00000100:00100000:0.0:1651532186.848185:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6928355 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951233984:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:0.0:1651532186.848192:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140736 pending 0 free 81283506176 avail 77112795136
00000100:00100000:0.0:1651532186.848208:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6928355 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951233984:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 23us (70us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532186.848211:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 507
00000100:00100000:1.0:1651532188.797305:0:39100:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ee01c0ad pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:39100:1731745997363392:10.240.43.61@tcp:400:kworker/u4:2.0
00000100:00100000:0.0:1651532188.797310:0:39099:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006ea40253 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9063caa-b124-4cb6-99ef-d01a735595c3:39099:1731745997363328:10.240.43.61@tcp:400:kworker/u4:2.0
00000100:00100000:1.0:1651532188.797570:0:39100:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ee01c0ad pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:39100:1731745997363392:10.240.43.61@tcp:400:kworker/u4:2.0
00000100:00100000:0.0:1651532188.797574:0:39099:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006ea40253 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9063caa-b124-4cb6-99ef-d01a735595c3:39099:1731745997363328:10.240.43.61@tcp:400:kworker/u4:2.0
00000100:00100000:1.0:1651532191.968221:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651532191.968262:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951234368
00000100:00100000:1.0:1651532191.968282:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 508
00000100:00100000:1.0:1651532191.968284:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ee01c0ad pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951234368:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:1.0:1651532191.968313:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 140736 pending 0 free 81283506176 avail 77112795136
00000100:00100000:1.0:1651532191.968338:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ee01c0ad pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951234368:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 53us (121us total) trans 0 rc 0/0
00000100:00100000:1.0:1651532191.968342:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 508
00000400:00000080:0.0:1651532193.001037:0:231959:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648
00000001:02000400:0.0:1651532193.001039:0:231959:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 398d: run aiocp to verify block size > stripe size ========================================================== 22:56:32 (1651532192)
00000100:00100000:1.0:1651532193.116516:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532193.116533:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469038912
00000100:00100000:1.0:1651532193.116560:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44948
00000100:00100000:1.0:1651532193.116562:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001304ce4c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:438145:x1731754469038912:12345-10.240.43.64@tcp:8:dd.0
00010000:00080000:1.0:1651532193.116587:0:167632:0:(ldlm_lib.c:1365:target_handle_connect()) lustre-OST0001: connection from 0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp t0 exp 0000000055bfac58 cur 22851 last 0
00000020:00000080:1.0:1651532193.116611:0:167632:0:(genops.c:1359:class_connect()) connect: client 0c703c47-a140-4387-a181-4e0a15e9b24e, cookie 0x3234de053ca575a
00002000:00100000:1.0:1651532193.116627:0:167632:0:(ofd_obd.c:150:ofd_parse_connect_data()) lustre-OST0001: cli 0c703c47-a140-4387-a181-4e0a15e9b24e/000000009ab3d8bc ocd_connect_flags: 0xa0465af2e3640078 ocd_version: 20f0000 ocd_grant: 350371840 ocd_index: 0 ocd_group 0
00002000:00100000:1.0:1651532193.116631:0:167632:0:(ofd_obd.c:249:ofd_parse_connect_data()) lustre-OST0001: cli <unknown> supports cksum type f7, return f7
00000020:01000000:1.0:1651532193.116665:0:167632:0:(lprocfs_status_server.c:544:lprocfs_exp_setup()) using hash 00000000427049c0
00002000:00080000:1.0:1651532193.116673:0:167632:0:(ofd_obd.c:391:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0
00000100:00080000:1.0:1651532193.116705:0:167632:0:(import.c:85:import_set_state_nolock()) 00000000a9b548ca �������: changing import state from RECOVER to FULL
00000100:00100000:1.0:1651532193.116746:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001304ce4c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438145:x1731754469038912:12345-10.240.43.64@tcp:8:dd.0 Request processed in 183us (232us total) trans 0 rc 0/0
00000100:00100000:1.0:1651532193.116751:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44948
00000100:00100000:1.0:1651532193.117002:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532193.117010:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469038976
00000100:00100000:1.0:1651532193.117026:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44949
00000100:00100000:1.0:1651532193.117028:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d710c5fd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+6:682204:x1731754469038976:12345-10.240.43.64@tcp:101:dd.0
00010000:00010000:1.0:1651532193.117032:0:167632:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532193.117055:0:167632:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca5761 lrc: 2/0,0 mode: --/PW res: [0x34546:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44fb46 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651532193.117065:0:167632:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34546:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:1.0:1651532193.117072:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532193.117073:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532193.117077:0:167632:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca5761 lrc: 3/0,0 mode: PW/PW res: [0x34546:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fb46 expref: 7 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532193.117085:0:167632:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca5761 lrc: 3/0,0 mode: PW/PW res: [0x34546:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fb46 expref: 7 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532193.117090:0:167632:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001cf49bf2, rc 0)
00000100:00100000:1.0:1651532193.117101:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d710c5fd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+7:682204:x1731754469038976:12345-10.240.43.64@tcp:101:dd.0 Request processed in 73us (100us total) trans 0 rc 0/0
00000100:00100000:1.0:1651532193.117104:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44949
00000100:00100000:1.0:1651532193.117356:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532193.117375:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469039104
00002000:00010000:1.0:1651532193.117383:0:166118:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 214342/0 (0->18446744073709551615)
00002000:00100000:1.0:1651532193.117384:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000374facb9 with x1731754469039104 ext(0->18446744073709551615)
00002000:00010000:1.0:1651532193.117388:0:166118:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000374facb9.
00000100:00100000:1.0:1651532193.117401:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250681
00000100:00100000:1.0:1651532193.117403:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000374facb9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438148:x1731754469039104:12345-10.240.43.64@tcp:10:dd.0
00000001:00080000:0.0:1651532193.240725:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869547 is committed
00000001:00100000:0.0:1651532193.240728:0:166098:0:(tgt_lastrcvd.c:537:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0c703c47-a140-4387-a181-4e0a15e9b24e
00002000:00010000:1.0:1651532193.240760:0:166118:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x34546:0x0] updating lvb size from disk: 0 -> 0
00002000:00010000:1.0:1651532193.240762:0:166118:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x34546:0x0] updating lvb mtime from disk: 0 -> 1651532193
00002000:00010000:1.0:1651532193.240763:0:166118:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x34546:0x0] updating lvb atime from disk: 0 -> 0
00002000:00010000:1.0:1651532193.240764:0:166118:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x34546:0x0] updating lvb ctime from disk: 0 -> 1651532193
00002000:00010000:1.0:1651532193.240765:0:166118:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x34546:0x0] updating lvb blocks from disk: 0 -> 0
00000100:00100000:1.0:1651532193.240779:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000374facb9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438148:x1731754469039104:12345-10.240.43.64@tcp:10:dd.0 Request processed in 123375us (123423us total) trans 21474869547 rc 0/0
00000100:00100000:1.0:1651532193.240782:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250681
00002000:00010000:1.0:1651532193.240784:0:166118:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 214342/0 (0->18446744073709551615)
00002000:00100000:1.0:1651532193.240785:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000374facb9 with x1731754469039104 ext(0->18446744073709551615)
00002000:00010000:1.0:1651532193.240786:0:166118:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000374facb9.
00000100:00100000:1.0:1651532193.316703:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532193.316712:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469039360
00002000:00100000:1.0:1651532193.316721:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x34546:0x0] (0->4194303)  req@0000000063869776 x1731754469039360/t0(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:654/0 lens 488/0 e 0 to 0 dl 1651532199 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0'
00002000:00100000:1.0:1651532193.316725:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000063869776 with x1731754469039360 ext(0->4194303)
00002000:00010000:1.0:1651532193.316727:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000063869776
00000100:00100000:1.0:1651532193.316737:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250682
00000100:00100000:1.0:1651532193.316739:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000063869776 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438146:x1731754469039360:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:1.0:1651532193.321755:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000063869776 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754469039360:12345-10.240.43.64@tcp:4:dd.0 Request processed in 5013us (5050us total) trans 21474869548 rc 0/0
00000100:00100000:1.0:1651532193.321760:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250682
00002000:00100000:1.0:1651532193.321765:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x34546:0x0] (0->4194303)  req@0000000063869776 x1731754469039360/t21474869548(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:654/0 lens 488/448 e 0 to 0 dl 1651532199 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0'
00002000:00100000:1.0:1651532193.321773:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000063869776 with x1731754469039360 ext(0->4194303)
00002000:00010000:1.0:1651532193.321775:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000063869776
00000100:00100000:1.0:1651532193.383567:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532193.383577:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469039616
00002000:00100000:1.0:1651532193.383588:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x34546:0x0] (4194304->8388607)  req@0000000052213cb9 x1731754469039616/t0(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:654/0 lens 488/0 e 0 to 0 dl 1651532199 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0'
00002000:00100000:1.0:1651532193.383592:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000052213cb9 with x1731754469039616 ext(4194304->8388607)
00002000:00010000:1.0:1651532193.383593:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000052213cb9
00000100:00100000:1.0:1651532193.383605:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250683
00000100:00100000:1.0:1651532193.383607:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000052213cb9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754469039616:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:1.0:1651532193.393605:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000052213cb9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438148:x1731754469039616:12345-10.240.43.64@tcp:4:dd.0 Request processed in 9995us (10036us total) trans 21474869549 rc 0/0
00000100:00100000:1.0:1651532193.393611:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250683
00002000:00100000:1.0:1651532193.393615:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x34546:0x0] (4194304->8388607)  req@0000000052213cb9 x1731754469039616/t21474869549(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:654/0 lens 488/448 e 0 to 0 dl 1651532199 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0'
00002000:00100000:1.0:1651532193.393619:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000052213cb9 with x1731754469039616 ext(4194304->8388607)
00002000:00010000:1.0:1651532193.393622:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000052213cb9
00000100:00100000:1.0:1651532193.457952:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532193.457961:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469039872
00002000:00100000:1.0:1651532193.457970:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x34546:0x0] (8388608->12582911)  req@00000000be87d738 x1731754469039872/t0(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:654/0 lens 488/0 e 0 to 0 dl 1651532199 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0'
00002000:00100000:1.0:1651532193.457974:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000be87d738 with x1731754469039872 ext(8388608->12582911)
00002000:00010000:1.0:1651532193.457975:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000be87d738
00000100:00100000:1.0:1651532193.457988:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250684
00000100:00100000:1.0:1651532193.457990:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000be87d738 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438146:x1731754469039872:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:1.0:1651532193.468604:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000be87d738 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754469039872:12345-10.240.43.64@tcp:4:dd.0 Request processed in 10611us (10651us total) trans 21474869550 rc 0/0
00000100:00100000:1.0:1651532193.468609:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250684
00002000:00100000:1.0:1651532193.468613:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x34546:0x0] (8388608->12582911)  req@00000000be87d738 x1731754469039872/t21474869550(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:654/0 lens 488/448 e 0 to 0 dl 1651532199 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0'
00002000:00100000:1.0:1651532193.468618:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000be87d738 with x1731754469039872 ext(8388608->12582911)
00002000:00010000:1.0:1651532193.468620:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000be87d738
00000100:00100000:1.0:1651532193.528567:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532193.528576:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469040128
00002000:00100000:1.0:1651532193.528585:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x34546:0x0] (12582912->16777215)  req@000000006ea40253 x1731754469040128/t0(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:654/0 lens 488/0 e 0 to 0 dl 1651532199 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0'
00002000:00100000:1.0:1651532193.528589:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000006ea40253 with x1731754469040128 ext(12582912->16777215)
00002000:00010000:1.0:1651532193.528591:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000006ea40253
00000100:00100000:1.0:1651532193.528602:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250685
00000100:00100000:1.0:1651532193.528604:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006ea40253 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754469040128:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:1.0:1651532193.539621:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006ea40253 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754469040128:12345-10.240.43.64@tcp:4:dd.0 Request processed in 11015us (11054us total) trans 21474869551 rc 0/0
00000100:00100000:1.0:1651532193.539626:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250685
00002000:00100000:1.0:1651532193.539630:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x34546:0x0] (12582912->16777215)  req@000000006ea40253 x1731754469040128/t21474869551(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:654/0 lens 488/448 e 0 to 0 dl 1651532199 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0'
00002000:00100000:1.0:1651532193.539635:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000006ea40253 with x1731754469040128 ext(12582912->16777215)
00002000:00010000:1.0:1651532193.539636:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000006ea40253
00000100:00100000:1.0:1651532193.600553:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532193.600562:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469040384
00002000:00100000:1.0:1651532193.600571:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x34546:0x0] (16777216->20971519)  req@00000000670433b4 x1731754469040384/t0(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:654/0 lens 488/0 e 0 to 0 dl 1651532199 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0'
00002000:00100000:1.0:1651532193.600575:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000670433b4 with x1731754469040384 ext(16777216->20971519)
00002000:00010000:1.0:1651532193.600576:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000670433b4
00000100:00100000:1.0:1651532193.600588:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250686
00000100:00100000:1.0:1651532193.600590:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000670433b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438146:x1731754469040384:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:1.0:1651532193.611552:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000670433b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754469040384:12345-10.240.43.64@tcp:4:dd.0 Request processed in 10959us (10998us total) trans 21474869552 rc 0/0
00000100:00100000:1.0:1651532193.611557:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250686
00002000:00100000:1.0:1651532193.611561:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x34546:0x0] (16777216->20971519)  req@00000000670433b4 x1731754469040384/t21474869552(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:654/0 lens 488/448 e 0 to 0 dl 1651532199 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0'
00002000:00100000:1.0:1651532193.611565:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000670433b4 with x1731754469040384 ext(16777216->20971519)
00002000:00010000:1.0:1651532193.611567:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000670433b4
00000100:00100000:1.0:1651532193.672594:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532193.672603:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469040640
00002000:00100000:1.0:1651532193.672612:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x34546:0x0] (20971520->25165823)  req@00000000e4e3ecb5 x1731754469040640/t0(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:654/0 lens 488/0 e 0 to 0 dl 1651532199 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0'
00002000:00100000:1.0:1651532193.672616:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000e4e3ecb5 with x1731754469040640 ext(20971520->25165823)
00002000:00010000:1.0:1651532193.672618:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000e4e3ecb5
00000100:00100000:1.0:1651532193.672629:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250687
00000100:00100000:1.0:1651532193.672632:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e4e3ecb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754469040640:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:1.0:1651532193.683558:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e4e3ecb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754469040640:12345-10.240.43.64@tcp:4:dd.0 Request processed in 10923us (10962us total) trans 21474869553 rc 0/0
00000100:00100000:1.0:1651532193.683573:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250687
00002000:00100000:1.0:1651532193.683577:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x34546:0x0] (20971520->25165823)  req@00000000e4e3ecb5 x1731754469040640/t21474869553(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:654/0 lens 488/448 e 0 to 0 dl 1651532199 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0'
00002000:00100000:1.0:1651532193.683582:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000e4e3ecb5 with x1731754469040640 ext(20971520->25165823)
00002000:00010000:1.0:1651532193.683584:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000e4e3ecb5
00000100:00100000:1.0:1651532193.745571:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532193.745580:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469040896
00002000:00100000:1.0:1651532193.745589:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x34546:0x0] (25165824->29360127)  req@00000000b67ad021 x1731754469040896/t0(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:654/0 lens 488/0 e 0 to 0 dl 1651532199 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0'
00002000:00100000:1.0:1651532193.745593:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000b67ad021 with x1731754469040896 ext(25165824->29360127)
00002000:00010000:1.0:1651532193.745594:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000b67ad021
00000100:00100000:1.0:1651532193.745605:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250688
00000100:00100000:1.0:1651532193.745607:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b67ad021 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438146:x1731754469040896:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:1.0:1651532193.756447:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b67ad021 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754469040896:12345-10.240.43.64@tcp:4:dd.0 Request processed in 10838us (10875us total) trans 21474869554 rc 0/0
00000100:00100000:1.0:1651532193.756452:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250688
00002000:00100000:1.0:1651532193.756455:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x34546:0x0] (25165824->29360127)  req@00000000b67ad021 x1731754469040896/t21474869554(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:654/0 lens 488/448 e 0 to 0 dl 1651532199 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0'
00002000:00100000:1.0:1651532193.756460:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000b67ad021 with x1731754469040896 ext(25165824->29360127)
00002000:00010000:1.0:1651532193.756462:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000b67ad021
00000100:00100000:1.0:1651532193.808557:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532193.808566:0:166118:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469041280
00002000:00100000:1.0:1651532193.808574:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x34546:0x0] (29360128->33554431)  req@00000000fb90eb28 x1731754469041280/t0(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:654/0 lens 488/0 e 0 to 0 dl 1651532199 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0'
00002000:00100000:1.0:1651532193.808582:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000fb90eb28 with x1731754469041280 ext(29360128->33554431)
00002000:00010000:1.0:1651532193.808584:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000fb90eb28
00000100:00100000:1.0:1651532193.808595:0:166118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250689
00000100:00100000:1.0:1651532193.808597:0:166118:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fb90eb28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+20:438146:x1731754469041280:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:1.0:1651532193.815278:0:166118:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fb90eb28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+22:438146:x1731754469041280:12345-10.240.43.64@tcp:4:dd.0 Request processed in 6679us (6720us total) trans 21474869555 rc 0/0
00000100:00100000:1.0:1651532193.815283:0:166118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250689
00002000:00100000:1.0:1651532193.815286:0:166118:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x100010000:0x34546:0x0] (29360128->33554431)  req@00000000fb90eb28 x1731754469041280/t21474869555(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:654/0 lens 488/448 e 0 to 0 dl 1651532199 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0'
00002000:00100000:1.0:1651532193.815291:0:166118:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000fb90eb28 with x1731754469041280 ext(29360128->33554431)
00002000:00010000:1.0:1651532193.815292:0:166118:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000fb90eb28
00000100:00100000:1.0:1651532193.934110:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532193.934119:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532193.934132:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532193.934140:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532193.934150:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532193.934151:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469042240
00000100:00100000:1.0:1651532193.934159:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469042432
00000100:00100000:1.0:1651532193.934173:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469042304
00000100:00100000:0.0:1651532193.934174:0:192754:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469042176
00000100:00100000:1.0:1651532193.934179:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469042560
00000100:00100000:1.0:1651532193.934186:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250690
00000100:00100000:1.0:1651532193.934188:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000071f9ee43 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+26:438149:x1731754469042240:12345-10.240.43.64@tcp:3:aiocp.0
00010000:00010000:1.0:1651532193.934212:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca5768 lrc: 3/1,0 mode: --/PR res: [0x34546:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532193.934218:0:192754:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250691
00010000:00010000:1.0:1651532193.934221:0:192753:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca5761 lrc: 2/0,0 mode: PW/PW res: [0x34546:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fb46 expref: 26 pid: 167632 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532193.934221:0:192754:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002d3e5ae4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+26:438149:x1731754469042432:12345-10.240.43.64@tcp:3:aiocp.0
00010000:00010000:1.0:1651532193.934240:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532193.934241:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532193.934242:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca5768 lrc: 4/1,0 mode: --/PR res: [0x34546:0x0:0x0].0x0 rrc: 4 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.934243:0:192754:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca576f lrc: 3/1,0 mode: --/PR res: [0x34546:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.934250:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532193.934251:0:192754:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532193.934252:0:192754:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca576f lrc: 3/1,0 mode: --/PR res: [0x34546:0x0:0x0].0x0 rrc: 4 type: EXT [12582912->16777215] (req 12582912->16777215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532193.934257:0:192753:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca5761 lrc: 3/0,0 mode: PW/PW res: [0x34546:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fb46 expref: 26 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532193.934262:0:192753:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca5761 lrc: 4/0,0 mode: PW/PW res: [0x34546:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fb46 expref: 26 pid: 167632 timeout: 23002 lvb_type: 0
00010000:00010000:0.0:1651532193.934267:0:192754:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca576f lrc: 3/1,0 mode: --/PR res: [0x34546:0x0:0x0].0x0 rrc: 4 type: EXT [12582912->16777215] (req 12582912->16777215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532193.934269:0:192753:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c6960eaf pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:192753:1731745997363456:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651532193.934276:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250692
00000100:00100000:0.0:1651532193.934278:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000094cfb6b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+26:438149:x1731754469042304:12345-10.240.43.64@tcp:3:aiocp.0
00010000:00010000:0.0:1651532193.934284:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca5776 lrc: 3/1,0 mode: --/PR res: [0x34546:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532193.934287:0:192753:0:(client.c:2492:ptlrpc_set_wait()) set 000000003176d4e8 going to sleep for 11 seconds
00010000:00010000:0.0:1651532193.934287:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532193.934288:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532193.934289:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca5776 lrc: 3/1,0 mode: --/PR res: [0x34546:0x0:0x0].0x0 rrc: 5 type: EXT [8388608->12582911] (req 8388608->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.934294:0:216321:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca5776 lrc: 3/1,0 mode: --/PR res: [0x34546:0x0:0x0].0x0 rrc: 5 type: EXT [8388608->12582911] (req 8388608->12582911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532193.934295:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250693
00000100:00100000:1.0:1651532193.934297:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009414203c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+26:438149:x1731754469042560:12345-10.240.43.64@tcp:3:aiocp.0
00000100:00100000:0.0:1651532193.934301:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250694
00000100:00100000:0.0:1651532193.934303:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009078ca7d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+26:438149:x1731754469042176:12345-10.240.43.64@tcp:3:aiocp.0
00010000:00010000:1.0:1651532193.934304:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca577d lrc: 3/1,0 mode: --/PR res: [0x34546:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.934307:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca5784 lrc: 3/1,0 mode: --/PR res: [0x34546:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532193.934308:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532193.934309:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532193.934309:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca577d lrc: 3/1,0 mode: --/PR res: [0x34546:0x0:0x0].0x0 rrc: 8 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.934313:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532193.934314:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532193.934314:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca5784 lrc: 3/1,0 mode: --/PR res: [0x34546:0x0:0x0].0x0 rrc: 7 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532193.934319:0:192755:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca577d lrc: 3/1,0 mode: --/PR res: [0x34546:0x0:0x0].0x0 rrc: 8 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.934319:0:216323:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca5784 lrc: 3/1,0 mode: --/PR res: [0x34546:0x0:0x0].0x0 rrc: 7 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532193.934380:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532193.934389:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532193.934401:0:166117:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469043200
00000100:00100000:0.0:1651532193.934422:0:166117:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469043328
00000100:00100000:0.0:1651532193.934428:0:166117:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250695
00000100:00100000:0.0:1651532193.934430:0:166117:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000de3fc5c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+28:438146:x1731754469043200:12345-10.240.43.64@tcp:3:aiocp.0
00010000:00010000:0.0:1651532193.934436:0:166117:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca578b lrc: 3/1,0 mode: --/PR res: [0x34546:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166117 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.934440:0:166117:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532193.934441:0:166117:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532193.934443:0:166117:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca578b lrc: 3/1,0 mode: --/PR res: [0x34546:0x0:0x0].0x0 rrc: 8 type: EXT [22020096->26214399] (req 22020096->26214399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166117 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.934446:0:166117:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca578b lrc: 3/1,0 mode: --/PR res: [0x34546:0x0:0x0].0x0 rrc: 8 type: EXT [22020096->26214399] (req 22020096->26214399) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166117 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532193.934454:0:192756:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250696
00000100:00100000:0.0:1651532193.934455:0:192756:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b462545d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+28:438146:x1731754469043328:12345-10.240.43.64@tcp:3:aiocp.0
00010000:00010000:0.0:1651532193.934459:0:192756:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca5792 lrc: 3/1,0 mode: --/PR res: [0x34546:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192756 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.934462:0:192756:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532193.934463:0:192756:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532193.934464:0:192756:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca5792 lrc: 3/1,0 mode: --/PR res: [0x34546:0x0:0x0].0x0 rrc: 9 type: EXT [30408704->33554431] (req 30408704->33554431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192756 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.934466:0:192756:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca5792 lrc: 3/1,0 mode: --/PR res: [0x34546:0x0:0x0].0x0 rrc: 9 type: EXT [30408704->33554431] (req 30408704->33554431) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192756 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532193.934481:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532193.934489:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532193.934495:0:176086:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469043136
00000100:00100000:0.0:1651532193.934502:0:176086:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469043264
00000100:00100000:0.0:1651532193.934514:0:176086:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250697
00000100:00100000:0.0:1651532193.934515:0:176086:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000091075bf7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+30:438146:x1731754469043136:12345-10.240.43.64@tcp:3:aiocp.0
00010000:00010000:0.0:1651532193.934521:0:176086:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca5799 lrc: 3/1,0 mode: --/PR res: [0x34546:0x0:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 176086 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.934525:0:176086:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00000100:00100000:1.0:1651532193.934529:0:166116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250698
00000100:00100000:1.0:1651532193.934531:0:166116:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001797bd5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+30:438146:x1731754469043264:12345-10.240.43.64@tcp:3:aiocp.0
00010000:00010000:0.0:1651532193.934534:0:176086:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532193.934535:0:176086:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca5799 lrc: 3/1,0 mode: --/PR res: [0x34546:0x0:0x0].0x0 rrc: 10 type: EXT [17825792->22020095] (req 17825792->22020095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 176086 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532193.934539:0:166116:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca57a0 lrc: 3/1,0 mode: --/PR res: [0x34546:0x0:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166116 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532193.934554:0:166116:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532193.934555:0:166116:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532193.934556:0:166116:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca57a0 lrc: 3/1,0 mode: --/PR res: [0x34546:0x0:0x0].0x0 rrc: 11 type: EXT [26214400->30408703] (req 26214400->30408703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166116 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532193.934560:0:166116:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca57a0 lrc: 3/1,0 mode: --/PR res: [0x34546:0x0:0x0].0x0 rrc: 12 type: EXT [26214400->30408703] (req 26214400->30408703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166116 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.934560:0:176086:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca5799 lrc: 3/1,0 mode: --/PR res: [0x34546:0x0:0x0].0x0 rrc: 11 type: EXT [17825792->22020095] (req 17825792->22020095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 176086 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532193.934782:0:192753:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c6960eaf pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:192753:1731745997363456:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651532193.934788:0:192753:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca5768 lrc: 3/1,0 mode: --/PR res: [0x34546:0x0:0x0].0x0 rrc: 11 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532193.944422:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532193.944433:0:166102:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469043456
00010000:00010000:0.0:1651532193.944440:0:166102:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca5761 lrc: 4/0,0 mode: PW/PW res: [0x34546:0x0:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fb46 expref: 31 pid: 167632 timeout: 23002 lvb_type: 0
00000100:00100000:0.0:1651532193.944449:0:166102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 310
00000100:00100000:0.0:1651532193.944451:0:166102:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003b5b354a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+31:438147:x1731754469043456:12345-10.240.43.64@tcp:103:ldlm_bl_06.0
00010000:00010000:0.0:1651532193.944456:0:166102:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00002000:00010000:0.0:1651532193.944462:0:166102:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x34546:0x0] updating lvb size from disk: 0 -> 33554432
00002000:00010000:0.0:1651532193.944463:0:166102:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x34546:0x0] updating lvb blocks from disk: 0 -> 65536
00010000:00010000:0.0:1651532193.944465:0:166102:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca5761 lrc: 4/0,0 mode: PW/PW res: [0x34546:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fb46 expref: 31 pid: 167632 timeout: 23002 lvb_type: 0
00010000:00010000:0.0:1651532193.944470:0:166102:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca5761 lrc: 3/0,0 mode: PW/PW res: [0x34546:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fb46 expref: 31 pid: 167632 timeout: 23002 lvb_type: 0
00010000:00010000:0.0:1651532193.944479:0:166102:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca5761 lrc: 0/0,0 mode: --/PW res: [0x34546:0x0:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fb46 expref: 31 pid: 167632 timeout: 23002 lvb_type: 0
00010000:00010000:0.0:1651532193.944484:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532193.944485:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532193.944487:0:166102:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca5768 lrc: 3/1,0 mode: PR/PR res: [0x34546:0x0:0x0].0x0 rrc: 11 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.944491:0:166102:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca5768 lrc: 4/1,0 mode: PR/PR res: [0x34546:0x0:0x0].0x0 rrc: 11 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.944494:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532193.944494:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532193.944495:0:166102:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca576f lrc: 3/1,0 mode: PR/PR res: [0x34546:0x0:0x0].0x0 rrc: 11 type: EXT [12582912->16777215] (req 12582912->16777215) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.944498:0:166102:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca576f lrc: 4/1,0 mode: PR/PR res: [0x34546:0x0:0x0].0x0 rrc: 11 type: EXT [12582912->16777215] (req 12582912->16777215) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.944500:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532193.944501:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532193.944501:0:166102:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca5776 lrc: 3/1,0 mode: PR/PR res: [0x34546:0x0:0x0].0x0 rrc: 11 type: EXT [8388608->12582911] (req 8388608->12582911) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.944504:0:166102:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca5776 lrc: 4/1,0 mode: PR/PR res: [0x34546:0x0:0x0].0x0 rrc: 11 type: EXT [8388608->12582911] (req 8388608->12582911) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.944507:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532193.944507:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532193.944508:0:166102:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca577d lrc: 3/1,0 mode: PR/PR res: [0x34546:0x0:0x0].0x0 rrc: 11 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.944510:0:166102:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca577d lrc: 4/1,0 mode: PR/PR res: [0x34546:0x0:0x0].0x0 rrc: 11 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.944513:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532193.944514:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532193.944514:0:166102:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca5784 lrc: 3/1,0 mode: PR/PR res: [0x34546:0x0:0x0].0x0 rrc: 11 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.944517:0:166102:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca5784 lrc: 4/1,0 mode: PR/PR res: [0x34546:0x0:0x0].0x0 rrc: 11 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.944520:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532193.944520:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532193.944521:0:166102:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca578b lrc: 3/1,0 mode: PR/PR res: [0x34546:0x0:0x0].0x0 rrc: 11 type: EXT [22020096->26214399] (req 22020096->26214399) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 166117 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.944523:0:166102:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca578b lrc: 4/1,0 mode: PR/PR res: [0x34546:0x0:0x0].0x0 rrc: 11 type: EXT [22020096->26214399] (req 22020096->26214399) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 166117 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.944526:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532193.944526:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532193.944527:0:166102:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca5792 lrc: 3/1,0 mode: PR/PR res: [0x34546:0x0:0x0].0x0 rrc: 11 type: EXT [30408704->33554431] (req 30408704->33554431) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192756 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.944529:0:166102:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca5792 lrc: 4/1,0 mode: PR/PR res: [0x34546:0x0:0x0].0x0 rrc: 11 type: EXT [30408704->33554431] (req 30408704->33554431) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192756 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.944532:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532193.944532:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532193.944533:0:166102:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca5799 lrc: 3/1,0 mode: PR/PR res: [0x34546:0x0:0x0].0x0 rrc: 11 type: EXT [17825792->22020095] (req 17825792->22020095) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 176086 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.944535:0:166102:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca5799 lrc: 4/1,0 mode: PR/PR res: [0x34546:0x0:0x0].0x0 rrc: 11 type: EXT [17825792->22020095] (req 17825792->22020095) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 176086 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.944538:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532193.944539:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532193.944539:0:166102:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca57a0 lrc: 3/1,0 mode: PR/PR res: [0x34546:0x0:0x0].0x0 rrc: 11 type: EXT [26214400->30408703] (req 26214400->30408703) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 166116 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.944542:0:166102:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca57a0 lrc: 4/1,0 mode: PR/PR res: [0x34546:0x0:0x0].0x0 rrc: 11 type: EXT [26214400->30408703] (req 26214400->30408703) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 166116 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.944562:0:166102:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1651532193.944571:0:192755:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca577d lrc: 3/1,0 mode: PR/PR res: [0x34546:0x0:0x0].0x0 rrc: 10 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532193.944576:0:166102:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003b5b354a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+30:438147:x1731754469043456:12345-10.240.43.64@tcp:103:ldlm_bl_06.0 Request processed in 124us (155us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532193.944579:0:166102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 310
00010000:00010000:1.0:1651532193.944580:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca577d lrc: 3/1,0 mode: PR/PR res: [0x34546:0x0:0x0].0x0 rrc: 10 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.944589:0:192756:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca5792 lrc: 3/1,0 mode: PR/PR res: [0x34546:0x0:0x0].0x0 rrc: 10 type: EXT [30408704->33554431] (req 30408704->33554431) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192756 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.944592:0:192756:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca5792 lrc: 3/1,0 mode: PR/PR res: [0x34546:0x0:0x0].0x0 rrc: 10 type: EXT [30408704->33554431] (req 30408704->33554431) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192756 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532193.944643:0:166116:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca57a0 lrc: 3/1,0 mode: PR/PR res: [0x34546:0x0:0x0].0x0 rrc: 10 type: EXT [26214400->30408703] (req 26214400->30408703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166116 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532193.944658:0:166116:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca57a0 lrc: 3/1,0 mode: PR/PR res: [0x34546:0x0:0x0].0x0 rrc: 10 type: EXT [26214400->30408703] (req 26214400->30408703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166116 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.944765:0:216323:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca5784 lrc: 3/1,0 mode: PR/PR res: [0x34546:0x0:0x0].0x0 rrc: 10 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.944769:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca5784 lrc: 3/1,0 mode: PR/PR res: [0x34546:0x0:0x0].0x0 rrc: 10 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532193.944860:0:192753:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca5768 lrc: 3/1,0 mode: PR/PR res: [0x34546:0x0:0x0].0x0 rrc: 10 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532193.944864:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca5768 lrc: 3/1,0 mode: PR/PR res: [0x34546:0x0:0x0].0x0 rrc: 10 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.944959:0:216321:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca5776 lrc: 3/1,0 mode: PR/PR res: [0x34546:0x0:0x0].0x0 rrc: 10 type: EXT [8388608->12582911] (req 8388608->12582911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.944963:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca5776 lrc: 3/1,0 mode: PR/PR res: [0x34546:0x0:0x0].0x0 rrc: 10 type: EXT [8388608->12582911] (req 8388608->12582911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.945115:0:166117:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca578b lrc: 3/1,0 mode: PR/PR res: [0x34546:0x0:0x0].0x0 rrc: 10 type: EXT [22020096->26214399] (req 22020096->26214399) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166117 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.945119:0:166117:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca578b lrc: 3/1,0 mode: PR/PR res: [0x34546:0x0:0x0].0x0 rrc: 10 type: EXT [22020096->26214399] (req 22020096->26214399) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166117 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.945374:0:176086:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca5799 lrc: 3/1,0 mode: PR/PR res: [0x34546:0x0:0x0].0x0 rrc: 10 type: EXT [17825792->22020095] (req 17825792->22020095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 176086 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.945378:0:176086:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca5799 lrc: 3/1,0 mode: PR/PR res: [0x34546:0x0:0x0].0x0 rrc: 10 type: EXT [17825792->22020095] (req 17825792->22020095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 176086 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.945637:0:192754:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca576f lrc: 3/1,0 mode: PR/PR res: [0x34546:0x0:0x0].0x0 rrc: 10 type: EXT [12582912->16777215] (req 12582912->16777215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.945641:0:192754:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca576f lrc: 3/1,0 mode: PR/PR res: [0x34546:0x0:0x0].0x0 rrc: 10 type: EXT [12582912->16777215] (req 12582912->16777215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532193.948359:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca577d lrc: 3/1,0 mode: PR/PR res: [0x34546:0x0:0x0].0x0 rrc: 10 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532193.948373:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca577d lrc: 2/0,0 mode: PR/PR res: [0x34546:0x0:0x0].0x0 rrc: 10 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532193.948394:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009414203c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+37:438149:x1731754469042560:12345-10.240.43.64@tcp:3:aiocp.0 Request processed in 14096us (14243us total) trans 0 rc 1048576/1048576
00000100:00100000:1.0:1651532193.948398:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250693
00010000:00010000:0.0:1651532193.948428:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca577d lrc: 2/0,0 mode: PR/PR res: [0x34546:0x0:0x0].0x0 rrc: 10 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.948432:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000eebd17a1 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651532193.948434:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca577d lrc: 2/0,0 mode: PR/PR res: [0x34546:0x0:0x0].0x0 rrc: 10 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.948438:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca577d lrc: 3/0,0 mode: PR/PR res: [0x34546:0x0:0x0].0x0 rrc: 10 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.948446:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca577d lrc: 1/0,0 mode: --/PR res: [0x34546:0x0:0x0].0x0 rrc: 10 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.948453:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca577d lrc: 0/0,0 mode: --/PR res: [0x34546:0x0:0x0].0x0 rrc: 10 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.951093:0:192756:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca5792 lrc: 3/1,0 mode: PR/PR res: [0x34546:0x0:0x0].0x0 rrc: 9 type: EXT [30408704->33554431] (req 30408704->33554431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192756 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.951098:0:192756:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca5792 lrc: 2/0,0 mode: PR/PR res: [0x34546:0x0:0x0].0x0 rrc: 9 type: EXT [30408704->33554431] (req 30408704->33554431) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192756 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532193.951117:0:192756:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b462545d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+35:438146:x1731754469043328:12345-10.240.43.64@tcp:3:aiocp.0 Request processed in 16660us (16727us total) trans 0 rc 3145728/3145728
00000100:00100000:0.0:1651532193.951120:0:192756:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250696
00010000:00010000:0.0:1651532193.951129:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca5792 lrc: 2/0,0 mode: PR/PR res: [0x34546:0x0:0x0].0x0 rrc: 9 type: EXT [30408704->33554431] (req 30408704->33554431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192756 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.951133:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000820577fb already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651532193.951134:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca5792 lrc: 2/0,0 mode: PR/PR res: [0x34546:0x0:0x0].0x0 rrc: 9 type: EXT [30408704->33554431] (req 30408704->33554431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192756 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.951136:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca5792 lrc: 3/0,0 mode: PR/PR res: [0x34546:0x0:0x0].0x0 rrc: 9 type: EXT [30408704->33554431] (req 30408704->33554431) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192756 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.951142:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca5792 lrc: 1/0,0 mode: --/PR res: [0x34546:0x0:0x0].0x0 rrc: 9 type: EXT [30408704->33554431] (req 30408704->33554431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192756 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.951145:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca5792 lrc: 0/0,0 mode: --/PR res: [0x34546:0x0:0x0].0x0 rrc: 9 type: EXT [30408704->33554431] (req 30408704->33554431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192756 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532193.955399:0:166116:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca57a0 lrc: 3/1,0 mode: PR/PR res: [0x34546:0x0:0x0].0x0 rrc: 8 type: EXT [26214400->30408703] (req 26214400->30408703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166116 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532193.955405:0:166116:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca57a0 lrc: 2/0,0 mode: PR/PR res: [0x34546:0x0:0x0].0x0 rrc: 8 type: EXT [26214400->30408703] (req 26214400->30408703) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166116 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532193.955434:0:166116:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001797bd5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+33:438146:x1731754469043264:12345-10.240.43.64@tcp:3:aiocp.0 Request processed in 20902us (20945us total) trans 0 rc 4194304/4194304
00000100:00100000:1.0:1651532193.955451:0:166116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250698
00010000:00010000:1.0:1651532193.955466:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca57a0 lrc: 2/0,0 mode: PR/PR res: [0x34546:0x0:0x0].0x0 rrc: 8 type: EXT [26214400->30408703] (req 26214400->30408703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166116 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532193.955470:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d3014069 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651532193.955471:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca57a0 lrc: 2/0,0 mode: PR/PR res: [0x34546:0x0:0x0].0x0 rrc: 8 type: EXT [26214400->30408703] (req 26214400->30408703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166116 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532193.955474:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca57a0 lrc: 3/0,0 mode: PR/PR res: [0x34546:0x0:0x0].0x0 rrc: 8 type: EXT [26214400->30408703] (req 26214400->30408703) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166116 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532193.955481:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca57a0 lrc: 1/0,0 mode: --/PR res: [0x34546:0x0:0x0].0x0 rrc: 8 type: EXT [26214400->30408703] (req 26214400->30408703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166116 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532193.955484:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca57a0 lrc: 0/0,0 mode: --/PR res: [0x34546:0x0:0x0].0x0 rrc: 8 type: EXT [26214400->30408703] (req 26214400->30408703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166116 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.958468:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca5784 lrc: 3/1,0 mode: PR/PR res: [0x34546:0x0:0x0].0x0 rrc: 7 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.958474:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca5784 lrc: 2/0,0 mode: PR/PR res: [0x34546:0x0:0x0].0x0 rrc: 7 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532193.958495:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009078ca7d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+31:438149:x1731754469042176:12345-10.240.43.64@tcp:3:aiocp.0 Request processed in 24191us (24362us total) trans 0 rc 4194304/4194304
00000100:00100000:0.0:1651532193.958499:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250694
00010000:00010000:0.0:1651532193.958508:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca5784 lrc: 2/0,0 mode: PR/PR res: [0x34546:0x0:0x0].0x0 rrc: 7 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.958512:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fb2f6575 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651532193.958513:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca5784 lrc: 2/0,0 mode: PR/PR res: [0x34546:0x0:0x0].0x0 rrc: 7 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.958516:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca5784 lrc: 3/0,0 mode: PR/PR res: [0x34546:0x0:0x0].0x0 rrc: 7 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.958522:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca5784 lrc: 1/0,0 mode: --/PR res: [0x34546:0x0:0x0].0x0 rrc: 7 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.958525:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca5784 lrc: 0/0,0 mode: --/PR res: [0x34546:0x0:0x0].0x0 rrc: 7 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.960802:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca5768 lrc: 3/1,0 mode: PR/PR res: [0x34546:0x0:0x0].0x0 rrc: 6 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.960811:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca5768 lrc: 2/0,0 mode: PR/PR res: [0x34546:0x0:0x0].0x0 rrc: 6 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532193.960829:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000071f9ee43 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+29:438149:x1731754469042240:12345-10.240.43.64@tcp:3:aiocp.0 Request processed in 26641us (26720us total) trans 0 rc 4194304/4194304
00000100:00100000:0.0:1651532193.960833:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250690
00010000:00010000:0.0:1651532193.960841:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca5768 lrc: 2/0,0 mode: PR/PR res: [0x34546:0x0:0x0].0x0 rrc: 6 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.960844:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009c5faf65 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651532193.960845:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca5768 lrc: 2/0,0 mode: PR/PR res: [0x34546:0x0:0x0].0x0 rrc: 6 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.960848:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca5768 lrc: 3/0,0 mode: PR/PR res: [0x34546:0x0:0x0].0x0 rrc: 6 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.960854:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca5768 lrc: 1/0,0 mode: --/PR res: [0x34546:0x0:0x0].0x0 rrc: 6 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.960857:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca5768 lrc: 0/0,0 mode: --/PR res: [0x34546:0x0:0x0].0x0 rrc: 6 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.961963:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca5776 lrc: 3/1,0 mode: PR/PR res: [0x34546:0x0:0x0].0x0 rrc: 5 type: EXT [8388608->12582911] (req 8388608->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.961968:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca5776 lrc: 2/0,0 mode: PR/PR res: [0x34546:0x0:0x0].0x0 rrc: 5 type: EXT [8388608->12582911] (req 8388608->12582911) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532193.961991:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000094cfb6b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+27:438149:x1731754469042304:12345-10.240.43.64@tcp:3:aiocp.0 Request processed in 27712us (27851us total) trans 0 rc 4194304/4194304
00000100:00100000:0.0:1651532193.961995:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250692
00010000:00010000:0.0:1651532193.962236:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca5776 lrc: 2/0,0 mode: PR/PR res: [0x34546:0x0:0x0].0x0 rrc: 5 type: EXT [8388608->12582911] (req 8388608->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.962245:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f765708a already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651532193.962247:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca5776 lrc: 2/0,0 mode: PR/PR res: [0x34546:0x0:0x0].0x0 rrc: 5 type: EXT [8388608->12582911] (req 8388608->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.962250:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca5776 lrc: 3/0,0 mode: PR/PR res: [0x34546:0x0:0x0].0x0 rrc: 5 type: EXT [8388608->12582911] (req 8388608->12582911) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.962255:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca5776 lrc: 1/0,0 mode: --/PR res: [0x34546:0x0:0x0].0x0 rrc: 5 type: EXT [8388608->12582911] (req 8388608->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.962258:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca5776 lrc: 0/0,0 mode: --/PR res: [0x34546:0x0:0x0].0x0 rrc: 5 type: EXT [8388608->12582911] (req 8388608->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.964778:0:166117:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca578b lrc: 3/1,0 mode: PR/PR res: [0x34546:0x0:0x0].0x0 rrc: 4 type: EXT [22020096->26214399] (req 22020096->26214399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166117 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.964783:0:166117:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca578b lrc: 2/0,0 mode: PR/PR res: [0x34546:0x0:0x0].0x0 rrc: 4 type: EXT [22020096->26214399] (req 22020096->26214399) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166117 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532193.964805:0:166117:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000de3fc5c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+25:438146:x1731754469043200:12345-10.240.43.64@tcp:3:aiocp.0 Request processed in 30374us (30425us total) trans 0 rc 4194304/4194304
00000100:00100000:0.0:1651532193.964812:0:166117:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250695
00010000:00010000:0.0:1651532193.964821:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca578b lrc: 2/0,0 mode: PR/PR res: [0x34546:0x0:0x0].0x0 rrc: 4 type: EXT [22020096->26214399] (req 22020096->26214399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166117 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.964824:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f5657138 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651532193.964826:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca578b lrc: 2/0,0 mode: PR/PR res: [0x34546:0x0:0x0].0x0 rrc: 4 type: EXT [22020096->26214399] (req 22020096->26214399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166117 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.964829:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca578b lrc: 3/0,0 mode: PR/PR res: [0x34546:0x0:0x0].0x0 rrc: 4 type: EXT [22020096->26214399] (req 22020096->26214399) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166117 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.964834:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca578b lrc: 1/0,0 mode: --/PR res: [0x34546:0x0:0x0].0x0 rrc: 4 type: EXT [22020096->26214399] (req 22020096->26214399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166117 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.964837:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca578b lrc: 0/0,0 mode: --/PR res: [0x34546:0x0:0x0].0x0 rrc: 4 type: EXT [22020096->26214399] (req 22020096->26214399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166117 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.966550:0:176086:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca5799 lrc: 3/1,0 mode: PR/PR res: [0x34546:0x0:0x0].0x0 rrc: 3 type: EXT [17825792->22020095] (req 17825792->22020095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 176086 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.966555:0:176086:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca5799 lrc: 2/0,0 mode: PR/PR res: [0x34546:0x0:0x0].0x0 rrc: 3 type: EXT [17825792->22020095] (req 17825792->22020095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 176086 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532193.966575:0:176086:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000091075bf7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+23:438146:x1731754469043136:12345-10.240.43.64@tcp:3:aiocp.0 Request processed in 32058us (32094us total) trans 0 rc 4194304/4194304
00000100:00100000:0.0:1651532193.966578:0:176086:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250697
00010000:00010000:0.0:1651532193.966585:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca5799 lrc: 2/0,0 mode: PR/PR res: [0x34546:0x0:0x0].0x0 rrc: 3 type: EXT [17825792->22020095] (req 17825792->22020095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 176086 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.966590:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fab23815 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651532193.966591:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca5799 lrc: 2/0,0 mode: PR/PR res: [0x34546:0x0:0x0].0x0 rrc: 3 type: EXT [17825792->22020095] (req 17825792->22020095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 176086 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.966594:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca5799 lrc: 3/0,0 mode: PR/PR res: [0x34546:0x0:0x0].0x0 rrc: 3 type: EXT [17825792->22020095] (req 17825792->22020095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 176086 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.966599:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca5799 lrc: 1/0,0 mode: --/PR res: [0x34546:0x0:0x0].0x0 rrc: 3 type: EXT [17825792->22020095] (req 17825792->22020095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 176086 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.966602:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca5799 lrc: 0/0,0 mode: --/PR res: [0x34546:0x0:0x0].0x0 rrc: 3 type: EXT [17825792->22020095] (req 17825792->22020095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 176086 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.968408:0:192754:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca576f lrc: 3/1,0 mode: PR/PR res: [0x34546:0x0:0x0].0x0 rrc: 2 type: EXT [12582912->16777215] (req 12582912->16777215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.968412:0:192754:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca576f lrc: 2/0,0 mode: PR/PR res: [0x34546:0x0:0x0].0x0 rrc: 2 type: EXT [12582912->16777215] (req 12582912->16777215) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532193.968437:0:192754:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002d3e5ae4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438149:x1731754469042432:12345-10.240.43.64@tcp:3:aiocp.0 Request processed in 34215us (34317us total) trans 0 rc 4194304/4194304
00000100:00100000:0.0:1651532193.968440:0:192754:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250691
00010000:00010000:0.0:1651532193.968448:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca576f lrc: 2/0,0 mode: PR/PR res: [0x34546:0x0:0x0].0x0 rrc: 2 type: EXT [12582912->16777215] (req 12582912->16777215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.968451:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e2ec18e1 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651532193.968452:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca576f lrc: 2/0,0 mode: PR/PR res: [0x34546:0x0:0x0].0x0 rrc: 2 type: EXT [12582912->16777215] (req 12582912->16777215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.968457:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca576f lrc: 3/0,0 mode: PR/PR res: [0x34546:0x0:0x0].0x0 rrc: 2 type: EXT [12582912->16777215] (req 12582912->16777215) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.968462:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca576f lrc: 1/0,0 mode: --/PR res: [0x34546:0x0:0x0].0x0 rrc: 2 type: EXT [12582912->16777215] (req 12582912->16777215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.968464:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca576f lrc: 0/0,0 mode: --/PR res: [0x34546:0x0:0x0].0x0 rrc: 2 type: EXT [12582912->16777215] (req 12582912->16777215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192754 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532193.979694:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532193.979725:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532193.979747:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532193.979764:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532193.979774:0:166117:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469043712
00000100:00100000:0.0:1651532193.979792:0:166117:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469043840
00000100:00100000:0.0:1651532193.979797:0:166117:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469043968
00000100:00100000:0.0:1651532193.979807:0:166117:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469044096
00000100:00100000:0.0:1651532193.979814:0:166117:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250699
00000100:00100000:0.0:1651532193.979816:0:166117:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ac545f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+24:438148:x1731754469043712:12345-10.240.43.64@tcp:4:aiocp.0
00000100:00100000:1.0:1651532193.979823:0:166116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250700
00000100:00100000:1.0:1651532193.979827:0:166116:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000380124f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+24:438148:x1731754469043840:12345-10.240.43.64@tcp:4:aiocp.0
00002000:00010000:1.0:1651532193.979853:0:166116:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34547:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:1.0:1651532193.979856:0:166116:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca57a7 lrc: 3/0,1 mode: --/PW res: [0x34547:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166116 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.979856:0:166117:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca57ae lrc: 3/0,1 mode: --/PW res: [0x34547:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166117 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.979862:0:166117:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532193.979863:0:166117:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532193.979865:0:166117:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca57ae lrc: 3/0,1 mode: PW/PW res: [0x34547:0x0:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166117 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.979870:0:166117:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca57ae lrc: 3/0,1 mode: PW/PW res: [0x34547:0x0:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166117 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532193.979871:0:166116:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532193.979871:0:166116:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532193.979872:0:166116:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca57a7 lrc: 3/0,1 mode: PW/PW res: [0x34547:0x0:0x0].0x0 rrc: 4 type: EXT [8388608->12582911] (req 8388608->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166116 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532193.979886:0:166116:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca57a7 lrc: 3/0,1 mode: PW/PW res: [0x34547:0x0:0x0].0x0 rrc: 3 type: EXT [8388608->12582911] (req 8388608->12582911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 166116 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532193.980685:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532193.980694:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469043776
00000100:00100000:1.0:1651532193.980700:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532193.980714:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532193.980715:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469043904
00000100:00100000:0.0:1651532193.980720:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469044032
00000100:00100000:1.0:1651532193.980723:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532193.980724:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250701
00000100:00100000:0.0:1651532193.980726:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cebf7380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+29:438148:x1731754469043968:12345-10.240.43.64@tcp:4:aiocp.0
00010000:00010000:0.0:1651532193.980733:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca57b5 lrc: 3/0,1 mode: --/PW res: [0x34547:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.980738:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532193.980739:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532193.980740:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca57b5 lrc: 3/0,1 mode: PW/PW res: [0x34547:0x0:0x0].0x0 rrc: 4 type: EXT [16777216->20971519] (req 16777216->20971519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.980744:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca57b5 lrc: 3/0,1 mode: PW/PW res: [0x34547:0x0:0x0].0x0 rrc: 4 type: EXT [16777216->20971519] (req 16777216->20971519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532193.980752:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469044160
00000100:00100000:1.0:1651532193.980764:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250702
00000100:00100000:1.0:1651532193.980765:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f7096c29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+30:438148:x1731754469044096:12345-10.240.43.64@tcp:4:aiocp.0
00010000:00010000:1.0:1651532193.980773:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca57bc lrc: 3/0,1 mode: --/PW res: [0x34547:0x0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532193.980777:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532193.980778:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532193.980779:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca57bc lrc: 3/0,1 mode: PW/PW res: [0x34547:0x0:0x0].0x0 rrc: 5 type: EXT [25165824->29360127] (req 25165824->29360127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532193.980783:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca57bc lrc: 3/0,1 mode: PW/PW res: [0x34547:0x0:0x0].0x0 rrc: 5 type: EXT [25165824->29360127] (req 25165824->29360127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532193.981708:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250703
00000100:00100000:0.0:1651532193.981710:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c6960eaf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+32:438148:x1731754469043776:12345-10.240.43.64@tcp:4:aiocp.0
00010000:00010000:0.0:1651532193.981717:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca57c3 lrc: 3/0,1 mode: --/PW res: [0x34547:0x0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.981722:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532193.981723:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532193.981723:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca57c3 lrc: 3/0,1 mode: PW/PW res: [0x34547:0x0:0x0].0x0 rrc: 6 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.981727:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca57c3 lrc: 3/0,1 mode: PW/PW res: [0x34547:0x0:0x0].0x0 rrc: 6 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532193.982156:0:192756:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250704
00000100:00100000:1.0:1651532193.982158:0:192756:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000232e8d19 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+32:438148:x1731754469043904:12345-10.240.43.64@tcp:4:aiocp.0
00010000:00010000:1.0:1651532193.982167:0:192756:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca57ca lrc: 3/0,1 mode: --/PW res: [0x34547:0x0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192756 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532193.982175:0:192756:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532193.982176:0:192756:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532193.982177:0:192756:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca57ca lrc: 3/0,1 mode: PW/PW res: [0x34547:0x0:0x0].0x0 rrc: 7 type: EXT [12582912->16777215] (req 12582912->16777215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192756 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532193.982181:0:192756:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca57ca lrc: 3/0,1 mode: PW/PW res: [0x34547:0x0:0x0].0x0 rrc: 7 type: EXT [12582912->16777215] (req 12582912->16777215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192756 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532193.982691:0:216322:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250705
00000100:00100000:0.0:1651532193.982693:0:216322:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002eb188c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+33:438148:x1731754469044032:12345-10.240.43.64@tcp:4:aiocp.0
00010000:00010000:0.0:1651532193.982712:0:216322:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca57d1 lrc: 3/0,1 mode: --/PW res: [0x34547:0x0:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.982717:0:216322:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532193.982717:0:216322:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532193.982718:0:216322:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca57d1 lrc: 3/0,1 mode: PW/PW res: [0x34547:0x0:0x0].0x0 rrc: 8 type: EXT [20971520->25165823] (req 20971520->25165823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532193.982722:0:216322:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca57d1 lrc: 3/0,1 mode: PW/PW res: [0x34547:0x0:0x0].0x0 rrc: 8 type: EXT [20971520->25165823] (req 20971520->25165823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532193.982917:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250706
00000100:00100000:1.0:1651532193.982919:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000074640db2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+34:438148:x1731754469044160:12345-10.240.43.64@tcp:4:aiocp.0
00010000:00010000:1.0:1651532193.982926:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca57d8 lrc: 3/0,1 mode: --/PW res: [0x34547:0x0:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532193.982930:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532193.982930:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532193.982931:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca57d8 lrc: 3/0,1 mode: PW/PW res: [0x34547:0x0:0x0].0x0 rrc: 9 type: EXT [29360128->33554431] (req 29360128->33554431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532193.982935:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca57d8 lrc: 3/0,1 mode: PW/PW res: [0x34547:0x0:0x0].0x0 rrc: 9 type: EXT [29360128->33554431] (req 29360128->33554431) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532195.549825:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869556 is committed
00002000:00010000:1.0:1651532195.549936:0:166116:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x34547:0x0] updating lvb size from disk: 0 -> 33554432
00002000:00010000:1.0:1651532195.549939:0:166116:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x34547:0x0] updating lvb mtime from disk: 0 -> 1651532193
00002000:00010000:1.0:1651532195.549941:0:166116:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x34547:0x0] updating lvb ctime from disk: 0 -> 1651532193
00002000:00010000:1.0:1651532195.549942:0:166116:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x34547:0x0] updating lvb blocks from disk: 0 -> 65536
00010000:00010000:1.0:1651532195.549952:0:166116:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca57a7 lrc: 3/0,1 mode: PW/PW res: [0x34547:0x0:0x0].0x0 rrc: 9 type: EXT [8388608->12582911] (req 8388608->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166116 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532195.549968:0:166116:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca57a7 lrc: 2/0,0 mode: PW/PW res: [0x34547:0x0:0x0].0x0 rrc: 9 type: EXT [8388608->12582911] (req 8388608->12582911) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166116 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532195.550000:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca57a7 lrc: 2/0,0 mode: PW/PW res: [0x34547:0x0:0x0].0x0 rrc: 9 type: EXT [8388608->12582911] (req 8388608->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166116 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532195.550022:0:166116:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000380124f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+33:438148:x1731754469043840:12345-10.240.43.64@tcp:4:aiocp.0 Request processed in 1570193us (1570296us total) trans 21474869556 rc 0/0
00010000:00010000:0.0:1651532195.550026:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d3014069 already unused, calling callback (0000000049fddea7)
00000100:00100000:1.0:1651532195.550028:0:166116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250700
00010000:00010000:0.0:1651532195.550028:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca57a7 lrc: 2/0,0 mode: PW/PW res: [0x34547:0x0:0x0].0x0 rrc: 9 type: EXT [8388608->12582911] (req 8388608->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166116 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532195.550032:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca57a7 lrc: 3/0,0 mode: PW/PW res: [0x34547:0x0:0x0].0x0 rrc: 9 type: EXT [8388608->12582911] (req 8388608->12582911) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166116 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532195.550044:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca57a7 lrc: 1/0,0 mode: --/PW res: [0x34547:0x0:0x0].0x0 rrc: 9 type: EXT [8388608->12582911] (req 8388608->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166116 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532195.550052:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca57a7 lrc: 0/0,0 mode: --/PW res: [0x34547:0x0:0x0].0x0 rrc: 9 type: EXT [8388608->12582911] (req 8388608->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166116 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532196.277517:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869563 is committed
00010000:00010000:0.0:1651532196.277592:0:166117:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca57ae lrc: 3/0,1 mode: PW/PW res: [0x34547:0x0:0x0].0x0 rrc: 9 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 166117 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532196.277596:0:166117:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca57ae lrc: 2/0,0 mode: PW/PW res: [0x34547:0x0:0x0].0x0 rrc: 9 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 166117 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532196.277610:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca57c3 lrc: 3/0,1 mode: PW/PW res: [0x34547:0x0:0x0].0x0 rrc: 8 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532196.277615:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca57c3 lrc: 2/0,0 mode: PW/PW res: [0x34547:0x0:0x0].0x0 rrc: 8 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532196.277631:0:166117:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ac545f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438148:x1731754469043712:12345-10.240.43.64@tcp:4:aiocp.0 Request processed in 2297807us (2297931us total) trans 21474869557 rc 0/0
00000100:00100000:0.0:1651532196.277636:0:166117:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250699
00000100:00100000:1.0:1651532196.277645:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c6960eaf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754469043776:12345-10.240.43.64@tcp:4:aiocp.0 Request processed in 2295934us (2296960us total) trans 21474869560 rc 0/0
00000100:00100000:1.0:1651532196.277649:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250703
00010000:00010000:0.0:1651532196.277687:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca57d8 lrc: 3/0,1 mode: PW/PW res: [0x34547:0x0:0x0].0x0 rrc: 8 type: EXT [29360128->33554431] (req 29360128->33554431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532196.277691:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca57d8 lrc: 2/0,0 mode: PW/PW res: [0x34547:0x0:0x0].0x0 rrc: 8 type: EXT [29360128->33554431] (req 29360128->33554431) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532196.277700:0:192756:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca57ca lrc: 3/0,1 mode: PW/PW res: [0x34547:0x0:0x0].0x0 rrc: 8 type: EXT [12582912->16777215] (req 12582912->16777215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192756 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532196.277706:0:192756:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca57ca lrc: 2/0,0 mode: PW/PW res: [0x34547:0x0:0x0].0x0 rrc: 8 type: EXT [12582912->16777215] (req 12582912->16777215) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192756 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532196.277708:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000074640db2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754469044160:12345-10.240.43.64@tcp:4:aiocp.0 Request processed in 2294788us (2296985us total) trans 21474869562 rc 0/0
00000100:00100000:0.0:1651532196.277711:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250706
00000100:00100000:1.0:1651532196.277729:0:192756:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000232e8d19 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754469043904:12345-10.240.43.64@tcp:4:aiocp.0 Request processed in 2295569us (2297028us total) trans 21474869561 rc 0/0
00000100:00100000:1.0:1651532196.277734:0:192756:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250704
00010000:00010000:1.0:1651532196.277746:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca57ae lrc: 2/0,0 mode: PW/PW res: [0x34547:0x0:0x0].0x0 rrc: 8 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166117 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532196.277755:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e2ec18e1 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651532196.277756:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca57ae lrc: 2/0,0 mode: PW/PW res: [0x34547:0x0:0x0].0x0 rrc: 9 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 166117 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532196.277760:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca57ae lrc: 3/0,0 mode: PW/PW res: [0x34547:0x0:0x0].0x0 rrc: 8 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 166117 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532196.277760:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca57b5 lrc: 3/0,1 mode: PW/PW res: [0x34547:0x0:0x0].0x0 rrc: 9 type: EXT [16777216->20971519] (req 16777216->20971519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532196.277764:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca57b5 lrc: 2/0,0 mode: PW/PW res: [0x34547:0x0:0x0].0x0 rrc: 8 type: EXT [16777216->20971519] (req 16777216->20971519) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532196.277775:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca57ae lrc: 1/0,0 mode: --/PW res: [0x34547:0x0:0x0].0x0 rrc: 8 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166117 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532196.277778:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca57ae lrc: 0/0,0 mode: --/PW res: [0x34547:0x0:0x0].0x0 rrc: 8 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 166117 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532196.277781:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cebf7380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754469043968:12345-10.240.43.64@tcp:4:aiocp.0 Request processed in 2297054us (2298034us total) trans 21474869559 rc 0/0
00010000:00010000:1.0:1651532196.277782:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca57c3 lrc: 2/0,0 mode: PW/PW res: [0x34547:0x0:0x0].0x0 rrc: 7 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532196.277784:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f5657138 already unused, calling callback (0000000049fddea7)
00000100:00100000:0.0:1651532196.277784:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250701
00010000:00010000:1.0:1651532196.277785:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca57c3 lrc: 2/0,0 mode: PW/PW res: [0x34547:0x0:0x0].0x0 rrc: 7 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532196.277788:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca57c3 lrc: 3/0,0 mode: PW/PW res: [0x34547:0x0:0x0].0x0 rrc: 7 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532196.277792:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca57c3 lrc: 1/0,0 mode: --/PW res: [0x34547:0x0:0x0].0x0 rrc: 7 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532196.277794:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca57c3 lrc: 0/0,0 mode: --/PW res: [0x34547:0x0:0x0].0x0 rrc: 7 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532196.277800:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca57d8 lrc: 2/0,0 mode: PW/PW res: [0x34547:0x0:0x0].0x0 rrc: 6 type: EXT [29360128->33554431] (req 29360128->33554431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532196.277803:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c806f265 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651532196.277804:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca57d8 lrc: 2/0,0 mode: PW/PW res: [0x34547:0x0:0x0].0x0 rrc: 6 type: EXT [29360128->33554431] (req 29360128->33554431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532196.277806:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca57d8 lrc: 3/0,0 mode: PW/PW res: [0x34547:0x0:0x0].0x0 rrc: 6 type: EXT [29360128->33554431] (req 29360128->33554431) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532196.277810:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca57d8 lrc: 1/0,0 mode: --/PW res: [0x34547:0x0:0x0].0x0 rrc: 6 type: EXT [29360128->33554431] (req 29360128->33554431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532196.277812:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca57d8 lrc: 0/0,0 mode: --/PW res: [0x34547:0x0:0x0].0x0 rrc: 6 type: EXT [29360128->33554431] (req 29360128->33554431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532196.277815:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca57ca lrc: 2/0,0 mode: PW/PW res: [0x34547:0x0:0x0].0x0 rrc: 5 type: EXT [12582912->16777215] (req 12582912->16777215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192756 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532196.277818:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c8969b4f already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651532196.277818:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca57ca lrc: 2/0,0 mode: PW/PW res: [0x34547:0x0:0x0].0x0 rrc: 5 type: EXT [12582912->16777215] (req 12582912->16777215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192756 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532196.277821:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca57ca lrc: 3/0,0 mode: PW/PW res: [0x34547:0x0:0x0].0x0 rrc: 5 type: EXT [12582912->16777215] (req 12582912->16777215) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192756 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532196.277824:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca57ca lrc: 1/0,0 mode: --/PW res: [0x34547:0x0:0x0].0x0 rrc: 5 type: EXT [12582912->16777215] (req 12582912->16777215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192756 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532196.277827:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca57ca lrc: 0/0,0 mode: --/PW res: [0x34547:0x0:0x0].0x0 rrc: 5 type: EXT [12582912->16777215] (req 12582912->16777215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192756 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532196.277830:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca57b5 lrc: 2/0,0 mode: PW/PW res: [0x34547:0x0:0x0].0x0 rrc: 5 type: EXT [16777216->20971519] (req 16777216->20971519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532196.277830:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca57bc lrc: 3/0,1 mode: PW/PW res: [0x34547:0x0:0x0].0x0 rrc: 6 type: EXT [25165824->29360127] (req 25165824->29360127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532196.277833:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca57bc lrc: 2/0,0 mode: PW/PW res: [0x34547:0x0:0x0].0x0 rrc: 4 type: EXT [25165824->29360127] (req 25165824->29360127) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532196.277836:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fab23815 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651532196.277836:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca57b5 lrc: 2/0,0 mode: PW/PW res: [0x34547:0x0:0x0].0x0 rrc: 4 type: EXT [16777216->20971519] (req 16777216->20971519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532196.277839:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca57b5 lrc: 3/0,0 mode: PW/PW res: [0x34547:0x0:0x0].0x0 rrc: 4 type: EXT [16777216->20971519] (req 16777216->20971519) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532196.277842:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca57b5 lrc: 1/0,0 mode: --/PW res: [0x34547:0x0:0x0].0x0 rrc: 4 type: EXT [16777216->20971519] (req 16777216->20971519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532196.277845:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca57b5 lrc: 0/0,0 mode: --/PW res: [0x34547:0x0:0x0].0x0 rrc: 4 type: EXT [16777216->20971519] (req 16777216->20971519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532196.277847:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f7096c29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438148:x1731754469044096:12345-10.240.43.64@tcp:4:aiocp.0 Request processed in 2297081us (2298083us total) trans 21474869558 rc 0/0
00010000:00010000:1.0:1651532196.277848:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca57bc lrc: 2/0,0 mode: PW/PW res: [0x34547:0x0:0x0].0x0 rrc: 3 type: EXT [25165824->29360127] (req 25165824->29360127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532196.277849:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250702
00010000:00010000:1.0:1651532196.277850:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f2af03c8 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651532196.277851:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca57bc lrc: 2/0,0 mode: PW/PW res: [0x34547:0x0:0x0].0x0 rrc: 3 type: EXT [25165824->29360127] (req 25165824->29360127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532196.277854:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca57bc lrc: 3/0,0 mode: PW/PW res: [0x34547:0x0:0x0].0x0 rrc: 3 type: EXT [25165824->29360127] (req 25165824->29360127) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532196.277857:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca57bc lrc: 1/0,0 mode: --/PW res: [0x34547:0x0:0x0].0x0 rrc: 3 type: EXT [25165824->29360127] (req 25165824->29360127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532196.277860:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca57bc lrc: 0/0,0 mode: --/PW res: [0x34547:0x0:0x0].0x0 rrc: 3 type: EXT [25165824->29360127] (req 25165824->29360127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532196.277894:0:216322:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca57d1 lrc: 3/0,1 mode: PW/PW res: [0x34547:0x0:0x0].0x0 rrc: 2 type: EXT [20971520->25165823] (req 20971520->25165823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532196.277897:0:216322:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca57d1 lrc: 2/0,0 mode: PW/PW res: [0x34547:0x0:0x0].0x0 rrc: 2 type: EXT [20971520->25165823] (req 20971520->25165823) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532196.277920:0:216322:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002eb188c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438148:x1731754469044032:12345-10.240.43.64@tcp:4:aiocp.0 Request processed in 2295226us (2297205us total) trans 21474869563 rc 0/0
00000100:00100000:0.0:1651532196.277923:0:216322:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250705
00010000:00010000:0.0:1651532196.277930:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca57d1 lrc: 2/0,0 mode: PW/PW res: [0x34547:0x0:0x0].0x0 rrc: 2 type: EXT [20971520->25165823] (req 20971520->25165823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532196.277933:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f765708a already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651532196.277934:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca57d1 lrc: 2/0,0 mode: PW/PW res: [0x34547:0x0:0x0].0x0 rrc: 2 type: EXT [20971520->25165823] (req 20971520->25165823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532196.277938:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca57d1 lrc: 3/0,0 mode: PW/PW res: [0x34547:0x0:0x0].0x0 rrc: 2 type: EXT [20971520->25165823] (req 20971520->25165823) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532196.277943:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca57d1 lrc: 1/0,0 mode: --/PW res: [0x34547:0x0:0x0].0x0 rrc: 2 type: EXT [20971520->25165823] (req 20971520->25165823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532196.277946:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca57d1 lrc: 0/0,0 mode: --/PW res: [0x34547:0x0:0x0].0x0 rrc: 2 type: EXT [20971520->25165823] (req 20971520->25165823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532196.480205:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532196.480219:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469045248
00000100:00100000:1.0:1651532196.480250:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44950
00000100:00100000:1.0:1651532196.480252:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bedaf1f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+5:438146:x1731754469045248:12345-10.240.43.64@tcp:101:diff.0
00010000:00010000:1.0:1651532196.480259:0:167632:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532196.480266:0:167632:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca57df lrc: 2/0,0 mode: --/PR res: [0x34546:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44fb70 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651532196.480272:0:167632:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34546:0x0] initial LVB size: 33554432, mtime: 0x627061a1, atime: 0x0, ctime: 0x627061a1, blocks: 0x10000
00010000:00010000:1.0:1651532196.480279:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532196.480280:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532196.480284:0:167632:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca57df lrc: 3/0,0 mode: PR/PR res: [0x34546:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fb70 expref: 6 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532196.480290:0:167632:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca57df lrc: 3/0,0 mode: PR/PR res: [0x34546:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fb70 expref: 6 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532196.480295:0:167632:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f2af03c8, rc 0)
00000100:00100000:1.0:1651532196.480306:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bedaf1f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438146:x1731754469045248:12345-10.240.43.64@tcp:101:diff.0 Request processed in 54us (102us total) trans 0 rc 0/0
00000100:00100000:1.0:1651532196.480313:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44950
00000100:00100000:1.0:1651532196.481221:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532196.481239:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469045376
00000100:00100000:1.0:1651532196.481252:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44951
00000100:00100000:1.0:1651532196.481253:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000029096870 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438146:x1731754469045376:12345-10.240.43.64@tcp:101:diff.0
00010000:00010000:1.0:1651532196.481257:0:167632:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532196.481261:0:167632:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca57e6 lrc: 2/0,0 mode: --/PR res: [0x34547:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44fb7e expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651532196.481266:0:167632:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34547:0x0] initial LVB size: 33554432, mtime: 0x627061a1, atime: 0x0, ctime: 0x627061a1, blocks: 0x10000
00010000:00010000:1.0:1651532196.481270:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532196.481270:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532196.481272:0:167632:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca57e6 lrc: 3/0,0 mode: PR/PR res: [0x34547:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fb7e expref: 7 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532196.481277:0:167632:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca57e6 lrc: 3/0,0 mode: PR/PR res: [0x34547:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fb7e expref: 7 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532196.481281:0:167632:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c8969b4f, rc 0)
00000100:00100000:1.0:1651532196.481290:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000029096870 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438146:x1731754469045376:12345-10.240.43.64@tcp:101:diff.0 Request processed in 36us (70us total) trans 0 rc 0/0
00000100:00100000:1.0:1651532196.481293:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44951
00000100:00100000:1.0:1651532196.484216:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532196.484239:0:216322:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469045952
00002000:00100000:0.0:1651532196.484252:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34546:0x0] (0->2097151)  req@00000000dfff0362 x1731754469045952/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:696/0 lens 488/0 e 0 to 0 dl 1651532241 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00002000:00100000:0.0:1651532196.484257:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000dfff0362 with x1731754469045952 ext(0->2097151)
00002000:00010000:0.0:1651532196.484259:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000dfff0362
00000100:00100000:0.0:1651532196.484265:0:216322:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250707
00000100:00100000:0.0:1651532196.484267:0:216322:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dfff0362 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438146:x1731754469045952:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:0.0:1651532196.486823:0:216322:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dfff0362 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438146:x1731754469045952:12345-10.240.43.64@tcp:3:diff.0 Request processed in 2554us (2606us total) trans 0 rc 2097152/2097152
00000100:00100000:0.0:1651532196.486826:0:216322:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250707
00002000:00100000:0.0:1651532196.486829:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34546:0x0] (0->2097151)  req@00000000dfff0362 x1731754469045952/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:696/0 lens 488/440 e 0 to 0 dl 1651532241 ref 1 fl Complete:/0/0 rc 2097152/2097152 job:'diff.0'
00002000:00100000:0.0:1651532196.486833:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000dfff0362 with x1731754469045952 ext(0->2097151)
00002000:00010000:0.0:1651532196.486834:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000dfff0362
00000100:00100000:1.0:1651532196.491906:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532196.491929:0:216322:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469046144
00002000:00100000:0.0:1651532196.491937:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34547:0x0] (0->2097151)  req@00000000295be4cd x1731754469046144/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:696/0 lens 488/0 e 0 to 0 dl 1651532241 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00002000:00100000:0.0:1651532196.491941:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000295be4cd with x1731754469046144 ext(0->2097151)
00002000:00010000:0.0:1651532196.491942:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000295be4cd
00000100:00100000:0.0:1651532196.491947:0:216322:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250708
00000100:00100000:0.0:1651532196.491949:0:216322:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000295be4cd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438146:x1731754469046144:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:0.0:1651532196.493904:0:216322:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000295be4cd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438146:x1731754469046144:12345-10.240.43.64@tcp:3:diff.0 Request processed in 1954us (1998us total) trans 0 rc 2097152/2097152
00000100:00100000:0.0:1651532196.493908:0:216322:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250708
00002000:00100000:0.0:1651532196.493910:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34547:0x0] (0->2097151)  req@00000000295be4cd x1731754469046144/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:696/0 lens 488/440 e 0 to 0 dl 1651532241 ref 1 fl Complete:/0/0 rc 2097152/2097152 job:'diff.0'
00002000:00100000:0.0:1651532196.493913:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000295be4cd with x1731754469046144 ext(0->2097151)
00002000:00010000:0.0:1651532196.493914:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000295be4cd
00000100:00100000:1.0:1651532196.499555:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532196.499577:0:216322:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469046464
00002000:00100000:0.0:1651532196.499584:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34546:0x0] (2097152->4194303)  req@000000001eda4376 x1731754469046464/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:696/0 lens 488/0 e 0 to 0 dl 1651532241 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00002000:00100000:0.0:1651532196.499588:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000001eda4376 with x1731754469046464 ext(2097152->4194303)
00002000:00010000:0.0:1651532196.499589:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000001eda4376
00000100:00100000:0.0:1651532196.499595:0:216322:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250709
00000100:00100000:0.0:1651532196.499596:0:216322:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001eda4376 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438146:x1731754469046464:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:0.0:1651532196.501650:0:216322:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001eda4376 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438146:x1731754469046464:12345-10.240.43.64@tcp:3:diff.0 Request processed in 2053us (2095us total) trans 0 rc 2097152/2097152
00000100:00100000:0.0:1651532196.501654:0:216322:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250709
00002000:00100000:0.0:1651532196.501656:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34546:0x0] (2097152->4194303)  req@000000001eda4376 x1731754469046464/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:696/0 lens 488/440 e 0 to 0 dl 1651532241 ref 1 fl Complete:/0/0 rc 2097152/2097152 job:'diff.0'
00002000:00100000:0.0:1651532196.501661:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000001eda4376 with x1731754469046464 ext(2097152->4194303)
00002000:00010000:0.0:1651532196.501663:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000001eda4376
00000100:00100000:1.0:1651532196.505209:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532196.505237:0:216322:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469046720
00002000:00100000:0.0:1651532196.505244:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34547:0x0] (2097152->4194303)  req@00000000c4db449c x1731754469046720/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:696/0 lens 488/0 e 0 to 0 dl 1651532241 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00002000:00100000:0.0:1651532196.505248:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000c4db449c with x1731754469046720 ext(2097152->4194303)
00002000:00010000:0.0:1651532196.505249:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000c4db449c
00000100:00100000:0.0:1651532196.505254:0:216322:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250710
00000100:00100000:0.0:1651532196.505256:0:216322:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c4db449c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438149:x1731754469046720:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:0.0:1651532196.507145:0:216322:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c4db449c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438149:x1731754469046720:12345-10.240.43.64@tcp:3:diff.0 Request processed in 1888us (1936us total) trans 0 rc 2097152/2097152
00000100:00100000:0.0:1651532196.507149:0:216322:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250710
00002000:00100000:0.0:1651532196.507152:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34547:0x0] (2097152->4194303)  req@00000000c4db449c x1731754469046720/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:696/0 lens 488/440 e 0 to 0 dl 1651532241 ref 1 fl Complete:/0/0 rc 2097152/2097152 job:'diff.0'
00002000:00100000:0.0:1651532196.507155:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000c4db449c with x1731754469046720 ext(2097152->4194303)
00002000:00010000:0.0:1651532196.507156:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000c4db449c
00000100:00100000:1.0:1651532196.513059:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532196.513081:0:216322:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469046976
00002000:00100000:0.0:1651532196.513088:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34546:0x0] (4194304->8388607)  req@00000000b5b5b4c0 x1731754469046976/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:696/0 lens 488/0 e 0 to 0 dl 1651532241 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00002000:00100000:0.0:1651532196.513092:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000b5b5b4c0 with x1731754469046976 ext(4194304->8388607)
00002000:00010000:0.0:1651532196.513093:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000b5b5b4c0
00000100:00100000:0.0:1651532196.513098:0:216322:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250711
00000100:00100000:0.0:1651532196.513100:0:216322:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b5b5b4c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438148:x1731754469046976:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:0.0:1651532196.516836:0:216322:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b5b5b4c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438148:x1731754469046976:12345-10.240.43.64@tcp:3:diff.0 Request processed in 3734us (3777us total) trans 0 rc 4194304/4194304
00000100:00100000:0.0:1651532196.516840:0:216322:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250711
00002000:00100000:0.0:1651532196.516842:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34546:0x0] (4194304->8388607)  req@00000000b5b5b4c0 x1731754469046976/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:696/0 lens 488/440 e 0 to 0 dl 1651532241 ref 1 fl Complete:/0/0 rc 4194304/4194304 job:'diff.0'
00002000:00100000:0.0:1651532196.516846:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000b5b5b4c0 with x1731754469046976 ext(4194304->8388607)
00002000:00010000:0.0:1651532196.516848:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000b5b5b4c0
00000100:00100000:1.0:1651532196.522517:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532196.522539:0:216322:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469047168
00002000:00100000:0.0:1651532196.522547:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34547:0x0] (4194304->8388607)  req@000000002bdf9f80 x1731754469047168/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:696/0 lens 488/0 e 0 to 0 dl 1651532241 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00002000:00100000:0.0:1651532196.522551:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000002bdf9f80 with x1731754469047168 ext(4194304->8388607)
00002000:00010000:0.0:1651532196.522552:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000002bdf9f80
00000100:00100000:0.0:1651532196.522561:0:216322:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250712
00000100:00100000:0.0:1651532196.522563:0:216322:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002bdf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438148:x1731754469047168:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:0.0:1651532196.526243:0:216322:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002bdf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438148:x1731754469047168:12345-10.240.43.64@tcp:3:diff.0 Request processed in 3678us (3726us total) trans 0 rc 4194304/4194304
00000100:00100000:0.0:1651532196.526247:0:216322:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250712
00002000:00100000:0.0:1651532196.526249:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34547:0x0] (4194304->8388607)  req@000000002bdf9f80 x1731754469047168/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:696/0 lens 488/440 e 0 to 0 dl 1651532241 ref 1 fl Complete:/0/0 rc 4194304/4194304 job:'diff.0'
00002000:00100000:0.0:1651532196.526253:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000002bdf9f80 with x1731754469047168 ext(4194304->8388607)
00002000:00010000:0.0:1651532196.526254:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000002bdf9f80
00000100:00100000:1.0:1651532196.538439:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532196.538451:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532196.538457:0:216322:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469047680
00000100:00100000:1.0:1651532196.538460:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469047616
00002000:00100000:0.0:1651532196.538466:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34546:0x0] (12582912->16777215)  req@00000000e11ae1c5 x1731754469047680/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:696/0 lens 488/0 e 0 to 0 dl 1651532241 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00002000:00100000:1.0:1651532196.538471:0:192755:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x100010000:0x34546:0x0] (8388608->12582911)  req@000000007a693f14 x1731754469047616/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:696/0 lens 488/0 e 0 to 0 dl 1651532241 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00002000:00100000:0.0:1651532196.538474:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000e11ae1c5 with x1731754469047680 ext(12582912->16777215)
00002000:00010000:0.0:1651532196.538475:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000e11ae1c5
00002000:00100000:1.0:1651532196.538476:0:192755:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000007a693f14 with x1731754469047616 ext(8388608->12582911)
00002000:00010000:1.0:1651532196.538477:0:192755:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000007a693f14
00000100:00100000:0.0:1651532196.538481:0:216322:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250713
00000100:00100000:0.0:1651532196.538483:0:216322:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e11ae1c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754469047680:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:1.0:1651532196.538484:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250714
00000100:00100000:1.0:1651532196.538486:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007a693f14 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754469047616:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:0.0:1651532196.542994:0:216322:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e11ae1c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438146:x1731754469047680:12345-10.240.43.64@tcp:3:diff.0 Request processed in 4507us (4554us total) trans 0 rc 4194304/4194304
00000100:00100000:0.0:1651532196.542999:0:216322:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250713
00002000:00100000:0.0:1651532196.543003:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34546:0x0] (12582912->16777215)  req@00000000e11ae1c5 x1731754469047680/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:696/0 lens 488/440 e 0 to 0 dl 1651532241 ref 1 fl Complete:/0/0 rc 4194304/4194304 job:'diff.0'
00002000:00100000:0.0:1651532196.543007:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000e11ae1c5 with x1731754469047680 ext(12582912->16777215)
00002000:00010000:0.0:1651532196.543010:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000e11ae1c5
00000100:00100000:1.0:1651532196.545699:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007a693f14 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438146:x1731754469047616:12345-10.240.43.64@tcp:3:diff.0 Request processed in 7211us (7246us total) trans 0 rc 4194304/4194304
00000100:00100000:1.0:1651532196.545703:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250714
00002000:00100000:1.0:1651532196.545706:0:192755:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x100010000:0x34546:0x0] (8388608->12582911)  req@000000007a693f14 x1731754469047616/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:696/0 lens 488/440 e 0 to 0 dl 1651532241 ref 1 fl Complete:/0/0 rc 4194304/4194304 job:'diff.0'
00002000:00100000:1.0:1651532196.545710:0:192755:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000007a693f14 with x1731754469047616 ext(8388608->12582911)
00002000:00010000:1.0:1651532196.545712:0:192755:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000007a693f14
00000100:00100000:0.0:1651532196.554001:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532196.554025:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469047936
00002000:00100000:1.0:1651532196.554035:0:192755:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x100010000:0x34547:0x0] (8388608->12582911)  req@00000000f99d9ea1 x1731754469047936/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:696/0 lens 488/0 e 0 to 0 dl 1651532241 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00002000:00100000:1.0:1651532196.554039:0:192755:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000f99d9ea1 with x1731754469047936 ext(8388608->12582911)
00002000:00010000:1.0:1651532196.554040:0:192755:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000f99d9ea1
00000100:00100000:1.0:1651532196.554051:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250715
00000100:00100000:1.0:1651532196.554053:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f99d9ea1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438148:x1731754469047936:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:0.0:1651532196.554237:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532196.554245:0:216322:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469048000
00002000:00100000:0.0:1651532196.554253:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34547:0x0] (12582912->16777215)  req@000000004237e3f1 x1731754469048000/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:696/0 lens 488/0 e 0 to 0 dl 1651532241 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00002000:00100000:0.0:1651532196.554257:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000004237e3f1 with x1731754469048000 ext(12582912->16777215)
00002000:00010000:0.0:1651532196.554259:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000004237e3f1
00000100:00100000:0.0:1651532196.554264:0:216322:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250716
00000100:00100000:0.0:1651532196.554266:0:216322:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004237e3f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754469048000:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:1.0:1651532196.558428:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f99d9ea1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754469047936:12345-10.240.43.64@tcp:3:diff.0 Request processed in 4372us (4426us total) trans 0 rc 4194304/4194304
00000100:00100000:1.0:1651532196.558433:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250715
00002000:00100000:1.0:1651532196.558437:0:192755:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x100010000:0x34547:0x0] (8388608->12582911)  req@00000000f99d9ea1 x1731754469047936/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:696/0 lens 488/440 e 0 to 0 dl 1651532241 ref 1 fl Complete:/0/0 rc 4194304/4194304 job:'diff.0'
00002000:00100000:1.0:1651532196.558442:0:192755:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000f99d9ea1 with x1731754469047936 ext(8388608->12582911)
00002000:00010000:1.0:1651532196.558444:0:192755:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000f99d9ea1
00000100:00100000:0.0:1651532196.561116:0:216322:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004237e3f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438148:x1731754469048000:12345-10.240.43.64@tcp:3:diff.0 Request processed in 6848us (6879us total) trans 0 rc 4194304/4194304
00000100:00100000:0.0:1651532196.561121:0:216322:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250716
00002000:00100000:0.0:1651532196.561125:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34547:0x0] (12582912->16777215)  req@000000004237e3f1 x1731754469048000/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:696/0 lens 488/440 e 0 to 0 dl 1651532241 ref 1 fl Complete:/0/0 rc 4194304/4194304 job:'diff.0'
00002000:00100000:0.0:1651532196.561130:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000004237e3f1 with x1731754469048000 ext(12582912->16777215)
00002000:00010000:0.0:1651532196.561131:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000004237e3f1
00000100:00100000:1.0:1651532196.581422:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532196.581435:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532196.581443:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469048704
00000100:00100000:0.0:1651532196.581445:0:216322:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469048640
00002000:00100000:1.0:1651532196.581452:0:192755:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x100010000:0x34546:0x0] (20971520->25165823)  req@00000000f2eb86bf x1731754469048704/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:696/0 lens 488/0 e 0 to 0 dl 1651532241 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00002000:00100000:0.0:1651532196.581454:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34546:0x0] (16777216->20971519)  req@00000000e589436f x1731754469048640/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:696/0 lens 488/0 e 0 to 0 dl 1651532241 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00002000:00100000:1.0:1651532196.581456:0:192755:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000f2eb86bf with x1731754469048704 ext(20971520->25165823)
00002000:00010000:1.0:1651532196.581458:0:192755:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000f2eb86bf
00002000:00100000:0.0:1651532196.581458:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000e589436f with x1731754469048640 ext(16777216->20971519)
00002000:00010000:0.0:1651532196.581459:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000e589436f
00000100:00100000:1.0:1651532196.581466:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250717
00000100:00100000:1.0:1651532196.581468:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f2eb86bf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754469048704:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:0.0:1651532196.581474:0:216322:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250718
00000100:00100000:0.0:1651532196.581476:0:216322:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e589436f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754469048640:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:0.0:1651532196.586095:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532196.586106:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532196.586122:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469048960
00000100:00100000:0.0:1651532196.586128:0:192756:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469049024
00002000:00100000:1.0:1651532196.586134:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x34547:0x0] (16777216->20971519)  req@000000001e61ed2d x1731754469048960/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:696/0 lens 488/0 e 0 to 0 dl 1651532241 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00002000:00100000:0.0:1651532196.586137:0:192756:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x100010000:0x34547:0x0] (20971520->25165823)  req@0000000043b0f16d x1731754469049024/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:696/0 lens 488/0 e 0 to 0 dl 1651532241 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00002000:00100000:1.0:1651532196.586139:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000001e61ed2d with x1731754469048960 ext(16777216->20971519)
00002000:00010000:1.0:1651532196.586141:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000001e61ed2d
00002000:00100000:0.0:1651532196.586141:0:192756:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000043b0f16d with x1731754469049024 ext(20971520->25165823)
00002000:00010000:0.0:1651532196.586143:0:192756:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000043b0f16d
00000100:00100000:1.0:1651532196.586158:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250719
00000100:00100000:1.0:1651532196.586160:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001e61ed2d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754469048960:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:0.0:1651532196.586161:0:192756:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250720
00000100:00100000:0.0:1651532196.586163:0:192756:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000043b0f16d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754469049024:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:1.0:1651532196.586674:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f2eb86bf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754469048704:12345-10.240.43.64@tcp:3:diff.0 Request processed in 5195us (5242us total) trans 0 rc 4194304/4194304
00000100:00100000:1.0:1651532196.586678:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250717
00002000:00100000:1.0:1651532196.586681:0:192755:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x100010000:0x34546:0x0] (20971520->25165823)  req@00000000f2eb86bf x1731754469048704/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:696/0 lens 488/440 e 0 to 0 dl 1651532241 ref 1 fl Complete:/0/0 rc 4194304/4194304 job:'diff.0'
00002000:00100000:1.0:1651532196.586685:0:192755:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000f2eb86bf with x1731754469048704 ext(20971520->25165823)
00002000:00010000:1.0:1651532196.586692:0:192755:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000f2eb86bf
00000100:00100000:1.0:1651532196.587289:0:216322:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e589436f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754469048640:12345-10.240.43.64@tcp:3:diff.0 Request processed in 5812us (5854us total) trans 0 rc 4194304/4194304
00000100:00100000:1.0:1651532196.587293:0:216322:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250718
00002000:00100000:1.0:1651532196.587296:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34546:0x0] (16777216->20971519)  req@00000000e589436f x1731754469048640/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:696/0 lens 488/440 e 0 to 0 dl 1651532241 ref 1 fl Complete:/0/0 rc 4194304/4194304 job:'diff.0'
00002000:00100000:1.0:1651532196.587299:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000e589436f with x1731754469048640 ext(16777216->20971519)
00002000:00010000:1.0:1651532196.587301:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000e589436f
00000100:00100000:1.0:1651532196.590045:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001e61ed2d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438146:x1731754469048960:12345-10.240.43.64@tcp:3:diff.0 Request processed in 3883us (3949us total) trans 0 rc 4194304/4194304
00000100:00100000:1.0:1651532196.590049:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250719
00002000:00100000:1.0:1651532196.590052:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x34547:0x0] (16777216->20971519)  req@000000001e61ed2d x1731754469048960/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:696/0 lens 488/440 e 0 to 0 dl 1651532241 ref 1 fl Complete:/0/0 rc 4194304/4194304 job:'diff.0'
00002000:00100000:1.0:1651532196.590056:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000001e61ed2d with x1731754469048960 ext(16777216->20971519)
00002000:00010000:1.0:1651532196.590058:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000001e61ed2d
00000100:00100000:0.0:1651532196.592407:0:192756:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000043b0f16d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438146:x1731754469049024:12345-10.240.43.64@tcp:3:diff.0 Request processed in 6242us (6299us total) trans 0 rc 4194304/4194304
00000100:00100000:0.0:1651532196.592411:0:192756:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250720
00002000:00100000:0.0:1651532196.592414:0:192756:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x100010000:0x34547:0x0] (20971520->25165823)  req@0000000043b0f16d x1731754469049024/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:696/0 lens 488/440 e 0 to 0 dl 1651532241 ref 1 fl Complete:/0/0 rc 4194304/4194304 job:'diff.0'
00002000:00100000:0.0:1651532196.592419:0:192756:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000043b0f16d with x1731754469049024 ext(20971520->25165823)
00002000:00010000:0.0:1651532196.592421:0:192756:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000043b0f16d
00000100:00100000:0.0:1651532196.610406:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532196.610416:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532196.610429:0:192756:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469049728
00000100:00100000:1.0:1651532196.610438:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469049664
00002000:00100000:0.0:1651532196.610438:0:192756:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x100010000:0x34546:0x0] (29360128->33554431)  req@00000000a5d8c030 x1731754469049728/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:696/0 lens 488/0 e 0 to 0 dl 1651532241 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00002000:00100000:0.0:1651532196.610442:0:192756:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000a5d8c030 with x1731754469049728 ext(29360128->33554431)
00002000:00010000:0.0:1651532196.610443:0:192756:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000a5d8c030
00002000:00100000:1.0:1651532196.610447:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x34546:0x0] (25165824->29360127)  req@0000000015411af3 x1731754469049664/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:696/0 lens 488/0 e 0 to 0 dl 1651532241 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00000100:00100000:0.0:1651532196.610452:0:192756:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250721
00000100:00100000:0.0:1651532196.610454:0:192756:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a5d8c030 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754469049728:12345-10.240.43.64@tcp:3:diff.0
00002000:00100000:1.0:1651532196.610461:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000015411af3 with x1731754469049664 ext(25165824->29360127)
00002000:00010000:1.0:1651532196.610462:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000015411af3
00000100:00100000:1.0:1651532196.610468:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250722
00000100:00100000:1.0:1651532196.610470:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000015411af3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754469049664:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:0.0:1651532196.613783:0:192756:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a5d8c030 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438146:x1731754469049728:12345-10.240.43.64@tcp:3:diff.0 Request processed in 3327us (3376us total) trans 0 rc 4194304/4194304
00000100:00100000:0.0:1651532196.613788:0:192756:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250721
00002000:00100000:0.0:1651532196.613792:0:192756:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x100010000:0x34546:0x0] (29360128->33554431)  req@00000000a5d8c030 x1731754469049728/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:696/0 lens 488/440 e 0 to 0 dl 1651532241 ref 1 fl Complete:/0/0 rc 4194304/4194304 job:'diff.0'
00002000:00100000:0.0:1651532196.613797:0:192756:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000a5d8c030 with x1731754469049728 ext(29360128->33554431)
00002000:00010000:0.0:1651532196.613798:0:192756:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000a5d8c030
00000100:00100000:0.0:1651532196.615732:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532196.615740:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532196.615767:0:216322:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469049984
00002000:00100000:0.0:1651532196.615776:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34547:0x0] (25165824->29360127)  req@00000000f646cd75 x1731754469049984/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:696/0 lens 488/0 e 0 to 0 dl 1651532241 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00002000:00100000:0.0:1651532196.615784:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000f646cd75 with x1731754469049984 ext(25165824->29360127)
00002000:00010000:0.0:1651532196.615785:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000f646cd75
00000100:00100000:0.0:1651532196.615791:0:216322:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469050048
00002000:00100000:0.0:1651532196.615795:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34547:0x0] (29360128->33554431)  req@000000004ffe7cb4 x1731754469050048/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:696/0 lens 488/0 e 0 to 0 dl 1651532241 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00002000:00100000:0.0:1651532196.615798:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000004ffe7cb4 with x1731754469050048 ext(29360128->33554431)
00002000:00010000:0.0:1651532196.615799:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000004ffe7cb4
00000100:00100000:0.0:1651532196.615803:0:216322:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250723
00000100:00100000:0.0:1651532196.615805:0:216322:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f646cd75 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438146:x1731754469049984:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:1.0:1651532196.615825:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000015411af3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438146:x1731754469049664:12345-10.240.43.64@tcp:3:diff.0 Request processed in 5354us (5408us total) trans 0 rc 4194304/4194304
00000100:00100000:1.0:1651532196.615829:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250722
00002000:00100000:1.0:1651532196.615831:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x34546:0x0] (25165824->29360127)  req@0000000015411af3 x1731754469049664/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:696/0 lens 488/440 e 0 to 0 dl 1651532241 ref 1 fl Complete:/0/0 rc 4194304/4194304 job:'diff.0'
00002000:00100000:1.0:1651532196.615835:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000015411af3 with x1731754469049664 ext(25165824->29360127)
00002000:00010000:1.0:1651532196.615837:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000015411af3
00000100:00100000:1.0:1651532196.615843:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250724
00000100:00100000:1.0:1651532196.615844:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004ffe7cb4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754469050048:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:1.0:1651532196.619335:0:216322:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f646cd75 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438146:x1731754469049984:12345-10.240.43.64@tcp:3:diff.0 Request processed in 3528us (3603us total) trans 0 rc 4194304/4194304
00000100:00100000:1.0:1651532196.619340:0:216322:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250723
00002000:00100000:1.0:1651532196.619343:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34547:0x0] (25165824->29360127)  req@00000000f646cd75 x1731754469049984/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:696/0 lens 488/440 e 0 to 0 dl 1651532241 ref 1 fl Complete:/0/0 rc 4194304/4194304 job:'diff.0'
00002000:00100000:1.0:1651532196.619347:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000f646cd75 with x1731754469049984 ext(25165824->29360127)
00002000:00010000:1.0:1651532196.619349:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000f646cd75
00000100:00100000:1.0:1651532196.620791:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004ffe7cb4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438146:x1731754469050048:12345-10.240.43.64@tcp:3:diff.0 Request processed in 4945us (5050us total) trans 0 rc 4194304/4194304
00000100:00100000:1.0:1651532196.620798:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250724
00002000:00100000:1.0:1651532196.620800:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x34547:0x0] (29360128->33554431)  req@000000004ffe7cb4 x1731754469050048/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:696/0 lens 488/440 e 0 to 0 dl 1651532241 ref 1 fl Complete:/0/0 rc 4194304/4194304 job:'diff.0'
00002000:00100000:1.0:1651532196.620803:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000004ffe7cb4 with x1731754469050048 ext(29360128->33554431)
00002000:00010000:1.0:1651532196.620805:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000004ffe7cb4
00000100:00100000:1.0:1651532197.088165:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651532197.088182:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951234880
00000100:00100000:1.0:1651532197.088205:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 509
00000100:00100000:1.0:1651532197.088208:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a19b10fa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951234880:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:1.0:1651532197.088235:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 75490752 pending 0 free 81216397312 avail 77045686272
00000100:00100000:1.0:1651532197.088273:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a19b10fa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951234880:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 64us (111us total) trans 0 rc 0/0
00000100:00100000:1.0:1651532197.088277:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 509
00000400:00000080:1.0:1651532198.027960:0:232177:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648
00000001:02000400:1.0:1651532198.027963:0:232177:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 398e: O_Direct open cleared by fcntl doesn't cause hang ========================================================== 22:56:37 (1651532197)
00000100:00100000:1.0:1651532198.049315:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532198.049334:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469051712
00000100:00100000:0.0:1651532198.049355:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44952
00000100:00100000:0.0:1651532198.049358:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000964ce442 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+7:682799:x1731754469051712:12345-10.240.43.64@tcp:101:dd.0
00010000:00010000:0.0:1651532198.049378:0:167632:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532198.049399:0:167632:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca57ed lrc: 2/0,0 mode: --/PW res: [0x34548:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44fbcb expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00002000:00010000:0.0:1651532198.049416:0:167632:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34548:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:0.0:1651532198.049426:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532198.049427:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532198.049432:0:167632:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca57ed lrc: 3/0,0 mode: PW/PW res: [0x34548:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fbcb expref: 8 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532198.049441:0:167632:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f765708a/0x3234de053ca57ed lrc: 3/0,0 mode: PW/PW res: [0x34548:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fbcb expref: 8 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532198.049451:0:167632:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f765708a, rc 0)
00000100:00100000:0.0:1651532198.049480:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000964ce442 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+8:682799:x1731754469051712:12345-10.240.43.64@tcp:101:dd.0 Request processed in 122us (168us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532198.049484:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44952
00000100:00100000:1.0:1651532198.141926:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651532198.141945:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951235008
00000100:00100000:0.0:1651532198.141956:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 44953
00000100:00100000:0.0:1651532198.141957:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008f58a6d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951235008:12345-10.240.43.61@tcp:6:osp-syn-1-0.0
00002000:00080000:0.0:1651532198.141967:0:166113:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:214342 count 1
00010000:00010000:0.0:1651532198.141974:0:166113:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca57f4 lrc: 3/0,1 mode: --/PW res: [0x34546:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532198.141980:0:166113:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca57df lrc: 2/0,0 mode: PR/PR res: [0x34546:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fb70 expref: 7 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532198.141984:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532198.141984:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532198.141985:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca57f4 lrc: 4/0,1 mode: --/PW res: [0x34546:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532198.141997:0:166113:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca57df lrc: 3/0,0 mode: PR/PR res: [0x34546:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fb70 expref: 7 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532198.142002:0:166113:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca57df lrc: 4/0,0 mode: PR/PR res: [0x34546:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fb70 expref: 7 pid: 167632 timeout: 23006 lvb_type: 1
00000100:00100000:0.0:1651532198.142008:0:166113:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ec383f97 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:166113:1731745997363520:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651532198.142042:0:166113:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f54ad06c going to sleep for 6 seconds
00000100:00100000:0.0:1651532198.142299:0:166113:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ec383f97 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:166113:1731745997363520:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651532198.142306:0:166113:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca57f4 lrc: 3/0,1 mode: --/PW res: [0x34546:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532198.142447:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532198.142458:0:166104:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469053184
00010000:00010000:0.0:1651532198.142465:0:166104:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca57df lrc: 4/0,0 mode: PR/PR res: [0x34546:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fb70 expref: 8 pid: 167632 timeout: 23006 lvb_type: 1
00000100:00100000:0.0:1651532198.142474:0:166104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 311
00000100:00100000:0.0:1651532198.142476:0:166104:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ec383f97 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754469053184:12345-10.240.43.64@tcp:103:ldlm_bl_05.0
00010000:00010000:0.0:1651532198.142480:0:166104:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651532198.142482:0:166104:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca57df lrc: 4/0,0 mode: PR/PR res: [0x34546:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fb70 expref: 8 pid: 167632 timeout: 23006 lvb_type: 1
00010000:00010000:0.0:1651532198.142486:0:166104:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca57df lrc: 3/0,0 mode: PR/PR res: [0x34546:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fb70 expref: 8 pid: 167632 timeout: 23006 lvb_type: 1
00010000:00010000:0.0:1651532198.142494:0:166104:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca57df lrc: 0/0,0 mode: --/PR res: [0x34546:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fb70 expref: 8 pid: 167632 timeout: 23006 lvb_type: 1
00010000:00010000:0.0:1651532198.142498:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532198.142498:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532198.142499:0:166104:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca57f4 lrc: 3/0,1 mode: PW/PW res: [0x34546:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532198.142506:0:166104:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca57f4 lrc: 4/0,1 mode: PW/PW res: [0x34546:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532198.142513:0:166104:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651532198.142536:0:166104:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ec383f97 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438146:x1731754469053184:12345-10.240.43.64@tcp:103:ldlm_bl_05.0 Request processed in 58us (89us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532198.142539:0:166104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 311
00010000:00010000:0.0:1651532198.142548:0:166113:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca57f4 lrc: 3/0,1 mode: PW/PW res: [0x34546:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532198.142551:0:166113:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca57f4 lrc: 3/0,1 mode: PW/PW res: [0x34546:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532198.142555:0:166113:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca57f4 lrc: 3/0,1 mode: PW/PW res: [0x34546:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532198.142558:0:166113:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca57f4 lrc: 2/0,0 mode: PW/PW res: [0x34546:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532198.142584:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca57f4 lrc: 2/0,0 mode: PW/PW res: [0x34546:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532198.142590:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fb2f6575 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651532198.142592:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca57f4 lrc: 2/0,0 mode: PW/PW res: [0x34546:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532198.142596:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca57f4 lrc: 3/0,0 mode: PW/PW res: [0x34546:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532198.142604:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca57f4 lrc: 1/0,0 mode: --/PW res: [0x34546:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532198.142607:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca57f4 lrc: 0/0,0 mode: --/PW res: [0x34546:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532198.145140:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008f58a6d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745951235008:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 3181us (3215us total) trans 21474869564 rc 0/0
00000100:00100000:0.0:1651532198.145144:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 44953
00000400:00000080:0.0:1651532199.837282:0:232395:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648
00000001:02000400:0.0:1651532199.837284:0:232395:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 398f: verify aio handles ll_direct_rw_pages errors correctly ========================================================== 22:56:39 (1651532199)
00000100:00100000:1.0:1651532199.956892:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532199.956910:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469054912
00000100:00100000:1.0:1651532199.956944:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44954
00000100:00100000:1.0:1651532199.956947:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004d249e37 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+7:683392:x1731754469054912:12345-10.240.43.64@tcp:101:dd.0
00010000:00010000:1.0:1651532199.956961:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532199.956977:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca57fb lrc: 2/0,0 mode: --/PW res: [0x34549:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44fc34 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651532199.957000:0:166113:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34549:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:1.0:1651532199.957010:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532199.957011:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532199.957015:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca57fb lrc: 3/0,0 mode: PW/PW res: [0x34549:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fc34 expref: 8 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532199.957022:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca57fb lrc: 3/0,0 mode: PW/PW res: [0x34549:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fc34 expref: 8 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532199.957028:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c806f265, rc 0)
00000100:00100000:1.0:1651532199.957061:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004d249e37 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+8:683392:x1731754469054912:12345-10.240.43.64@tcp:101:dd.0 Request processed in 114us (172us total) trans 0 rc 0/0
00000100:00100000:1.0:1651532199.957068:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44954
00000100:00100000:1.0:1651532199.957388:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532199.957400:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469055040
00002000:00010000:1.0:1651532199.957413:0:216321:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 214345/0 (0->18446744073709551615)
00002000:00100000:1.0:1651532199.957415:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000000df1eb0d with x1731754469055040 ext(0->18446744073709551615)
00002000:00010000:1.0:1651532199.957419:0:216321:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000000df1eb0d.
00000100:00100000:1.0:1651532199.957427:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250725
00000100:00100000:1.0:1651532199.957428:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000df1eb0d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754469055040:12345-10.240.43.64@tcp:10:dd.0
00002000:00010000:1.0:1651532199.957503:0:216321:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x34549:0x0] updating lvb size from disk: 0 -> 0
00002000:00010000:1.0:1651532199.957504:0:216321:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x34549:0x0] updating lvb mtime from disk: 0 -> 1651532199
00002000:00010000:1.0:1651532199.957505:0:216321:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x34549:0x0] updating lvb atime from disk: 0 -> 0
00002000:00010000:1.0:1651532199.957506:0:216321:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x34549:0x0] updating lvb ctime from disk: 0 -> 1651532199
00002000:00010000:1.0:1651532199.957507:0:216321:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x34549:0x0] updating lvb blocks from disk: 0 -> 0
00000100:00100000:1.0:1651532199.957529:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000df1eb0d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754469055040:12345-10.240.43.64@tcp:10:dd.0 Request processed in 99us (141us total) trans 21474869565 rc 0/0
00000100:00100000:1.0:1651532199.957532:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250725
00002000:00010000:1.0:1651532199.957533:0:216321:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 214345/0 (0->18446744073709551615)
00002000:00100000:1.0:1651532199.957534:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000000df1eb0d with x1731754469055040 ext(0->18446744073709551615)
00002000:00010000:1.0:1651532199.957536:0:216321:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000000df1eb0d.
00000100:00100000:1.0:1651532200.003052:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532200.003061:0:216322:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469055296
00002000:00100000:1.0:1651532200.003076:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34549:0x0] (0->4194303)  req@000000007d76765b x1731754469055296/t0(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:700/0 lens 488/0 e 0 to 0 dl 1651532245 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0'
00002000:00100000:1.0:1651532200.003081:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000007d76765b with x1731754469055296 ext(0->4194303)
00002000:00010000:1.0:1651532200.003083:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000007d76765b
00000100:00100000:1.0:1651532200.003092:0:216322:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250726
00000100:00100000:1.0:1651532200.003093:0:216322:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007d76765b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754469055296:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:1.0:1651532200.015029:0:216322:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007d76765b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754469055296:12345-10.240.43.64@tcp:4:dd.0 Request processed in 11933us (11976us total) trans 21474869566 rc 0/0
00000100:00100000:1.0:1651532200.015035:0:216322:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250726
00002000:00100000:1.0:1651532200.015039:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34549:0x0] (0->4194303)  req@000000007d76765b x1731754469055296/t21474869566(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:700/0 lens 488/448 e 0 to 0 dl 1651532245 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0'
00002000:00100000:1.0:1651532200.015043:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000007d76765b with x1731754469055296 ext(0->4194303)
00002000:00010000:1.0:1651532200.015045:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000007d76765b
00000100:00100000:0.0:1651532200.038549:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532200.038575:0:216322:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469055552
00002000:00100000:1.0:1651532200.038586:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34549:0x0] (4194304->8388607)  req@0000000051619ab4 x1731754469055552/t0(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:700/0 lens 488/0 e 0 to 0 dl 1651532245 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0'
00002000:00100000:1.0:1651532200.038590:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000051619ab4 with x1731754469055552 ext(4194304->8388607)
00002000:00010000:1.0:1651532200.038591:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000051619ab4
00000100:00100000:1.0:1651532200.038602:0:216322:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250727
00000100:00100000:1.0:1651532200.038604:0:216322:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000051619ab4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438146:x1731754469055552:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:1.0:1651532200.045158:0:216322:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000051619ab4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754469055552:12345-10.240.43.64@tcp:4:dd.0 Request processed in 6552us (6609us total) trans 21474869567 rc 0/0
00000100:00100000:1.0:1651532200.045163:0:216322:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250727
00002000:00100000:1.0:1651532200.045167:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34549:0x0] (4194304->8388607)  req@0000000051619ab4 x1731754469055552/t21474869567(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:700/0 lens 488/448 e 0 to 0 dl 1651532245 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0'
00002000:00100000:1.0:1651532200.045172:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000051619ab4 with x1731754469055552 ext(4194304->8388607)
00002000:00010000:1.0:1651532200.045174:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000051619ab4
00000100:00100000:0.0:1651532200.083848:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532200.083874:0:216322:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469055808
00002000:00100000:1.0:1651532200.083887:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34549:0x0] (8388608->12582911)  req@0000000055e8b273 x1731754469055808/t0(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:700/0 lens 488/0 e 0 to 0 dl 1651532245 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0'
00002000:00100000:1.0:1651532200.083891:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000055e8b273 with x1731754469055808 ext(8388608->12582911)
00002000:00010000:1.0:1651532200.083892:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000055e8b273
00000100:00100000:1.0:1651532200.083904:0:216322:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250728
00000100:00100000:1.0:1651532200.083906:0:216322:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000055e8b273 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754469055808:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:1.0:1651532200.096467:0:216322:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000055e8b273 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754469055808:12345-10.240.43.64@tcp:4:dd.0 Request processed in 12559us (12619us total) trans 21474869568 rc 0/0
00000100:00100000:1.0:1651532200.096472:0:216322:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250728
00002000:00100000:1.0:1651532200.096477:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34549:0x0] (8388608->12582911)  req@0000000055e8b273 x1731754469055808/t21474869568(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:700/0 lens 488/448 e 0 to 0 dl 1651532245 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0'
00002000:00100000:1.0:1651532200.096481:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000055e8b273 with x1731754469055808 ext(8388608->12582911)
00002000:00010000:1.0:1651532200.096483:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000055e8b273
00000100:00100000:0.0:1651532200.112079:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532200.112105:0:216322:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469056064
00002000:00100000:1.0:1651532200.112117:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34549:0x0] (12582912->16777215)  req@00000000ab1c7bbb x1731754469056064/t0(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:700/0 lens 488/0 e 0 to 0 dl 1651532245 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0'
00002000:00100000:1.0:1651532200.112122:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000ab1c7bbb with x1731754469056064 ext(12582912->16777215)
00002000:00010000:1.0:1651532200.112123:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000ab1c7bbb
00000100:00100000:1.0:1651532200.112136:0:216322:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250729
00000100:00100000:1.0:1651532200.112138:0:216322:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ab1c7bbb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754469056064:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:1.0:1651532200.118313:0:216322:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ab1c7bbb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754469056064:12345-10.240.43.64@tcp:4:dd.0 Request processed in 6173us (6233us total) trans 21474869569 rc 0/0
00000100:00100000:1.0:1651532200.118318:0:216322:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250729
00002000:00100000:1.0:1651532200.118322:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34549:0x0] (12582912->16777215)  req@00000000ab1c7bbb x1731754469056064/t21474869569(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:700/0 lens 488/448 e 0 to 0 dl 1651532245 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0'
00002000:00100000:1.0:1651532200.118328:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000ab1c7bbb with x1731754469056064 ext(12582912->16777215)
00002000:00010000:1.0:1651532200.118330:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000ab1c7bbb
00000100:00100000:1.0:1651532200.155970:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532200.155980:0:216322:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469056320
00002000:00100000:1.0:1651532200.155989:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34549:0x0] (16777216->20971519)  req@00000000ca77a195 x1731754469056320/t0(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:700/0 lens 488/0 e 0 to 0 dl 1651532245 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0'
00002000:00100000:1.0:1651532200.155993:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000ca77a195 with x1731754469056320 ext(16777216->20971519)
00002000:00010000:1.0:1651532200.155995:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000ca77a195
00000100:00100000:1.0:1651532200.156006:0:216322:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250730
00000100:00100000:1.0:1651532200.156007:0:216322:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ca77a195 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438148:x1731754469056320:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:1.0:1651532200.162392:0:216322:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ca77a195 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754469056320:12345-10.240.43.64@tcp:4:dd.0 Request processed in 6382us (6421us total) trans 21474869570 rc 0/0
00000100:00100000:1.0:1651532200.162397:0:216322:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250730
00002000:00100000:1.0:1651532200.162400:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34549:0x0] (16777216->20971519)  req@00000000ca77a195 x1731754469056320/t21474869570(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:700/0 lens 488/448 e 0 to 0 dl 1651532245 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0'
00002000:00100000:1.0:1651532200.162405:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000ca77a195 with x1731754469056320 ext(16777216->20971519)
00002000:00010000:1.0:1651532200.162406:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000ca77a195
00000100:00100000:0.0:1651532200.193909:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532200.193934:0:216322:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469056576
00002000:00100000:1.0:1651532200.193943:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34549:0x0] (20971520->25165823)  req@00000000074959ba x1731754469056576/t0(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:700/0 lens 488/0 e 0 to 0 dl 1651532245 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0'
00002000:00100000:1.0:1651532200.193947:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000074959ba with x1731754469056576 ext(20971520->25165823)
00002000:00010000:1.0:1651532200.193948:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000074959ba
00000100:00100000:1.0:1651532200.193959:0:216322:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250731
00000100:00100000:1.0:1651532200.193968:0:216322:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000074959ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438148:x1731754469056576:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:1.0:1651532200.200456:0:216322:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000074959ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438148:x1731754469056576:12345-10.240.43.64@tcp:4:dd.0 Request processed in 6485us (6547us total) trans 21474869571 rc 0/0
00000100:00100000:1.0:1651532200.200462:0:216322:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250731
00002000:00100000:1.0:1651532200.200467:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34549:0x0] (20971520->25165823)  req@00000000074959ba x1731754469056576/t21474869571(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:700/0 lens 488/448 e 0 to 0 dl 1651532245 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0'
00002000:00100000:1.0:1651532200.200471:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000074959ba with x1731754469056576 ext(20971520->25165823)
00002000:00010000:1.0:1651532200.200473:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000074959ba
00000100:00100000:1.0:1651532200.239090:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532200.239101:0:216322:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469056832
00002000:00100000:1.0:1651532200.239110:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34549:0x0] (25165824->29360127)  req@000000005c3dfe19 x1731754469056832/t0(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:700/0 lens 488/0 e 0 to 0 dl 1651532245 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0'
00002000:00100000:1.0:1651532200.239114:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000005c3dfe19 with x1731754469056832 ext(25165824->29360127)
00002000:00010000:1.0:1651532200.239115:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000005c3dfe19
00000100:00100000:1.0:1651532200.239127:0:216322:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250732
00000100:00100000:1.0:1651532200.239129:0:216322:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005c3dfe19 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+21:438148:x1731754469056832:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:1.0:1651532200.251428:0:216322:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005c3dfe19 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+23:438148:x1731754469056832:12345-10.240.43.64@tcp:4:dd.0 Request processed in 12296us (12337us total) trans 21474869572 rc 0/0
00000100:00100000:1.0:1651532200.251433:0:216322:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250732
00002000:00100000:1.0:1651532200.251436:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34549:0x0] (25165824->29360127)  req@000000005c3dfe19 x1731754469056832/t21474869572(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:700/0 lens 488/448 e 0 to 0 dl 1651532245 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0'
00002000:00100000:1.0:1651532200.251441:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000005c3dfe19 with x1731754469056832 ext(25165824->29360127)
00002000:00010000:1.0:1651532200.251443:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000005c3dfe19
00000100:00100000:0.0:1651532200.266284:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532200.266309:0:216322:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469057216
00002000:00100000:1.0:1651532200.266318:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34549:0x0] (29360128->33554431)  req@00000000aacbbaef x1731754469057216/t0(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:700/0 lens 488/0 e 0 to 0 dl 1651532245 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0'
00002000:00100000:1.0:1651532200.266322:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000aacbbaef with x1731754469057216 ext(29360128->33554431)
00002000:00010000:1.0:1651532200.266323:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000aacbbaef
00000100:00100000:1.0:1651532200.266335:0:216322:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250733
00000100:00100000:1.0:1651532200.266337:0:216322:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aacbbaef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+23:438146:x1731754469057216:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:1.0:1651532200.273743:0:216322:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aacbbaef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+25:438146:x1731754469057216:12345-10.240.43.64@tcp:4:dd.0 Request processed in 7404us (7459us total) trans 21474869573 rc 0/0
00000100:00100000:1.0:1651532200.273748:0:216322:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250733
00002000:00100000:1.0:1651532200.273752:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34549:0x0] (29360128->33554431)  req@00000000aacbbaef x1731754469057216/t21474869573(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:700/0 lens 488/448 e 0 to 0 dl 1651532245 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0'
00002000:00100000:1.0:1651532200.273757:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000aacbbaef with x1731754469057216 ext(29360128->33554431)
00002000:00010000:1.0:1651532200.273759:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000aacbbaef
00000100:00100000:0.0:1651532200.298423:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532200.298450:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469057792
00000100:00100000:1.0:1651532200.298466:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44955
00000100:00100000:1.0:1651532200.298468:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d3d59e23 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+25:438146:x1731754469057792:12345-10.240.43.64@tcp:101:diff.0
00010000:00010000:1.0:1651532200.298474:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532200.298492:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5802 lrc: 2/0,0 mode: --/PR res: [0x3454a:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44fc57 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651532200.298501:0:166113:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x3454a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:1.0:1651532200.298508:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532200.298509:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532200.298513:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5802 lrc: 3/0,0 mode: PR/PR res: [0x3454a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fc57 expref: 26 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532200.298522:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5802 lrc: 3/0,0 mode: PR/PR res: [0x3454a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fc57 expref: 26 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532200.298528:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000000bb25cc, rc 0)
00000100:00100000:1.0:1651532200.298540:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d3d59e23 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+26:438146:x1731754469057792:12345-10.240.43.64@tcp:101:diff.0 Request processed in 71us (118us total) trans 0 rc 0/0
00000100:00100000:1.0:1651532200.298543:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44955
00000100:00100000:0.0:1651532200.301999:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532200.302026:0:216322:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469058112
00002000:00100000:1.0:1651532200.302035:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x3454a:0x0] (0->4095)  req@00000000993daf3f x1731754469058112/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:700/0 lens 488/0 e 0 to 0 dl 1651532245 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00002000:00100000:1.0:1651532200.302040:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000993daf3f with x1731754469058112 ext(0->4095)
00002000:00010000:1.0:1651532200.302041:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000993daf3f
00000100:00100000:1.0:1651532200.302051:0:216322:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250734
00000100:00100000:1.0:1651532200.302053:0:216322:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000993daf3f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+26:438146:x1731754469058112:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:1.0:1651532200.302087:0:216322:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000993daf3f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+26:438146:x1731754469058112:12345-10.240.43.64@tcp:3:diff.0 Request processed in 33us (88us total) trans 0 rc 0/0
00000100:00100000:1.0:1651532200.302090:0:216322:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250734
00002000:00100000:1.0:1651532200.302092:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x3454a:0x0] (0->4095)  req@00000000993daf3f x1731754469058112/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:700/0 lens 488/440 e 0 to 0 dl 1651532245 ref 1 fl Complete:/0/0 rc 0/0 job:'diff.0'
00002000:00100000:1.0:1651532200.302096:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000993daf3f with x1731754469058112 ext(0->4095)
00002000:00010000:1.0:1651532200.302097:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000993daf3f
00000400:00000080:0.0:1651532201.647148:0:232613:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648
00000001:02000400:0.0:1651532201.647151:0:232613:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 398g: verify parallel dio async RPC submission ========================================================== 22:56:41 (1651532201)
00000100:00100000:0.0:1651532202.208164:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651532202.208195:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651532202.208205:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951235328
00000100:00100000:0.0:1651532202.208219:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951235520
00000100:00100000:1.0:1651532202.208249:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 510
00000100:00100000:0.0:1651532202.208250:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 63
00000100:00100000:1.0:1651532202.208251:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000094d62d64 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745951235328:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00000100:00100000:0.0:1651532202.208252:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000036ee6adc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745951235520:12345-10.240.43.61@tcp:400:kworker/u4:0.0
00002000:00000024:1.0:1651532202.208273:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 28672 granted 142992832 pending 33751040 free 81216397312 avail 77045686272
00000100:00100000:0.0:1651532202.208292:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000036ee6adc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745951235520:12345-10.240.43.61@tcp:400:kworker/u4:0.0 Request processed in 39us (97us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532202.208296:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 63
00000100:00100000:1.0:1651532202.208297:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000094d62d64 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745951235328:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 45us (136us total) trans 0 rc 0/0
00000100:00100000:1.0:1651532202.208301:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 510
00000001:00080000:0.0:1651532204.845584:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869573 is committed
00000001:00080000:0.0:1651532204.845594:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869564 is committed
00000100:00100000:0.0:1651532205.282812:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651532205.282823:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651532205.282831:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951235712
00000100:00100000:0.0:1651532205.282841:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951235776
00000100:00100000:0.0:1651532205.282846:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 44956
00000100:00100000:0.0:1651532205.282848:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000047c291a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745951235712:12345-10.240.43.61@tcp:6:osp-syn-1-0.0
00002000:00080000:0.0:1651532205.282858:0:167632:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:214343 count 1
00010000:00010000:0.0:1651532205.282880:0:167632:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca5809 lrc: 3/0,1 mode: --/PW res: [0x34547:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532205.282891:0:167632:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca57e6 lrc: 2/0,0 mode: PR/PR res: [0x34547:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fb7e expref: 8 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532205.282897:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532205.282898:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532205.282899:0:167632:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca5809 lrc: 4/0,1 mode: --/PW res: [0x34547:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532205.282913:0:167632:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca57e6 lrc: 3/0,0 mode: PR/PR res: [0x34547:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fb7e expref: 8 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532205.282918:0:167632:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca57e6 lrc: 4/0,0 mode: PR/PR res: [0x34547:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fb7e expref: 8 pid: 167632 timeout: 23013 lvb_type: 1
00000100:00100000:0.0:1651532205.282924:0:167632:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003158b8a7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:167632:1731745997363584:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651532205.282957:0:167632:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f23eeb5f going to sleep for 6 seconds
00000100:00100000:0.0:1651532205.282966:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 44957
00000100:00100000:0.0:1651532205.282968:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000089660739 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745951235776:12345-10.240.43.61@tcp:6:osp-syn-1-0.0
00002000:00080000:0.0:1651532205.282974:0:166112:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:214345 count 1
00010000:00010000:0.0:1651532205.282978:0:166112:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca5810 lrc: 3/0,1 mode: --/PW res: [0x34549:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532205.282984:0:166112:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca57fb lrc: 2/0,0 mode: PW/PW res: [0x34549:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fc34 expref: 8 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532205.282987:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532205.282987:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532205.282988:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca5810 lrc: 4/0,1 mode: --/PW res: [0x34549:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532205.283000:0:166112:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca57fb lrc: 3/0,0 mode: PW/PW res: [0x34549:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fc34 expref: 8 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532205.283003:0:166112:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca57fb lrc: 4/0,0 mode: PW/PW res: [0x34549:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fc34 expref: 8 pid: 166113 timeout: 23013 lvb_type: 0
00000100:00100000:0.0:1651532205.283007:0:166112:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f31dd71a pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:166112:1731745997363648:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651532205.283018:0:166112:0:(client.c:2492:ptlrpc_set_wait()) set 00000000f54ad06c going to sleep for 6 seconds
00000100:00100000:0.0:1651532205.287381:0:166112:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f31dd71a pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:166112:1731745997363648:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651532205.287383:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532205.287388:0:166112:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca5810 lrc: 3/0,1 mode: --/PW res: [0x34549:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532205.287404:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532205.287405:0:167632:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003158b8a7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:167632:1731745997363584:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651532205.287413:0:167632:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca5809 lrc: 3/0,1 mode: --/PW res: [0x34547:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532205.287420:0:166102:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469063232
00000100:00100000:0.0:1651532205.287428:0:166104:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469063296
00010000:00010000:1.0:1651532205.287429:0:166102:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca57e6 lrc: 4/0,0 mode: PR/PR res: [0x34547:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fb7e expref: 9 pid: 167632 timeout: 23013 lvb_type: 1
00010000:00010000:0.0:1651532205.287434:0:166104:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca57fb lrc: 4/0,0 mode: PW/PW res: [0x34549:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fc34 expref: 10 pid: 166113 timeout: 23013 lvb_type: 0
00000100:00100000:1.0:1651532205.287459:0:166102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 312
00000100:00100000:1.0:1651532205.287461:0:166102:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a8d7612 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438147:x1731754469063232:12345-10.240.43.64@tcp:103:ldlm_bl_06.0
00000100:00100000:0.0:1651532205.287464:0:166104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 313
00010000:00010000:1.0:1651532205.287466:0:166102:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00000100:00100000:0.0:1651532205.287466:0:166104:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c68ada5f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438147:x1731754469063296:12345-10.240.43.64@tcp:103:ldlm_bl_06.0
00010000:00010000:1.0:1651532205.287468:0:166102:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca57e6 lrc: 4/0,0 mode: PR/PR res: [0x34547:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fb7e expref: 10 pid: 167632 timeout: 23013 lvb_type: 1
00010000:00010000:0.0:1651532205.287469:0:166104:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651532205.287471:0:166104:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca57fb lrc: 4/0,0 mode: PW/PW res: [0x34549:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fc34 expref: 10 pid: 166113 timeout: 23013 lvb_type: 0
00010000:00010000:1.0:1651532205.287474:0:166102:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca57e6 lrc: 3/0,0 mode: PR/PR res: [0x34547:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fb7e expref: 10 pid: 167632 timeout: 23013 lvb_type: 1
00010000:00010000:0.0:1651532205.287477:0:166104:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca57fb lrc: 3/0,0 mode: PW/PW res: [0x34549:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fc34 expref: 10 pid: 166113 timeout: 23013 lvb_type: 0
00010000:00010000:1.0:1651532205.287484:0:166102:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca57e6 lrc: 0/0,0 mode: --/PR res: [0x34547:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fb7e expref: 10 pid: 167632 timeout: 23013 lvb_type: 1
00010000:00010000:0.0:1651532205.287484:0:166104:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca57fb lrc: 0/0,0 mode: --/PW res: [0x34549:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fc34 expref: 10 pid: 166113 timeout: 23013 lvb_type: 0
00010000:00010000:0.0:1651532205.287488:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532205.287489:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532205.287489:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532205.287489:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532205.287490:0:166102:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca5809 lrc: 3/0,1 mode: PW/PW res: [0x34547:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532205.287490:0:166104:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca5810 lrc: 3/0,1 mode: PW/PW res: [0x34549:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532205.287494:0:166104:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca5810 lrc: 4/0,1 mode: PW/PW res: [0x34549:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532205.287498:0:166102:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca5809 lrc: 4/0,1 mode: PW/PW res: [0x34547:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532205.287501:0:166104:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1651532205.287508:0:166102:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651532205.287517:0:166104:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c68ada5f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754469063296:12345-10.240.43.64@tcp:103:ldlm_bl_06.0 Request processed in 51us (113us total) trans 0 rc 0/0
00000100:00100000:1.0:1651532205.287518:0:166102:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a8d7612 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754469063232:12345-10.240.43.64@tcp:103:ldlm_bl_06.0 Request processed in 56us (137us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532205.287520:0:166104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 313
00000100:00100000:1.0:1651532205.287522:0:166102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 312
00010000:00010000:0.0:1651532205.287539:0:166112:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca5810 lrc: 3/0,1 mode: PW/PW res: [0x34549:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532205.287543:0:166112:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca5810 lrc: 3/0,1 mode: PW/PW res: [0x34549:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532205.287547:0:166112:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca5810 lrc: 3/0,1 mode: PW/PW res: [0x34549:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532205.287555:0:166112:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca5810 lrc: 2/0,0 mode: PW/PW res: [0x34549:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532205.287576:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca5810 lrc: 2/0,0 mode: PW/PW res: [0x34549:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532205.287580:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c1022d42 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651532205.287582:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca5810 lrc: 2/0,0 mode: PW/PW res: [0x34549:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532205.287586:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca5810 lrc: 3/0,0 mode: PW/PW res: [0x34549:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532205.287591:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca5810 lrc: 1/0,0 mode: --/PW res: [0x34549:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532205.287594:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca5810 lrc: 0/0,0 mode: --/PW res: [0x34549:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532205.288255:0:167632:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca5809 lrc: 3/0,1 mode: PW/PW res: [0x34547:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532205.288259:0:167632:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca5809 lrc: 3/0,1 mode: PW/PW res: [0x34547:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532205.288264:0:167632:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca5809 lrc: 3/0,1 mode: PW/PW res: [0x34547:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532205.288267:0:167632:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca5809 lrc: 2/0,0 mode: PW/PW res: [0x34547:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532205.290467:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000089660739 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:39030:x1731745951235776:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 7497us (7643us total) trans 21474869574 rc 0/0
00000100:00100000:0.0:1651532205.290471:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 44957
00010000:00010000:0.0:1651532205.290479:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca5809 lrc: 2/0,0 mode: PW/PW res: [0x34547:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532205.290484:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000820577fb already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651532205.290485:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca5809 lrc: 2/0,0 mode: PW/PW res: [0x34547:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532205.290488:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca5809 lrc: 3/0,0 mode: PW/PW res: [0x34547:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532205.290493:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca5809 lrc: 1/0,0 mode: --/PW res: [0x34547:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532205.290496:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca5809 lrc: 0/0,0 mode: --/PW res: [0x34547:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532205.291101:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000047c291a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745951235712:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 8251us (8289us total) trans 21474869575 rc 0/0
00000100:00100000:1.0:1651532205.291105:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 44956
00000100:00100000:0.0:1651532207.328133:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651532207.328158:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951236032
00000100:00100000:1.0:1651532207.328173:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 511
00000100:00100000:1.0:1651532207.328175:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f31dd71a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745951236032:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:1.0:1651532207.328184:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 28672 granted 109241792 pending 0 free 81283506176 avail 77112795136
00000100:00100000:1.0:1651532207.328199:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f31dd71a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745951236032:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 23us (67us total) trans 0 rc 0/0
00000100:00100000:1.0:1651532207.328202:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 511
00000100:00100000:0.0:1651532210.368944:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532210.368969:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469064768
00000100:00100000:1.0:1651532210.368986:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 64
00000100:00100000:1.0:1651532210.368988:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000046de8644 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438148:x1731754469064768:12345-10.240.43.64@tcp:400:kworker/u4:1.0
00000100:00100000:1.0:1651532210.369006:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000046de8644 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438148:x1731754469064768:12345-10.240.43.64@tcp:400:kworker/u4:1.0 Request processed in 17us (64us total) trans 0 rc 0/0
00000100:00100000:1.0:1651532210.369009:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 64
00000001:00080000:0.0:1651532211.442284:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869575 is committed
00000100:00100000:0.0:1651532211.466936:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651532211.466959:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951236288
00000100:00100000:1.0:1651532211.466974:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 44958
00000100:00100000:1.0:1651532211.466978:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000046e76bd1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951236288:12345-10.240.43.61@tcp:6:osp-syn-1-0.0
00002000:00080000:1.0:1651532211.466985:0:167632:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:214346 count 1
00010000:00010000:1.0:1651532211.466992:0:167632:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca5817 lrc: 3/0,1 mode: --/PW res: [0x3454a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532211.466998:0:167632:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5802 lrc: 2/0,0 mode: PR/PR res: [0x3454a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fc57 expref: 6 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532211.467002:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532211.467003:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532211.467004:0:167632:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca5817 lrc: 4/0,1 mode: --/PW res: [0x3454a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532211.467012:0:167632:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5802 lrc: 3/0,0 mode: PR/PR res: [0x3454a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fc57 expref: 6 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532211.467017:0:167632:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5802 lrc: 4/0,0 mode: PR/PR res: [0x3454a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fc57 expref: 6 pid: 166113 timeout: 23020 lvb_type: 1
00000100:00100000:1.0:1651532211.467022:0:167632:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004c512052 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:167632:1731745997363712:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651532211.467037:0:167632:0:(client.c:2492:ptlrpc_set_wait()) set 00000000c8fe001d going to sleep for 6 seconds
00000100:00100000:0.0:1651532211.467410:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532211.467419:0:166103:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469064832
00000100:00100000:1.0:1651532211.467420:0:167632:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004c512052 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:167632:1731745997363712:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651532211.467426:0:167632:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca5817 lrc: 3/0,1 mode: --/PW res: [0x3454a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532211.467427:0:166103:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5802 lrc: 4/0,0 mode: PR/PR res: [0x3454a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fc57 expref: 7 pid: 166113 timeout: 23020 lvb_type: 1
00000100:00100000:0.0:1651532211.467447:0:166103:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 314
00000100:00100000:0.0:1651532211.467450:0:166103:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007fc0def2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438149:x1731754469064832:12345-10.240.43.64@tcp:103:ldlm_bl_01.0
00010000:00010000:0.0:1651532211.467454:0:166103:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651532211.467456:0:166103:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5802 lrc: 4/0,0 mode: PR/PR res: [0x3454a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fc57 expref: 7 pid: 166113 timeout: 23020 lvb_type: 1
00010000:00010000:0.0:1651532211.467461:0:166103:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5802 lrc: 3/0,0 mode: PR/PR res: [0x3454a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fc57 expref: 7 pid: 166113 timeout: 23020 lvb_type: 1
00010000:00010000:0.0:1651532211.467468:0:166103:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5802 lrc: 0/0,0 mode: --/PR res: [0x3454a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fc57 expref: 7 pid: 166113 timeout: 23020 lvb_type: 1
00010000:00010000:0.0:1651532211.467473:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532211.467473:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532211.467475:0:166103:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca5817 lrc: 3/0,1 mode: PW/PW res: [0x3454a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532211.467478:0:166103:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca5817 lrc: 4/0,1 mode: PW/PW res: [0x3454a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532211.467490:0:166103:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651532211.467500:0:166103:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007fc0def2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754469064832:12345-10.240.43.64@tcp:103:ldlm_bl_01.0 Request processed in 50us (91us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532211.467506:0:166103:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 314
00010000:00010000:1.0:1651532211.467530:0:167632:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca5817 lrc: 3/0,1 mode: PW/PW res: [0x3454a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532211.467538:0:167632:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca5817 lrc: 3/0,1 mode: PW/PW res: [0x3454a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532211.467542:0:167632:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca5817 lrc: 3/0,1 mode: PW/PW res: [0x3454a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532211.467545:0:167632:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca5817 lrc: 2/0,0 mode: PW/PW res: [0x3454a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532211.467628:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000046e76bd1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745951236288:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 649us (693us total) trans 21474869576 rc 0/0
00000100:00100000:1.0:1651532211.467632:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 44958
00010000:00010000:1.0:1651532211.467640:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca5817 lrc: 2/0,0 mode: PW/PW res: [0x3454a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532211.467644:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c8969b4f already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651532211.467645:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca5817 lrc: 2/0,0 mode: PW/PW res: [0x3454a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532211.467648:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca5817 lrc: 3/0,0 mode: PW/PW res: [0x3454a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532211.467654:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca5817 lrc: 1/0,0 mode: --/PW res: [0x3454a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532211.467657:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca5817 lrc: 0/0,0 mode: --/PW res: [0x3454a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532212.448095:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651532212.448104:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951236416
00000100:00100000:1.0:1651532212.448118:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 512
00000100:00100000:1.0:1651532212.448120:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004c512052 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745951236416:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:1.0:1651532212.448127:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 28672 granted 109241792 pending 0 free 81283506176 avail 77112795136
00000100:00100000:1.0:1651532212.448141:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004c512052 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745951236416:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 20us (47us total) trans 0 rc 0/0
00000100:00100000:1.0:1651532212.448144:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 512
00000100:00100000:1.0:1651532213.885321:0:39100:0:(ptlrpcd.c:414:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1651532213.885321:0:39099:0:(ptlrpcd.c:414:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1651532213.885327:0:39099:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006e9adaac pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:39099:1731745997363840:10.240.43.61@tcp:400:kworker/u4:1.0
00000100:00100000:1.0:1651532213.885328:0:39100:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001946d870 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9063caa-b124-4cb6-99ef-d01a735595c3:39100:1731745997363776:10.240.43.61@tcp:400:kworker/u4:1.0
00000100:00100000:0.0:1651532213.885582:0:39099:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006e9adaac pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:39099:1731745997363840:10.240.43.61@tcp:400:kworker/u4:1.0
00000100:00100000:1.0:1651532213.885589:0:39100:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001946d870 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9063caa-b124-4cb6-99ef-d01a735595c3:39100:1731745997363776:10.240.43.61@tcp:400:kworker/u4:1.0
00000100:00100000:0.0:1651532217.568097:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651532217.568115:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951236608
00000100:00100000:1.0:1651532217.568130:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 513
00000100:00100000:1.0:1651532217.568133:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006e9adaac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745951236608:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:1.0:1651532217.568141:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 28672 granted 109241792 pending 0 free 81283506176 avail 77112795136
00000100:00100000:1.0:1651532217.568159:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006e9adaac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745951236608:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 25us (63us total) trans 0 rc 0/0
00000100:00100000:1.0:1651532217.568162:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 513
00000001:00080000:0.0:1651532217.575955:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869576 is committed
00000100:00100000:0.0:1651532222.688124:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651532222.688158:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951236736
00000100:00100000:1.0:1651532222.688177:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 514
00000100:00100000:1.0:1651532222.688179:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dac65852 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951236736:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:1.0:1651532222.688189:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 28672 granted 109241792 pending 0 free 81283506176 avail 77112795136
00000100:00100000:1.0:1651532222.688209:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dac65852 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951236736:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 30us (87us total) trans 0 rc 0/0
00000100:00100000:1.0:1651532222.688215:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 514
00000400:00000080:0.0:1651532224.977819:0:232832:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648
00000001:02000400:0.0:1651532224.977822:0:232832:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 398h: verify correctness of read
00000100:00100000:0.0:1651532225.332633:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532225.332651:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469067904
00000100:00100000:0.0:1651532225.332670:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44959
00000100:00100000:0.0:1651532225.332673:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005ec1cbc3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+6:684632:x1731754469067904:12345-10.240.43.64@tcp:101:dd.0
00010000:00010000:0.0:1651532225.332682:0:167632:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532225.332709:0:167632:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca581e lrc: 2/0,0 mode: --/PW res: [0x3454b:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44fd5a expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00002000:00010000:0.0:1651532225.332721:0:167632:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x3454b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:0.0:1651532225.332731:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532225.332732:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532225.332736:0:167632:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca581e lrc: 3/0,0 mode: PW/PW res: [0x3454b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fd5a expref: 7 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532225.332743:0:167632:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca581e lrc: 3/0,0 mode: PW/PW res: [0x3454b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fd5a expref: 7 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532225.332752:0:167632:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000820577fb, rc 0)
00000100:00100000:0.0:1651532225.332774:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005ec1cbc3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+7:684632:x1731754469067904:12345-10.240.43.64@tcp:101:dd.0 Request processed in 101us (144us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532225.332777:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44959
00000100:00100000:0.0:1651532225.333034:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532225.333055:0:216322:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469068032
00002000:00010000:1.0:1651532225.333067:0:216322:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 214347/0 (0->18446744073709551615)
00002000:00100000:1.0:1651532225.333069:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000001946d870 with x1731754469068032 ext(0->18446744073709551615)
00002000:00010000:1.0:1651532225.333074:0:216322:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000001946d870.
00000100:00100000:1.0:1651532225.333088:0:216322:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250735
00000100:00100000:1.0:1651532225.333090:0:216322:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001946d870 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438146:x1731754469068032:12345-10.240.43.64@tcp:10:dd.0
00002000:00010000:1.0:1651532225.333152:0:216322:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x3454b:0x0] updating lvb size from disk: 0 -> 0
00002000:00010000:1.0:1651532225.333154:0:216322:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x3454b:0x0] updating lvb mtime from disk: 0 -> 1651532225
00002000:00010000:1.0:1651532225.333155:0:216322:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x3454b:0x0] updating lvb atime from disk: 0 -> 0
00002000:00010000:1.0:1651532225.333156:0:216322:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x3454b:0x0] updating lvb ctime from disk: 0 -> 1651532225
00002000:00010000:1.0:1651532225.333157:0:216322:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x3454b:0x0] updating lvb blocks from disk: 0 -> 0
00000100:00100000:1.0:1651532225.333177:0:216322:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001946d870 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754469068032:12345-10.240.43.64@tcp:10:dd.0 Request processed in 87us (144us total) trans 21474869577 rc 0/0
00000100:00100000:1.0:1651532225.333181:0:216322:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250735
00002000:00010000:1.0:1651532225.333182:0:216322:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 214347/0 (0->18446744073709551615)
00002000:00100000:1.0:1651532225.333183:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000001946d870 with x1731754469068032 ext(0->18446744073709551615)
00002000:00010000:1.0:1651532225.333185:0:216322:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000001946d870.
00000100:00100000:0.0:1651532225.370741:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532225.370765:0:216322:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469068352
00000100:00100000:1.0:1651532225.370782:0:216322:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250736
00000100:00100000:1.0:1651532225.370784:0:216322:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003158b8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754469068352:12345-10.240.43.64@tcp:4:dd.0
00010000:00010000:1.0:1651532225.370794:0:216322:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca5825 lrc: 3/0,1 mode: --/PW res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532225.370801:0:216322:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca581e lrc: 2/0,0 mode: PW/PW res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fd5a expref: 8 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532225.370806:0:216322:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532225.370807:0:216322:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532225.370808:0:216322:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca5825 lrc: 4/0,1 mode: --/PW res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532225.370820:0:216322:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca581e lrc: 3/0,0 mode: PW/PW res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fd5a expref: 8 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532225.370825:0:216322:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca581e lrc: 4/0,0 mode: PW/PW res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fd5a expref: 8 pid: 167632 timeout: 23034 lvb_type: 0
00000100:00100000:1.0:1651532225.370831:0:216322:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c9d21511 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_009:lustre-OST0001_UUID:216322:1731745997363904:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651532225.370855:0:216322:0:(client.c:2492:ptlrpc_set_wait()) set 000000009a3b53d0 going to sleep for 6 seconds
00000100:00100000:1.0:1651532225.371103:0:216322:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c9d21511 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_009:lustre-OST0001_UUID:216322:1731745997363904:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651532225.371109:0:216322:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca5825 lrc: 3/0,1 mode: --/PW res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532225.371147:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532225.371158:0:166103:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469068544
00010000:00010000:0.0:1651532225.371165:0:166103:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca581e lrc: 4/0,0 mode: PW/PW res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fd5a expref: 9 pid: 167632 timeout: 23034 lvb_type: 0
00000100:00100000:0.0:1651532225.371177:0:166103:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 315
00000100:00100000:0.0:1651532225.371179:0:166103:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000086e4a704 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438149:x1731754469068544:12345-10.240.43.64@tcp:103:ldlm_bl_03.0
00010000:00010000:0.0:1651532225.371184:0:166103:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651532225.371188:0:166103:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca581e lrc: 4/0,0 mode: PW/PW res: [0x3454b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fd5a expref: 9 pid: 167632 timeout: 23034 lvb_type: 0
00010000:00010000:0.0:1651532225.371192:0:166103:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca581e lrc: 3/0,0 mode: PW/PW res: [0x3454b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fd5a expref: 9 pid: 167632 timeout: 23034 lvb_type: 0
00010000:00010000:0.0:1651532225.371200:0:166103:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca581e lrc: 0/0,0 mode: --/PW res: [0x3454b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fd5a expref: 9 pid: 167632 timeout: 23034 lvb_type: 0
00010000:00010000:0.0:1651532225.371204:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532225.371205:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532225.371207:0:166103:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca5825 lrc: 3/0,1 mode: PW/PW res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532225.371210:0:166103:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca5825 lrc: 4/0,1 mode: PW/PW res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532225.371220:0:166103:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1651532225.371233:0:216322:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca5825 lrc: 3/0,1 mode: PW/PW res: [0x3454b:0x0:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532225.371242:0:216322:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca5825 lrc: 3/0,1 mode: PW/PW res: [0x3454b:0x0:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532225.371245:0:166103:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000086e4a704 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754469068544:12345-10.240.43.64@tcp:103:ldlm_bl_03.0 Request processed in 65us (98us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532225.371248:0:166103:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 315
00000001:00080000:0.0:1651532225.867220:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869578 is committed
00002000:00010000:1.0:1651532225.867319:0:216322:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x3454b:0x0] updating lvb size from disk: 0 -> 4194304
00002000:00010000:1.0:1651532225.867321:0:216322:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x3454b:0x0] updating lvb blocks from disk: 0 -> 8192
00010000:00010000:1.0:1651532225.867328:0:216322:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca5825 lrc: 3/0,1 mode: PW/PW res: [0x3454b:0x0:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532225.867336:0:216322:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca5825 lrc: 2/0,0 mode: PW/PW res: [0x3454b:0x0:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532225.867377:0:216322:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003158b8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438146:x1731754469068352:12345-10.240.43.64@tcp:4:dd.0 Request processed in 496591us (496635us total) trans 21474869578 rc 0/0
00000100:00100000:1.0:1651532225.867382:0:216322:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250736
00010000:00010000:1.0:1651532225.867404:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca5825 lrc: 2/0,0 mode: PW/PW res: [0x3454b:0x0:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532225.867409:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c8969b4f already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651532225.867411:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca5825 lrc: 2/0,0 mode: PW/PW res: [0x3454b:0x0:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532225.867414:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca5825 lrc: 3/0,0 mode: PW/PW res: [0x3454b:0x0:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532225.867423:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca5825 lrc: 1/0,0 mode: --/PW res: [0x3454b:0x0:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532225.867426:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca5825 lrc: 0/0,0 mode: --/PW res: [0x3454b:0x0:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532225.904101:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532225.904126:0:216322:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469068864
00000100:00100000:1.0:1651532225.904148:0:216322:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250737
00000100:00100000:1.0:1651532225.904150:0:216322:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009c93d7f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438146:x1731754469068864:12345-10.240.43.64@tcp:4:dd.0
00002000:00010000:1.0:1651532225.904163:0:216322:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x3454b:0x0] initial LVB size: 4194304, mtime: 0x627061c1, atime: 0x0, ctime: 0x627061c1, blocks: 0x2000
00010000:00010000:1.0:1651532225.904168:0:216322:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca582c lrc: 3/0,1 mode: --/PW res: [0x3454b:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532225.904172:0:216322:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532225.904173:0:216322:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532225.904175:0:216322:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca582c lrc: 3/0,1 mode: PW/PW res: [0x3454b:0x0:0x0].0x0 rrc: 2 type: EXT [4194304->7340031] (req 4194304->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532225.904180:0:216322:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca582c lrc: 3/0,1 mode: PW/PW res: [0x3454b:0x0:0x0].0x0 rrc: 2 type: EXT [4194304->7340031] (req 4194304->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532225.904493:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532225.904503:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469069184
00000100:00100000:0.0:1651532225.904531:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250738
00000100:00100000:0.0:1651532225.904533:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003b5b354a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438146:x1731754469069184:12345-10.240.43.64@tcp:4:dd.0
00010000:00010000:0.0:1651532225.904543:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca5833 lrc: 3/0,1 mode: --/PW res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532225.904548:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532225.904549:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532225.904550:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca5833 lrc: 3/0,1 mode: PW/PW res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532225.904555:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca5833 lrc: 3/0,1 mode: PW/PW res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532226.201417:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869579 is committed
00002000:00010000:1.0:1651532226.201485:0:216322:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x3454b:0x0] updating lvb size from disk: 4194304 -> 8388608
00002000:00010000:1.0:1651532226.201488:0:216322:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x3454b:0x0] updating lvb blocks from disk: 8192 -> 16384
00010000:00010000:1.0:1651532226.201492:0:216322:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca582c lrc: 3/0,1 mode: PW/PW res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [4194304->7340031] (req 4194304->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532226.201498:0:216322:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca582c lrc: 2/0,0 mode: PW/PW res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [4194304->7340031] (req 4194304->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532226.201526:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca582c lrc: 2/0,0 mode: PW/PW res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [4194304->7340031] (req 4194304->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532226.201540:0:216322:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009c93d7f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438146:x1731754469068864:12345-10.240.43.64@tcp:4:dd.0 Request processed in 297388us (297439us total) trans 21474869579 rc 0/0
00000100:00100000:1.0:1651532226.201544:0:216322:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250737
00010000:00010000:0.0:1651532226.201550:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c8969b4f already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651532226.201552:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca582c lrc: 2/0,0 mode: PW/PW res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [4194304->7340031] (req 4194304->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532226.201556:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca582c lrc: 3/0,0 mode: PW/PW res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [4194304->7340031] (req 4194304->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532226.201564:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca582c lrc: 1/0,0 mode: --/PW res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [4194304->7340031] (req 4194304->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532226.201567:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca582c lrc: 0/0,0 mode: --/PW res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [4194304->7340031] (req 4194304->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532226.236889:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869580 is committed
00010000:00010000:0.0:1651532226.236916:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca5833 lrc: 3/0,1 mode: PW/PW res: [0x3454b:0x0:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532226.236920:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca5833 lrc: 2/0,0 mode: PW/PW res: [0x3454b:0x0:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532226.236945:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003b5b354a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438146:x1731754469069184:12345-10.240.43.64@tcp:4:dd.0 Request processed in 332411us (332452us total) trans 21474869580 rc 0/0
00010000:00010000:1.0:1651532226.236947:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca5833 lrc: 2/0,0 mode: PW/PW res: [0x3454b:0x0:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532226.236949:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250738
00010000:00010000:1.0:1651532226.236953:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000820577fb already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651532226.236954:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca5833 lrc: 2/0,0 mode: PW/PW res: [0x3454b:0x0:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532226.236961:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca5833 lrc: 3/0,0 mode: PW/PW res: [0x3454b:0x0:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532226.236968:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca5833 lrc: 1/0,0 mode: --/PW res: [0x3454b:0x0:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532226.236971:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca5833 lrc: 0/0,0 mode: --/PW res: [0x3454b:0x0:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532226.273037:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532226.273061:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469069504
00000100:00100000:0.0:1651532226.273079:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250739
00000100:00100000:0.0:1651532226.273081:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c9d21511 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438146:x1731754469069504:12345-10.240.43.64@tcp:4:dd.0
00002000:00010000:0.0:1651532226.273094:0:216321:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x3454b:0x0] initial LVB size: 8388608, mtime: 0x627061c1, atime: 0x0, ctime: 0x627061c1, blocks: 0x4000
00010000:00010000:0.0:1651532226.273096:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca583a lrc: 3/0,1 mode: --/PW res: [0x3454b:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532226.273101:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532226.273102:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532226.273104:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca583a lrc: 3/0,1 mode: PW/PW res: [0x3454b:0x0:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532226.273108:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca583a lrc: 3/0,1 mode: PW/PW res: [0x3454b:0x0:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532226.274215:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532226.274234:0:216322:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469069696
00000100:00100000:1.0:1651532226.274256:0:216322:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250740
00000100:00100000:1.0:1651532226.274258:0:216322:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002dca0b15 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754469069696:12345-10.240.43.64@tcp:4:dd.0
00010000:00010000:1.0:1651532226.274266:0:216322:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca5841 lrc: 3/0,1 mode: --/PW res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532226.274271:0:216322:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532226.274271:0:216322:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532226.274272:0:216322:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca5841 lrc: 3/0,1 mode: PW/PW res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [9437184->12582911] (req 9437184->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532226.274277:0:216322:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca5841 lrc: 3/0,1 mode: PW/PW res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [9437184->12582911] (req 9437184->12582911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532226.570328:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869581 is committed
00002000:00010000:1.0:1651532226.570384:0:216321:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x3454b:0x0] updating lvb size from disk: 8388608 -> 12582912
00002000:00010000:1.0:1651532226.570386:0:216321:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x3454b:0x0] updating lvb mtime from disk: 1651532225 -> 1651532226
00002000:00010000:1.0:1651532226.570400:0:216321:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x3454b:0x0] updating lvb ctime from disk: 1651532225 -> 1651532226
00002000:00010000:1.0:1651532226.570401:0:216321:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x3454b:0x0] updating lvb blocks from disk: 16384 -> 24576
00010000:00010000:1.0:1651532226.570405:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca583a lrc: 3/0,1 mode: PW/PW res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532226.570411:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca583a lrc: 2/0,0 mode: PW/PW res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532226.570438:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c9d21511 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438146:x1731754469069504:12345-10.240.43.64@tcp:4:dd.0 Request processed in 297356us (297401us total) trans 21474869581 rc 0/0
00000100:00100000:1.0:1651532226.570443:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250739
00010000:00010000:1.0:1651532226.570468:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca583a lrc: 2/0,0 mode: PW/PW res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532226.570472:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000820577fb already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651532226.570474:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca583a lrc: 2/0,0 mode: PW/PW res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532226.570477:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca583a lrc: 3/0,0 mode: PW/PW res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532226.570486:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca583a lrc: 1/0,0 mode: --/PW res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532226.570489:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca583a lrc: 0/0,0 mode: --/PW res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532226.610239:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869582 is committed
00010000:00010000:1.0:1651532226.610292:0:216322:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca5841 lrc: 3/0,1 mode: PW/PW res: [0x3454b:0x0:0x0].0x0 rrc: 2 type: EXT [9437184->12582911] (req 9437184->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532226.610298:0:216322:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca5841 lrc: 2/0,0 mode: PW/PW res: [0x3454b:0x0:0x0].0x0 rrc: 2 type: EXT [9437184->12582911] (req 9437184->12582911) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532226.610325:0:216322:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002dca0b15 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438147:x1731754469069696:12345-10.240.43.64@tcp:4:dd.0 Request processed in 336066us (336110us total) trans 21474869582 rc 0/0
00010000:00010000:0.0:1651532226.610326:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca5841 lrc: 2/0,0 mode: PW/PW res: [0x3454b:0x0:0x0].0x0 rrc: 2 type: EXT [9437184->12582911] (req 9437184->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532226.610328:0:216322:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250740
00010000:00010000:0.0:1651532226.610332:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c8969b4f already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651532226.610334:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca5841 lrc: 2/0,0 mode: PW/PW res: [0x3454b:0x0:0x0].0x0 rrc: 2 type: EXT [9437184->12582911] (req 9437184->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532226.610337:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca5841 lrc: 3/0,0 mode: PW/PW res: [0x3454b:0x0:0x0].0x0 rrc: 2 type: EXT [9437184->12582911] (req 9437184->12582911) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532226.610344:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca5841 lrc: 1/0,0 mode: --/PW res: [0x3454b:0x0:0x0].0x0 rrc: 2 type: EXT [9437184->12582911] (req 9437184->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532226.610346:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca5841 lrc: 0/0,0 mode: --/PW res: [0x3454b:0x0:0x0].0x0 rrc: 2 type: EXT [9437184->12582911] (req 9437184->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532226.647126:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532226.647136:0:216322:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469070208
00000100:00100000:1.0:1651532226.647151:0:216322:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250741
00000100:00100000:1.0:1651532226.647153:0:216322:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000863110f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438147:x1731754469070208:12345-10.240.43.64@tcp:4:dd.0
00002000:00010000:1.0:1651532226.647164:0:216322:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x3454b:0x0] initial LVB size: 12582912, mtime: 0x627061c2, atime: 0x0, ctime: 0x627061c2, blocks: 0x6000
00010000:00010000:1.0:1651532226.647166:0:216322:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5848 lrc: 3/0,1 mode: --/PW res: [0x3454b:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532226.647171:0:216322:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532226.647172:0:216322:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532226.647174:0:216322:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5848 lrc: 3/0,1 mode: PW/PW res: [0x3454b:0x0:0x0].0x0 rrc: 2 type: EXT [12582912->16777215] (req 12582912->16777215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532226.647178:0:216322:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5848 lrc: 3/0,1 mode: PW/PW res: [0x3454b:0x0:0x0].0x0 rrc: 2 type: EXT [12582912->16777215] (req 12582912->16777215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532226.943258:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869583 is committed
00002000:00010000:1.0:1651532226.943322:0:216322:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x3454b:0x0] updating lvb size from disk: 12582912 -> 16777216
00002000:00010000:1.0:1651532226.943324:0:216322:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x3454b:0x0] updating lvb blocks from disk: 24576 -> 32768
00010000:00010000:1.0:1651532226.943330:0:216322:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5848 lrc: 3/0,1 mode: PW/PW res: [0x3454b:0x0:0x0].0x0 rrc: 2 type: EXT [12582912->16777215] (req 12582912->16777215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532226.943340:0:216322:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5848 lrc: 2/0,0 mode: PW/PW res: [0x3454b:0x0:0x0].0x0 rrc: 2 type: EXT [12582912->16777215] (req 12582912->16777215) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532226.943368:0:216322:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000863110f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438147:x1731754469070208:12345-10.240.43.64@tcp:4:dd.0 Request processed in 296213us (296241us total) trans 21474869583 rc 0/0
00000100:00100000:1.0:1651532226.943372:0:216322:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250741
00010000:00010000:1.0:1651532226.943382:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5848 lrc: 2/0,0 mode: PW/PW res: [0x3454b:0x0:0x0].0x0 rrc: 2 type: EXT [12582912->16777215] (req 12582912->16777215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532226.943386:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000000bb25cc already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651532226.943400:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5848 lrc: 2/0,0 mode: PW/PW res: [0x3454b:0x0:0x0].0x0 rrc: 2 type: EXT [12582912->16777215] (req 12582912->16777215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532226.943404:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5848 lrc: 3/0,0 mode: PW/PW res: [0x3454b:0x0:0x0].0x0 rrc: 2 type: EXT [12582912->16777215] (req 12582912->16777215) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532226.943411:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5848 lrc: 1/0,0 mode: --/PW res: [0x3454b:0x0:0x0].0x0 rrc: 2 type: EXT [12582912->16777215] (req 12582912->16777215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532226.943414:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5848 lrc: 0/0,0 mode: --/PW res: [0x3454b:0x0:0x0].0x0 rrc: 2 type: EXT [12582912->16777215] (req 12582912->16777215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532226.980016:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532226.980025:0:216322:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469070592
00000100:00100000:1.0:1651532226.980044:0:216322:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250742
00000100:00100000:1.0:1651532226.980046:0:216322:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c68ada5f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438147:x1731754469070592:12345-10.240.43.64@tcp:4:dd.0
00002000:00010000:1.0:1651532226.980059:0:216322:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x3454b:0x0] initial LVB size: 16777216, mtime: 0x627061c2, atime: 0x0, ctime: 0x627061c2, blocks: 0x8000
00010000:00010000:1.0:1651532226.980062:0:216322:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca584f lrc: 3/0,1 mode: --/PW res: [0x3454b:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532226.980066:0:216322:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532226.980067:0:216322:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532226.980069:0:216322:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca584f lrc: 3/0,1 mode: PW/PW res: [0x3454b:0x0:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532226.980073:0:216322:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca584f lrc: 3/0,1 mode: PW/PW res: [0x3454b:0x0:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532226.981070:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532226.981113:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469070784
00000100:00100000:0.0:1651532226.981130:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250743
00000100:00100000:0.0:1651532226.981157:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a8d7612 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754469070784:12345-10.240.43.64@tcp:4:dd.0
00010000:00010000:0.0:1651532226.981166:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca5856 lrc: 3/0,1 mode: --/PW res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532226.981172:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532226.981173:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532226.981174:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca5856 lrc: 3/0,1 mode: PW/PW res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [17825792->20971519] (req 17825792->20971519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532226.981179:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca5856 lrc: 3/0,1 mode: PW/PW res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [17825792->20971519] (req 17825792->20971519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532227.217263:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869584 is committed
00002000:00010000:1.0:1651532227.217310:0:216322:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x3454b:0x0] updating lvb size from disk: 16777216 -> 20971520
00002000:00010000:1.0:1651532227.217313:0:216322:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x3454b:0x0] updating lvb blocks from disk: 32768 -> 40960
00010000:00010000:1.0:1651532227.217318:0:216322:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca584f lrc: 3/0,1 mode: PW/PW res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532227.217323:0:216322:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca584f lrc: 2/0,0 mode: PW/PW res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532227.217349:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca584f lrc: 2/0,0 mode: PW/PW res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532227.217355:0:216322:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c68ada5f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438147:x1731754469070592:12345-10.240.43.64@tcp:4:dd.0 Request processed in 237307us (237339us total) trans 21474869584 rc 0/0
00010000:00010000:0.0:1651532227.217355:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000000bb25cc already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651532227.217356:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca584f lrc: 2/0,0 mode: PW/PW res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532227.217359:0:216322:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250742
00010000:00010000:0.0:1651532227.217361:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca584f lrc: 3/0,0 mode: PW/PW res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532227.217369:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca584f lrc: 1/0,0 mode: --/PW res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532227.217374:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca584f lrc: 0/0,0 mode: --/PW res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532227.259711:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869585 is committed
00010000:00010000:0.0:1651532227.259749:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca5856 lrc: 3/0,1 mode: PW/PW res: [0x3454b:0x0:0x0].0x0 rrc: 2 type: EXT [17825792->20971519] (req 17825792->20971519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532227.259753:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca5856 lrc: 2/0,0 mode: PW/PW res: [0x3454b:0x0:0x0].0x0 rrc: 2 type: EXT [17825792->20971519] (req 17825792->20971519) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532227.259778:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca5856 lrc: 2/0,0 mode: PW/PW res: [0x3454b:0x0:0x0].0x0 rrc: 2 type: EXT [17825792->20971519] (req 17825792->20971519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532227.259782:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a8d7612 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438146:x1731754469070784:12345-10.240.43.64@tcp:4:dd.0 Request processed in 278624us (278713us total) trans 21474869585 rc 0/0
00000100:00100000:0.0:1651532227.259787:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250743
00010000:00010000:1.0:1651532227.259788:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c1022d42 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651532227.259791:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca5856 lrc: 2/0,0 mode: PW/PW res: [0x3454b:0x0:0x0].0x0 rrc: 2 type: EXT [17825792->20971519] (req 17825792->20971519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532227.259794:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca5856 lrc: 3/0,0 mode: PW/PW res: [0x3454b:0x0:0x0].0x0 rrc: 2 type: EXT [17825792->20971519] (req 17825792->20971519) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532227.259801:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca5856 lrc: 1/0,0 mode: --/PW res: [0x3454b:0x0:0x0].0x0 rrc: 2 type: EXT [17825792->20971519] (req 17825792->20971519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532227.259803:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca5856 lrc: 0/0,0 mode: --/PW res: [0x3454b:0x0:0x0].0x0 rrc: 2 type: EXT [17825792->20971519] (req 17825792->20971519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532227.296027:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532227.296050:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469071296
00000100:00100000:0.0:1651532227.296070:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250744
00000100:00100000:0.0:1651532227.296072:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005fd5b3bd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438146:x1731754469071296:12345-10.240.43.64@tcp:4:dd.0
00002000:00010000:0.0:1651532227.296084:0:216321:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x3454b:0x0] initial LVB size: 20971520, mtime: 0x627061c2, atime: 0x0, ctime: 0x627061c2, blocks: 0xa000
00010000:00010000:0.0:1651532227.296087:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca585d lrc: 3/0,1 mode: --/PW res: [0x3454b:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532227.296092:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532227.296093:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532227.296094:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca585d lrc: 3/0,1 mode: PW/PW res: [0x3454b:0x0:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532227.296099:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca585d lrc: 3/0,1 mode: PW/PW res: [0x3454b:0x0:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532227.297072:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532227.297082:0:216322:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469071488
00000100:00100000:1.0:1651532227.297095:0:216322:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250745
00000100:00100000:1.0:1651532227.297097:0:216322:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000060c4b7c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754469071488:12345-10.240.43.64@tcp:4:dd.0
00010000:00010000:1.0:1651532227.297105:0:216322:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5864 lrc: 3/0,1 mode: --/PW res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532227.297111:0:216322:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532227.297112:0:216322:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532227.297113:0:216322:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5864 lrc: 3/0,1 mode: PW/PW res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [22020096->25165823] (req 22020096->25165823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532227.297117:0:216322:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5864 lrc: 3/0,1 mode: PW/PW res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [22020096->25165823] (req 22020096->25165823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532227.526060:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869586 is committed
00002000:00010000:1.0:1651532227.526115:0:216321:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x3454b:0x0] updating lvb size from disk: 20971520 -> 25165824
00002000:00010000:1.0:1651532227.526118:0:216321:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x3454b:0x0] updating lvb mtime from disk: 1651532226 -> 1651532227
00002000:00010000:1.0:1651532227.526120:0:216321:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x3454b:0x0] updating lvb ctime from disk: 1651532226 -> 1651532227
00002000:00010000:1.0:1651532227.526121:0:216321:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x3454b:0x0] updating lvb blocks from disk: 40960 -> 49152
00010000:00010000:1.0:1651532227.526124:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca585d lrc: 3/0,1 mode: PW/PW res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532227.526131:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca585d lrc: 2/0,0 mode: PW/PW res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532227.526169:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005fd5b3bd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438146:x1731754469071296:12345-10.240.43.64@tcp:4:dd.0 Request processed in 230094us (230141us total) trans 21474869586 rc 0/0
00000100:00100000:1.0:1651532227.526176:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250744
00010000:00010000:1.0:1651532227.526201:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca585d lrc: 2/0,0 mode: PW/PW res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532227.526206:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fb2f6575 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651532227.526207:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca585d lrc: 2/0,0 mode: PW/PW res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532227.526211:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca585d lrc: 3/0,0 mode: PW/PW res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532227.526219:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca585d lrc: 1/0,0 mode: --/PW res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532227.526234:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca585d lrc: 0/0,0 mode: --/PW res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532227.567797:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869587 is committed
00010000:00010000:1.0:1651532227.567850:0:216322:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5864 lrc: 3/0,1 mode: PW/PW res: [0x3454b:0x0:0x0].0x0 rrc: 2 type: EXT [22020096->25165823] (req 22020096->25165823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532227.567855:0:216322:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5864 lrc: 2/0,0 mode: PW/PW res: [0x3454b:0x0:0x0].0x0 rrc: 2 type: EXT [22020096->25165823] (req 22020096->25165823) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532227.567884:0:216322:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000060c4b7c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438147:x1731754469071488:12345-10.240.43.64@tcp:4:dd.0 Request processed in 270785us (270812us total) trans 21474869587 rc 0/0
00010000:00010000:0.0:1651532227.567884:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5864 lrc: 2/0,0 mode: PW/PW res: [0x3454b:0x0:0x0].0x0 rrc: 2 type: EXT [22020096->25165823] (req 22020096->25165823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532227.567887:0:216322:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250745
00010000:00010000:0.0:1651532227.567890:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c806f265 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651532227.567892:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5864 lrc: 2/0,0 mode: PW/PW res: [0x3454b:0x0:0x0].0x0 rrc: 2 type: EXT [22020096->25165823] (req 22020096->25165823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532227.567896:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5864 lrc: 3/0,0 mode: PW/PW res: [0x3454b:0x0:0x0].0x0 rrc: 2 type: EXT [22020096->25165823] (req 22020096->25165823) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532227.567902:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5864 lrc: 1/0,0 mode: --/PW res: [0x3454b:0x0:0x0].0x0 rrc: 2 type: EXT [22020096->25165823] (req 22020096->25165823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532227.567905:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5864 lrc: 0/0,0 mode: --/PW res: [0x3454b:0x0:0x0].0x0 rrc: 2 type: EXT [22020096->25165823] (req 22020096->25165823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532227.604026:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532227.604037:0:216322:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469072000
00000100:00100000:1.0:1651532227.604052:0:216322:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250746
00000100:00100000:1.0:1651532227.604054:0:216322:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005a58c8e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438147:x1731754469072000:12345-10.240.43.64@tcp:4:dd.0
00002000:00010000:1.0:1651532227.604066:0:216322:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x3454b:0x0] initial LVB size: 25165824, mtime: 0x627061c3, atime: 0x0, ctime: 0x627061c3, blocks: 0xc000
00010000:00010000:1.0:1651532227.604068:0:216322:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca586b lrc: 3/0,1 mode: --/PW res: [0x3454b:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532227.604073:0:216322:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532227.604074:0:216322:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532227.604075:0:216322:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca586b lrc: 3/0,1 mode: PW/PW res: [0x3454b:0x0:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532227.604079:0:216322:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca586b lrc: 3/0,1 mode: PW/PW res: [0x3454b:0x0:0x0].0x0 rrc: 2 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532227.605357:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532227.605412:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469072192
00000100:00100000:1.0:1651532227.605430:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250747
00000100:00100000:1.0:1651532227.605432:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005cebe8e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754469072192:12345-10.240.43.64@tcp:4:dd.0
00010000:00010000:1.0:1651532227.605439:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca5872 lrc: 3/0,1 mode: --/PW res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532227.605444:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532227.605444:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532227.605445:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca5872 lrc: 3/0,1 mode: PW/PW res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [26214400->29360127] (req 26214400->29360127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532227.605449:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca5872 lrc: 3/0,1 mode: PW/PW res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [26214400->29360127] (req 26214400->29360127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532227.808212:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651532227.808236:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951236992
00000100:00100000:1.0:1651532227.808255:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 515
00000100:00100000:1.0:1651532227.808257:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003a1231f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951236992:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:1.0:1651532227.808266:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 1101824 granted 184739264 pending 4292608 free 81258340352 avail 77087629312
00000100:00100000:1.0:1651532227.808290:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003a1231f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951236992:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 33us (82us total) trans 0 rc 0/0
00000100:00100000:1.0:1651532227.808294:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 515
00000001:00080000:0.0:1651532227.924059:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869588 is committed
00002000:00010000:1.0:1651532227.924111:0:216322:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x3454b:0x0] updating lvb size from disk: 25165824 -> 29360128
00002000:00010000:1.0:1651532227.924114:0:216322:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x3454b:0x0] updating lvb blocks from disk: 49152 -> 57344
00010000:00010000:1.0:1651532227.924118:0:216322:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca586b lrc: 3/0,1 mode: PW/PW res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532227.924124:0:216322:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca586b lrc: 2/0,0 mode: PW/PW res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532227.924151:0:216322:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005a58c8e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438147:x1731754469072000:12345-10.240.43.64@tcp:4:dd.0 Request processed in 320095us (320125us total) trans 21474869588 rc 0/0
00000100:00100000:1.0:1651532227.924155:0:216322:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250746
00010000:00010000:1.0:1651532227.924164:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca586b lrc: 2/0,0 mode: PW/PW res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532227.924168:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f2af03c8 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651532227.924169:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca586b lrc: 2/0,0 mode: PW/PW res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532227.924172:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca586b lrc: 3/0,0 mode: PW/PW res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532227.924180:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca586b lrc: 1/0,0 mode: --/PW res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532227.924197:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca586b lrc: 0/0,0 mode: --/PW res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [25165824->26214399] (req 25165824->26214399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532227.973780:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869589 is committed
00010000:00010000:1.0:1651532227.973834:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca5872 lrc: 3/0,1 mode: PW/PW res: [0x3454b:0x0:0x0].0x0 rrc: 2 type: EXT [26214400->29360127] (req 26214400->29360127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532227.973839:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca5872 lrc: 2/0,0 mode: PW/PW res: [0x3454b:0x0:0x0].0x0 rrc: 2 type: EXT [26214400->29360127] (req 26214400->29360127) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532227.973866:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005cebe8e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438146:x1731754469072192:12345-10.240.43.64@tcp:4:dd.0 Request processed in 368433us (368508us total) trans 21474869589 rc 0/0
00010000:00010000:0.0:1651532227.973867:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca5872 lrc: 2/0,0 mode: PW/PW res: [0x3454b:0x0:0x0].0x0 rrc: 2 type: EXT [26214400->29360127] (req 26214400->29360127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532227.973872:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250747
00010000:00010000:0.0:1651532227.973873:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d3014069 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651532227.973874:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca5872 lrc: 2/0,0 mode: PW/PW res: [0x3454b:0x0:0x0].0x0 rrc: 2 type: EXT [26214400->29360127] (req 26214400->29360127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532227.973882:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca5872 lrc: 3/0,0 mode: PW/PW res: [0x3454b:0x0:0x0].0x0 rrc: 2 type: EXT [26214400->29360127] (req 26214400->29360127) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532227.973889:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca5872 lrc: 1/0,0 mode: --/PW res: [0x3454b:0x0:0x0].0x0 rrc: 2 type: EXT [26214400->29360127] (req 26214400->29360127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532227.973891:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca5872 lrc: 0/0,0 mode: --/PW res: [0x3454b:0x0:0x0].0x0 rrc: 2 type: EXT [26214400->29360127] (req 26214400->29360127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532228.011059:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532228.011068:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469072832
00000100:00100000:1.0:1651532228.011080:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250748
00000100:00100000:1.0:1651532228.011082:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000179bceb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438147:x1731754469072832:12345-10.240.43.64@tcp:4:dd.0
00002000:00010000:1.0:1651532228.011092:0:216321:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x3454b:0x0] initial LVB size: 29360128, mtime: 0x627061c3, atime: 0x0, ctime: 0x627061c3, blocks: 0xe000
00010000:00010000:1.0:1651532228.011095:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca5879 lrc: 3/0,1 mode: --/PW res: [0x3454b:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532228.011100:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532228.011101:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532228.011102:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca5879 lrc: 3/0,1 mode: PW/PW res: [0x3454b:0x0:0x0].0x0 rrc: 2 type: EXT [29360128->33554431] (req 29360128->33554431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532228.011107:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca5879 lrc: 3/0,1 mode: PW/PW res: [0x3454b:0x0:0x0].0x0 rrc: 2 type: EXT [29360128->33554431] (req 29360128->33554431) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532228.307308:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869590 is committed
00002000:00010000:1.0:1651532228.307368:0:216321:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x3454b:0x0] updating lvb size from disk: 29360128 -> 33554432
00002000:00010000:1.0:1651532228.307371:0:216321:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x3454b:0x0] updating lvb mtime from disk: 1651532227 -> 1651532228
00002000:00010000:1.0:1651532228.307372:0:216321:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x3454b:0x0] updating lvb ctime from disk: 1651532227 -> 1651532228
00002000:00010000:1.0:1651532228.307373:0:216321:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x3454b:0x0] updating lvb blocks from disk: 57344 -> 65536
00010000:00010000:1.0:1651532228.307378:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca5879 lrc: 3/0,1 mode: PW/PW res: [0x3454b:0x0:0x0].0x0 rrc: 2 type: EXT [29360128->33554431] (req 29360128->33554431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532228.307384:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca5879 lrc: 2/0,0 mode: PW/PW res: [0x3454b:0x0:0x0].0x0 rrc: 2 type: EXT [29360128->33554431] (req 29360128->33554431) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532228.307432:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000179bceb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438147:x1731754469072832:12345-10.240.43.64@tcp:4:dd.0 Request processed in 296348us (296373us total) trans 21474869590 rc 0/0
00000100:00100000:1.0:1651532228.307436:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250748
00010000:00010000:1.0:1651532228.307446:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca5879 lrc: 2/0,0 mode: PW/PW res: [0x3454b:0x0:0x0].0x0 rrc: 2 type: EXT [29360128->33554431] (req 29360128->33554431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532228.307450:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f2af03c8 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651532228.307451:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca5879 lrc: 2/0,0 mode: PW/PW res: [0x3454b:0x0:0x0].0x0 rrc: 2 type: EXT [29360128->33554431] (req 29360128->33554431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532228.307455:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca5879 lrc: 3/0,0 mode: PW/PW res: [0x3454b:0x0:0x0].0x0 rrc: 2 type: EXT [29360128->33554431] (req 29360128->33554431) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532228.307462:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca5879 lrc: 1/0,0 mode: --/PW res: [0x3454b:0x0:0x0].0x0 rrc: 2 type: EXT [29360128->33554431] (req 29360128->33554431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532228.307465:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca5879 lrc: 0/0,0 mode: --/PW res: [0x3454b:0x0:0x0].0x0 rrc: 2 type: EXT [29360128->33554431] (req 29360128->33554431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532228.318783:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532228.318809:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469073536
00000100:00100000:0.0:1651532228.318825:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44960
00000100:00100000:0.0:1651532228.318827:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009273ce78 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+6:684635:x1731754469073536:12345-10.240.43.64@tcp:101:dd.0
00010000:00010000:0.0:1651532228.318833:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532228.318840:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca5880 lrc: 2/0,0 mode: --/PW res: [0x3454c:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44fd76 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00002000:00010000:0.0:1651532228.318848:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x3454c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:0.0:1651532228.318855:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532228.318855:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532228.318859:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca5880 lrc: 3/0,0 mode: PW/PW res: [0x3454c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fd76 expref: 7 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532228.318865:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca5880 lrc: 3/0,0 mode: PW/PW res: [0x3454c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fd76 expref: 7 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532228.318870:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fab23815, rc 0)
00000100:00100000:0.0:1651532228.318890:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009273ce78 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+7:684635:x1731754469073536:12345-10.240.43.64@tcp:101:dd.0 Request processed in 62us (107us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532228.318893:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44960
00000100:00100000:1.0:1651532228.319491:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532228.319500:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469073664
00002000:00010000:1.0:1651532228.319508:0:216321:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 214348/0 (0->18446744073709551615)
00002000:00100000:1.0:1651532228.319509:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000dae56eb6 with x1731754469073664 ext(0->18446744073709551615)
00002000:00010000:1.0:1651532228.319513:0:216321:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000dae56eb6.
00000100:00100000:1.0:1651532228.319524:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250749
00000100:00100000:1.0:1651532228.319527:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dae56eb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438149:x1731754469073664:12345-10.240.43.64@tcp:10:dd.0
00002000:00010000:1.0:1651532228.319564:0:216321:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x3454c:0x0] updating lvb size from disk: 0 -> 0
00002000:00010000:1.0:1651532228.319565:0:216321:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x3454c:0x0] updating lvb mtime from disk: 0 -> 1651532228
00002000:00010000:1.0:1651532228.319566:0:216321:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x3454c:0x0] updating lvb atime from disk: 0 -> 0
00002000:00010000:1.0:1651532228.319567:0:216321:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x3454c:0x0] updating lvb ctime from disk: 0 -> 1651532228
00002000:00010000:1.0:1651532228.319568:0:216321:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x3454c:0x0] updating lvb blocks from disk: 0 -> 0
00000100:00100000:1.0:1651532228.319580:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dae56eb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754469073664:12345-10.240.43.64@tcp:10:dd.0 Request processed in 53us (90us total) trans 21474869591 rc 0/0
00000100:00100000:1.0:1651532228.319583:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250749
00002000:00010000:1.0:1651532228.319585:0:216321:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 214348/0 (0->18446744073709551615)
00002000:00100000:1.0:1651532228.319585:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000dae56eb6 with x1731754469073664 ext(0->18446744073709551615)
00002000:00010000:1.0:1651532228.319587:0:216321:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000dae56eb6.
00000100:00100000:1.0:1651532228.319955:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532228.319977:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469073856
00000100:00100000:0.0:1651532228.319986:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44961
00000100:00100000:0.0:1651532228.319988:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000406dd259 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754469073856:12345-10.240.43.64@tcp:101:dd.0
00010000:00010000:0.0:1651532228.319991:0:167632:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532228.319995:0:167632:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca5887 lrc: 2/0,0 mode: --/PR res: [0x3454b:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44fd8b expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00002000:00010000:0.0:1651532228.320000:0:167632:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x3454b:0x0] initial LVB size: 33554432, mtime: 0x627061c4, atime: 0x0, ctime: 0x627061c4, blocks: 0x10000
00010000:00010000:0.0:1651532228.320005:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532228.320005:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532228.320007:0:167632:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca5887 lrc: 3/0,0 mode: PR/PR res: [0x3454b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fd8b expref: 9 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532228.320012:0:167632:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca5887 lrc: 3/0,0 mode: PR/PR res: [0x3454b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fd8b expref: 9 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532228.320016:0:167632:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f5657138, rc 0)
00000100:00100000:0.0:1651532228.320031:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000406dd259 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438149:x1731754469073856:12345-10.240.43.64@tcp:101:dd.0 Request processed in 43us (77us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532228.320034:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44961
00000100:00100000:1.0:1651532228.323323:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532228.323331:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469074176
00000100:00100000:1.0:1651532228.323345:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250750
00000100:00100000:1.0:1651532228.323347:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005bcbef99 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438149:x1731754469074176:12345-10.240.43.64@tcp:3:dd.0
00010000:00010000:1.0:1651532228.323355:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca588e lrc: 3/1,0 mode: --/PR res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532228.323360:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532228.323361:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532228.323362:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca588e lrc: 3/1,0 mode: PR/PR res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532228.323366:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca588e lrc: 3/1,0 mode: PR/PR res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532228.327638:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca588e lrc: 3/1,0 mode: PR/PR res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532228.327644:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca588e lrc: 2/0,0 mode: PR/PR res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532228.327666:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005bcbef99 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438149:x1731754469074176:12345-10.240.43.64@tcp:3:dd.0 Request processed in 4317us (4343us total) trans 0 rc 4194304/4194304
00000100:00100000:1.0:1651532228.327669:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250750
00010000:00010000:1.0:1651532228.327678:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca588e lrc: 2/0,0 mode: PR/PR res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532228.327681:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f2af03c8 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651532228.327683:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca588e lrc: 2/0,0 mode: PR/PR res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532228.327686:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca588e lrc: 3/0,0 mode: PR/PR res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532228.327691:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca588e lrc: 1/0,0 mode: --/PR res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532228.327694:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca588e lrc: 0/0,0 mode: --/PR res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532228.329772:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532228.329780:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469074432
00000100:00100000:1.0:1651532228.329800:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250751
00000100:00100000:1.0:1651532228.329802:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e66563dc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438149:x1731754469074432:12345-10.240.43.64@tcp:4:dd.0
00010000:00010000:1.0:1651532228.329810:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca5895 lrc: 3/0,1 mode: --/PW res: [0x3454c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532228.329816:0:216321:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca5880 lrc: 2/0,0 mode: PW/PW res: [0x3454c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fd76 expref: 9 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532228.329819:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532228.329820:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532228.329821:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca5895 lrc: 4/0,1 mode: --/PW res: [0x3454c:0x0:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532228.329833:0:216321:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca5880 lrc: 3/0,0 mode: PW/PW res: [0x3454c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fd76 expref: 9 pid: 166112 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532228.329838:0:216321:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca5880 lrc: 4/0,0 mode: PW/PW res: [0x3454c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fd76 expref: 9 pid: 166112 timeout: 23036 lvb_type: 0
00000100:00100000:1.0:1651532228.329844:0:216321:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dc87aa2d pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997363968:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651532228.329863:0:216321:0:(client.c:2492:ptlrpc_set_wait()) set 000000000d54aa61 going to sleep for 6 seconds
00000100:00100000:1.0:1651532228.330185:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532228.330204:0:216321:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dc87aa2d pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997363968:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651532228.330209:0:166103:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469074688
00010000:00010000:1.0:1651532228.330210:0:216321:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca5895 lrc: 3/0,1 mode: --/PW res: [0x3454c:0x0:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532228.330217:0:166103:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca5880 lrc: 4/0,0 mode: PW/PW res: [0x3454c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fd76 expref: 10 pid: 166112 timeout: 23036 lvb_type: 0
00000100:00100000:0.0:1651532228.330245:0:166103:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 316
00000100:00100000:0.0:1651532228.330247:0:166103:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ee471aa7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438146:x1731754469074688:12345-10.240.43.64@tcp:103:ldlm_bl_06.0
00010000:00010000:0.0:1651532228.330251:0:166103:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651532228.330256:0:166103:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca5880 lrc: 4/0,0 mode: PW/PW res: [0x3454c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fd76 expref: 10 pid: 166112 timeout: 23036 lvb_type: 0
00010000:00010000:0.0:1651532228.330261:0:166103:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca5880 lrc: 3/0,0 mode: PW/PW res: [0x3454c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fd76 expref: 10 pid: 166112 timeout: 23036 lvb_type: 0
00010000:00010000:0.0:1651532228.330268:0:166103:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca5880 lrc: 0/0,0 mode: --/PW res: [0x3454c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fd76 expref: 10 pid: 166112 timeout: 23036 lvb_type: 0
00010000:00010000:0.0:1651532228.330271:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532228.330272:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532228.330273:0:166103:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca5895 lrc: 3/0,1 mode: PW/PW res: [0x3454c:0x0:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532228.330277:0:166103:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca5895 lrc: 4/0,1 mode: PW/PW res: [0x3454c:0x0:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532228.330288:0:166103:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1651532228.330296:0:216321:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca5895 lrc: 3/0,1 mode: PW/PW res: [0x3454c:0x0:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532228.330301:0:166103:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ee471aa7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438146:x1731754469074688:12345-10.240.43.64@tcp:103:ldlm_bl_06.0 Request processed in 53us (116us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532228.330304:0:166103:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 316
00010000:00010000:1.0:1651532228.330306:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca5895 lrc: 3/0,1 mode: PW/PW res: [0x3454c:0x0:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532228.683358:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869592 is committed
00002000:00010000:1.0:1651532228.683430:0:216321:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x3454c:0x0] updating lvb size from disk: 0 -> 4194304
00002000:00010000:1.0:1651532228.683433:0:216321:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x3454c:0x0] updating lvb blocks from disk: 0 -> 8192
00010000:00010000:1.0:1651532228.683438:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca5895 lrc: 3/0,1 mode: PW/PW res: [0x3454c:0x0:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532228.683444:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca5895 lrc: 2/0,0 mode: PW/PW res: [0x3454c:0x0:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532228.683470:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca5895 lrc: 2/0,0 mode: PW/PW res: [0x3454c:0x0:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532228.683475:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e66563dc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438149:x1731754469074432:12345-10.240.43.64@tcp:4:dd.0 Request processed in 353672us (353703us total) trans 21474869592 rc 0/0
00010000:00010000:0.0:1651532228.683477:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009c5faf65 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651532228.683478:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca5895 lrc: 2/0,0 mode: PW/PW res: [0x3454c:0x0:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532228.683479:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250751
00010000:00010000:0.0:1651532228.683482:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca5895 lrc: 3/0,0 mode: PW/PW res: [0x3454c:0x0:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532228.683489:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca5895 lrc: 1/0,0 mode: --/PW res: [0x3454c:0x0:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532228.683492:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca5895 lrc: 0/0,0 mode: --/PW res: [0x3454c:0x0:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532228.732243:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532228.732252:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469075072
00000100:00100000:1.0:1651532228.732270:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250752
00000100:00100000:1.0:1651532228.732272:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc87aa2d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438148:x1731754469075072:12345-10.240.43.64@tcp:3:dd.0
00010000:00010000:1.0:1651532228.732281:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca589c lrc: 3/1,0 mode: --/PR res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532228.732286:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532228.732287:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532228.732288:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca589c lrc: 3/1,0 mode: PR/PR res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532228.732293:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca589c lrc: 3/1,0 mode: PR/PR res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532228.736119:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca589c lrc: 3/1,0 mode: PR/PR res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532228.736125:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca589c lrc: 2/0,0 mode: PR/PR res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532228.736146:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc87aa2d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438148:x1731754469075072:12345-10.240.43.64@tcp:3:dd.0 Request processed in 3872us (3903us total) trans 0 rc 4194304/4194304
00000100:00100000:1.0:1651532228.736149:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250752
00010000:00010000:1.0:1651532228.736158:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca589c lrc: 2/0,0 mode: PR/PR res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532228.736161:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f2af03c8 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651532228.736162:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca589c lrc: 2/0,0 mode: PR/PR res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532228.736165:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca589c lrc: 3/0,0 mode: PR/PR res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532228.736171:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca589c lrc: 1/0,0 mode: --/PR res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532228.736174:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca589c lrc: 0/0,0 mode: --/PR res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532228.738208:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532228.738216:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469075456
00000100:00100000:1.0:1651532228.738243:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250753
00000100:00100000:1.0:1651532228.738245:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000512a5ed4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438149:x1731754469075456:12345-10.240.43.64@tcp:4:dd.0
00002000:00010000:1.0:1651532228.738256:0:216321:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x3454c:0x0] initial LVB size: 4194304, mtime: 0x627061c4, atime: 0x0, ctime: 0x627061c4, blocks: 0x2000
00010000:00010000:1.0:1651532228.738259:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca58a3 lrc: 3/0,1 mode: --/PW res: [0x3454c:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532228.738263:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532228.738263:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532228.738264:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca58a3 lrc: 3/0,1 mode: PW/PW res: [0x3454c:0x0:0x0].0x0 rrc: 2 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532228.738268:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca58a3 lrc: 3/0,1 mode: PW/PW res: [0x3454c:0x0:0x0].0x0 rrc: 2 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532228.971705:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869593 is committed
00002000:00010000:1.0:1651532228.971764:0:216321:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x3454c:0x0] updating lvb size from disk: 4194304 -> 8388608
00002000:00010000:1.0:1651532228.971767:0:216321:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x3454c:0x0] updating lvb blocks from disk: 8192 -> 16384
00010000:00010000:1.0:1651532228.971772:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca58a3 lrc: 3/0,1 mode: PW/PW res: [0x3454c:0x0:0x0].0x0 rrc: 2 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532228.971777:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca58a3 lrc: 2/0,0 mode: PW/PW res: [0x3454c:0x0:0x0].0x0 rrc: 2 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532228.971803:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca58a3 lrc: 2/0,0 mode: PW/PW res: [0x3454c:0x0:0x0].0x0 rrc: 2 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532228.971808:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000512a5ed4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438149:x1731754469075456:12345-10.240.43.64@tcp:4:dd.0 Request processed in 233561us (233599us total) trans 21474869593 rc 0/0
00010000:00010000:0.0:1651532228.971809:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000eebd17a1 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651532228.971810:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca58a3 lrc: 2/0,0 mode: PW/PW res: [0x3454c:0x0:0x0].0x0 rrc: 2 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532228.971812:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250753
00010000:00010000:0.0:1651532228.971814:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca58a3 lrc: 3/0,0 mode: PW/PW res: [0x3454c:0x0:0x0].0x0 rrc: 2 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532228.971821:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca58a3 lrc: 1/0,0 mode: --/PW res: [0x3454c:0x0:0x0].0x0 rrc: 2 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532228.971824:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca58a3 lrc: 0/0,0 mode: --/PW res: [0x3454c:0x0:0x0].0x0 rrc: 2 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532228.974338:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532228.974347:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469075840
00000100:00100000:1.0:1651532228.974365:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250754
00000100:00100000:1.0:1651532228.974368:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000021ef2e12 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438148:x1731754469075840:12345-10.240.43.64@tcp:3:dd.0
00010000:00010000:1.0:1651532228.974377:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca58aa lrc: 3/1,0 mode: --/PR res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532228.974382:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532228.974383:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532228.974384:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca58aa lrc: 3/1,0 mode: PR/PR res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [8388608->12582911] (req 8388608->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532228.974401:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca58aa lrc: 3/1,0 mode: PR/PR res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [8388608->12582911] (req 8388608->12582911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532228.978138:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca58aa lrc: 3/1,0 mode: PR/PR res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [8388608->12582911] (req 8388608->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532228.978144:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca58aa lrc: 2/0,0 mode: PR/PR res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [8388608->12582911] (req 8388608->12582911) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532228.978164:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000021ef2e12 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438148:x1731754469075840:12345-10.240.43.64@tcp:3:dd.0 Request processed in 3795us (3827us total) trans 0 rc 4194304/4194304
00000100:00100000:1.0:1651532228.978168:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250754
00010000:00010000:1.0:1651532228.978176:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca58aa lrc: 2/0,0 mode: PR/PR res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [8388608->12582911] (req 8388608->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532228.978180:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f2af03c8 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651532228.978181:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca58aa lrc: 2/0,0 mode: PR/PR res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [8388608->12582911] (req 8388608->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532228.978184:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca58aa lrc: 3/0,0 mode: PR/PR res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [8388608->12582911] (req 8388608->12582911) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532228.978191:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca58aa lrc: 1/0,0 mode: --/PR res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [8388608->12582911] (req 8388608->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532228.978194:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca58aa lrc: 0/0,0 mode: --/PR res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [8388608->12582911] (req 8388608->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532228.980453:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532228.980462:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469076224
00000100:00100000:1.0:1651532228.980479:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250755
00000100:00100000:1.0:1651532228.980481:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000026b86a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438149:x1731754469076224:12345-10.240.43.64@tcp:4:dd.0
00002000:00010000:1.0:1651532228.980493:0:216321:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x3454c:0x0] initial LVB size: 8388608, mtime: 0x627061c4, atime: 0x0, ctime: 0x627061c4, blocks: 0x4000
00010000:00010000:1.0:1651532228.980495:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca58b1 lrc: 3/0,1 mode: --/PW res: [0x3454c:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532228.980499:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532228.980500:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532228.980501:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca58b1 lrc: 3/0,1 mode: PW/PW res: [0x3454c:0x0:0x0].0x0 rrc: 2 type: EXT [8388608->12582911] (req 8388608->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532228.980505:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca58b1 lrc: 3/0,1 mode: PW/PW res: [0x3454c:0x0:0x0].0x0 rrc: 2 type: EXT [8388608->12582911] (req 8388608->12582911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532229.247470:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869594 is committed
00002000:00010000:1.0:1651532229.247532:0:216321:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x3454c:0x0] updating lvb size from disk: 8388608 -> 12582912
00002000:00010000:1.0:1651532229.247534:0:216321:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x3454c:0x0] updating lvb blocks from disk: 16384 -> 24576
00010000:00010000:1.0:1651532229.247539:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca58b1 lrc: 3/0,1 mode: PW/PW res: [0x3454c:0x0:0x0].0x0 rrc: 2 type: EXT [8388608->12582911] (req 8388608->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532229.247560:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca58b1 lrc: 2/0,0 mode: PW/PW res: [0x3454c:0x0:0x0].0x0 rrc: 2 type: EXT [8388608->12582911] (req 8388608->12582911) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532229.247588:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000026b86a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438149:x1731754469076224:12345-10.240.43.64@tcp:4:dd.0 Request processed in 267105us (267134us total) trans 21474869594 rc 0/0
00000100:00100000:1.0:1651532229.247592:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250755
00010000:00010000:1.0:1651532229.247603:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca58b1 lrc: 2/0,0 mode: PW/PW res: [0x3454c:0x0:0x0].0x0 rrc: 2 type: EXT [8388608->12582911] (req 8388608->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532229.247606:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001cf49bf2 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651532229.247607:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca58b1 lrc: 2/0,0 mode: PW/PW res: [0x3454c:0x0:0x0].0x0 rrc: 2 type: EXT [8388608->12582911] (req 8388608->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532229.247610:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca58b1 lrc: 3/0,0 mode: PW/PW res: [0x3454c:0x0:0x0].0x0 rrc: 2 type: EXT [8388608->12582911] (req 8388608->12582911) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532229.247617:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca58b1 lrc: 1/0,0 mode: --/PW res: [0x3454c:0x0:0x0].0x0 rrc: 2 type: EXT [8388608->12582911] (req 8388608->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532229.247619:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca58b1 lrc: 0/0,0 mode: --/PW res: [0x3454c:0x0:0x0].0x0 rrc: 2 type: EXT [8388608->12582911] (req 8388608->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532229.249813:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532229.249822:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469076608
00000100:00100000:1.0:1651532229.249842:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250756
00000100:00100000:1.0:1651532229.249844:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e29ae1f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438148:x1731754469076608:12345-10.240.43.64@tcp:3:dd.0
00010000:00010000:1.0:1651532229.249863:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca58b8 lrc: 3/1,0 mode: --/PR res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532229.249867:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532229.249868:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532229.249870:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca58b8 lrc: 3/1,0 mode: PR/PR res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [12582912->16777215] (req 12582912->16777215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532229.249874:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca58b8 lrc: 3/1,0 mode: PR/PR res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [12582912->16777215] (req 12582912->16777215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532229.253698:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca58b8 lrc: 3/1,0 mode: PR/PR res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [12582912->16777215] (req 12582912->16777215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532229.253703:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca58b8 lrc: 2/0,0 mode: PR/PR res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [12582912->16777215] (req 12582912->16777215) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532229.253730:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca58b8 lrc: 2/0,0 mode: PR/PR res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [12582912->16777215] (req 12582912->16777215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532229.253731:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e29ae1f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438148:x1731754469076608:12345-10.240.43.64@tcp:3:dd.0 Request processed in 3885us (3918us total) trans 0 rc 4194304/4194304
00000100:00100000:1.0:1651532229.253735:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250756
00010000:00010000:0.0:1651532229.253736:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f2af03c8 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651532229.253737:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca58b8 lrc: 2/0,0 mode: PR/PR res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [12582912->16777215] (req 12582912->16777215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532229.253741:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca58b8 lrc: 3/0,0 mode: PR/PR res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [12582912->16777215] (req 12582912->16777215) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532229.253748:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca58b8 lrc: 1/0,0 mode: --/PR res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [12582912->16777215] (req 12582912->16777215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532229.253751:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca58b8 lrc: 0/0,0 mode: --/PR res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [12582912->16777215] (req 12582912->16777215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532229.256036:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532229.256044:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469076992
00000100:00100000:1.0:1651532229.256060:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250757
00000100:00100000:1.0:1651532229.256062:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000033438d31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438149:x1731754469076992:12345-10.240.43.64@tcp:4:dd.0
00002000:00010000:1.0:1651532229.256074:0:216321:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x3454c:0x0] initial LVB size: 12582912, mtime: 0x627061c4, atime: 0x0, ctime: 0x627061c4, blocks: 0x6000
00010000:00010000:1.0:1651532229.256076:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca58bf lrc: 3/0,1 mode: --/PW res: [0x3454c:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532229.256092:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532229.256093:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532229.256094:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca58bf lrc: 3/0,1 mode: PW/PW res: [0x3454c:0x0:0x0].0x0 rrc: 2 type: EXT [12582912->16777215] (req 12582912->16777215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532229.256098:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca58bf lrc: 3/0,1 mode: PW/PW res: [0x3454c:0x0:0x0].0x0 rrc: 2 type: EXT [12582912->16777215] (req 12582912->16777215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532229.313063:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532229.313088:0:216322:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469077120
00002000:00100000:0.0:1651532229.313102:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34548:0x0] (0->1233)  req@00000000d6817cf7 x1731754469077120/t0(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:729/0 lens 1728/0 e 0 to 0 dl 1651532274 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dd.0'
00002000:00100000:0.0:1651532229.313108:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000d6817cf7 with x1731754469077120 ext(0->1233)
00002000:00010000:0.0:1651532229.313110:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000d6817cf7
00000100:00100000:0.0:1651532229.313118:0:216322:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250758
00000100:00100000:0.0:1651532229.313120:0:216322:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d6817cf7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754469077120:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:0.0:1651532229.369165:0:216322:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d6817cf7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438148:x1731754469077120:12345-10.240.43.64@tcp:4:dd.0 Request processed in 56043us (56102us total) trans 21474869596 rc 0/0
00000100:00100000:0.0:1651532229.369170:0:216322:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250758
00002000:00100000:0.0:1651532229.369173:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x34548:0x0] (0->1233)  req@00000000d6817cf7 x1731754469077120/t21474869596(0) o4->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:729/0 lens 1728/448 e 0 to 0 dl 1651532274 ref 1 fl Complete:/0/0 rc 0/0 job:'dd.0'
00002000:00100000:0.0:1651532229.369177:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000d6817cf7 with x1731754469077120 ext(0->1233)
00002000:00010000:0.0:1651532229.369179:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000d6817cf7
00000001:00080000:0.0:1651532229.594934:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869595 is committed
00002000:00010000:1.0:1651532229.594999:0:216321:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x3454c:0x0] updating lvb size from disk: 12582912 -> 16777216
00002000:00010000:1.0:1651532229.595001:0:216321:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x3454c:0x0] updating lvb mtime from disk: 1651532228 -> 1651532229
00002000:00010000:1.0:1651532229.595002:0:216321:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x3454c:0x0] updating lvb ctime from disk: 1651532228 -> 1651532229
00002000:00010000:1.0:1651532229.595003:0:216321:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x3454c:0x0] updating lvb blocks from disk: 24576 -> 32768
00010000:00010000:1.0:1651532229.595008:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca58bf lrc: 3/0,1 mode: PW/PW res: [0x3454c:0x0:0x0].0x0 rrc: 2 type: EXT [12582912->16777215] (req 12582912->16777215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532229.595013:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca58bf lrc: 2/0,0 mode: PW/PW res: [0x3454c:0x0:0x0].0x0 rrc: 2 type: EXT [12582912->16777215] (req 12582912->16777215) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532229.595038:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000033438d31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438149:x1731754469076992:12345-10.240.43.64@tcp:4:dd.0 Request processed in 338974us (339002us total) trans 21474869595 rc 0/0
00000100:00100000:1.0:1651532229.595042:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250757
00010000:00010000:1.0:1651532229.595051:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca58bf lrc: 2/0,0 mode: PW/PW res: [0x3454c:0x0:0x0].0x0 rrc: 2 type: EXT [12582912->16777215] (req 12582912->16777215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532229.595055:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001cf49bf2 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651532229.595056:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca58bf lrc: 2/0,0 mode: PW/PW res: [0x3454c:0x0:0x0].0x0 rrc: 2 type: EXT [12582912->16777215] (req 12582912->16777215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532229.595061:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca58bf lrc: 3/0,0 mode: PW/PW res: [0x3454c:0x0:0x0].0x0 rrc: 2 type: EXT [12582912->16777215] (req 12582912->16777215) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532229.595068:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca58bf lrc: 1/0,0 mode: --/PW res: [0x3454c:0x0:0x0].0x0 rrc: 2 type: EXT [12582912->16777215] (req 12582912->16777215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532229.595071:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca58bf lrc: 0/0,0 mode: --/PW res: [0x3454c:0x0:0x0].0x0 rrc: 2 type: EXT [12582912->16777215] (req 12582912->16777215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532229.597471:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532229.597480:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469077312
00000100:00100000:1.0:1651532229.597497:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250759
00000100:00100000:1.0:1651532229.597499:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000042f25668 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754469077312:12345-10.240.43.64@tcp:3:dd.0
00010000:00010000:1.0:1651532229.597508:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca58c6 lrc: 3/1,0 mode: --/PR res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532229.597512:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532229.597513:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532229.597515:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca58c6 lrc: 3/1,0 mode: PR/PR res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [16777216->20971519] (req 16777216->20971519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532229.597519:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca58c6 lrc: 3/1,0 mode: PR/PR res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [16777216->20971519] (req 16777216->20971519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532229.601482:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca58c6 lrc: 3/1,0 mode: PR/PR res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [16777216->20971519] (req 16777216->20971519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532229.601491:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca58c6 lrc: 2/0,0 mode: PR/PR res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [16777216->20971519] (req 16777216->20971519) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532229.601511:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000042f25668 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754469077312:12345-10.240.43.64@tcp:3:dd.0 Request processed in 4011us (4041us total) trans 0 rc 4194304/4194304
00000100:00100000:1.0:1651532229.601515:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250759
00010000:00010000:1.0:1651532229.601523:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca58c6 lrc: 2/0,0 mode: PR/PR res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [16777216->20971519] (req 16777216->20971519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532229.601527:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000060a6272d already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651532229.601528:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca58c6 lrc: 2/0,0 mode: PR/PR res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [16777216->20971519] (req 16777216->20971519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532229.601531:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca58c6 lrc: 3/0,0 mode: PR/PR res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [16777216->20971519] (req 16777216->20971519) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532229.601536:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca58c6 lrc: 1/0,0 mode: --/PR res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [16777216->20971519] (req 16777216->20971519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532229.601539:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca58c6 lrc: 0/0,0 mode: --/PR res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [16777216->20971519] (req 16777216->20971519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532229.603576:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532229.603584:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469077696
00000100:00100000:1.0:1651532229.603603:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250760
00000100:00100000:1.0:1651532229.603605:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007fc97a96 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438149:x1731754469077696:12345-10.240.43.64@tcp:4:dd.0
00002000:00010000:1.0:1651532229.603618:0:216321:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x3454c:0x0] initial LVB size: 16777216, mtime: 0x627061c5, atime: 0x0, ctime: 0x627061c5, blocks: 0x8000
00010000:00010000:1.0:1651532229.603621:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca58cd lrc: 3/0,1 mode: --/PW res: [0x3454c:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532229.603625:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532229.603626:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532229.603627:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca58cd lrc: 3/0,1 mode: PW/PW res: [0x3454c:0x0:0x0].0x0 rrc: 2 type: EXT [16777216->20971519] (req 16777216->20971519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532229.603631:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca58cd lrc: 3/0,1 mode: PW/PW res: [0x3454c:0x0:0x0].0x0 rrc: 2 type: EXT [16777216->20971519] (req 16777216->20971519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532229.916258:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869597 is committed
00002000:00010000:1.0:1651532229.916318:0:216321:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x3454c:0x0] updating lvb size from disk: 16777216 -> 20971520
00002000:00010000:1.0:1651532229.916321:0:216321:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x3454c:0x0] updating lvb blocks from disk: 32768 -> 40960
00010000:00010000:1.0:1651532229.916326:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca58cd lrc: 3/0,1 mode: PW/PW res: [0x3454c:0x0:0x0].0x0 rrc: 2 type: EXT [16777216->20971519] (req 16777216->20971519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532229.916332:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca58cd lrc: 2/0,0 mode: PW/PW res: [0x3454c:0x0:0x0].0x0 rrc: 2 type: EXT [16777216->20971519] (req 16777216->20971519) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532229.916360:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007fc97a96 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438149:x1731754469077696:12345-10.240.43.64@tcp:4:dd.0 Request processed in 312754us (312784us total) trans 21474869597 rc 0/0
00000100:00100000:1.0:1651532229.916364:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250760
00010000:00010000:1.0:1651532229.916374:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca58cd lrc: 2/0,0 mode: PW/PW res: [0x3454c:0x0:0x0].0x0 rrc: 2 type: EXT [16777216->20971519] (req 16777216->20971519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532229.916378:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001cf49bf2 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651532229.916379:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca58cd lrc: 2/0,0 mode: PW/PW res: [0x3454c:0x0:0x0].0x0 rrc: 2 type: EXT [16777216->20971519] (req 16777216->20971519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532229.916384:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca58cd lrc: 3/0,0 mode: PW/PW res: [0x3454c:0x0:0x0].0x0 rrc: 2 type: EXT [16777216->20971519] (req 16777216->20971519) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532229.916402:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca58cd lrc: 1/0,0 mode: --/PW res: [0x3454c:0x0:0x0].0x0 rrc: 2 type: EXT [16777216->20971519] (req 16777216->20971519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532229.916405:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca58cd lrc: 0/0,0 mode: --/PW res: [0x3454c:0x0:0x0].0x0 rrc: 2 type: EXT [16777216->20971519] (req 16777216->20971519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532229.918889:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532229.918898:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469078080
00000100:00100000:1.0:1651532229.918919:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250761
00000100:00100000:1.0:1651532229.918921:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a610be9f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438148:x1731754469078080:12345-10.240.43.64@tcp:3:dd.0
00010000:00010000:1.0:1651532229.918930:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca58d4 lrc: 3/1,0 mode: --/PR res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532229.918935:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532229.918936:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532229.918937:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca58d4 lrc: 3/1,0 mode: PR/PR res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [20971520->25165823] (req 20971520->25165823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532229.918942:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca58d4 lrc: 3/1,0 mode: PR/PR res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [20971520->25165823] (req 20971520->25165823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532229.922760:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca58d4 lrc: 3/1,0 mode: PR/PR res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [20971520->25165823] (req 20971520->25165823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532229.922769:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca58d4 lrc: 2/0,0 mode: PR/PR res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [20971520->25165823] (req 20971520->25165823) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532229.922790:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a610be9f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438148:x1731754469078080:12345-10.240.43.64@tcp:3:dd.0 Request processed in 3868us (3902us total) trans 0 rc 4194304/4194304
00000100:00100000:1.0:1651532229.922794:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250761
00010000:00010000:1.0:1651532229.922802:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca58d4 lrc: 2/0,0 mode: PR/PR res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [20971520->25165823] (req 20971520->25165823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532229.922805:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000060a6272d already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651532229.922807:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca58d4 lrc: 2/0,0 mode: PR/PR res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [20971520->25165823] (req 20971520->25165823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532229.922810:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca58d4 lrc: 3/0,0 mode: PR/PR res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [20971520->25165823] (req 20971520->25165823) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532229.922815:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca58d4 lrc: 1/0,0 mode: --/PR res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [20971520->25165823] (req 20971520->25165823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532229.922818:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca58d4 lrc: 0/0,0 mode: --/PR res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [20971520->25165823] (req 20971520->25165823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532229.924958:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532229.924967:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469078464
00000100:00100000:1.0:1651532229.924984:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250762
00000100:00100000:1.0:1651532229.924986:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b5fcbec3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438149:x1731754469078464:12345-10.240.43.64@tcp:4:dd.0
00002000:00010000:1.0:1651532229.924999:0:216321:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x3454c:0x0] initial LVB size: 20971520, mtime: 0x627061c5, atime: 0x0, ctime: 0x627061c5, blocks: 0xa000
00010000:00010000:1.0:1651532229.925002:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca58db lrc: 3/0,1 mode: --/PW res: [0x3454c:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532229.925006:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532229.925006:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532229.925008:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca58db lrc: 3/0,1 mode: PW/PW res: [0x3454c:0x0:0x0].0x0 rrc: 2 type: EXT [20971520->25165823] (req 20971520->25165823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532229.925012:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca58db lrc: 3/0,1 mode: PW/PW res: [0x3454c:0x0:0x0].0x0 rrc: 2 type: EXT [20971520->25165823] (req 20971520->25165823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532230.306868:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869598 is committed
00002000:00010000:1.0:1651532230.306928:0:216321:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x3454c:0x0] updating lvb size from disk: 20971520 -> 25165824
00002000:00010000:1.0:1651532230.306931:0:216321:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x3454c:0x0] updating lvb blocks from disk: 40960 -> 49152
00010000:00010000:1.0:1651532230.306936:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca58db lrc: 3/0,1 mode: PW/PW res: [0x3454c:0x0:0x0].0x0 rrc: 2 type: EXT [20971520->25165823] (req 20971520->25165823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532230.306941:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca58db lrc: 2/0,0 mode: PW/PW res: [0x3454c:0x0:0x0].0x0 rrc: 2 type: EXT [20971520->25165823] (req 20971520->25165823) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532230.306966:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca58db lrc: 2/0,0 mode: PW/PW res: [0x3454c:0x0:0x0].0x0 rrc: 2 type: EXT [20971520->25165823] (req 20971520->25165823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532230.306972:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001cf49bf2 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651532230.306974:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca58db lrc: 2/0,0 mode: PW/PW res: [0x3454c:0x0:0x0].0x0 rrc: 2 type: EXT [20971520->25165823] (req 20971520->25165823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532230.306976:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b5fcbec3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438149:x1731754469078464:12345-10.240.43.64@tcp:4:dd.0 Request processed in 381988us (382017us total) trans 21474869598 rc 0/0
00010000:00010000:0.0:1651532230.306978:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca58db lrc: 3/0,0 mode: PW/PW res: [0x3454c:0x0:0x0].0x0 rrc: 2 type: EXT [20971520->25165823] (req 20971520->25165823) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532230.306980:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250762
00010000:00010000:0.0:1651532230.306986:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca58db lrc: 1/0,0 mode: --/PW res: [0x3454c:0x0:0x0].0x0 rrc: 2 type: EXT [20971520->25165823] (req 20971520->25165823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532230.306988:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca58db lrc: 0/0,0 mode: --/PW res: [0x3454c:0x0:0x0].0x0 rrc: 2 type: EXT [20971520->25165823] (req 20971520->25165823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532230.308981:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532230.308990:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469078848
00000100:00100000:1.0:1651532230.309009:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250763
00000100:00100000:1.0:1651532230.309011:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004dec7490 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438148:x1731754469078848:12345-10.240.43.64@tcp:3:dd.0
00010000:00010000:1.0:1651532230.309022:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca58e2 lrc: 3/1,0 mode: --/PR res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532230.309027:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532230.309028:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532230.309029:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca58e2 lrc: 3/1,0 mode: PR/PR res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [25165824->29360127] (req 25165824->29360127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532230.309034:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca58e2 lrc: 3/1,0 mode: PR/PR res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [25165824->29360127] (req 25165824->29360127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532230.312836:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca58e2 lrc: 3/1,0 mode: PR/PR res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [25165824->29360127] (req 25165824->29360127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532230.312842:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca58e2 lrc: 2/0,0 mode: PR/PR res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [25165824->29360127] (req 25165824->29360127) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532230.312863:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004dec7490 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438148:x1731754469078848:12345-10.240.43.64@tcp:3:dd.0 Request processed in 3851us (3882us total) trans 0 rc 4194304/4194304
00000100:00100000:1.0:1651532230.312866:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250763
00010000:00010000:1.0:1651532230.312875:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca58e2 lrc: 2/0,0 mode: PR/PR res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [25165824->29360127] (req 25165824->29360127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532230.312879:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000060a6272d already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651532230.312880:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca58e2 lrc: 2/0,0 mode: PR/PR res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [25165824->29360127] (req 25165824->29360127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532230.312883:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca58e2 lrc: 3/0,0 mode: PR/PR res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [25165824->29360127] (req 25165824->29360127) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532230.312890:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca58e2 lrc: 1/0,0 mode: --/PR res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [25165824->29360127] (req 25165824->29360127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532230.312893:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca58e2 lrc: 0/0,0 mode: --/PR res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [25165824->29360127] (req 25165824->29360127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532230.314917:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532230.314925:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469079232
00000100:00100000:1.0:1651532230.314943:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250764
00000100:00100000:1.0:1651532230.314945:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000505be2f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438149:x1731754469079232:12345-10.240.43.64@tcp:4:dd.0
00002000:00010000:1.0:1651532230.314955:0:216321:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x3454c:0x0] initial LVB size: 25165824, mtime: 0x627061c5, atime: 0x0, ctime: 0x627061c5, blocks: 0xc000
00010000:00010000:1.0:1651532230.314958:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca58e9 lrc: 3/0,1 mode: --/PW res: [0x3454c:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532230.314962:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532230.314962:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532230.314964:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca58e9 lrc: 3/0,1 mode: PW/PW res: [0x3454c:0x0:0x0].0x0 rrc: 2 type: EXT [25165824->29360127] (req 25165824->29360127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532230.314968:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca58e9 lrc: 3/0,1 mode: PW/PW res: [0x3454c:0x0:0x0].0x0 rrc: 2 type: EXT [25165824->29360127] (req 25165824->29360127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532230.534475:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869599 is committed
00002000:00010000:1.0:1651532230.534534:0:216321:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x3454c:0x0] updating lvb size from disk: 25165824 -> 29360128
00002000:00010000:1.0:1651532230.534536:0:216321:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x3454c:0x0] updating lvb mtime from disk: 1651532229 -> 1651532230
00002000:00010000:1.0:1651532230.534537:0:216321:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x3454c:0x0] updating lvb ctime from disk: 1651532229 -> 1651532230
00002000:00010000:1.0:1651532230.534538:0:216321:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x3454c:0x0] updating lvb blocks from disk: 49152 -> 57344
00010000:00010000:1.0:1651532230.534544:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca58e9 lrc: 3/0,1 mode: PW/PW res: [0x3454c:0x0:0x0].0x0 rrc: 2 type: EXT [25165824->29360127] (req 25165824->29360127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532230.534549:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca58e9 lrc: 2/0,0 mode: PW/PW res: [0x3454c:0x0:0x0].0x0 rrc: 2 type: EXT [25165824->29360127] (req 25165824->29360127) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532230.534575:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000505be2f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438149:x1731754469079232:12345-10.240.43.64@tcp:4:dd.0 Request processed in 219629us (219659us total) trans 21474869599 rc 0/0
00000100:00100000:1.0:1651532230.534579:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250764
00010000:00010000:1.0:1651532230.534589:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca58e9 lrc: 2/0,0 mode: PW/PW res: [0x3454c:0x0:0x0].0x0 rrc: 2 type: EXT [25165824->29360127] (req 25165824->29360127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532230.534592:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000022b2104e already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651532230.534593:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca58e9 lrc: 2/0,0 mode: PW/PW res: [0x3454c:0x0:0x0].0x0 rrc: 2 type: EXT [25165824->29360127] (req 25165824->29360127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532230.534597:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca58e9 lrc: 3/0,0 mode: PW/PW res: [0x3454c:0x0:0x0].0x0 rrc: 2 type: EXT [25165824->29360127] (req 25165824->29360127) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532230.534603:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca58e9 lrc: 1/0,0 mode: --/PW res: [0x3454c:0x0:0x0].0x0 rrc: 2 type: EXT [25165824->29360127] (req 25165824->29360127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532230.534606:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca58e9 lrc: 0/0,0 mode: --/PW res: [0x3454c:0x0:0x0].0x0 rrc: 2 type: EXT [25165824->29360127] (req 25165824->29360127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532230.537090:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532230.537099:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469079616
00000100:00100000:1.0:1651532230.537116:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250765
00000100:00100000:1.0:1651532230.537118:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000016ae8a48 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438148:x1731754469079616:12345-10.240.43.64@tcp:3:dd.0
00010000:00010000:1.0:1651532230.537128:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca58f0 lrc: 3/1,0 mode: --/PR res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532230.537132:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532230.537133:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532230.537134:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca58f0 lrc: 3/1,0 mode: PR/PR res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [29360128->33554431] (req 29360128->33554431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532230.537139:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca58f0 lrc: 3/1,0 mode: PR/PR res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [29360128->33554431] (req 29360128->33554431) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532230.540190:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca58f0 lrc: 3/1,0 mode: PR/PR res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [29360128->33554431] (req 29360128->33554431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532230.540196:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca58f0 lrc: 2/0,0 mode: PR/PR res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [29360128->33554431] (req 29360128->33554431) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532230.540216:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca58f0 lrc: 2/0,0 mode: PR/PR res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [29360128->33554431] (req 29360128->33554431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532230.540234:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000016ae8a48 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438148:x1731754469079616:12345-10.240.43.64@tcp:3:dd.0 Request processed in 3102us (3132us total) trans 0 rc 4194304/4194304
00010000:00010000:0.0:1651532230.540236:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000060a6272d already unused, calling callback (0000000049fddea7)
00000100:00100000:1.0:1651532230.540238:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250765
00010000:00010000:0.0:1651532230.540238:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca58f0 lrc: 2/0,0 mode: PR/PR res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [29360128->33554431] (req 29360128->33554431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532230.540242:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca58f0 lrc: 3/0,0 mode: PR/PR res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [29360128->33554431] (req 29360128->33554431) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532230.540248:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca58f0 lrc: 1/0,0 mode: --/PR res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [29360128->33554431] (req 29360128->33554431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532230.540251:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca58f0 lrc: 0/0,0 mode: --/PR res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [29360128->33554431] (req 29360128->33554431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532230.542495:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532230.542503:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469080000
00000100:00100000:1.0:1651532230.542520:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250766
00000100:00100000:1.0:1651532230.542522:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005e25f721 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438149:x1731754469080000:12345-10.240.43.64@tcp:4:dd.0
00002000:00010000:1.0:1651532230.542532:0:216321:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x3454c:0x0] initial LVB size: 29360128, mtime: 0x627061c6, atime: 0x0, ctime: 0x627061c6, blocks: 0xe000
00010000:00010000:1.0:1651532230.542535:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca58f7 lrc: 3/0,1 mode: --/PW res: [0x3454c:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532230.542543:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532230.542543:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532230.542544:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca58f7 lrc: 3/0,1 mode: PW/PW res: [0x3454c:0x0:0x0].0x0 rrc: 2 type: EXT [29360128->33554431] (req 29360128->33554431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532230.542548:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca58f7 lrc: 3/0,1 mode: PW/PW res: [0x3454c:0x0:0x0].0x0 rrc: 2 type: EXT [29360128->33554431] (req 29360128->33554431) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532230.840260:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869600 is committed
00002000:00010000:1.0:1651532230.840314:0:216321:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x3454c:0x0] updating lvb size from disk: 29360128 -> 33554432
00002000:00010000:1.0:1651532230.840316:0:216321:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x3454c:0x0] updating lvb blocks from disk: 57344 -> 65536
00010000:00010000:1.0:1651532230.840322:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca58f7 lrc: 3/0,1 mode: PW/PW res: [0x3454c:0x0:0x0].0x0 rrc: 2 type: EXT [29360128->33554431] (req 29360128->33554431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532230.840327:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca58f7 lrc: 2/0,0 mode: PW/PW res: [0x3454c:0x0:0x0].0x0 rrc: 2 type: EXT [29360128->33554431] (req 29360128->33554431) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532230.840352:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005e25f721 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438149:x1731754469080000:12345-10.240.43.64@tcp:4:dd.0 Request processed in 297829us (297857us total) trans 21474869600 rc 0/0
00000100:00100000:1.0:1651532230.840356:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250766
00010000:00010000:1.0:1651532230.840365:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca58f7 lrc: 2/0,0 mode: PW/PW res: [0x3454c:0x0:0x0].0x0 rrc: 2 type: EXT [29360128->33554431] (req 29360128->33554431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532230.840368:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000022b2104e already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651532230.840370:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca58f7 lrc: 2/0,0 mode: PW/PW res: [0x3454c:0x0:0x0].0x0 rrc: 2 type: EXT [29360128->33554431] (req 29360128->33554431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532230.840373:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca58f7 lrc: 3/0,0 mode: PW/PW res: [0x3454c:0x0:0x0].0x0 rrc: 2 type: EXT [29360128->33554431] (req 29360128->33554431) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532230.840380:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca58f7 lrc: 1/0,0 mode: --/PW res: [0x3454c:0x0:0x0].0x0 rrc: 2 type: EXT [29360128->33554431] (req 29360128->33554431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532230.840383:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca58f7 lrc: 0/0,0 mode: --/PW res: [0x3454c:0x0:0x0].0x0 rrc: 2 type: EXT [29360128->33554431] (req 29360128->33554431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532230.847622:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532230.847647:0:166112:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469080512
00000100:00100000:0.0:1651532230.847662:0:166112:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44962
00000100:00100000:0.0:1651532230.847664:0:166112:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000032d0cd6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438149:x1731754469080512:12345-10.240.43.64@tcp:101:diff.0
00010000:00010000:0.0:1651532230.847669:0:166112:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532230.847675:0:166112:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca58fe lrc: 2/0,0 mode: --/PR res: [0x3454c:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44fda0 expref: -99 pid: 166112 timeout: 0 lvb_type: 0
00002000:00010000:0.0:1651532230.847682:0:166112:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x3454c:0x0] initial LVB size: 33554432, mtime: 0x627061c6, atime: 0x0, ctime: 0x627061c6, blocks: 0x10000
00010000:00010000:0.0:1651532230.847688:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532230.847689:0:166112:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532230.847692:0:166112:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca58fe lrc: 3/0,0 mode: PR/PR res: [0x3454c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fda0 expref: 8 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532230.847702:0:166112:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca58fe lrc: 3/0,0 mode: PR/PR res: [0x3454c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fda0 expref: 8 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532230.847707:0:166112:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fab23815, rc 0)
00000100:00100000:0.0:1651532230.847726:0:166112:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000032d0cd6a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754469080512:12345-10.240.43.64@tcp:101:diff.0 Request processed in 61us (104us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532230.847729:0:166112:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44962
00000100:00100000:1.0:1651532230.850176:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532230.850185:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469080960
00002000:00100000:1.0:1651532230.850195:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x3454b:0x0] (0->2097151)  req@000000007a31f638 x1731754469080960/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:730/0 lens 488/0 e 0 to 0 dl 1651532275 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00002000:00100000:1.0:1651532230.850200:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000007a31f638 with x1731754469080960 ext(0->2097151)
00002000:00010000:1.0:1651532230.850202:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000007a31f638
00000100:00100000:1.0:1651532230.850213:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250767
00000100:00100000:1.0:1651532230.850215:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007a31f638 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754469080960:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:1.0:1651532230.851884:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007a31f638 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754469080960:12345-10.240.43.64@tcp:3:diff.0 Request processed in 1667us (1707us total) trans 0 rc 2097152/2097152
00000100:00100000:1.0:1651532230.851888:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250767
00002000:00100000:1.0:1651532230.851891:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x3454b:0x0] (0->2097151)  req@000000007a31f638 x1731754469080960/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:730/0 lens 488/440 e 0 to 0 dl 1651532275 ref 1 fl Complete:/0/0 rc 2097152/2097152 job:'diff.0'
00002000:00100000:1.0:1651532230.851895:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000007a31f638 with x1731754469080960 ext(0->2097151)
00002000:00010000:1.0:1651532230.851897:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000007a31f638
00000100:00100000:1.0:1651532230.857059:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532230.857068:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469081152
00002000:00100000:1.0:1651532230.857077:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x3454c:0x0] (0->2097151)  req@00000000fd911c68 x1731754469081152/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:730/0 lens 488/0 e 0 to 0 dl 1651532275 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00002000:00100000:1.0:1651532230.857081:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000fd911c68 with x1731754469081152 ext(0->2097151)
00002000:00010000:1.0:1651532230.857082:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000fd911c68
00000100:00100000:1.0:1651532230.857093:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250768
00000100:00100000:1.0:1651532230.857094:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fd911c68 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754469081152:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:1.0:1651532230.858639:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fd911c68 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754469081152:12345-10.240.43.64@tcp:3:diff.0 Request processed in 1543us (1579us total) trans 0 rc 2097152/2097152
00000100:00100000:1.0:1651532230.858643:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250768
00002000:00100000:1.0:1651532230.858646:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x3454c:0x0] (0->2097151)  req@00000000fd911c68 x1731754469081152/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:730/0 lens 488/440 e 0 to 0 dl 1651532275 ref 1 fl Complete:/0/0 rc 2097152/2097152 job:'diff.0'
00002000:00100000:1.0:1651532230.858650:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000fd911c68 with x1731754469081152 ext(0->2097151)
00002000:00010000:1.0:1651532230.858651:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000fd911c68
00000100:00100000:1.0:1651532230.864272:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532230.864280:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469081472
00002000:00100000:1.0:1651532230.864287:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x3454b:0x0] (2097152->4194303)  req@0000000040d48dfa x1731754469081472/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:730/0 lens 488/0 e 0 to 0 dl 1651532275 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00002000:00100000:1.0:1651532230.864291:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000040d48dfa with x1731754469081472 ext(2097152->4194303)
00002000:00010000:1.0:1651532230.864292:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000040d48dfa
00000100:00100000:1.0:1651532230.864302:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250769
00000100:00100000:1.0:1651532230.864304:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000040d48dfa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754469081472:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:1.0:1651532230.865802:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000040d48dfa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754469081472:12345-10.240.43.64@tcp:3:diff.0 Request processed in 1497us (1530us total) trans 0 rc 2097152/2097152
00000100:00100000:1.0:1651532230.865806:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250769
00002000:00100000:1.0:1651532230.865810:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x3454b:0x0] (2097152->4194303)  req@0000000040d48dfa x1731754469081472/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:730/0 lens 488/440 e 0 to 0 dl 1651532275 ref 1 fl Complete:/0/0 rc 2097152/2097152 job:'diff.0'
00002000:00100000:1.0:1651532230.865814:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000040d48dfa with x1731754469081472 ext(2097152->4194303)
00002000:00010000:1.0:1651532230.865815:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000040d48dfa
00000100:00100000:1.0:1651532230.869416:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532230.869424:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469081664
00002000:00100000:1.0:1651532230.869432:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x3454c:0x0] (2097152->4194303)  req@00000000539246fb x1731754469081664/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:730/0 lens 488/0 e 0 to 0 dl 1651532275 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00002000:00100000:1.0:1651532230.869435:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000539246fb with x1731754469081664 ext(2097152->4194303)
00002000:00010000:1.0:1651532230.869436:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000539246fb
00000100:00100000:1.0:1651532230.869448:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250770
00000100:00100000:1.0:1651532230.869449:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000539246fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754469081664:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:1.0:1651532230.870889:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000539246fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754469081664:12345-10.240.43.64@tcp:3:diff.0 Request processed in 1439us (1473us total) trans 0 rc 2097152/2097152
00000100:00100000:1.0:1651532230.870893:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250770
00002000:00100000:1.0:1651532230.870896:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x3454c:0x0] (2097152->4194303)  req@00000000539246fb x1731754469081664/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:730/0 lens 488/440 e 0 to 0 dl 1651532275 ref 1 fl Complete:/0/0 rc 2097152/2097152 job:'diff.0'
00002000:00100000:1.0:1651532230.870900:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000539246fb with x1731754469081664 ext(2097152->4194303)
00002000:00010000:1.0:1651532230.870901:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000539246fb
00000100:00100000:1.0:1651532230.876799:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532230.876807:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469081984
00002000:00100000:1.0:1651532230.876814:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x3454b:0x0] (4194304->8388607)  req@00000000cc04fc7a x1731754469081984/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:730/0 lens 488/0 e 0 to 0 dl 1651532275 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00002000:00100000:1.0:1651532230.876817:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000cc04fc7a with x1731754469081984 ext(4194304->8388607)
00002000:00010000:1.0:1651532230.876820:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000cc04fc7a
00000100:00100000:1.0:1651532230.876830:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250771
00000100:00100000:1.0:1651532230.876832:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cc04fc7a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754469081984:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:1.0:1651532230.879585:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cc04fc7a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754469081984:12345-10.240.43.64@tcp:3:diff.0 Request processed in 2751us (2785us total) trans 0 rc 4194304/4194304
00000100:00100000:1.0:1651532230.879589:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250771
00002000:00100000:1.0:1651532230.879592:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x3454b:0x0] (4194304->8388607)  req@00000000cc04fc7a x1731754469081984/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:730/0 lens 488/440 e 0 to 0 dl 1651532275 ref 1 fl Complete:/0/0 rc 4194304/4194304 job:'diff.0'
00002000:00100000:1.0:1651532230.879596:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000cc04fc7a with x1731754469081984 ext(4194304->8388607)
00002000:00010000:1.0:1651532230.879598:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000cc04fc7a
00000100:00100000:1.0:1651532230.885263:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532230.885271:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469082176
00002000:00100000:1.0:1651532230.885278:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x3454c:0x0] (4194304->8388607)  req@000000003eacb3fe x1731754469082176/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:730/0 lens 488/0 e 0 to 0 dl 1651532275 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00002000:00100000:1.0:1651532230.885282:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000003eacb3fe with x1731754469082176 ext(4194304->8388607)
00002000:00010000:1.0:1651532230.885283:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000003eacb3fe
00000100:00100000:1.0:1651532230.885294:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250772
00000100:00100000:1.0:1651532230.885295:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003eacb3fe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754469082176:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:1.0:1651532230.888091:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003eacb3fe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754469082176:12345-10.240.43.64@tcp:3:diff.0 Request processed in 2793us (2828us total) trans 0 rc 4194304/4194304
00000100:00100000:1.0:1651532230.888095:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250772
00002000:00100000:1.0:1651532230.888098:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x3454c:0x0] (4194304->8388607)  req@000000003eacb3fe x1731754469082176/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:730/0 lens 488/440 e 0 to 0 dl 1651532275 ref 1 fl Complete:/0/0 rc 4194304/4194304 job:'diff.0'
00002000:00100000:1.0:1651532230.888101:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000003eacb3fe with x1731754469082176 ext(4194304->8388607)
00002000:00010000:1.0:1651532230.888104:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000003eacb3fe
00000100:00100000:1.0:1651532230.900274:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532230.900293:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532230.900306:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469082688
00002000:00100000:1.0:1651532230.900314:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x3454b:0x0] (12582912->16777215)  req@000000005020f75d x1731754469082688/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:730/0 lens 488/0 e 0 to 0 dl 1651532275 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00000100:00100000:0.0:1651532230.900316:0:216322:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469082624
00002000:00100000:1.0:1651532230.900318:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000005020f75d with x1731754469082688 ext(12582912->16777215)
00002000:00010000:1.0:1651532230.900319:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000005020f75d
00000100:00100000:1.0:1651532230.900328:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250773
00000100:00100000:1.0:1651532230.900330:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005020f75d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438149:x1731754469082688:12345-10.240.43.64@tcp:3:diff.0
00002000:00100000:0.0:1651532230.900333:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x3454b:0x0] (8388608->12582911)  req@00000000c7a0caf7 x1731754469082624/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:730/0 lens 488/0 e 0 to 0 dl 1651532275 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00002000:00100000:0.0:1651532230.900338:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000c7a0caf7 with x1731754469082624 ext(8388608->12582911)
00002000:00010000:0.0:1651532230.900339:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000c7a0caf7
00000100:00100000:0.0:1651532230.900355:0:216322:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250774
00000100:00100000:0.0:1651532230.900358:0:216322:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c7a0caf7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438149:x1731754469082624:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:0.0:1651532230.903306:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005020f75d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754469082688:12345-10.240.43.64@tcp:3:diff.0 Request processed in 2974us (3032us total) trans 0 rc 4194304/4194304
00000100:00100000:0.0:1651532230.903310:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250773
00002000:00100000:0.0:1651532230.903314:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x3454b:0x0] (12582912->16777215)  req@000000005020f75d x1731754469082688/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:730/0 lens 488/440 e 0 to 0 dl 1651532275 ref 1 fl Complete:/0/0 rc 4194304/4194304 job:'diff.0'
00002000:00100000:0.0:1651532230.903319:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000005020f75d with x1731754469082688 ext(12582912->16777215)
00002000:00010000:0.0:1651532230.903321:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000005020f75d
00000100:00100000:0.0:1651532230.905317:0:216322:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c7a0caf7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754469082624:12345-10.240.43.64@tcp:3:diff.0 Request processed in 4958us (5024us total) trans 0 rc 4194304/4194304
00000100:00100000:0.0:1651532230.905324:0:216322:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250774
00002000:00100000:0.0:1651532230.905327:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x3454b:0x0] (8388608->12582911)  req@00000000c7a0caf7 x1731754469082624/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:730/0 lens 488/440 e 0 to 0 dl 1651532275 ref 1 fl Complete:/0/0 rc 4194304/4194304 job:'diff.0'
00002000:00100000:0.0:1651532230.905331:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000c7a0caf7 with x1731754469082624 ext(8388608->12582911)
00002000:00010000:0.0:1651532230.905332:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000c7a0caf7
00000100:00100000:1.0:1651532230.914460:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532230.914484:0:216322:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469082944
00002000:00100000:0.0:1651532230.914494:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x3454c:0x0] (8388608->12582911)  req@000000004afa659b x1731754469082944/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:730/0 lens 488/0 e 0 to 0 dl 1651532275 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00002000:00100000:0.0:1651532230.914498:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000004afa659b with x1731754469082944 ext(8388608->12582911)
00002000:00010000:0.0:1651532230.914499:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000004afa659b
00000100:00100000:0.0:1651532230.914505:0:216322:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250775
00000100:00100000:0.0:1651532230.914507:0:216322:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004afa659b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754469082944:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:1.0:1651532230.914680:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532230.914700:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469083008
00002000:00100000:0.0:1651532230.914707:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x3454c:0x0] (12582912->16777215)  req@000000009a4c1120 x1731754469083008/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:730/0 lens 488/0 e 0 to 0 dl 1651532275 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00002000:00100000:0.0:1651532230.914710:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000009a4c1120 with x1731754469083008 ext(12582912->16777215)
00002000:00010000:0.0:1651532230.914712:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000009a4c1120
00000100:00100000:0.0:1651532230.914717:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250776
00000100:00100000:0.0:1651532230.914719:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a4c1120 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754469083008:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:0.0:1651532230.917537:0:216322:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004afa659b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754469082944:12345-10.240.43.64@tcp:3:diff.0 Request processed in 3028us (3077us total) trans 0 rc 4194304/4194304
00000100:00100000:0.0:1651532230.917541:0:216322:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250775
00002000:00100000:0.0:1651532230.917545:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x3454c:0x0] (8388608->12582911)  req@000000004afa659b x1731754469082944/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:730/0 lens 488/440 e 0 to 0 dl 1651532275 ref 1 fl Complete:/0/0 rc 4194304/4194304 job:'diff.0'
00002000:00100000:0.0:1651532230.917550:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000004afa659b with x1731754469082944 ext(8388608->12582911)
00002000:00010000:0.0:1651532230.917552:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000004afa659b
00000100:00100000:0.0:1651532230.919356:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a4c1120 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754469083008:12345-10.240.43.64@tcp:3:diff.0 Request processed in 4636us (4676us total) trans 0 rc 4194304/4194304
00000100:00100000:0.0:1651532230.919360:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250776
00002000:00100000:0.0:1651532230.919362:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x3454c:0x0] (12582912->16777215)  req@000000009a4c1120 x1731754469083008/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:730/0 lens 488/440 e 0 to 0 dl 1651532275 ref 1 fl Complete:/0/0 rc 4194304/4194304 job:'diff.0'
00002000:00100000:0.0:1651532230.919366:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000009a4c1120 with x1731754469083008 ext(12582912->16777215)
00002000:00010000:0.0:1651532230.919367:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000009a4c1120
00000100:00100000:0.0:1651532230.939423:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532230.939431:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532230.939439:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469083712
00002000:00100000:0.0:1651532230.939447:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x3454b:0x0] (20971520->25165823)  req@000000004d72f458 x1731754469083712/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:730/0 lens 488/0 e 0 to 0 dl 1651532275 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00002000:00100000:0.0:1651532230.939451:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000004d72f458 with x1731754469083712 ext(20971520->25165823)
00002000:00010000:0.0:1651532230.939452:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000004d72f458
00000100:00100000:0.0:1651532230.939457:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469083648
00002000:00100000:0.0:1651532230.939460:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x3454b:0x0] (16777216->20971519)  req@00000000bfdd313b x1731754469083648/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:730/0 lens 488/0 e 0 to 0 dl 1651532275 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00002000:00100000:0.0:1651532230.939463:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000bfdd313b with x1731754469083648 ext(16777216->20971519)
00002000:00010000:0.0:1651532230.939464:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000bfdd313b
00000100:00100000:0.0:1651532230.939468:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250777
00000100:00100000:0.0:1651532230.939470:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004d72f458 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438146:x1731754469083712:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:0.0:1651532230.939665:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250778
00000100:00100000:0.0:1651532230.939667:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bfdd313b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438146:x1731754469083648:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:1.0:1651532230.942803:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004d72f458 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438146:x1731754469083712:12345-10.240.43.64@tcp:3:diff.0 Request processed in 3330us (3378us total) trans 0 rc 4194304/4194304
00000100:00100000:1.0:1651532230.942808:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250777
00002000:00100000:1.0:1651532230.942812:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x3454b:0x0] (20971520->25165823)  req@000000004d72f458 x1731754469083712/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:730/0 lens 488/440 e 0 to 0 dl 1651532275 ref 1 fl Complete:/0/0 rc 4194304/4194304 job:'diff.0'
00002000:00100000:1.0:1651532230.942816:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000004d72f458 with x1731754469083712 ext(20971520->25165823)
00002000:00010000:1.0:1651532230.942819:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000004d72f458
00000100:00100000:1.0:1651532230.944787:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532230.944796:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532230.944816:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469083968
00002000:00100000:1.0:1651532230.944826:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x3454c:0x0] (16777216->20971519)  req@0000000046a4b637 x1731754469083968/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:730/0 lens 488/0 e 0 to 0 dl 1651532275 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00002000:00100000:1.0:1651532230.944830:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000046a4b637 with x1731754469083968 ext(16777216->20971519)
00002000:00010000:1.0:1651532230.944832:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000046a4b637
00000100:00100000:1.0:1651532230.944841:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469084032
00002000:00100000:1.0:1651532230.944844:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x3454c:0x0] (20971520->25165823)  req@000000006f04ca27 x1731754469084032/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:730/0 lens 488/0 e 0 to 0 dl 1651532275 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00002000:00100000:1.0:1651532230.944848:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000006f04ca27 with x1731754469084032 ext(20971520->25165823)
00002000:00010000:1.0:1651532230.944849:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000006f04ca27
00000100:00100000:1.0:1651532230.944855:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250779
00000100:00100000:1.0:1651532230.944857:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000046a4b637 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438146:x1731754469083968:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:0.0:1651532230.944867:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bfdd313b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438146:x1731754469083648:12345-10.240.43.64@tcp:3:diff.0 Request processed in 5198us (5434us total) trans 0 rc 4194304/4194304
00000100:00100000:0.0:1651532230.944870:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250778
00002000:00100000:0.0:1651532230.944873:0:216323:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x100010000:0x3454b:0x0] (16777216->20971519)  req@00000000bfdd313b x1731754469083648/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:730/0 lens 488/440 e 0 to 0 dl 1651532275 ref 1 fl Complete:/0/0 rc 4194304/4194304 job:'diff.0'
00002000:00100000:0.0:1651532230.944877:0:216323:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000bfdd313b with x1731754469083648 ext(16777216->20971519)
00002000:00010000:0.0:1651532230.944878:0:216323:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000bfdd313b
00000100:00100000:0.0:1651532230.944884:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250780
00000100:00100000:0.0:1651532230.944886:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006f04ca27 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438146:x1731754469084032:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:1.0:1651532230.947596:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000046a4b637 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438146:x1731754469083968:12345-10.240.43.64@tcp:3:diff.0 Request processed in 2737us (2809us total) trans 0 rc 4194304/4194304
00000100:00100000:1.0:1651532230.947601:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250779
00002000:00100000:1.0:1651532230.947605:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x3454c:0x0] (16777216->20971519)  req@0000000046a4b637 x1731754469083968/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:730/0 lens 488/440 e 0 to 0 dl 1651532275 ref 1 fl Complete:/0/0 rc 4194304/4194304 job:'diff.0'
00002000:00100000:1.0:1651532230.947609:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000046a4b637 with x1731754469083968 ext(16777216->20971519)
00002000:00010000:1.0:1651532230.947611:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000046a4b637
00000100:00100000:0.0:1651532230.949814:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006f04ca27 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754469084032:12345-10.240.43.64@tcp:3:diff.0 Request processed in 4926us (5017us total) trans 0 rc 4194304/4194304
00000100:00100000:0.0:1651532230.949817:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250780
00002000:00100000:0.0:1651532230.949820:0:216323:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x100010000:0x3454c:0x0] (20971520->25165823)  req@000000006f04ca27 x1731754469084032/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:730/0 lens 488/440 e 0 to 0 dl 1651532275 ref 1 fl Complete:/0/0 rc 4194304/4194304 job:'diff.0'
00002000:00100000:0.0:1651532230.949824:0:216323:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000006f04ca27 with x1731754469084032 ext(20971520->25165823)
00002000:00010000:0.0:1651532230.949826:0:216323:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000006f04ca27
00000100:00100000:1.0:1651532230.970437:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532230.970451:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532230.970459:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469084736
00000100:00100000:0.0:1651532230.970460:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469084672
00002000:00100000:1.0:1651532230.970468:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x3454b:0x0] (29360128->33554431)  req@000000002c8e3ff9 x1731754469084736/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:730/0 lens 488/0 e 0 to 0 dl 1651532275 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00002000:00100000:0.0:1651532230.970468:0:216323:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x100010000:0x3454b:0x0] (25165824->29360127)  req@00000000745d3e59 x1731754469084672/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:730/0 lens 488/0 e 0 to 0 dl 1651532275 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00002000:00100000:1.0:1651532230.970472:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000002c8e3ff9 with x1731754469084736 ext(29360128->33554431)
00002000:00100000:0.0:1651532230.970472:0:216323:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000745d3e59 with x1731754469084672 ext(25165824->29360127)
00002000:00010000:1.0:1651532230.970473:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000002c8e3ff9
00002000:00010000:0.0:1651532230.970473:0:216323:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000745d3e59
00000100:00100000:1.0:1651532230.970482:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250781
00000100:00100000:1.0:1651532230.970484:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002c8e3ff9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438149:x1731754469084736:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:0.0:1651532230.970490:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250782
00000100:00100000:0.0:1651532230.970492:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000745d3e59 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438149:x1731754469084672:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:0.0:1651532230.973702:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532230.973716:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532230.973729:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469084992
00000100:00100000:0.0:1651532230.973735:0:216322:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469085056
00002000:00100000:1.0:1651532230.973739:0:192755:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x100010000:0x3454c:0x0] (25165824->29360127)  req@00000000f817afea x1731754469084992/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:730/0 lens 488/0 e 0 to 0 dl 1651532275 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00002000:00100000:0.0:1651532230.973744:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x3454c:0x0] (29360128->33554431)  req@00000000b462545d x1731754469085056/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:730/0 lens 488/0 e 0 to 0 dl 1651532275 ref 1 fl New:/0/ffffffff rc 0/-1 job:'diff.0'
00002000:00100000:0.0:1651532230.973748:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000b462545d with x1731754469085056 ext(29360128->33554431)
00002000:00010000:0.0:1651532230.973750:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000b462545d
00000100:00100000:0.0:1651532230.973756:0:216322:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250783
00000100:00100000:0.0:1651532230.973758:0:216322:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b462545d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754469085056:12345-10.240.43.64@tcp:3:diff.0
00002000:00100000:1.0:1651532230.973766:0:192755:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000f817afea with x1731754469084992 ext(25165824->29360127)
00002000:00010000:1.0:1651532230.973767:0:192755:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000f817afea
00000100:00100000:1.0:1651532230.973776:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250784
00000100:00100000:1.0:1651532230.973778:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f817afea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754469084992:12345-10.240.43.64@tcp:3:diff.0
00000100:00100000:1.0:1651532230.976456:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002c8e3ff9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754469084736:12345-10.240.43.64@tcp:3:diff.0 Request processed in 5970us (6018us total) trans 0 rc 4194304/4194304
00000100:00100000:1.0:1651532230.976468:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250781
00002000:00100000:1.0:1651532230.976472:0:216321:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x3454b:0x0] (29360128->33554431)  req@000000002c8e3ff9 x1731754469084736/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:730/0 lens 488/440 e 0 to 0 dl 1651532275 ref 1 fl Complete:/0/0 rc 4194304/4194304 job:'diff.0'
00002000:00100000:1.0:1651532230.976476:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000002c8e3ff9 with x1731754469084736 ext(29360128->33554431)
00002000:00010000:1.0:1651532230.976477:0:216321:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000002c8e3ff9
00000100:00100000:0.0:1651532230.977850:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000745d3e59 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438149:x1731754469084672:12345-10.240.43.64@tcp:3:diff.0 Request processed in 7357us (7399us total) trans 0 rc 4194304/4194304
00000100:00100000:0.0:1651532230.977855:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250782
00002000:00100000:0.0:1651532230.977857:0:216323:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x100010000:0x3454b:0x0] (25165824->29360127)  req@00000000745d3e59 x1731754469084672/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:730/0 lens 488/440 e 0 to 0 dl 1651532275 ref 1 fl Complete:/0/0 rc 4194304/4194304 job:'diff.0'
00002000:00100000:0.0:1651532230.977861:0:216323:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000745d3e59 with x1731754469084672 ext(25165824->29360127)
00002000:00010000:0.0:1651532230.977863:0:216323:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000745d3e59
00000100:00100000:0.0:1651532230.981026:0:216322:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b462545d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438146:x1731754469085056:12345-10.240.43.64@tcp:3:diff.0 Request processed in 7267us (7309us total) trans 0 rc 4194304/4194304
00000100:00100000:0.0:1651532230.981030:0:216322:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250783
00002000:00100000:0.0:1651532230.981033:0:216322:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x100010000:0x3454c:0x0] (29360128->33554431)  req@00000000b462545d x1731754469085056/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:730/0 lens 488/440 e 0 to 0 dl 1651532275 ref 1 fl Complete:/0/0 rc 4194304/4194304 job:'diff.0'
00002000:00100000:0.0:1651532230.981037:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000b462545d with x1731754469085056 ext(29360128->33554431)
00002000:00010000:0.0:1651532230.981040:0:216322:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000b462545d
00000100:00100000:1.0:1651532230.984710:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f817afea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754469084992:12345-10.240.43.64@tcp:3:diff.0 Request processed in 10931us (11008us total) trans 0 rc 4194304/4194304
00000100:00100000:1.0:1651532230.984715:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250784
00002000:00100000:1.0:1651532230.984718:0:192755:0:(ofd_dev.c:2619:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x100010000:0x3454c:0x0] (25165824->29360127)  req@00000000f817afea x1731754469084992/t0(0) o3->0c703c47-a140-4387-a181-4e0a15e9b24e@10.240.43.64@tcp:730/0 lens 488/440 e 0 to 0 dl 1651532275 ref 1 fl Complete:/0/0 rc 4194304/4194304 job:'diff.0'
00002000:00100000:1.0:1651532230.984722:0:192755:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000f817afea with x1731754469084992 ext(25165824->29360127)
00002000:00010000:1.0:1651532230.984724:0:192755:0:(ofd_dev.c:2624:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000f817afea
00000400:00000080:1.0:1651532232.353100:0:233051:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648
00000001:02000400:1.0:1651532232.353102:0:233051:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 398i: verify parallel dio handles ll_direct_rw_pages errors correctly ========================================================== 22:57:12 (1651532232)
00000100:00100000:0.0:1651532232.385208:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532232.385249:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469087552
00000100:00100000:1.0:1651532232.385274:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44963
00000100:00100000:1.0:1651532232.385277:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001797bd5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+8:685226:x1731754469087552:12345-10.240.43.64@tcp:101:dd.0
00010000:00010000:1.0:1651532232.385287:0:167632:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532232.385315:0:167632:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca5905 lrc: 2/0,0 mode: --/PW res: [0x3454d:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44fdf4 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651532232.385327:0:167632:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x3454d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:1.0:1651532232.385337:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532232.385338:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532232.385342:0:167632:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca5905 lrc: 3/0,0 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fdf4 expref: 9 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532232.385350:0:167632:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca5905 lrc: 3/0,0 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fdf4 expref: 9 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532232.385356:0:167632:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000022b2104e, rc 0)
00000100:00100000:1.0:1651532232.385380:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001797bd5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+9:685226:x1731754469087552:12345-10.240.43.64@tcp:101:dd.0 Request processed in 103us (174us total) trans 0 rc 0/0
00000100:00100000:1.0:1651532232.385384:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44963
00000100:00100000:0.0:1651532232.385657:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532232.385680:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469087680
00002000:00010000:1.0:1651532232.385689:0:192755:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 214349/0 (0->18446744073709551615)
00002000:00100000:1.0:1651532232.385690:0:192755:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000de3fc5c8 with x1731754469087680 ext(0->18446744073709551615)
00002000:00010000:1.0:1651532232.385694:0:192755:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000de3fc5c8.
00000100:00100000:1.0:1651532232.385707:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250785
00000100:00100000:1.0:1651532232.385709:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000de3fc5c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438149:x1731754469087680:12345-10.240.43.64@tcp:10:dd.0
00002000:00010000:1.0:1651532232.385773:0:192755:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x3454d:0x0] updating lvb size from disk: 0 -> 0
00002000:00010000:1.0:1651532232.385775:0:192755:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x3454d:0x0] updating lvb mtime from disk: 0 -> 1651532232
00002000:00010000:1.0:1651532232.385776:0:192755:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x3454d:0x0] updating lvb atime from disk: 0 -> 0
00002000:00010000:1.0:1651532232.385776:0:192755:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x3454d:0x0] updating lvb ctime from disk: 0 -> 1651532232
00002000:00010000:1.0:1651532232.385777:0:192755:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x3454d:0x0] updating lvb blocks from disk: 0 -> 0
00000100:00100000:1.0:1651532232.385790:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000de3fc5c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754469087680:12345-10.240.43.64@tcp:10:dd.0 Request processed in 80us (134us total) trans 21474869601 rc 0/0
00000100:00100000:1.0:1651532232.385793:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250785
00002000:00010000:1.0:1651532232.385795:0:192755:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 214349/0 (0->18446744073709551615)
00002000:00100000:1.0:1651532232.385796:0:192755:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000de3fc5c8 with x1731754469087680 ext(0->18446744073709551615)
00002000:00010000:1.0:1651532232.385797:0:192755:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000de3fc5c8.
00000100:00100000:0.0:1651532232.423107:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532232.423129:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469088000
00000100:00100000:1.0:1651532232.423145:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250786
00000100:00100000:1.0:1651532232.423147:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000091075bf7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754469088000:12345-10.240.43.64@tcp:4:dd.0
00010000:00010000:1.0:1651532232.423156:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca590c lrc: 3/0,1 mode: --/PW res: [0x3454d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532232.423162:0:192755:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca5905 lrc: 2/0,0 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fdf4 expref: 10 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532232.423165:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532232.423166:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532232.423167:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca590c lrc: 4/0,1 mode: --/PW res: [0x3454d:0x0:0x0].0x0 rrc: 3 type: EXT [0->3145727] (req 0->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532232.423179:0:192755:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca5905 lrc: 3/0,0 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fdf4 expref: 10 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532232.423188:0:192755:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca5905 lrc: 4/0,0 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fdf4 expref: 10 pid: 167632 timeout: 23041 lvb_type: 0
00000100:00100000:1.0:1651532232.423194:0:192755:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a003ea14 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0001_UUID:192755:1731745997364032:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651532232.423213:0:192755:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ac137653 going to sleep for 6 seconds
00000100:00100000:0.0:1651532232.423363:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532232.423372:0:216322:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469088192
00000100:00100000:0.0:1651532232.423386:0:216322:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250787
00000100:00100000:0.0:1651532232.423388:0:216322:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009ac545f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754469088192:12345-10.240.43.64@tcp:4:dd.0
00010000:00010000:0.0:1651532232.423409:0:216322:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca5913 lrc: 3/0,1 mode: --/PW res: [0x3454d:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532232.423415:0:216322:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532232.423416:0:216322:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532232.423417:0:216322:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca5913 lrc: 3/0,1 mode: --/PW res: [0x3454d:0x0:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532232.423421:0:216322:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca5913 lrc: 3/0,1 mode: --/PW res: [0x3454d:0x0:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532232.423599:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532232.423616:0:192755:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a003ea14 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0001_UUID:192755:1731745997364032:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651532232.423617:0:166103:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469088320
00010000:00010000:1.0:1651532232.423622:0:192755:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca590c lrc: 3/0,1 mode: --/PW res: [0x3454d:0x0:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 0->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532232.423625:0:166103:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca5905 lrc: 4/0,0 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fdf4 expref: 12 pid: 167632 timeout: 23041 lvb_type: 0
00000100:00100000:0.0:1651532232.423634:0:166103:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 317
00000100:00100000:0.0:1651532232.423636:0:166103:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007a31f638 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754469088320:12345-10.240.43.64@tcp:103:ldlm_bl_05.0
00010000:00010000:0.0:1651532232.423640:0:166103:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651532232.423646:0:166103:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca5905 lrc: 4/0,0 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fdf4 expref: 12 pid: 167632 timeout: 23041 lvb_type: 0
00010000:00010000:0.0:1651532232.423655:0:166103:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca5905 lrc: 3/0,0 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fdf4 expref: 12 pid: 167632 timeout: 23041 lvb_type: 0
00010000:00010000:0.0:1651532232.423663:0:166103:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca5905 lrc: 0/0,0 mode: --/PW res: [0x3454d:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fdf4 expref: 12 pid: 167632 timeout: 23041 lvb_type: 0
00010000:00010000:0.0:1651532232.423666:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532232.423667:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532232.423668:0:166103:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca590c lrc: 3/0,1 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 0->3145727) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532232.423671:0:166103:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca590c lrc: 4/0,1 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 0->3145727) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532232.423674:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532232.423675:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532232.423675:0:166103:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca5913 lrc: 3/0,1 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532232.423678:0:166103:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca5913 lrc: 4/0,1 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532232.423692:0:166103:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651532232.423704:0:166103:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007a31f638 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438146:x1731754469088320:12345-10.240.43.64@tcp:103:ldlm_bl_05.0 Request processed in 67us (105us total) trans 0 rc 0/0
00010000:00010000:1.0:1651532232.423705:0:192755:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca590c lrc: 3/0,1 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 3 type: EXT [0->3145727] (req 0->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532232.423707:0:166103:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 317
00010000:00010000:1.0:1651532232.423708:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca590c lrc: 3/0,1 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 3 type: EXT [0->3145727] (req 0->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532232.423714:0:216322:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca5913 lrc: 3/0,1 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532232.423721:0:216322:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca5913 lrc: 3/0,1 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532232.780739:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869602 is committed
00002000:00010000:1.0:1651532232.780800:0:216322:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x3454d:0x0] updating lvb size from disk: 0 -> 4194304
00002000:00010000:1.0:1651532232.780802:0:216322:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x3454d:0x0] updating lvb blocks from disk: 0 -> 8192
00010000:00010000:1.0:1651532232.780807:0:216322:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca5913 lrc: 3/0,1 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532232.780813:0:216322:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca5913 lrc: 2/0,0 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532232.780864:0:216322:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009ac545f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438149:x1731754469088192:12345-10.240.43.64@tcp:4:dd.0 Request processed in 357463us (357490us total) trans 21474869602 rc 0/0
00000100:00100000:1.0:1651532232.780873:0:216322:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250787
00010000:00010000:1.0:1651532232.780886:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca5913 lrc: 2/0,0 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532232.780890:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e2ec18e1 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651532232.780892:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca5913 lrc: 2/0,0 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532232.780895:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca5913 lrc: 3/0,0 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532232.780904:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca5913 lrc: 1/0,0 mode: --/PW res: [0x3454d:0x0:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532232.780907:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca5913 lrc: 0/0,0 mode: --/PW res: [0x3454d:0x0:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532232.826796:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869603 is committed
00010000:00010000:1.0:1651532232.826853:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca590c lrc: 3/0,1 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 2 type: EXT [0->3145727] (req 0->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532232.826857:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca590c lrc: 2/0,0 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 2 type: EXT [0->3145727] (req 0->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532232.826880:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000091075bf7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754469088000:12345-10.240.43.64@tcp:4:dd.0 Request processed in 403732us (403774us total) trans 21474869603 rc 0/0
00000100:00100000:1.0:1651532232.826883:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250786
00010000:00010000:1.0:1651532232.826892:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca590c lrc: 2/0,0 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 2 type: EXT [0->3145727] (req 0->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532232.826898:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f6ecb7e5 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651532232.826899:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca590c lrc: 2/0,0 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 2 type: EXT [0->3145727] (req 0->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532232.826902:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca590c lrc: 3/0,0 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 2 type: EXT [0->3145727] (req 0->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532232.826907:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca590c lrc: 1/0,0 mode: --/PW res: [0x3454d:0x0:0x0].0x0 rrc: 2 type: EXT [0->3145727] (req 0->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532232.826910:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca590c lrc: 0/0,0 mode: --/PW res: [0x3454d:0x0:0x0].0x0 rrc: 2 type: EXT [0->3145727] (req 0->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532232.863001:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532232.863025:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469088640
00000100:00100000:1.0:1651532232.863044:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250788
00000100:00100000:1.0:1651532232.863046:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003b5b354a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754469088640:12345-10.240.43.64@tcp:4:dd.0
00002000:00010000:1.0:1651532232.863058:0:192755:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x3454d:0x0] initial LVB size: 4194304, mtime: 0x627061c8, atime: 0x0, ctime: 0x627061c8, blocks: 0x2000
00010000:00010000:1.0:1651532232.863061:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca591a lrc: 3/0,1 mode: --/PW res: [0x3454d:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532232.863066:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532232.863066:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532232.863068:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca591a lrc: 3/0,1 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532232.863073:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca591a lrc: 3/0,1 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532232.863907:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532232.864027:0:216322:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469088832
00000100:00100000:1.0:1651532232.864043:0:216322:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250789
00000100:00100000:1.0:1651532232.864045:0:216322:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b10bc064 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754469088832:12345-10.240.43.64@tcp:4:dd.0
00010000:00010000:1.0:1651532232.864053:0:216322:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca5921 lrc: 3/0,1 mode: --/PW res: [0x3454d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532232.864057:0:216322:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532232.864058:0:216322:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532232.864059:0:216322:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca5921 lrc: 3/0,1 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 3 type: EXT [5242880->8388607] (req 5242880->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532232.864063:0:216322:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca5921 lrc: 3/0,1 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 3 type: EXT [5242880->8388607] (req 5242880->8388607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532232.928220:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651532232.928259:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951237632
00000100:00100000:0.0:1651532232.928273:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 516
00000100:00100000:0.0:1651532232.928275:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a003ea14 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951237632:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:0.0:1651532232.928282:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 1073152 granted 255620544 pending 4292608 free 81216393216 avail 77041389568
00000100:00100000:0.0:1651532232.928300:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a003ea14 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951237632:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 25us (82us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532232.928303:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 516
00000001:00080000:0.0:1651532233.134996:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869604 is committed
00002000:00010000:1.0:1651532233.135049:0:192755:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x3454d:0x0] updating lvb size from disk: 4194304 -> 8388608
00002000:00010000:1.0:1651532233.135051:0:192755:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x3454d:0x0] updating lvb blocks from disk: 8192 -> 16384
00010000:00010000:1.0:1651532233.135056:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca591a lrc: 3/0,1 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532233.135061:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca591a lrc: 2/0,0 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532233.135086:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003b5b354a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754469088640:12345-10.240.43.64@tcp:4:dd.0 Request processed in 272039us (272086us total) trans 21474869604 rc 0/0
00000100:00100000:1.0:1651532233.135090:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250788
00010000:00010000:1.0:1651532233.135099:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca591a lrc: 2/0,0 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532233.135104:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f6ecb7e5 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651532233.135106:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca591a lrc: 2/0,0 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532233.135109:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca591a lrc: 3/0,0 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532233.135136:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca591a lrc: 1/0,0 mode: --/PW res: [0x3454d:0x0:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532233.135139:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca591a lrc: 0/0,0 mode: --/PW res: [0x3454d:0x0:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532233.220672:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869605 is committed
00010000:00010000:1.0:1651532233.220726:0:216322:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca5921 lrc: 3/0,1 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 2 type: EXT [5242880->8388607] (req 5242880->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532233.220730:0:216322:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca5921 lrc: 2/0,0 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 2 type: EXT [5242880->8388607] (req 5242880->8388607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532233.220756:0:216322:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b10bc064 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754469088832:12345-10.240.43.64@tcp:4:dd.0 Request processed in 356710us (356849us total) trans 21474869605 rc 0/0
00000100:00100000:1.0:1651532233.220760:0:216322:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250789
00010000:00010000:1.0:1651532233.220768:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca5921 lrc: 2/0,0 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 2 type: EXT [5242880->8388607] (req 5242880->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532233.220772:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f58aeba9 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651532233.220773:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca5921 lrc: 2/0,0 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 2 type: EXT [5242880->8388607] (req 5242880->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532233.220777:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca5921 lrc: 3/0,0 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 2 type: EXT [5242880->8388607] (req 5242880->8388607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532233.220782:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca5921 lrc: 1/0,0 mode: --/PW res: [0x3454d:0x0:0x0].0x0 rrc: 2 type: EXT [5242880->8388607] (req 5242880->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532233.220785:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca5921 lrc: 0/0,0 mode: --/PW res: [0x3454d:0x0:0x0].0x0 rrc: 2 type: EXT [5242880->8388607] (req 5242880->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532233.256989:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532233.256999:0:216322:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469089280
00000100:00100000:1.0:1651532233.257011:0:216322:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250790
00000100:00100000:1.0:1651532233.257014:0:216322:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fd911c68 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754469089280:12345-10.240.43.64@tcp:4:dd.0
00002000:00010000:1.0:1651532233.257024:0:216322:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x3454d:0x0] initial LVB size: 8388608, mtime: 0x627061c8, atime: 0x0, ctime: 0x627061c8, blocks: 0x4000
00010000:00010000:1.0:1651532233.257026:0:216322:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca5928 lrc: 3/0,1 mode: --/PW res: [0x3454d:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532233.257031:0:216322:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532233.257031:0:216322:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532233.257033:0:216322:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca5928 lrc: 3/0,1 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532233.257038:0:216322:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca5928 lrc: 3/0,1 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532233.258164:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532233.258174:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469089600
00000100:00100000:1.0:1651532233.258188:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250791
00000100:00100000:1.0:1651532233.258190:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000040d48dfa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438149:x1731754469089600:12345-10.240.43.64@tcp:4:dd.0
00010000:00010000:1.0:1651532233.258198:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca592f lrc: 3/0,1 mode: --/PW res: [0x3454d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532233.258202:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532233.258203:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532233.258204:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca592f lrc: 3/0,1 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 3 type: EXT [9437184->12582911] (req 9437184->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532233.258208:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca592f lrc: 3/0,1 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 3 type: EXT [9437184->12582911] (req 9437184->12582911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532233.620215:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869606 is committed
00002000:00010000:1.0:1651532233.620264:0:216322:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x3454d:0x0] updating lvb size from disk: 8388608 -> 12582912
00002000:00010000:1.0:1651532233.620267:0:216322:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x3454d:0x0] updating lvb mtime from disk: 1651532232 -> 1651532233
00002000:00010000:1.0:1651532233.620268:0:216322:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x3454d:0x0] updating lvb ctime from disk: 1651532232 -> 1651532233
00002000:00010000:1.0:1651532233.620269:0:216322:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x3454d:0x0] updating lvb blocks from disk: 16384 -> 24576
00010000:00010000:1.0:1651532233.620273:0:216322:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca5928 lrc: 3/0,1 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532233.620279:0:216322:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca5928 lrc: 2/0,0 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532233.620289:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca5928 lrc: 2/0,0 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532233.620296:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f58aeba9 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651532233.620298:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca5928 lrc: 2/0,0 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532233.620304:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca5928 lrc: 3/0,0 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532233.620305:0:216322:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fd911c68 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438149:x1731754469089280:12345-10.240.43.64@tcp:4:dd.0 Request processed in 363290us (363316us total) trans 21474869606 rc 0/0
00000100:00100000:1.0:1651532233.620310:0:216322:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250790
00010000:00010000:0.0:1651532233.620322:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca5928 lrc: 1/0,0 mode: --/PW res: [0x3454d:0x0:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532233.620328:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca5928 lrc: 0/0,0 mode: --/PW res: [0x3454d:0x0:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532233.663307:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869607 is committed
00010000:00010000:0.0:1651532233.663347:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca592f lrc: 3/0,1 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 2 type: EXT [9437184->12582911] (req 9437184->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532233.663351:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca592f lrc: 2/0,0 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 2 type: EXT [9437184->12582911] (req 9437184->12582911) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532233.663378:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca592f lrc: 2/0,0 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 2 type: EXT [9437184->12582911] (req 9437184->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532233.663379:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000040d48dfa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754469089600:12345-10.240.43.64@tcp:4:dd.0 Request processed in 405187us (405215us total) trans 21474869607 rc 0/0
00000100:00100000:0.0:1651532233.663383:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250791
00010000:00010000:1.0:1651532233.663405:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f6ecb7e5 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651532233.663406:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca592f lrc: 2/0,0 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 2 type: EXT [9437184->12582911] (req 9437184->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532233.663410:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca592f lrc: 3/0,0 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 2 type: EXT [9437184->12582911] (req 9437184->12582911) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532233.663416:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca592f lrc: 1/0,0 mode: --/PW res: [0x3454d:0x0:0x0].0x0 rrc: 2 type: EXT [9437184->12582911] (req 9437184->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532233.663418:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca592f lrc: 0/0,0 mode: --/PW res: [0x3454d:0x0:0x0].0x0 rrc: 2 type: EXT [9437184->12582911] (req 9437184->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532233.700035:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532233.700058:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469089984
00000100:00100000:0.0:1651532233.700078:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250792
00000100:00100000:0.0:1651532233.700080:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000539246fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754469089984:12345-10.240.43.64@tcp:4:dd.0
00002000:00010000:0.0:1651532233.700091:0:192755:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x3454d:0x0] initial LVB size: 12582912, mtime: 0x627061c9, atime: 0x0, ctime: 0x627061c9, blocks: 0x6000
00010000:00010000:0.0:1651532233.700094:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca5936 lrc: 3/0,1 mode: --/PW res: [0x3454d:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532233.700098:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532233.700099:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532233.700101:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca5936 lrc: 3/0,1 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 2 type: EXT [12582912->14680063] (req 12582912->14680063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532233.700116:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca5936 lrc: 3/0,1 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 2 type: EXT [12582912->14680063] (req 12582912->14680063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532233.701118:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532233.701247:0:216322:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469090368
00000100:00100000:1.0:1651532233.701262:0:216322:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250793
00000100:00100000:1.0:1651532233.701264:0:216322:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002ae2aeac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754469090368:12345-10.240.43.64@tcp:4:dd.0
00010000:00010000:1.0:1651532233.701272:0:216322:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca593d lrc: 3/0,1 mode: --/PW res: [0x3454d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532233.701277:0:216322:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532233.701278:0:216322:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532233.701279:0:216322:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca593d lrc: 3/0,1 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 3 type: EXT [14680064->16777215] (req 14680064->16777215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532233.701283:0:216322:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca593d lrc: 3/0,1 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 3 type: EXT [14680064->16777215] (req 14680064->16777215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532233.963133:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869608 is committed
00002000:00010000:1.0:1651532233.963201:0:192755:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x3454d:0x0] updating lvb size from disk: 12582912 -> 16777216
00002000:00010000:1.0:1651532233.963204:0:192755:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x3454d:0x0] updating lvb blocks from disk: 24576 -> 32768
00010000:00010000:1.0:1651532233.963209:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca5936 lrc: 3/0,1 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 3 type: EXT [12582912->14680063] (req 12582912->14680063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532233.963214:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca5936 lrc: 2/0,0 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 3 type: EXT [12582912->14680063] (req 12582912->14680063) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532233.963259:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca5936 lrc: 2/0,0 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 3 type: EXT [12582912->14680063] (req 12582912->14680063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532233.963261:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000539246fb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438149:x1731754469089984:12345-10.240.43.64@tcp:4:dd.0 Request processed in 263180us (263226us total) trans 21474869608 rc 0/0
00010000:00010000:0.0:1651532233.963265:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000080362f27 already unused, calling callback (0000000049fddea7)
00000100:00100000:1.0:1651532233.963266:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250792
00010000:00010000:0.0:1651532233.963266:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca5936 lrc: 2/0,0 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 3 type: EXT [12582912->14680063] (req 12582912->14680063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532233.963270:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca5936 lrc: 3/0,0 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 3 type: EXT [12582912->14680063] (req 12582912->14680063) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532233.963279:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca5936 lrc: 1/0,0 mode: --/PW res: [0x3454d:0x0:0x0].0x0 rrc: 3 type: EXT [12582912->14680063] (req 12582912->14680063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532233.963282:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca5936 lrc: 0/0,0 mode: --/PW res: [0x3454d:0x0:0x0].0x0 rrc: 3 type: EXT [12582912->14680063] (req 12582912->14680063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532234.027062:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869609 is committed
00010000:00010000:1.0:1651532234.027089:0:216322:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca593d lrc: 3/0,1 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 2 type: EXT [14680064->16777215] (req 14680064->16777215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532234.027093:0:216322:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca593d lrc: 2/0,0 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 2 type: EXT [14680064->16777215] (req 14680064->16777215) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532234.027117:0:216322:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002ae2aeac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754469090368:12345-10.240.43.64@tcp:4:dd.0 Request processed in 325852us (326000us total) trans 21474869609 rc 0/0
00000100:00100000:1.0:1651532234.027121:0:216322:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250793
00010000:00010000:1.0:1651532234.027129:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca593d lrc: 2/0,0 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 2 type: EXT [14680064->16777215] (req 14680064->16777215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532234.027132:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f6ecb7e5 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651532234.027135:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca593d lrc: 2/0,0 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 2 type: EXT [14680064->16777215] (req 14680064->16777215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532234.027138:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca593d lrc: 3/0,0 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 2 type: EXT [14680064->16777215] (req 14680064->16777215) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532234.027143:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca593d lrc: 1/0,0 mode: --/PW res: [0x3454d:0x0:0x0].0x0 rrc: 2 type: EXT [14680064->16777215] (req 14680064->16777215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532234.027146:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca593d lrc: 0/0,0 mode: --/PW res: [0x3454d:0x0:0x0].0x0 rrc: 2 type: EXT [14680064->16777215] (req 14680064->16777215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532234.062986:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532234.063009:0:216322:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469090688
00000100:00100000:1.0:1651532234.063025:0:216322:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250794
00000100:00100000:1.0:1651532234.063027:0:216322:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a20162bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754469090688:12345-10.240.43.64@tcp:4:dd.0
00002000:00010000:1.0:1651532234.063037:0:216322:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x3454d:0x0] initial LVB size: 16777216, mtime: 0x627061c9, atime: 0x0, ctime: 0x627061c9, blocks: 0x8000
00010000:00010000:1.0:1651532234.063039:0:216322:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5944 lrc: 3/0,1 mode: --/PW res: [0x3454d:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532234.063043:0:216322:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532234.063044:0:216322:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532234.063046:0:216322:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5944 lrc: 3/0,1 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532234.063050:0:216322:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5944 lrc: 3/0,1 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532234.064121:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532234.064136:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469091008
00000100:00100000:1.0:1651532234.064150:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250795
00000100:00100000:1.0:1651532234.064161:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000033696ffa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438149:x1731754469091008:12345-10.240.43.64@tcp:4:dd.0
00010000:00010000:1.0:1651532234.064169:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca594b lrc: 3/0,1 mode: --/PW res: [0x3454d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532234.064174:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532234.064174:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532234.064175:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca594b lrc: 3/0,1 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 3 type: EXT [17825792->20971519] (req 17825792->20971519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532234.064179:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca594b lrc: 3/0,1 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 3 type: EXT [17825792->20971519] (req 17825792->20971519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532234.306892:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869610 is committed
00002000:00010000:1.0:1651532234.306957:0:216322:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x3454d:0x0] updating lvb size from disk: 16777216 -> 20971520
00002000:00010000:1.0:1651532234.306960:0:216322:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x3454d:0x0] updating lvb mtime from disk: 1651532233 -> 1651532234
00002000:00010000:1.0:1651532234.306961:0:216322:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x3454d:0x0] updating lvb ctime from disk: 1651532233 -> 1651532234
00002000:00010000:1.0:1651532234.306963:0:216322:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x3454d:0x0] updating lvb blocks from disk: 32768 -> 40960
00010000:00010000:1.0:1651532234.306968:0:216322:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5944 lrc: 3/0,1 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532234.306975:0:216322:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5944 lrc: 2/0,0 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532234.307004:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5944 lrc: 2/0,0 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532234.307011:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f6ecb7e5 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651532234.307012:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5944 lrc: 2/0,0 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532234.307018:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5944 lrc: 3/0,0 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532234.307025:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5944 lrc: 1/0,0 mode: --/PW res: [0x3454d:0x0:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532234.307032:0:216322:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a20162bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438149:x1731754469090688:12345-10.240.43.64@tcp:4:dd.0 Request processed in 244003us (244047us total) trans 21474869610 rc 0/0
00010000:00010000:0.0:1651532234.307034:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca5944 lrc: 0/0,0 mode: --/PW res: [0x3454d:0x0:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532234.307037:0:216322:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250794
00000001:00080000:1.0:1651532234.345048:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869611 is committed
00010000:00010000:0.0:1651532234.345102:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca594b lrc: 3/0,1 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 2 type: EXT [17825792->20971519] (req 17825792->20971519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532234.345107:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca594b lrc: 2/0,0 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 2 type: EXT [17825792->20971519] (req 17825792->20971519) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532234.345129:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000033696ffa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754469091008:12345-10.240.43.64@tcp:4:dd.0 Request processed in 280967us (281008us total) trans 21474869611 rc 0/0
00000100:00100000:0.0:1651532234.345133:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250795
00010000:00010000:0.0:1651532234.345141:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca594b lrc: 2/0,0 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 2 type: EXT [17825792->20971519] (req 17825792->20971519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532234.345145:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008b0c325f already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651532234.345146:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca594b lrc: 2/0,0 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 2 type: EXT [17825792->20971519] (req 17825792->20971519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532234.345149:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca594b lrc: 3/0,0 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 2 type: EXT [17825792->20971519] (req 17825792->20971519) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532234.345159:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca594b lrc: 1/0,0 mode: --/PW res: [0x3454d:0x0:0x0].0x0 rrc: 2 type: EXT [17825792->20971519] (req 17825792->20971519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532234.345161:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca594b lrc: 0/0,0 mode: --/PW res: [0x3454d:0x0:0x0].0x0 rrc: 2 type: EXT [17825792->20971519] (req 17825792->20971519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532234.382017:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532234.382026:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469091392
00000100:00100000:0.0:1651532234.382046:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250796
00000100:00100000:0.0:1651532234.382049:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001f3a0807 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754469091392:12345-10.240.43.64@tcp:4:dd.0
00002000:00010000:0.0:1651532234.382060:0:192755:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x3454d:0x0] initial LVB size: 20971520, mtime: 0x627061ca, atime: 0x0, ctime: 0x627061ca, blocks: 0xa000
00010000:00010000:0.0:1651532234.382063:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca5952 lrc: 3/0,1 mode: --/PW res: [0x3454d:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532234.382067:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532234.382068:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532234.382070:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca5952 lrc: 3/0,1 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 2 type: EXT [20971520->25165823] (req 20971520->25165823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532234.382074:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca5952 lrc: 3/0,1 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 2 type: EXT [20971520->25165823] (req 20971520->25165823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532234.687292:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869612 is committed
00002000:00010000:0.0:1651532234.687366:0:192755:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x3454d:0x0] updating lvb size from disk: 20971520 -> 25165824
00002000:00010000:0.0:1651532234.687369:0:192755:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x3454d:0x0] updating lvb blocks from disk: 40960 -> 49152
00010000:00010000:0.0:1651532234.687374:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca5952 lrc: 3/0,1 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 2 type: EXT [20971520->25165823] (req 20971520->25165823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532234.687385:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca5952 lrc: 2/0,0 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 2 type: EXT [20971520->25165823] (req 20971520->25165823) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532234.687420:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca5952 lrc: 2/0,0 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 2 type: EXT [20971520->25165823] (req 20971520->25165823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532234.687426:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000080362f27 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651532234.687427:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca5952 lrc: 2/0,0 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 2 type: EXT [20971520->25165823] (req 20971520->25165823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532234.687429:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001f3a0807 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754469091392:12345-10.240.43.64@tcp:4:dd.0 Request processed in 305379us (305412us total) trans 21474869612 rc 0/0
00010000:00010000:1.0:1651532234.687431:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca5952 lrc: 3/0,0 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 2 type: EXT [20971520->25165823] (req 20971520->25165823) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532234.687433:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250796
00010000:00010000:1.0:1651532234.687440:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca5952 lrc: 1/0,0 mode: --/PW res: [0x3454d:0x0:0x0].0x0 rrc: 2 type: EXT [20971520->25165823] (req 20971520->25165823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532234.687442:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca5952 lrc: 0/0,0 mode: --/PW res: [0x3454d:0x0:0x0].0x0 rrc: 2 type: EXT [20971520->25165823] (req 20971520->25165823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532234.700200:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651532234.700242:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951237696
00000100:00100000:1.0:1651532234.700259:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 44964
00000100:00100000:1.0:1651532234.700261:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a899ddab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951237696:12345-10.240.43.61@tcp:6:osp-syn-1-0.0
00002000:00080000:1.0:1651532234.700272:0:167632:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:214347 count 1
00010000:00010000:1.0:1651532234.700279:0:167632:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca5959 lrc: 3/0,1 mode: --/PW res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532234.700286:0:167632:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca5887 lrc: 2/0,0 mode: PR/PR res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fd8b expref: 7 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532234.700290:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532234.700291:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532234.700292:0:167632:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca5959 lrc: 4/0,1 mode: --/PW res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532234.700315:0:167632:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca5887 lrc: 3/0,0 mode: PR/PR res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fd8b expref: 7 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532234.700321:0:167632:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca5887 lrc: 4/0,0 mode: PR/PR res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fd8b expref: 7 pid: 167632 timeout: 23043 lvb_type: 1
00000100:00100000:1.0:1651532234.700327:0:167632:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cc04fc7a pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:167632:1731745997364096:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651532234.700353:0:167632:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a751e6ad going to sleep for 6 seconds
00000100:00100000:0.0:1651532234.700651:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532234.700662:0:166103:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469091584
00000100:00100000:1.0:1651532234.700663:0:167632:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cc04fc7a pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:167632:1731745997364096:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651532234.700670:0:167632:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca5959 lrc: 3/0,1 mode: --/PW res: [0x3454b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532234.700670:0:166103:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca5887 lrc: 4/0,0 mode: PR/PR res: [0x3454b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fd8b expref: 8 pid: 167632 timeout: 23043 lvb_type: 1
00000100:00100000:0.0:1651532234.700683:0:166103:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 318
00000100:00100000:0.0:1651532234.700685:0:166103:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c43262d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754469091584:12345-10.240.43.64@tcp:103:ldlm_bl_06.0
00010000:00010000:0.0:1651532234.700690:0:166103:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651532234.700691:0:166103:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca5887 lrc: 4/0,0 mode: PR/PR res: [0x3454b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fd8b expref: 8 pid: 167632 timeout: 23043 lvb_type: 1
00010000:00010000:0.0:1651532234.700696:0:166103:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca5887 lrc: 3/0,0 mode: PR/PR res: [0x3454b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fd8b expref: 8 pid: 167632 timeout: 23043 lvb_type: 1
00010000:00010000:0.0:1651532234.700703:0:166103:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca5887 lrc: 0/0,0 mode: --/PR res: [0x3454b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fd8b expref: 8 pid: 167632 timeout: 23043 lvb_type: 1
00010000:00010000:0.0:1651532234.700707:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532234.700709:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532234.700710:0:166103:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca5959 lrc: 3/0,1 mode: PW/PW res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532234.700714:0:166103:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca5959 lrc: 4/0,1 mode: PW/PW res: [0x3454b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532234.700725:0:166103:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651532234.700735:0:166103:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c43262d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438146:x1731754469091584:12345-10.240.43.64@tcp:103:ldlm_bl_06.0 Request processed in 50us (85us total) trans 0 rc 0/0
00010000:00010000:1.0:1651532234.700737:0:167632:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca5959 lrc: 3/0,1 mode: PW/PW res: [0x3454b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532234.700738:0:166103:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 318
00010000:00010000:1.0:1651532234.700741:0:167632:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca5959 lrc: 3/0,1 mode: PW/PW res: [0x3454b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532234.700745:0:167632:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca5959 lrc: 3/0,1 mode: PW/PW res: [0x3454b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532234.700747:0:167632:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca5959 lrc: 2/0,0 mode: PW/PW res: [0x3454b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532234.700769:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca5959 lrc: 2/0,0 mode: PW/PW res: [0x3454b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532234.700773:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f6135e30 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651532234.700774:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca5959 lrc: 2/0,0 mode: PW/PW res: [0x3454b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532234.700777:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca5959 lrc: 3/0,0 mode: PW/PW res: [0x3454b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532234.700782:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca5959 lrc: 1/0,0 mode: --/PW res: [0x3454b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532234.700785:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca5959 lrc: 0/0,0 mode: --/PW res: [0x3454b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532234.703345:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a899ddab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745951237696:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 3083us (3145us total) trans 21474869613 rc 0/0
00000100:00100000:1.0:1651532234.703351:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 44964
00000100:00100000:0.0:1651532234.725081:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532234.725089:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469091968
00000100:00100000:0.0:1651532234.725107:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250797
00000100:00100000:0.0:1651532234.725109:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003ffbc5dc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438148:x1731754469091968:12345-10.240.43.64@tcp:4:dd.0
00002000:00010000:0.0:1651532234.725119:0:192755:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x3454d:0x0] initial LVB size: 25165824, mtime: 0x627061ca, atime: 0x0, ctime: 0x627061ca, blocks: 0xc000
00010000:00010000:0.0:1651532234.725121:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca5960 lrc: 3/0,1 mode: --/PW res: [0x3454d:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532234.725125:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532234.725126:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532234.725127:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca5960 lrc: 3/0,1 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 2 type: EXT [25165824->28311551] (req 25165824->28311551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532234.725131:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca5960 lrc: 3/0,1 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 2 type: EXT [25165824->28311551] (req 25165824->28311551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532234.725605:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532234.725629:0:216322:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469092160
00000100:00100000:1.0:1651532234.725653:0:216322:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250798
00000100:00100000:1.0:1651532234.725655:0:216322:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d9e74b4c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754469092160:12345-10.240.43.64@tcp:4:dd.0
00010000:00010000:1.0:1651532234.725663:0:216322:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca5967 lrc: 3/0,1 mode: --/PW res: [0x3454d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532234.725668:0:216322:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532234.725669:0:216322:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532234.725670:0:216322:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca5967 lrc: 3/0,1 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532234.725674:0:216322:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca5967 lrc: 3/0,1 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 3 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532234.992112:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869614 is committed
00000001:00080000:1.0:1651532234.992116:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869613 is committed
00002000:00010000:0.0:1651532234.992188:0:192755:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x3454d:0x0] updating lvb size from disk: 25165824 -> 29360128
00002000:00010000:0.0:1651532234.992190:0:192755:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x3454d:0x0] updating lvb blocks from disk: 49152 -> 57344
00010000:00010000:0.0:1651532234.992196:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca5960 lrc: 3/0,1 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 3 type: EXT [25165824->28311551] (req 25165824->28311551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532234.992201:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca5960 lrc: 2/0,0 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 3 type: EXT [25165824->28311551] (req 25165824->28311551) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532234.992244:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003ffbc5dc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754469091968:12345-10.240.43.64@tcp:4:dd.0 Request processed in 267133us (267163us total) trans 21474869614 rc 0/0
00000100:00100000:0.0:1651532234.992248:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250797
00010000:00010000:0.0:1651532234.992259:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca5960 lrc: 2/0,0 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 3 type: EXT [25165824->28311551] (req 25165824->28311551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532234.992268:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f5657138 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651532234.992269:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca5960 lrc: 2/0,0 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 3 type: EXT [25165824->28311551] (req 25165824->28311551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532234.992273:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca5960 lrc: 3/0,0 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 3 type: EXT [25165824->28311551] (req 25165824->28311551) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532234.992281:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca5960 lrc: 1/0,0 mode: --/PW res: [0x3454d:0x0:0x0].0x0 rrc: 3 type: EXT [25165824->28311551] (req 25165824->28311551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532234.992284:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca5960 lrc: 0/0,0 mode: --/PW res: [0x3454d:0x0:0x0].0x0 rrc: 3 type: EXT [25165824->28311551] (req 25165824->28311551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532235.034650:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869615 is committed
00010000:00010000:1.0:1651532235.034675:0:216322:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca5967 lrc: 3/0,1 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532235.034681:0:216322:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca5967 lrc: 2/0,0 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532235.034709:0:216322:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d9e74b4c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438148:x1731754469092160:12345-10.240.43.64@tcp:4:dd.0 Request processed in 309052us (309104us total) trans 21474869615 rc 0/0
00010000:00010000:0.0:1651532235.034710:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca5967 lrc: 2/0,0 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532235.034713:0:216322:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250798
00010000:00010000:0.0:1651532235.034714:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f6135e30 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651532235.034716:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca5967 lrc: 2/0,0 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532235.034719:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca5967 lrc: 3/0,0 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532235.034724:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca5967 lrc: 1/0,0 mode: --/PW res: [0x3454d:0x0:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532235.034727:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6135e30/0x3234de053ca5967 lrc: 0/0,0 mode: --/PW res: [0x3454d:0x0:0x0].0x0 rrc: 2 type: EXT [28311552->29360127] (req 28311552->29360127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532235.071073:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532235.071082:0:216322:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469092480
00000100:00100000:1.0:1651532235.071101:0:216322:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250799
00000100:00100000:1.0:1651532235.071103:0:216322:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cc04fc7a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438148:x1731754469092480:12345-10.240.43.64@tcp:4:dd.0
00002000:00010000:1.0:1651532235.071115:0:216322:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x3454d:0x0] initial LVB size: 29360128, mtime: 0x627061ca, atime: 0x0, ctime: 0x627061ca, blocks: 0xe000
00010000:00010000:1.0:1651532235.071117:0:216322:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca596e lrc: 3/0,1 mode: --/PW res: [0x3454d:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532235.071123:0:216322:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532235.071124:0:216322:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532235.071125:0:216322:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca596e lrc: 3/0,1 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 2 type: EXT [29360128->32505855] (req 29360128->32505855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532235.071130:0:216322:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca596e lrc: 3/0,1 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 2 type: EXT [29360128->32505855] (req 29360128->32505855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532235.071604:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532235.071626:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469092800
00000100:00100000:0.0:1651532235.071640:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250800
00000100:00100000:0.0:1651532235.071642:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003eacb3fe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754469092800:12345-10.240.43.64@tcp:4:dd.0
00010000:00010000:0.0:1651532235.071649:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca5975 lrc: 3/0,1 mode: --/PW res: [0x3454d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532235.071654:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532235.071654:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532235.071655:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca5975 lrc: 3/0,1 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532235.071659:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca5975 lrc: 3/0,1 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 3 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532235.379165:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869616 is committed
00002000:00010000:0.0:1651532235.379266:0:216322:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x3454d:0x0] updating lvb size from disk: 29360128 -> 33554432
00002000:00010000:0.0:1651532235.379269:0:216322:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x3454d:0x0] updating lvb mtime from disk: 1651532234 -> 1651532235
00002000:00010000:0.0:1651532235.379271:0:216322:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x3454d:0x0] updating lvb ctime from disk: 1651532234 -> 1651532235
00002000:00010000:0.0:1651532235.379273:0:216322:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x3454d:0x0] updating lvb blocks from disk: 57344 -> 65536
00010000:00010000:0.0:1651532235.379278:0:216322:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca596e lrc: 3/0,1 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 3 type: EXT [29360128->32505855] (req 29360128->32505855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532235.379284:0:216322:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca596e lrc: 2/0,0 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 3 type: EXT [29360128->32505855] (req 29360128->32505855) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532235.379319:0:216322:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cc04fc7a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754469092480:12345-10.240.43.64@tcp:4:dd.0 Request processed in 308214us (308245us total) trans 21474869616 rc 0/0
00000100:00100000:0.0:1651532235.379327:0:216322:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250799
00010000:00010000:0.0:1651532235.379338:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca596e lrc: 2/0,0 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 3 type: EXT [29360128->32505855] (req 29360128->32505855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532235.379342:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000008b0c325f already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651532235.379343:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca596e lrc: 2/0,0 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 3 type: EXT [29360128->32505855] (req 29360128->32505855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532235.379346:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca596e lrc: 3/0,0 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 3 type: EXT [29360128->32505855] (req 29360128->32505855) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532235.379355:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca596e lrc: 1/0,0 mode: --/PW res: [0x3454d:0x0:0x0].0x0 rrc: 3 type: EXT [29360128->32505855] (req 29360128->32505855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532235.379358:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008b0c325f/0x3234de053ca596e lrc: 0/0,0 mode: --/PW res: [0x3454d:0x0:0x0].0x0 rrc: 3 type: EXT [29360128->32505855] (req 29360128->32505855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532235.419962:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869617 is committed
00010000:00010000:0.0:1651532235.420001:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca5975 lrc: 3/0,1 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532235.420005:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca5975 lrc: 2/0,0 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532235.420027:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003eacb3fe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438148:x1731754469092800:12345-10.240.43.64@tcp:4:dd.0 Request processed in 348385us (348423us total) trans 21474869617 rc 0/0
00010000:00010000:1.0:1651532235.420031:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca5975 lrc: 2/0,0 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532235.420031:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250800
00010000:00010000:1.0:1651532235.420037:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f5657138 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651532235.420038:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca5975 lrc: 2/0,0 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532235.420042:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca5975 lrc: 3/0,0 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532235.420053:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca5975 lrc: 1/0,0 mode: --/PW res: [0x3454d:0x0:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532235.420056:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca5975 lrc: 0/0,0 mode: --/PW res: [0x3454d:0x0:0x0].0x0 rrc: 2 type: EXT [32505856->33554431] (req 32505856->33554431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532235.432862:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532235.432874:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469093440
00000100:00100000:1.0:1651532235.432891:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44965
00000100:00100000:1.0:1651532235.432893:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005020f75d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+7:685230:x1731754469093440:12345-10.240.43.64@tcp:101:dd.0
00010000:00010000:1.0:1651532235.432899:0:167632:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532235.432914:0:167632:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca597c lrc: 2/0,0 mode: --/PW res: [0x3454e:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44fe10 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651532235.432921:0:167632:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x3454e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:1.0:1651532235.432928:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532235.432929:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532235.432933:0:167632:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca597c lrc: 3/0,0 mode: PW/PW res: [0x3454e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fe10 expref: 8 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532235.432939:0:167632:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca597c lrc: 3/0,0 mode: PW/PW res: [0x3454e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fe10 expref: 8 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532235.432943:0:167632:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f6ecb7e5, rc 0)
00000100:00100000:1.0:1651532235.432960:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005020f75d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+8:685230:x1731754469093440:12345-10.240.43.64@tcp:101:dd.0 Request processed in 66us (99us total) trans 0 rc 0/0
00000100:00100000:1.0:1651532235.432966:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44965
00000100:00100000:1.0:1651532235.433617:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532235.433639:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469093568
00002000:00010000:0.0:1651532235.433648:0:192755:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 214350/0 (0->18446744073709551615)
00002000:00100000:0.0:1651532235.433650:0:192755:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000006c46ca95 with x1731754469093568 ext(0->18446744073709551615)
00002000:00010000:0.0:1651532235.433654:0:192755:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000006c46ca95.
00000100:00100000:0.0:1651532235.433661:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250801
00000100:00100000:0.0:1651532235.433663:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006c46ca95 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754469093568:12345-10.240.43.64@tcp:10:dd.0
00002000:00010000:0.0:1651532235.433698:0:192755:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x3454e:0x0] updating lvb size from disk: 0 -> 0
00002000:00010000:0.0:1651532235.433700:0:192755:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x3454e:0x0] updating lvb mtime from disk: 0 -> 1651532235
00002000:00010000:0.0:1651532235.433701:0:192755:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x3454e:0x0] updating lvb atime from disk: 0 -> 0
00002000:00010000:0.0:1651532235.433701:0:192755:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x3454e:0x0] updating lvb ctime from disk: 0 -> 1651532235
00002000:00010000:0.0:1651532235.433702:0:192755:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x3454e:0x0] updating lvb blocks from disk: 0 -> 0
00000100:00100000:0.0:1651532235.433714:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006c46ca95 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438147:x1731754469093568:12345-10.240.43.64@tcp:10:dd.0 Request processed in 51us (98us total) trans 21474869618 rc 0/0
00000100:00100000:0.0:1651532235.433717:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250801
00002000:00010000:0.0:1651532235.433718:0:192755:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 214350/0 (0->18446744073709551615)
00002000:00100000:0.0:1651532235.433719:0:192755:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000006c46ca95 with x1731754469093568 ext(0->18446744073709551615)
00002000:00010000:0.0:1651532235.433721:0:192755:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000006c46ca95.
00000100:00100000:1.0:1651532235.434087:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532235.434095:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469093760
00000100:00100000:1.0:1651532235.434107:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44966
00000100:00100000:1.0:1651532235.434109:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000021f31110 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438147:x1731754469093760:12345-10.240.43.64@tcp:101:dd.0
00010000:00010000:1.0:1651532235.434112:0:167632:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532235.434117:0:167632:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca5983 lrc: 2/0,0 mode: --/PR res: [0x3454d:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44fe25 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651532235.434122:0:167632:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x3454d:0x0] initial LVB size: 33554432, mtime: 0x627061cb, atime: 0x0, ctime: 0x627061cb, blocks: 0x10000
00010000:00010000:1.0:1651532235.434126:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532235.434127:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532235.434128:0:167632:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca5983 lrc: 3/0,0 mode: PR/PR res: [0x3454d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fe25 expref: 10 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532235.434133:0:167632:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca5983 lrc: 3/0,0 mode: PR/PR res: [0x3454d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fe25 expref: 10 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532235.434137:0:167632:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f58aeba9, rc 0)
00000100:00100000:1.0:1651532235.434151:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000021f31110 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438147:x1731754469093760:12345-10.240.43.64@tcp:101:dd.0 Request processed in 42us (64us total) trans 0 rc 0/0
00000100:00100000:1.0:1651532235.434154:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44966
00000400:00000080:1.0:1651532236.785687:0:233269:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648
00000001:02000400:1.0:1651532236.785690:0:233269:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 398j: test parallel dio where stripe size > rpc_size ========================================================== 22:57:16 (1651532236)
00000100:00100000:1.0:1651532238.048148:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651532238.048180:0:182071:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951238016
00000100:00100000:0.0:1651532238.048202:0:182071:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 517
00000100:00100000:0.0:1651532238.048205:0:182071:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000aa58c961 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951238016:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:0.0:1651532238.048245:0:182071:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 3219456 granted 318387648 pending 0 free 81216393216 avail 77045682176
00000100:00100000:0.0:1651532238.048273:0:182071:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000aa58c961 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951238016:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 67us (129us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532238.048277:0:182071:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 517
00000100:00100000:1.0:1651532238.973304:0:39100:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cc11a3b9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:39100:1731745997364224:10.240.43.61@tcp:400:kworker/u4:2.0
00000100:00100000:0.0:1651532238.973307:0:39099:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000000615301 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9063caa-b124-4cb6-99ef-d01a735595c3:39099:1731745997364160:10.240.43.61@tcp:400:kworker/u4:2.0
00000100:00100000:0.0:1651532238.973593:0:39099:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000000615301 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9063caa-b124-4cb6-99ef-d01a735595c3:39099:1731745997364160:10.240.43.61@tcp:400:kworker/u4:2.0
00000100:00100000:1.0:1651532238.973596:0:39100:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cc11a3b9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:39100:1731745997364224:10.240.43.61@tcp:400:kworker/u4:2.0
00000100:00100000:1.0:1651532239.553019:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532239.553031:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469102272
00000100:00100000:1.0:1651532239.553048:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 65
00000100:00100000:1.0:1651532239.553051:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cc11a3b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754469102272:12345-10.240.43.64@tcp:400:kworker/u4:1.0
00000100:00100000:1.0:1651532239.553065:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cc11a3b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754469102272:12345-10.240.43.64@tcp:400:kworker/u4:1.0 Request processed in 14us (48us total) trans 0 rc 0/0
00000100:00100000:1.0:1651532239.553068:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 65
00000400:00000080:0.0:1651532241.669539:0:233487:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648
00000001:02000400:0.0:1651532241.669542:0:233487:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 398k: test enospc on first stripe ========= 22:57:21 (1651532241)
00000100:00100000:1.0:1651532242.304201:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651532242.304219:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651532242.304242:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651532242.304246:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951238144
00000100:00100000:1.0:1651532242.304253:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951238080
00000100:00100000:0.0:1651532242.304274:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951238208
00000100:00100000:1.0:1651532242.304279:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 44967
00000100:00100000:1.0:1651532242.304281:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000e33e11e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745951238144:12345-10.240.43.61@tcp:6:osp-syn-1-0.0
00000100:00100000:0.0:1651532242.304295:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 44968
00002000:00080000:1.0:1651532242.304297:0:166111:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:214349 count 1
00000100:00100000:0.0:1651532242.304298:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003158b8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745951238080:12345-10.240.43.61@tcp:6:osp-syn-1-0.0
00002000:00080000:0.0:1651532242.304306:0:167632:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:214348 count 1
00010000:00010000:1.0:1651532242.304312:0:166111:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca598a lrc: 3/0,1 mode: --/PW res: [0x3454d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532242.304314:0:167632:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca5991 lrc: 3/0,1 mode: --/PW res: [0x3454c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532242.304322:0:166111:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca5983 lrc: 2/0,0 mode: PR/PR res: [0x3454d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fe25 expref: 9 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532242.304322:0:167632:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca58fe lrc: 2/0,0 mode: PR/PR res: [0x3454c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fda0 expref: 9 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532242.304327:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532242.304327:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532242.304328:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532242.304328:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532242.304329:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca598a lrc: 4/0,1 mode: --/PW res: [0x3454d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532242.304329:0:167632:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca5991 lrc: 4/0,1 mode: --/PW res: [0x3454c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532242.304344:0:167632:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca58fe lrc: 3/0,0 mode: PR/PR res: [0x3454c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fda0 expref: 9 pid: 166112 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532242.304346:0:166111:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca5983 lrc: 3/0,0 mode: PR/PR res: [0x3454d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fe25 expref: 9 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532242.304349:0:167632:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca58fe lrc: 4/0,0 mode: PR/PR res: [0x3454c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fda0 expref: 9 pid: 166112 timeout: 23050 lvb_type: 1
00010000:00010000:1.0:1651532242.304350:0:166111:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca5983 lrc: 4/0,0 mode: PR/PR res: [0x3454d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fe25 expref: 9 pid: 167632 timeout: 23050 lvb_type: 1
00000100:00100000:1.0:1651532242.304356:0:166111:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000053497d pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:166111:1731745997364352:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651532242.304356:0:167632:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000567318ba pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:167632:1731745997364288:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651532242.304388:0:166111:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a751e6ad going to sleep for 6 seconds
00000100:00100000:0.0:1651532242.304392:0:167632:0:(client.c:2492:ptlrpc_set_wait()) set 000000008ce9bece going to sleep for 6 seconds
00000100:00100000:1.0:1651532242.304416:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 44969
00000100:00100000:1.0:1651532242.304419:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000000615301 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745951238208:12345-10.240.43.61@tcp:6:osp-syn-1-0.0
00002000:00080000:1.0:1651532242.304428:0:166113:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:214350 count 1
00010000:00010000:1.0:1651532242.304436:0:166113:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca5998 lrc: 3/0,1 mode: --/PW res: [0x3454e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532242.304444:0:166113:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca597c lrc: 2/0,0 mode: PW/PW res: [0x3454e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fe10 expref: 9 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532242.304448:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532242.304448:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532242.304449:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca5998 lrc: 4/0,1 mode: --/PW res: [0x3454e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532242.304458:0:166113:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca597c lrc: 3/0,0 mode: PW/PW res: [0x3454e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fe10 expref: 9 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532242.304462:0:166113:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca597c lrc: 4/0,0 mode: PW/PW res: [0x3454e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fe10 expref: 9 pid: 167632 timeout: 23050 lvb_type: 0
00000100:00100000:1.0:1651532242.304468:0:166113:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ffcdece2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:166113:1731745997364416:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651532242.304524:0:166113:0:(client.c:2492:ptlrpc_set_wait()) set 000000009a3b53d0 going to sleep for 6 seconds
00000100:00100000:1.0:1651532242.304924:0:166111:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000053497d pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:166111:1731745997364352:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651532242.304931:0:166111:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca598a lrc: 3/0,1 mode: --/PW res: [0x3454d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532242.304951:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532242.304963:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532242.304973:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532242.304987:0:167632:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000567318ba pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:167632:1731745997364288:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651532242.304992:0:167632:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca5991 lrc: 3/0,1 mode: --/PW res: [0x3454c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532242.305006:0:169267:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469121152
00010000:00010000:0.0:1651532242.305014:0:169267:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca5983 lrc: 4/0,0 mode: PR/PR res: [0x3454d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fe25 expref: 10 pid: 167632 timeout: 23050 lvb_type: 1
00000100:00100000:0.0:1651532242.305023:0:169267:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469121216
00010000:00010000:0.0:1651532242.305026:0:169267:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca58fe lrc: 4/0,0 mode: PR/PR res: [0x3454c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fda0 expref: 11 pid: 166112 timeout: 23050 lvb_type: 1
00000100:00100000:0.0:1651532242.305030:0:169267:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469121408
00010000:00010000:0.0:1651532242.305033:0:169267:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca597c lrc: 5/0,0 mode: PW/PW res: [0x3454e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fe10 expref: 12 pid: 167632 timeout: 23050 lvb_type: 0
00000100:00100000:0.0:1651532242.305038:0:169267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 319
00000100:00100000:0.0:1651532242.305039:0:169267:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ffcc974c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754469121152:12345-10.240.43.64@tcp:103:ldlm_bl_04.0
00010000:00010000:0.0:1651532242.305044:0:169267:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651532242.305045:0:169267:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca5983 lrc: 4/0,0 mode: PR/PR res: [0x3454d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fe25 expref: 12 pid: 167632 timeout: 23050 lvb_type: 1
00010000:00010000:0.0:1651532242.305049:0:169267:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca5983 lrc: 3/0,0 mode: PR/PR res: [0x3454d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fe25 expref: 12 pid: 167632 timeout: 23050 lvb_type: 1
00010000:00010000:0.0:1651532242.305065:0:169267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f58aeba9/0x3234de053ca5983 lrc: 0/0,0 mode: --/PR res: [0x3454d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fe25 expref: 12 pid: 167632 timeout: 23050 lvb_type: 1
00010000:00010000:0.0:1651532242.305070:0:169267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532242.305070:0:169267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532242.305072:0:169267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca598a lrc: 3/0,1 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532242.305075:0:169267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca598a lrc: 4/0,1 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532242.305086:0:169267:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651532242.305099:0:169267:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ffcc974c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754469121152:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 59us (149us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532242.305102:0:169267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 319
00000100:00100000:0.0:1651532242.305109:0:169267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 320
00000100:00100000:0.0:1651532242.305110:0:169267:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085f82b51 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438146:x1731754469121216:12345-10.240.43.64@tcp:103:ldlm_bl_05.0
00010000:00010000:0.0:1651532242.305113:0:169267:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651532242.305114:0:169267:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca58fe lrc: 4/0,0 mode: PR/PR res: [0x3454c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fda0 expref: 10 pid: 166112 timeout: 23050 lvb_type: 1
00010000:00010000:0.0:1651532242.305118:0:169267:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca58fe lrc: 3/0,0 mode: PR/PR res: [0x3454c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fda0 expref: 10 pid: 166112 timeout: 23050 lvb_type: 1
00010000:00010000:0.0:1651532242.305123:0:169267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca58fe lrc: 0/0,0 mode: --/PR res: [0x3454c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fda0 expref: 10 pid: 166112 timeout: 23050 lvb_type: 1
00010000:00010000:0.0:1651532242.305131:0:169267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532242.305131:0:169267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532242.305132:0:169267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca5991 lrc: 3/0,1 mode: PW/PW res: [0x3454c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532242.305135:0:169267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca5991 lrc: 4/0,1 mode: PW/PW res: [0x3454c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532242.305141:0:169267:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651532242.305147:0:169267:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085f82b51 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438146:x1731754469121216:12345-10.240.43.64@tcp:103:ldlm_bl_05.0 Request processed in 36us (184us total) trans 0 rc 0/0
00000100:00100000:1.0:1651532242.305149:0:166102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 321
00000100:00100000:0.0:1651532242.305151:0:169267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 320
00000100:00100000:1.0:1651532242.305152:0:166102:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000588d3697 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438146:x1731754469121408:12345-10.240.43.64@tcp:103:ldlm_bl_05.0
00010000:00010000:1.0:1651532242.305156:0:166102:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1651532242.305159:0:166102:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca597c lrc: 5/0,0 mode: PW/PW res: [0x3454e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fe10 expref: 8 pid: 167632 timeout: 23050 lvb_type: 0
00010000:00010000:0.0:1651532242.305159:0:167632:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca5991 lrc: 3/0,1 mode: PW/PW res: [0x3454c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532242.305162:0:167632:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca5991 lrc: 3/0,1 mode: PW/PW res: [0x3454c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532242.305164:0:166102:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca597c lrc: 4/0,0 mode: PW/PW res: [0x3454e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fe10 expref: 8 pid: 167632 timeout: 23050 lvb_type: 0
00010000:00010000:0.0:1651532242.305166:0:167632:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca5991 lrc: 3/0,1 mode: PW/PW res: [0x3454c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532242.305169:0:167632:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca5991 lrc: 2/0,0 mode: PW/PW res: [0x3454c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532242.305171:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532242.305172:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532242.305172:0:166102:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca5998 lrc: 3/0,1 mode: PW/PW res: [0x3454e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532242.305176:0:166102:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca5998 lrc: 4/0,1 mode: PW/PW res: [0x3454e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532242.305181:0:166102:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1651532242.305190:0:166102:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000588d3697 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438146:x1731754469121408:12345-10.240.43.64@tcp:103:ldlm_bl_05.0 Request processed in 39us (217us total) trans 0 rc 0/0
00000100:00100000:1.0:1651532242.305195:0:166102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 321
00010000:00010000:1.0:1651532242.305208:0:166113:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca597c lrc: 0/0,0 mode: --/PW res: [0x3454e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fe10 expref: 7 pid: 167632 timeout: 23050 lvb_type: 0
00000100:00100000:1.0:1651532242.305213:0:166113:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ffcdece2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:166113:1731745997364416:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651532242.305216:0:166113:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca5998 lrc: 3/0,1 mode: PW/PW res: [0x3454e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532242.305220:0:166113:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca5998 lrc: 3/0,1 mode: PW/PW res: [0x3454e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532242.305242:0:166113:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca5998 lrc: 3/0,1 mode: PW/PW res: [0x3454e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532242.305246:0:166113:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca5998 lrc: 3/0,1 mode: PW/PW res: [0x3454e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532242.305249:0:166113:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca5998 lrc: 2/0,0 mode: PW/PW res: [0x3454e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532242.305345:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000000615301 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:39029:x1731745951238208:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 926us (1102us total) trans 21474869620 rc 0/0
00000100:00100000:1.0:1651532242.305349:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 44969
00010000:00010000:1.0:1651532242.305358:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca5991 lrc: 2/0,0 mode: PW/PW res: [0x3454c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532242.305365:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f968d777 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651532242.305367:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca5991 lrc: 2/0,0 mode: PW/PW res: [0x3454c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532242.305370:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca5991 lrc: 3/0,0 mode: PW/PW res: [0x3454c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532242.305376:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca5991 lrc: 1/0,0 mode: --/PW res: [0x3454c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532242.305379:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca5991 lrc: 0/0,0 mode: --/PW res: [0x3454c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532242.305384:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca5998 lrc: 2/0,0 mode: PW/PW res: [0x3454e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532242.305387:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000060a6272d already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651532242.305388:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca5998 lrc: 2/0,0 mode: PW/PW res: [0x3454e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532242.305390:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca5998 lrc: 3/0,0 mode: PW/PW res: [0x3454e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532242.305394:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca5998 lrc: 1/0,0 mode: --/PW res: [0x3454e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532242.305396:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca5998 lrc: 0/0,0 mode: --/PW res: [0x3454e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532242.305470:0:166111:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca598a lrc: 3/0,1 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532242.305474:0:166111:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca598a lrc: 3/0,1 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532242.305477:0:166111:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca598a lrc: 3/0,1 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532242.305480:0:166111:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca598a lrc: 2/0,0 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532242.308129:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003158b8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:39029:x1731745951238080:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 3830us (3909us total) trans 21474869619 rc 0/0
00000100:00100000:0.0:1651532242.308133:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 44968
00010000:00010000:0.0:1651532242.308144:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca598a lrc: 2/0,0 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532242.308148:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000022b2104e already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651532242.308150:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca598a lrc: 2/0,0 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532242.308153:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca598a lrc: 3/0,0 mode: PW/PW res: [0x3454d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532242.308159:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca598a lrc: 1/0,0 mode: --/PW res: [0x3454d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532242.308161:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000022b2104e/0x3234de053ca598a lrc: 0/0,0 mode: --/PW res: [0x3454d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532242.308417:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000e33e11e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:39030:x1731745951238144:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 4135us (4220us total) trans 21474869621 rc 0/0
00000100:00100000:1.0:1651532242.308422:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 44967
00000001:00080000:1.0:1651532242.399825:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869618 is committed
00000100:00100000:0.0:1651532243.168186:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651532243.168208:0:182071:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951238784
00000100:00100000:0.0:1651532243.168248:0:182071:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 518
00000100:00100000:0.0:1651532243.168251:0:182071:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004c7cb322 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:39030:x1731745951238784:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:0.0:1651532243.168269:0:182071:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 3219456 granted 318387648 pending 0 free 81283502080 avail 77112791040
00000100:00100000:0.0:1651532243.168295:0:182071:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004c7cb322 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:39030:x1731745951238784:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 44us (113us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532243.168298:0:182071:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 518
00000100:00100000:0.0:1651532248.288191:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651532248.288211:0:182071:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951238848
00000100:00100000:0.0:1651532248.288256:0:182071:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 519
00000100:00100000:0.0:1651532248.288258:0:182071:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000780762a0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:39030:x1731745951238848:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:0.0:1651532248.288278:0:182071:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 3219456 granted 318387648 pending 0 free 81283502080 avail 77112791040
00000100:00100000:0.0:1651532248.288303:0:182071:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000780762a0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:39030:x1731745951238848:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 45us (117us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532248.288307:0:182071:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 519
00000001:00080000:1.0:1651532248.337515:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869621 is committed
00000100:00100000:0.0:1651532253.408213:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651532253.408247:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651532253.408264:0:182071:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951238976
00000100:00100000:0.0:1651532253.408265:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951239168
00000100:00100000:1.0:1651532253.408286:0:182071:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 520
00000100:00100000:0.0:1651532253.408286:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 66
00000100:00100000:0.0:1651532253.408288:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000015ad4671 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745951239168:12345-10.240.43.61@tcp:400:kworker/u4:2.0
00000100:00100000:1.0:1651532253.408289:0:182071:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004d9c5b96 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745951238976:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:1.0:1651532253.408305:0:182071:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 3219456 granted 318387648 pending 0 free 81283502080 avail 77112791040
00000100:00100000:0.0:1651532253.408318:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000015ad4671 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745951239168:12345-10.240.43.61@tcp:400:kworker/u4:2.0 Request processed in 30us (72us total) trans 0 rc 0/0
00000100:00100000:1.0:1651532253.408322:0:182071:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004d9c5b96 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745951238976:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 33us (115us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532253.408322:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 66
00000100:00100000:1.0:1651532253.408326:0:182071:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 520
00000100:00100000:0.0:1651532257.473292:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532257.473332:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469122496
00000100:00100000:1.0:1651532257.473359:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 521
00000100:00100000:1.0:1651532257.473361:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000369eaefe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0c703c47-a140-4387-a181-4e0a15e9b24e+6:687013:x1731754469122496:12345-10.240.43.64@tcp:13:lctl.0
00002000:00000024:1.0:1651532257.473378:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 3219456 granted 318387648 pending 0 free 81283502080 avail 77112791040
00000100:00100000:1.0:1651532257.473431:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000369eaefe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0c703c47-a140-4387-a181-4e0a15e9b24e+6:687013:x1731754469122496:12345-10.240.43.64@tcp:13:lctl.0 Request processed in 69us (143us total) trans 0 rc 0/0
00000100:00100000:1.0:1651532257.473435:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 521
00000400:00000080:0.0:1651532257.786722:0:233541:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648
00000001:02000400:0.0:1651532257.786724:0:233541:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity test_398k 150507472 > 600000 skipping out-of-space test on OST0
00000400:00000080:0.0:1651532258.140303:0:233595:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648
00000001:02000400:0.0:1651532258.140306:0:233595:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 398l: test enospc on intermediate stripe/RPC ========================================================== 22:57:37 (1651532257)
00000100:00100000:0.0:1651532258.528199:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651532258.528237:0:182071:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951239424
00000100:00100000:1.0:1651532258.528261:0:182071:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 522
00000100:00100000:1.0:1651532258.528264:0:182071:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000056da8167 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951239424:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:1.0:1651532258.528279:0:182071:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 3219456 granted 318387648 pending 0 free 81283502080 avail 77112791040
00000100:00100000:1.0:1651532258.528313:0:182071:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000056da8167 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951239424:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 48us (118us total) trans 0 rc 0/0
00000100:00100000:1.0:1651532258.528317:0:182071:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 522
00000100:00100000:0.0:1651532262.114881:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651532262.114899:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951239552
00000100:00100000:0.0:1651532262.114919:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 44970
00000100:00100000:0.0:1651532262.114921:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000bd28b3f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:330937:x1731745951239552:12345-10.240.43.61@tcp:5:osp-pre-1-0.0
00002000:00080000:0.0:1651532262.114945:0:167632:0:(ofd_dev.c:1706:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x0 at 214370
00000100:00100000:0.0:1651532262.115916:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000bd28b3f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:330937:x1731745951239552:12345-10.240.43.61@tcp:5:osp-pre-1-0.0 Request processed in 994us (1038us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532262.115927:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 44970
00000100:00100000:0.0:1651532262.121808:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532262.121816:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469124224
00000100:00100000:0.0:1651532262.121825:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44971
00000100:00100000:0.0:1651532262.121827:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000862392e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+6:687479:x1731754469124224:12345-10.240.43.64@tcp:101:dd.0
00010000:00010000:0.0:1651532262.121832:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532262.121843:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca599f lrc: 2/0,0 mode: --/PW res: [0x34551:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ff1a expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00002000:00010000:0.0:1651532262.121853:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34551:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:0.0:1651532262.121860:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532262.121861:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532262.121865:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca599f lrc: 3/0,0 mode: PW/PW res: [0x34551:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ff1a expref: 7 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532262.121872:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca599f lrc: 3/0,0 mode: PW/PW res: [0x34551:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ff1a expref: 7 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532262.121877:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fab23815, rc 0)
00000100:00100000:0.0:1651532262.121888:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000862392e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+7:687479:x1731754469124224:12345-10.240.43.64@tcp:101:dd.0 Request processed in 60us (81us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532262.121891:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44971
00000100:00100000:0.0:1651532262.122569:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532262.122576:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469124352
00000100:00100000:0.0:1651532262.122583:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44972
00000100:00100000:0.0:1651532262.122585:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000609b5f90 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+7:687479:x1731754469124352:12345-10.240.43.64@tcp:101:dd.0
00010000:00010000:0.0:1651532262.122591:0:167632:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532262.122596:0:167632:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca59a6 lrc: 2/0,0 mode: --/PW res: [0x34552:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ff28 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00002000:00010000:0.0:1651532262.122602:0:167632:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34552:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:0.0:1651532262.122606:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532262.122607:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532262.122608:0:167632:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca59a6 lrc: 3/0,0 mode: PW/PW res: [0x34552:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ff28 expref: 8 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532262.122613:0:167632:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca59a6 lrc: 3/0,0 mode: PW/PW res: [0x34552:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ff28 expref: 8 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532262.122617:0:167632:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000775318ab, rc 0)
00000100:00100000:0.0:1651532262.122626:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000609b5f90 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+8:687479:x1731754469124352:12345-10.240.43.64@tcp:101:dd.0 Request processed in 41us (58us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532262.122629:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44972
00000100:00100000:0.0:1651532262.123206:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532262.123216:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532262.123243:0:216322:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469124480
00002000:00010000:0.0:1651532262.123250:0:216322:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 214353/0 (0->18446744073709551615)
00002000:00100000:0.0:1651532262.123252:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000005f5a393c with x1731754469124480 ext(0->18446744073709551615)
00002000:00010000:0.0:1651532262.123255:0:216322:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000005f5a393c.
00000100:00100000:0.0:1651532262.123265:0:216322:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469124608
00002000:00010000:0.0:1651532262.123268:0:216322:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 214354/0 (0->18446744073709551615)
00002000:00100000:0.0:1651532262.123269:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000567318ba with x1731754469124608 ext(0->18446744073709551615)
00002000:00010000:0.0:1651532262.123271:0:216322:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000567318ba.
00000100:00100000:0.0:1651532262.123276:0:216322:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250802
00000100:00100000:0.0:1651532262.123278:0:216322:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005f5a393c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754469124480:12345-10.240.43.64@tcp:10:dd.0
00000100:00100000:1.0:1651532262.123284:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250803
00000100:00100000:1.0:1651532262.123287:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000567318ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754469124608:12345-10.240.43.64@tcp:10:dd.0
00002000:00010000:0.0:1651532262.123320:0:216322:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x34551:0x0] updating lvb size from disk: 0 -> 0
00002000:00010000:0.0:1651532262.123321:0:216322:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x34551:0x0] updating lvb mtime from disk: 0 -> 1651532262
00002000:00010000:0.0:1651532262.123322:0:216322:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x34551:0x0] updating lvb atime from disk: 0 -> 0
00002000:00010000:0.0:1651532262.123323:0:216322:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x34551:0x0] updating lvb ctime from disk: 0 -> 1651532262
00002000:00010000:0.0:1651532262.123324:0:216322:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x34551:0x0] updating lvb blocks from disk: 0 -> 0
00000100:00100000:0.0:1651532262.123336:0:216322:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005f5a393c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754469124480:12345-10.240.43.64@tcp:10:dd.0 Request processed in 57us (130us total) trans 21474869622 rc 0/0
00000100:00100000:0.0:1651532262.123339:0:216322:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250802
00002000:00010000:1.0:1651532262.123340:0:216323:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x34552:0x0] updating lvb size from disk: 0 -> 0
00002000:00010000:0.0:1651532262.123340:0:216322:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 214353/0 (0->18446744073709551615)
00002000:00100000:0.0:1651532262.123341:0:216322:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000005f5a393c with x1731754469124480 ext(0->18446744073709551615)
00002000:00010000:1.0:1651532262.123342:0:216323:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x34552:0x0] updating lvb mtime from disk: 0 -> 1651532262
00002000:00010000:0.0:1651532262.123342:0:216322:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000005f5a393c.
00002000:00010000:1.0:1651532262.123343:0:216323:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x34552:0x0] updating lvb atime from disk: 0 -> 0
00002000:00010000:1.0:1651532262.123344:0:216323:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x34552:0x0] updating lvb ctime from disk: 0 -> 1651532262
00002000:00010000:1.0:1651532262.123344:0:216323:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x34552:0x0] updating lvb blocks from disk: 0 -> 0
00000100:00100000:1.0:1651532262.123358:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000567318ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438148:x1731754469124608:12345-10.240.43.64@tcp:10:dd.0 Request processed in 71us (142us total) trans 21474869623 rc 0/0
00000100:00100000:1.0:1651532262.123362:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250803
00002000:00010000:1.0:1651532262.123363:0:216323:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 214354/0 (0->18446744073709551615)
00002000:00100000:1.0:1651532262.123364:0:216323:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000567318ba with x1731754469124608 ext(0->18446744073709551615)
00002000:00010000:1.0:1651532262.123368:0:216323:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000567318ba.
00000100:00100000:0.0:1651532262.159963:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532262.159996:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532262.160008:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469124864
00000100:00100000:0.0:1651532262.160020:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469124928
00000100:00100000:1.0:1651532262.160023:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250804
00000100:00100000:1.0:1651532262.160026:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003562cf4d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754469124864:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:0.0:1651532262.160030:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250805
00000100:00100000:0.0:1651532262.160032:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006e255cae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754469124928:12345-10.240.43.64@tcp:4:dd.0
00010000:00010000:1.0:1651532262.160038:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca59ad lrc: 3/0,1 mode: --/PW res: [0x34551:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532262.160040:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca59b4 lrc: 3/0,1 mode: --/PW res: [0x34552:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532262.160045:0:216323:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca599f lrc: 2/0,0 mode: PW/PW res: [0x34551:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ff1a expref: 11 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532262.160045:0:216321:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca59a6 lrc: 2/0,0 mode: PW/PW res: [0x34552:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ff28 expref: 11 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532262.160049:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532262.160049:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532262.160050:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532262.160051:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca59ad lrc: 4/0,1 mode: --/PW res: [0x34551:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532262.160051:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532262.160052:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca59b4 lrc: 4/0,1 mode: --/PW res: [0x34552:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532262.160063:0:216323:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca599f lrc: 3/0,0 mode: PW/PW res: [0x34551:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ff1a expref: 11 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532262.160063:0:216321:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca59a6 lrc: 3/0,0 mode: PW/PW res: [0x34552:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ff28 expref: 11 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532262.160068:0:216321:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca59a6 lrc: 4/0,0 mode: PW/PW res: [0x34552:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ff28 expref: 11 pid: 167632 timeout: 23070 lvb_type: 0
00010000:00010000:1.0:1651532262.160069:0:216323:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca599f lrc: 4/0,0 mode: PW/PW res: [0x34551:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ff1a expref: 11 pid: 166111 timeout: 23070 lvb_type: 0
00000100:00100000:1.0:1651532262.160074:0:216323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ffcdece2 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_010:lustre-OST0001_UUID:216323:1731745997364480:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651532262.160074:0:216321:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000009c4c564 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997364544:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651532262.160093:0:216321:0:(client.c:2492:ptlrpc_set_wait()) set 000000008ce9bece going to sleep for 6 seconds
00000100:00100000:1.0:1651532262.160094:0:216323:0:(client.c:2492:ptlrpc_set_wait()) set 00000000dd08ea3b going to sleep for 6 seconds
00000100:00100000:0.0:1651532262.160476:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532262.160487:0:166102:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469125184
00000100:00100000:0.0:1651532262.160494:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:1.0:1651532262.160496:0:166102:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca59a6 lrc: 5/0,0 mode: PW/PW res: [0x34552:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ff28 expref: 12 pid: 167632 timeout: 23070 lvb_type: 0
00000100:00100000:1.0:1651532262.160507:0:166102:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469125312
00010000:00010000:1.0:1651532262.160512:0:166102:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca599f lrc: 5/0,0 mode: PW/PW res: [0x34551:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ff1a expref: 13 pid: 166111 timeout: 23070 lvb_type: 0
00000100:00100000:0.0:1651532262.160512:0:166104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 322
00000100:00100000:0.0:1651532262.160514:0:166104:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b129d249 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754469125184:12345-10.240.43.64@tcp:103:ldlm_bl_06.0
00000100:00100000:1.0:1651532262.160522:0:166102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 323
00000100:00100000:1.0:1651532262.160523:0:166102:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a925fbf6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754469125312:12345-10.240.43.64@tcp:103:ldlm_bl_06.0
00010000:00010000:0.0:1651532262.160524:0:166104:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1651532262.160527:0:166102:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651532262.160530:0:166104:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca59a6 lrc: 5/0,0 mode: PW/PW res: [0x34552:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ff28 expref: 13 pid: 167632 timeout: 23070 lvb_type: 0
00010000:00010000:1.0:1651532262.160532:0:166102:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca599f lrc: 5/0,0 mode: PW/PW res: [0x34551:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ff1a expref: 13 pid: 166111 timeout: 23070 lvb_type: 0
00010000:00010000:0.0:1651532262.160535:0:166104:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca59a6 lrc: 4/0,0 mode: PW/PW res: [0x34552:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ff28 expref: 13 pid: 167632 timeout: 23070 lvb_type: 0
00010000:00010000:1.0:1651532262.160536:0:166102:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca599f lrc: 4/0,0 mode: PW/PW res: [0x34551:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ff1a expref: 13 pid: 166111 timeout: 23070 lvb_type: 0
00010000:00010000:1.0:1651532262.160543:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532262.160543:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532262.160543:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532262.160544:0:166102:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca59ad lrc: 3/0,1 mode: PW/PW res: [0x34551:0x0:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532262.160544:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532262.160544:0:166104:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca59b4 lrc: 3/0,1 mode: PW/PW res: [0x34552:0x0:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532262.160548:0:166102:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca59ad lrc: 4/0,1 mode: PW/PW res: [0x34551:0x0:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532262.160551:0:166104:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca59b4 lrc: 4/0,1 mode: PW/PW res: [0x34552:0x0:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532262.160553:0:166102:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1651532262.160557:0:166104:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1651532262.160566:0:166102:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a925fbf6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754469125312:12345-10.240.43.64@tcp:103:ldlm_bl_06.0 Request processed in 42us (72us total) trans 0 rc 0/0
00000100:00100000:1.0:1651532262.160570:0:166102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 323
00000100:00100000:0.0:1651532262.160572:0:166104:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b129d249 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754469125184:12345-10.240.43.64@tcp:103:ldlm_bl_06.0 Request processed in 57us (96us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532262.160575:0:166104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 322
00010000:00010000:1.0:1651532262.160585:0:216323:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca599f lrc: 0/0,0 mode: --/PW res: [0x34551:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ff1a expref: 11 pid: 166111 timeout: 23070 lvb_type: 0
00000100:00100000:1.0:1651532262.160589:0:216323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ffcdece2 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_010:lustre-OST0001_UUID:216323:1731745997364480:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651532262.160597:0:216323:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca59ad lrc: 3/0,1 mode: PW/PW res: [0x34551:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532262.160599:0:216321:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca59a6 lrc: 0/0,0 mode: --/PW res: [0x34552:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ff28 expref: 10 pid: 167632 timeout: 23070 lvb_type: 0
00010000:00010000:1.0:1651532262.160601:0:216323:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca59ad lrc: 3/0,1 mode: PW/PW res: [0x34551:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532262.160603:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca59ad lrc: 3/0,1 mode: PW/PW res: [0x34551:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532262.160603:0:216321:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000009c4c564 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997364544:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651532262.160608:0:216321:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca59b4 lrc: 3/0,1 mode: PW/PW res: [0x34552:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532262.160611:0:216321:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca59b4 lrc: 3/0,1 mode: PW/PW res: [0x34552:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532262.160614:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca59b4 lrc: 3/0,1 mode: PW/PW res: [0x34552:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532262.162045:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532262.162097:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532262.162397:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469125632
00000100:00100000:1.0:1651532262.162421:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469125568
00000100:00100000:1.0:1651532262.162431:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250806
00000100:00100000:1.0:1651532262.162433:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000009c4c564 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754469125632:12345-10.240.43.64@tcp:4:dd.0
00010000:00010000:1.0:1651532262.162442:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca59bb lrc: 3/0,1 mode: --/PW res: [0x34552:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532262.162447:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532262.162447:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532262.162448:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca59bb lrc: 3/0,1 mode: PW/PW res: [0x34552:0x0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532262.162461:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca59bb lrc: 3/0,1 mode: PW/PW res: [0x34552:0x0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532262.162559:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250807
00000100:00100000:0.0:1651532262.162562:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f7006631 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438148:x1731754469125568:12345-10.240.43.64@tcp:4:dd.0
00010000:00010000:0.0:1651532262.162571:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca59c2 lrc: 3/0,1 mode: --/PW res: [0x34551:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532262.162577:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532262.162578:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532262.162579:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca59c2 lrc: 3/0,1 mode: PW/PW res: [0x34551:0x0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532262.162583:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca59c2 lrc: 3/0,1 mode: PW/PW res: [0x34551:0x0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532262.607953:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869624 is committed
00002000:00010000:0.0:1651532262.608029:0:216323:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x34551:0x0] updating lvb size from disk: 0 -> 2097152
00002000:00010000:0.0:1651532262.608031:0:216323:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x34551:0x0] updating lvb blocks from disk: 0 -> 4096
00010000:00010000:0.0:1651532262.608037:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca59ad lrc: 3/0,1 mode: PW/PW res: [0x34551:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532262.608043:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca59ad lrc: 2/0,0 mode: PW/PW res: [0x34551:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532262.608076:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003562cf4d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754469124864:12345-10.240.43.64@tcp:4:dd.0 Request processed in 448049us (448112us total) trans 21474869624 rc 0/0
00000100:00100000:0.0:1651532262.608080:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250804
00010000:00010000:0.0:1651532262.608092:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca59ad lrc: 2/0,0 mode: PW/PW res: [0x34551:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532262.608096:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000060a6272d already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651532262.608098:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca59ad lrc: 2/0,0 mode: PW/PW res: [0x34551:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532262.608101:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca59ad lrc: 3/0,0 mode: PW/PW res: [0x34551:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532262.608114:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca59ad lrc: 1/0,0 mode: --/PW res: [0x34551:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532262.608117:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000060a6272d/0x3234de053ca59ad lrc: 0/0,0 mode: --/PW res: [0x34551:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532262.648042:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869627 is committed
00002000:00010000:0.0:1651532262.648090:0:192755:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x34552:0x0] updating lvb size from disk: 0 -> 2097152
00002000:00010000:0.0:1651532262.648092:0:192755:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x34552:0x0] updating lvb blocks from disk: 0 -> 4096
00010000:00010000:0.0:1651532262.648095:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca59bb lrc: 3/0,1 mode: PW/PW res: [0x34552:0x0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532262.648098:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca59bb lrc: 2/0,0 mode: PW/PW res: [0x34552:0x0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532262.648117:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000009c4c564 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438148:x1731754469125632:12345-10.240.43.64@tcp:4:dd.0 Request processed in 485684us (486073us total) trans 21474869626 rc 0/0
00000100:00100000:0.0:1651532262.648121:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250806
00010000:00010000:0.0:1651532262.648128:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca59bb lrc: 2/0,0 mode: PW/PW res: [0x34552:0x0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532262.648132:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f6ecb7e5 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651532262.648133:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca59bb lrc: 2/0,0 mode: PW/PW res: [0x34552:0x0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532262.648136:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca59bb lrc: 3/0,0 mode: PW/PW res: [0x34552:0x0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532262.648145:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca59bb lrc: 1/0,0 mode: --/PW res: [0x34552:0x0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532262.648148:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6ecb7e5/0x3234de053ca59bb lrc: 0/0,0 mode: --/PW res: [0x34552:0x0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532262.648170:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca59c2 lrc: 3/0,1 mode: PW/PW res: [0x34551:0x0:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532262.648173:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca59c2 lrc: 2/0,0 mode: PW/PW res: [0x34551:0x0:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532262.648193:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f7006631 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754469125568:12345-10.240.43.64@tcp:4:dd.0 Request processed in 485631us (486097us total) trans 21474869627 rc 0/0
00000100:00100000:0.0:1651532262.648196:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250807
00010000:00010000:1.0:1651532262.648199:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca59c2 lrc: 2/0,0 mode: PW/PW res: [0x34551:0x0:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532262.648209:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002c5e01dd already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651532262.648210:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca59c2 lrc: 2/0,0 mode: PW/PW res: [0x34551:0x0:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532262.648214:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca59c2 lrc: 3/0,0 mode: PW/PW res: [0x34551:0x0:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532262.648220:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca59c2 lrc: 1/0,0 mode: --/PW res: [0x34551:0x0:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532262.648234:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca59c2 lrc: 0/0,0 mode: --/PW res: [0x34551:0x0:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532262.648242:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca59b4 lrc: 3/0,1 mode: PW/PW res: [0x34552:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532262.648246:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca59b4 lrc: 2/0,0 mode: PW/PW res: [0x34552:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532262.648259:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006e255cae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438148:x1731754469124928:12345-10.240.43.64@tcp:4:dd.0 Request processed in 488226us (488263us total) trans 21474869625 rc 0/0
00000100:00100000:0.0:1651532262.648262:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250805
00010000:00010000:0.0:1651532262.648268:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca59b4 lrc: 2/0,0 mode: PW/PW res: [0x34552:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532262.648275:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000075a78972 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651532262.648276:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca59b4 lrc: 2/0,0 mode: PW/PW res: [0x34552:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532262.648278:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca59b4 lrc: 3/0,0 mode: PW/PW res: [0x34552:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532262.648283:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca59b4 lrc: 1/0,0 mode: --/PW res: [0x34552:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532262.648286:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca59b4 lrc: 0/0,0 mode: --/PW res: [0x34552:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532262.684988:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532262.684998:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469126016
00000100:00100000:0.0:1651532262.685012:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250808
00000100:00100000:0.0:1651532262.685014:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c683c211 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438148:x1731754469126016:12345-10.240.43.64@tcp:4:dd.0
00002000:00010000:0.0:1651532262.685025:0:216321:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34551:0x0] initial LVB size: 2097152, mtime: 0x627061e6, atime: 0x0, ctime: 0x627061e6, blocks: 0x1000
00010000:00010000:0.0:1651532262.685027:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca59c9 lrc: 3/0,1 mode: --/PW res: [0x34551:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532262.685032:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532262.685033:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532262.685034:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca59c9 lrc: 3/0,1 mode: PW/PW res: [0x34551:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532262.685039:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca59c9 lrc: 3/0,1 mode: PW/PW res: [0x34551:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532262.685105:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532262.685124:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469126080
00000100:00100000:1.0:1651532262.685140:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250809
00000100:00100000:1.0:1651532262.685142:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ffcdece2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438148:x1731754469126080:12345-10.240.43.64@tcp:4:dd.0
00002000:00010000:1.0:1651532262.685152:0:192753:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34552:0x0] initial LVB size: 2097152, mtime: 0x627061e6, atime: 0x0, ctime: 0x627061e6, blocks: 0x1000
00010000:00010000:1.0:1651532262.685155:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca59d0 lrc: 3/0,1 mode: --/PW res: [0x34552:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532262.685160:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532262.685160:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532262.685161:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca59d0 lrc: 3/0,1 mode: PW/PW res: [0x34552:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532262.685165:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca59d0 lrc: 3/0,1 mode: PW/PW res: [0x34552:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532263.035151:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869629 is committed
00002000:00010000:1.0:1651532263.035198:0:192753:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x34552:0x0] updating lvb size from disk: 2097152 -> 4194304
00002000:00010000:1.0:1651532263.035199:0:192753:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x34552:0x0] updating lvb blocks from disk: 4096 -> 8192
00010000:00010000:1.0:1651532263.035204:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca59d0 lrc: 3/0,1 mode: PW/PW res: [0x34552:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532263.035209:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca59d0 lrc: 2/0,0 mode: PW/PW res: [0x34552:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00002000:00010000:0.0:1651532263.035212:0:216321:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x34551:0x0] updating lvb size from disk: 2097152 -> 4194304
00002000:00010000:0.0:1651532263.035215:0:216321:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x34551:0x0] updating lvb blocks from disk: 4096 -> 8192
00010000:00010000:0.0:1651532263.035219:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca59c9 lrc: 3/0,1 mode: PW/PW res: [0x34551:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532263.035237:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca59c9 lrc: 2/0,0 mode: PW/PW res: [0x34551:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532263.035248:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ffcdece2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438148:x1731754469126080:12345-10.240.43.64@tcp:4:dd.0 Request processed in 350104us (350143us total) trans 21474869629 rc 0/0
00000100:00100000:1.0:1651532263.035252:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250809
00010000:00010000:1.0:1651532263.035264:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca59d0 lrc: 2/0,0 mode: PW/PW res: [0x34552:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532263.035267:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001cf49bf2 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651532263.035269:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca59d0 lrc: 2/0,0 mode: PW/PW res: [0x34552:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532263.035269:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c683c211 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438148:x1731754469126016:12345-10.240.43.64@tcp:4:dd.0 Request processed in 350254us (350281us total) trans 21474869628 rc 0/0
00010000:00010000:1.0:1651532263.035272:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca59d0 lrc: 3/0,0 mode: PW/PW res: [0x34552:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532263.035273:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250808
00010000:00010000:1.0:1651532263.035279:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca59d0 lrc: 1/0,0 mode: --/PW res: [0x34552:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532263.035282:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca59d0 lrc: 0/0,0 mode: --/PW res: [0x34552:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532263.035283:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca59c9 lrc: 2/0,0 mode: PW/PW res: [0x34551:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532263.035287:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000075a78972 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651532263.035288:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca59c9 lrc: 2/0,0 mode: PW/PW res: [0x34551:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532263.035291:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca59c9 lrc: 3/0,0 mode: PW/PW res: [0x34551:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532263.035297:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca59c9 lrc: 1/0,0 mode: --/PW res: [0x34551:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532263.035300:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca59c9 lrc: 0/0,0 mode: --/PW res: [0x34551:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532263.089370:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532263.089396:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469126592
00000100:00100000:1.0:1651532263.089419:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 523
00000100:00100000:1.0:1651532263.089421:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003d9ef3c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0c703c47-a140-4387-a181-4e0a15e9b24e+6:687483:x1731754469126592:12345-10.240.43.64@tcp:13:lctl.0
00002000:00000024:1.0:1651532263.089429:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 2146304 granted 357474880 pending 0 free 81283502080 avail 77104205824
00000100:00100000:1.0:1651532263.089444:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003d9ef3c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0c703c47-a140-4387-a181-4e0a15e9b24e+6:687483:x1731754469126592:12345-10.240.43.64@tcp:13:lctl.0 Request processed in 22us (75us total) trans 0 rc 0/0
00000100:00100000:1.0:1651532263.089447:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 523
00000400:00000080:0.0:1651532263.391819:0:233649:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648
00000001:02000400:0.0:1651532263.391821:0:233649:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity test_398l 150489656 > 600000 skipping out-of-space test on OST0
00000100:00100000:0.0:1651532263.416131:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532263.416145:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532263.416158:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469126720
00000100:00100000:0.0:1651532263.416182:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469126848
00000100:00100000:0.0:1651532263.416189:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44973
00000100:00100000:0.0:1651532263.416191:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007a31f638 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438146:x1731754469126720:12345-10.240.43.64@tcp:101:rm.0
00000100:00100000:1.0:1651532263.416197:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44974
00000100:00100000:1.0:1651532263.416200:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000bade01cc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438146:x1731754469126848:12345-10.240.43.64@tcp:101:rm.0
00010000:00010000:0.0:1651532263.416201:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532263.416206:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532263.416212:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca59d7 lrc: 2/0,0 mode: --/PR res: [0x34551:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ff3d expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532263.416213:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca59de lrc: 2/0,0 mode: --/PR res: [0x34552:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ff4b expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651532263.416235:0:166113:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34552:0x0] initial LVB size: 4194304, mtime: 0x627061e6, atime: 0x0, ctime: 0x627061e6, blocks: 0x2000
00002000:00010000:0.0:1651532263.416240:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34551:0x0] initial LVB size: 4194304, mtime: 0x627061e6, atime: 0x0, ctime: 0x627061e6, blocks: 0x2000
00010000:00010000:1.0:1651532263.416249:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532263.416249:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532263.416250:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532263.416250:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532263.416254:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca59de lrc: 3/0,0 mode: PR/PR res: [0x34552:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ff4b expref: 9 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532263.416254:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca59d7 lrc: 3/0,0 mode: PR/PR res: [0x34551:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ff3d expref: 9 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532263.416264:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca59de lrc: 3/0,0 mode: PR/PR res: [0x34552:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ff4b expref: 9 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532263.416264:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca59d7 lrc: 3/0,0 mode: PR/PR res: [0x34551:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ff3d expref: 9 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532263.416269:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001cf49bf2, rc 0)
00010000:00010000:0.0:1651532263.416269:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000075a78972, rc 0)
00000100:00100000:0.0:1651532263.416293:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007a31f638 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438146:x1731754469126720:12345-10.240.43.64@tcp:101:rm.0 Request processed in 101us (165us total) trans 0 rc 0/0
00000100:00100000:1.0:1651532263.416297:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000bade01cc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438146:x1731754469126848:12345-10.240.43.64@tcp:101:rm.0 Request processed in 97us (152us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532263.416297:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44973
00000100:00100000:1.0:1651532263.416303:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44974
00000100:00100000:1.0:1651532263.648361:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651532263.648378:0:182071:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951239744
00000100:00100000:1.0:1651532263.648397:0:182071:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 524
00000100:00100000:1.0:1651532263.648399:0:182071:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000942b56fd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951239744:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:1.0:1651532263.648425:0:182071:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 2146304 granted 357474880 pending 0 free 81275113472 avail 77104402432
00000100:00100000:1.0:1651532263.648468:0:182071:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000942b56fd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951239744:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 68us (110us total) trans 0 rc 0/0
00000100:00100000:1.0:1651532263.648472:0:182071:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 524
00000400:00000080:0.0:1651532263.749336:0:233703:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648
00000001:02000400:0.0:1651532263.749338:0:233703:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 398m: test RPC failures with parallel dio ========================================================== 22:57:43 (1651532263)
00000100:00100000:1.0:1651532263.970419:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532263.970438:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469128128
00000100:00100000:1.0:1651532263.970462:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44975
00000100:00100000:1.0:1651532263.970465:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007f998d3c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+8:687797:x1731754469128128:12345-10.240.43.64@tcp:101:dd.0
00010000:00010000:1.0:1651532263.970475:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532263.970487:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca59e5 lrc: 2/0,0 mode: --/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ff83 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651532263.970498:0:166113:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34555:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:1.0:1651532263.970508:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532263.970509:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532263.970513:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca59e5 lrc: 3/0,0 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ff83 expref: 9 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532263.970520:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca59e5 lrc: 3/0,0 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ff83 expref: 9 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532263.970530:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f2af03c8, rc 0)
00000100:00100000:1.0:1651532263.970552:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007f998d3c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+9:687797:x1731754469128128:12345-10.240.43.64@tcp:101:dd.0 Request processed in 86us (146us total) trans 0 rc 0/0
00000100:00100000:1.0:1651532263.970555:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44975
00000100:00100000:1.0:1651532263.971133:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532263.971141:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469128256
00000100:00100000:1.0:1651532263.971154:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44976
00000100:00100000:1.0:1651532263.971156:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000964ce442 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+9:687797:x1731754469128256:12345-10.240.43.64@tcp:101:dd.0
00010000:00010000:1.0:1651532263.971159:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532263.971164:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca59ec lrc: 2/0,0 mode: --/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ff91 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651532263.971169:0:166113:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34556:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:1.0:1651532263.971174:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532263.971174:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532263.971176:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca59ec lrc: 3/0,0 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ff91 expref: 10 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532263.971180:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca59ec lrc: 3/0,0 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ff91 expref: 10 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532263.971184:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000eebd17a1, rc 0)
00000100:00100000:1.0:1651532263.971194:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000964ce442 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+10:687797:x1731754469128256:12345-10.240.43.64@tcp:101:dd.0 Request processed in 38us (62us total) trans 0 rc 0/0
00000100:00100000:1.0:1651532263.971197:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44976
00000100:00100000:1.0:1651532263.971466:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532263.971480:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532263.971489:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469128384
00000100:00100000:0.0:1651532263.971491:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469128512
00002000:00010000:1.0:1651532263.971497:0:192753:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 214357/0 (0->18446744073709551615)
00002000:00100000:1.0:1651532263.971499:0:192753:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000008f58a6d8 with x1731754469128384 ext(0->18446744073709551615)
00002000:00010000:0.0:1651532263.971501:0:216321:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 214358/0 (0->18446744073709551615)
00002000:00010000:1.0:1651532263.971502:0:192753:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000008f58a6d8.
00002000:00100000:0.0:1651532263.971503:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000004d249e37 with x1731754469128512 ext(0->18446744073709551615)
00002000:00010000:0.0:1651532263.971507:0:216321:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000004d249e37.
00000100:00100000:1.0:1651532263.971512:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250810
00000100:00100000:1.0:1651532263.971513:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000008f58a6d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754469128384:12345-10.240.43.64@tcp:10:dd.0
00000100:00100000:0.0:1651532263.971520:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250811
00000100:00100000:0.0:1651532263.971523:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004d249e37 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754469128512:12345-10.240.43.64@tcp:10:dd.0
00002000:00010000:1.0:1651532263.971577:0:192753:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x34555:0x0] updating lvb size from disk: 0 -> 0
00002000:00010000:1.0:1651532263.971578:0:192753:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x34555:0x0] updating lvb mtime from disk: 0 -> 1651532263
00002000:00010000:0.0:1651532263.971578:0:216321:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x34556:0x0] updating lvb size from disk: 0 -> 0
00002000:00010000:1.0:1651532263.971579:0:192753:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x34555:0x0] updating lvb atime from disk: 0 -> 0
00002000:00010000:0.0:1651532263.971579:0:216321:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x34556:0x0] updating lvb mtime from disk: 0 -> 1651532263
00002000:00010000:1.0:1651532263.971580:0:192753:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x34555:0x0] updating lvb ctime from disk: 0 -> 1651532263
00002000:00010000:0.0:1651532263.971580:0:216321:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x34556:0x0] updating lvb atime from disk: 0 -> 0
00002000:00010000:1.0:1651532263.971581:0:192753:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x34555:0x0] updating lvb blocks from disk: 0 -> 0
00002000:00010000:0.0:1651532263.971581:0:216321:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x34556:0x0] updating lvb ctime from disk: 0 -> 1651532263
00002000:00010000:0.0:1651532263.971582:0:216321:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x34556:0x0] updating lvb blocks from disk: 0 -> 0
00000100:00100000:1.0:1651532263.971592:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000008f58a6d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754469128384:12345-10.240.43.64@tcp:10:dd.0 Request processed in 78us (127us total) trans 21474869630 rc 0/0
00000100:00100000:1.0:1651532263.971595:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250810
00000100:00100000:0.0:1651532263.971595:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004d249e37 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754469128512:12345-10.240.43.64@tcp:10:dd.0 Request processed in 72us (115us total) trans 21474869631 rc 0/0
00002000:00010000:1.0:1651532263.971596:0:192753:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 214357/0 (0->18446744073709551615)
00002000:00100000:1.0:1651532263.971597:0:192753:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000008f58a6d8 with x1731754469128384 ext(0->18446744073709551615)
00002000:00010000:1.0:1651532263.971599:0:192753:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000008f58a6d8.
00000100:00100000:0.0:1651532263.971599:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250811
00002000:00010000:0.0:1651532263.971600:0:216321:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 214358/0 (0->18446744073709551615)
00002000:00100000:0.0:1651532263.971601:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000004d249e37 with x1731754469128512 ext(0->18446744073709551615)
00002000:00010000:0.0:1651532263.971603:0:216321:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000004d249e37.
00000100:00100000:1.0:1651532264.009136:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532264.009159:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469128832
00000100:00100000:0.0:1651532264.009172:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250812
00000100:00100000:0.0:1651532264.009174:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000053497d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438149:x1731754469128832:12345-10.240.43.64@tcp:4:dd.0
00010000:00010000:0.0:1651532264.009183:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca59f3 lrc: 3/0,1 mode: --/PW res: [0x34555:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532264.009210:0:192755:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca59e5 lrc: 2/0,0 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ff83 expref: 12 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532264.009215:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532264.009216:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532264.009217:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca59f3 lrc: 4/0,1 mode: --/PW res: [0x34555:0x0:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532264.009244:0:192755:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca59e5 lrc: 3/0,0 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ff83 expref: 12 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532264.009249:0:192755:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca59e5 lrc: 4/0,0 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ff83 expref: 12 pid: 166113 timeout: 23072 lvb_type: 0
00000100:00100000:1.0:1651532264.009251:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532264.009260:0:192755:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005020f75d pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0001_UUID:192755:1731745997364608:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651532264.009266:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469128896
00000100:00100000:1.0:1651532264.009278:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250813
00000100:00100000:1.0:1651532264.009279:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000df1eb0d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438149:x1731754469128896:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:0.0:1651532264.009283:0:192755:0:(client.c:2492:ptlrpc_set_wait()) set 000000008ce9bece going to sleep for 6 seconds
00010000:00010000:1.0:1651532264.009293:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca59fa lrc: 3/0,1 mode: --/PW res: [0x34556:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532264.009301:0:216323:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca59ec lrc: 2/0,0 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ff91 expref: 13 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532264.009305:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532264.009305:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532264.009306:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca59fa lrc: 4/0,1 mode: --/PW res: [0x34556:0x0:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532264.009314:0:216323:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca59ec lrc: 3/0,0 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ff91 expref: 13 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532264.009318:0:216323:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca59ec lrc: 4/0,0 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ff91 expref: 13 pid: 166113 timeout: 23072 lvb_type: 0
00000100:00100000:1.0:1651532264.009322:0:216323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007d76765b pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_010:lustre-OST0001_UUID:216323:1731745997364672:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651532264.009333:0:216323:0:(client.c:2492:ptlrpc_set_wait()) set 000000005d950c46 going to sleep for 6 seconds
00000100:00100000:1.0:1651532264.009741:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532264.009751:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532264.009753:0:192755:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005020f75d pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0001_UUID:192755:1731745997364608:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651532264.009764:0:216323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007d76765b pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_010:lustre-OST0001_UUID:216323:1731745997364672:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651532264.009765:0:192755:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca59f3 lrc: 3/0,1 mode: --/PW res: [0x34555:0x0:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532264.009769:0:216323:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca59fa lrc: 3/0,1 mode: --/PW res: [0x34556:0x0:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532264.009774:0:169267:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469129216
00000100:00100000:1.0:1651532264.009780:0:166103:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469129280
00010000:00010000:0.0:1651532264.009780:0:169267:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca59e5 lrc: 4/0,0 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ff83 expref: 14 pid: 166113 timeout: 23072 lvb_type: 0
00010000:00010000:1.0:1651532264.009786:0:166103:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca59ec lrc: 4/0,0 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ff91 expref: 15 pid: 166113 timeout: 23072 lvb_type: 0
00000100:00100000:0.0:1651532264.009789:0:169267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 324
00000100:00100000:0.0:1651532264.009791:0:169267:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009c93d7f2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754469129216:12345-10.240.43.64@tcp:103:ldlm_bl_05.0
00010000:00010000:0.0:1651532264.009795:0:169267:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00000100:00100000:1.0:1651532264.009798:0:166103:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 325
00010000:00010000:0.0:1651532264.009799:0:169267:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca59e5 lrc: 4/0,0 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ff83 expref: 15 pid: 166113 timeout: 23072 lvb_type: 0
00000100:00100000:1.0:1651532264.009800:0:166103:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c4ea889e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438146:x1731754469129280:12345-10.240.43.64@tcp:103:ldlm_bl_05.0
00010000:00010000:1.0:1651532264.009802:0:166103:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651532264.009804:0:169267:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca59e5 lrc: 3/0,0 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ff83 expref: 15 pid: 166113 timeout: 23072 lvb_type: 0
00010000:00010000:1.0:1651532264.009806:0:166103:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca59ec lrc: 4/0,0 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ff91 expref: 15 pid: 166113 timeout: 23072 lvb_type: 0
00010000:00010000:1.0:1651532264.009810:0:166103:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca59ec lrc: 3/0,0 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ff91 expref: 15 pid: 166113 timeout: 23072 lvb_type: 0
00010000:00010000:0.0:1651532264.009812:0:169267:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f2af03c8/0x3234de053ca59e5 lrc: 0/0,0 mode: --/PW res: [0x34555:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ff83 expref: 15 pid: 166113 timeout: 23072 lvb_type: 0
00010000:00010000:0.0:1651532264.009815:0:169267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532264.009816:0:166103:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca59ec lrc: 0/0,0 mode: --/PW res: [0x34556:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ff91 expref: 14 pid: 166113 timeout: 23072 lvb_type: 0
00010000:00010000:0.0:1651532264.009816:0:169267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532264.009817:0:169267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca59f3 lrc: 3/0,1 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532264.009820:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532264.009820:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532264.009820:0:169267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca59f3 lrc: 4/0,1 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532264.009821:0:166103:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca59fa lrc: 3/0,1 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532264.009824:0:166103:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca59fa lrc: 4/0,1 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532264.009827:0:169267:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1651532264.009831:0:166103:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651532264.009842:0:169267:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009c93d7f2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754469129216:12345-10.240.43.64@tcp:103:ldlm_bl_05.0 Request processed in 50us (101us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532264.009845:0:169267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 324
00000100:00100000:1.0:1651532264.009847:0:166103:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c4ea889e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754469129280:12345-10.240.43.64@tcp:103:ldlm_bl_05.0 Request processed in 46us (95us total) trans 0 rc 0/0
00000100:00100000:1.0:1651532264.009849:0:166103:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 325
00010000:00010000:0.0:1651532264.009854:0:192755:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca59f3 lrc: 3/0,1 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532264.009857:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca59f3 lrc: 3/0,1 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532264.009858:0:216323:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca59fa lrc: 3/0,1 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532264.009865:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca59fa lrc: 3/0,1 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532264.061290:0:39099:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005020f75d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9063caa-b124-4cb6-99ef-d01a735595c3:39099:1731745997364736:10.240.43.61@tcp:400:kworker/u4:2.0
00000100:00100000:1.0:1651532264.061292:0:39100:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007a31f638 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:39100:1731745997364800:10.240.43.61@tcp:400:kworker/u4:2.0
00000100:00100000:0.0:1651532264.061644:0:39099:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005020f75d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9063caa-b124-4cb6-99ef-d01a735595c3:39099:1731745997364736:10.240.43.61@tcp:400:kworker/u4:2.0
00000100:00100000:1.0:1651532264.061655:0:39100:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007a31f638 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:39100:1731745997364800:10.240.43.61@tcp:400:kworker/u4:2.0
00000001:00080000:1.0:1651532264.195445:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869632 is committed
00002000:00010000:0.0:1651532264.195515:0:192755:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x34555:0x0] updating lvb size from disk: 0 -> 2097152
00002000:00010000:0.0:1651532264.195517:0:192755:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x34555:0x0] updating lvb mtime from disk: 1651532263 -> 1651532264
00002000:00010000:0.0:1651532264.195518:0:192755:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x34555:0x0] updating lvb ctime from disk: 1651532263 -> 1651532264
00002000:00010000:0.0:1651532264.195519:0:192755:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x34555:0x0] updating lvb blocks from disk: 0 -> 4096
00010000:00010000:0.0:1651532264.195525:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca59f3 lrc: 3/0,1 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532264.195530:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca59f3 lrc: 2/0,0 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532264.195559:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca59f3 lrc: 2/0,0 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532264.195564:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000053497d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438149:x1731754469128832:12345-10.240.43.64@tcp:4:dd.0 Request processed in 186389us (186427us total) trans 21474869632 rc 0/0
00000100:00100000:0.0:1651532264.195569:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250812
00010000:00010000:1.0:1651532264.195584:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000775318ab already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651532264.195585:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca59f3 lrc: 2/0,0 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532264.195590:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca59f3 lrc: 3/0,0 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532264.195598:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca59f3 lrc: 1/0,0 mode: --/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532264.195601:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca59f3 lrc: 0/0,0 mode: --/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532264.220493:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869633 is committed
00002000:00010000:1.0:1651532264.220527:0:216323:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x34556:0x0] updating lvb size from disk: 0 -> 2097152
00002000:00010000:1.0:1651532264.220529:0:216323:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x34556:0x0] updating lvb mtime from disk: 1651532263 -> 1651532264
00002000:00010000:1.0:1651532264.220530:0:216323:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x34556:0x0] updating lvb ctime from disk: 1651532263 -> 1651532264
00002000:00010000:1.0:1651532264.220532:0:216323:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x34556:0x0] updating lvb blocks from disk: 0 -> 4096
00010000:00010000:1.0:1651532264.220536:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca59fa lrc: 3/0,1 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532264.220539:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca59fa lrc: 2/0,0 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532264.220564:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000df1eb0d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754469128896:12345-10.240.43.64@tcp:4:dd.0 Request processed in 211283us (211313us total) trans 21474869633 rc 0/0
00000100:00100000:1.0:1651532264.220568:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250813
00010000:00010000:0.0:1651532264.220569:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca59fa lrc: 2/0,0 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532264.220575:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000009c5faf65 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651532264.220576:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca59fa lrc: 2/0,0 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532264.220580:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca59fa lrc: 3/0,0 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532264.220586:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca59fa lrc: 1/0,0 mode: --/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532264.220589:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009c5faf65/0x3234de053ca59fa lrc: 0/0,0 mode: --/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532268.768193:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651532268.768217:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951239936
00000100:00100000:1.0:1651532268.768243:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 525
00000100:00100000:1.0:1651532268.768245:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005020f75d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951239936:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:1.0:1651532268.768258:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 2146304 granted 353182272 pending 0 free 81270919168 avail 77100208128
00000100:00100000:1.0:1651532268.768275:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005020f75d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951239936:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 29us (83us total) trans 0 rc 0/0
00000100:00100000:1.0:1651532268.768278:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 525
00000100:00100000:0.0:1651532268.857522:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651532268.857531:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651532268.857540:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951240000
00000100:00100000:0.0:1651532268.857550:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951240128
00000100:00100000:0.0:1651532268.857555:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 44977
00000100:00100000:0.0:1651532268.857557:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007a31f638 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745951240000:12345-10.240.43.61@tcp:6:osp-syn-1-0.0
00002000:00080000:0.0:1651532268.857566:0:206699:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:214353 count 1
00010000:00010000:0.0:1651532268.857583:0:206699:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca5a01 lrc: 3/0,1 mode: --/PW res: [0x34551:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532268.857592:0:206699:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca59d7 lrc: 2/0,0 mode: PR/PR res: [0x34551:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ff3d expref: 7 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532268.857597:0:206699:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532268.857598:0:206699:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532268.857599:0:206699:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca5a01 lrc: 4/0,1 mode: --/PW res: [0x34551:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532268.857610:0:206699:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca59d7 lrc: 3/0,0 mode: PR/PR res: [0x34551:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ff3d expref: 7 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532268.857616:0:206699:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca59d7 lrc: 4/0,0 mode: PR/PR res: [0x34551:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ff3d expref: 7 pid: 166111 timeout: 23077 lvb_type: 1
00000100:00100000:0.0:1651532268.857622:0:206699:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ffcc974c pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:206699:1731745997364864:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651532268.857648:0:206699:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ed9ce67f going to sleep for 6 seconds
00000100:00100000:0.0:1651532268.857658:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 44978
00000100:00100000:0.0:1651532268.857660:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c43262d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745951240128:12345-10.240.43.61@tcp:6:osp-syn-1-0.0
00002000:00080000:0.0:1651532268.857666:0:167632:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:214354 count 1
00010000:00010000:0.0:1651532268.857670:0:167632:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca5a08 lrc: 3/0,1 mode: --/PW res: [0x34552:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532268.857676:0:167632:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca59de lrc: 2/0,0 mode: PR/PR res: [0x34552:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ff4b expref: 7 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532268.857679:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532268.857680:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532268.857680:0:167632:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca5a08 lrc: 4/0,1 mode: --/PW res: [0x34552:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532268.857687:0:167632:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca59de lrc: 3/0,0 mode: PR/PR res: [0x34552:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ff4b expref: 7 pid: 166113 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532268.857691:0:167632:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca59de lrc: 4/0,0 mode: PR/PR res: [0x34552:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ff4b expref: 7 pid: 166113 timeout: 23077 lvb_type: 1
00000100:00100000:0.0:1651532268.857695:0:167632:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005f06cf32 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:167632:1731745997364928:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651532268.857706:0:167632:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a01e87d3 going to sleep for 6 seconds
00000100:00100000:1.0:1651532268.858073:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532268.858082:0:167632:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005f06cf32 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:167632:1731745997364928:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651532268.858085:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532268.858088:0:167632:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca5a08 lrc: 3/0,1 mode: --/PW res: [0x34552:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532268.858092:0:166102:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469129984
00010000:00010000:1.0:1651532268.858101:0:166102:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca59d7 lrc: 4/0,0 mode: PR/PR res: [0x34551:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ff3d expref: 8 pid: 166111 timeout: 23077 lvb_type: 1
00000100:00100000:0.0:1651532268.858101:0:206699:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ffcc974c pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:206699:1731745997364864:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651532268.858104:0:206699:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca5a01 lrc: 3/0,1 mode: --/PW res: [0x34551:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532268.858114:0:166102:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469130112
00010000:00010000:1.0:1651532268.858118:0:166102:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca59de lrc: 4/0,0 mode: PR/PR res: [0x34552:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ff4b expref: 9 pid: 166113 timeout: 23077 lvb_type: 1
00000100:00100000:0.0:1651532268.858128:0:166103:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 326
00000100:00100000:1.0:1651532268.858130:0:166102:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 327
00000100:00100000:0.0:1651532268.858130:0:166103:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000059e5b3a2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754469129984:12345-10.240.43.64@tcp:103:ldlm_bl_02.0
00000100:00100000:1.0:1651532268.858134:0:166102:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007d76765b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754469130112:12345-10.240.43.64@tcp:103:ldlm_bl_02.0
00010000:00010000:0.0:1651532268.858135:0:166103:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1651532268.858137:0:166102:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651532268.858137:0:166103:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca59d7 lrc: 4/0,0 mode: PR/PR res: [0x34551:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ff3d expref: 9 pid: 166111 timeout: 23077 lvb_type: 1
00010000:00010000:1.0:1651532268.858139:0:166102:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca59de lrc: 4/0,0 mode: PR/PR res: [0x34552:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ff4b expref: 9 pid: 166113 timeout: 23077 lvb_type: 1
00010000:00010000:0.0:1651532268.858142:0:166103:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca59d7 lrc: 3/0,0 mode: PR/PR res: [0x34551:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ff3d expref: 9 pid: 166111 timeout: 23077 lvb_type: 1
00010000:00010000:1.0:1651532268.858144:0:166102:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca59de lrc: 3/0,0 mode: PR/PR res: [0x34552:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ff4b expref: 9 pid: 166113 timeout: 23077 lvb_type: 1
00010000:00010000:0.0:1651532268.858149:0:166103:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca59d7 lrc: 0/0,0 mode: --/PR res: [0x34551:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ff3d expref: 9 pid: 166111 timeout: 23077 lvb_type: 1
00010000:00010000:1.0:1651532268.858150:0:166102:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca59de lrc: 0/0,0 mode: --/PR res: [0x34552:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ff4b expref: 9 pid: 166113 timeout: 23077 lvb_type: 1
00010000:00010000:0.0:1651532268.858153:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532268.858154:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532268.858154:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532268.858155:0:166102:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532268.858155:0:166103:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca5a01 lrc: 3/0,1 mode: PW/PW res: [0x34551:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532268.858156:0:166102:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca5a08 lrc: 3/0,1 mode: PW/PW res: [0x34552:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532268.858159:0:166103:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca5a01 lrc: 4/0,1 mode: PW/PW res: [0x34551:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532268.858160:0:166102:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca5a08 lrc: 4/0,1 mode: PW/PW res: [0x34552:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532268.858166:0:166103:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1651532268.858169:0:166102:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1651532268.858180:0:166102:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007d76765b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438148:x1731754469130112:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 46us (95us total) trans 0 rc 0/0
00000100:00100000:1.0:1651532268.858183:0:166102:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 327
00000100:00100000:0.0:1651532268.858187:0:166103:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000059e5b3a2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438148:x1731754469129984:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 56us (114us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532268.858190:0:166103:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 326
00010000:00010000:0.0:1651532268.858200:0:167632:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca5a08 lrc: 3/0,1 mode: PW/PW res: [0x34552:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532268.858203:0:167632:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca5a08 lrc: 3/0,1 mode: PW/PW res: [0x34552:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532268.858207:0:167632:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca5a08 lrc: 3/0,1 mode: PW/PW res: [0x34552:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532268.858210:0:167632:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca5a08 lrc: 2/0,0 mode: PW/PW res: [0x34552:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532268.858250:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca5a08 lrc: 2/0,0 mode: PW/PW res: [0x34552:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532268.858254:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000032ee36ee already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651532268.858255:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca5a08 lrc: 2/0,0 mode: PW/PW res: [0x34552:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532268.858260:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca5a08 lrc: 3/0,0 mode: PW/PW res: [0x34552:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532268.858266:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca5a08 lrc: 1/0,0 mode: --/PW res: [0x34552:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532268.858268:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca5a08 lrc: 0/0,0 mode: --/PW res: [0x34552:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532268.858718:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c43262d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:39030:x1731745951240128:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1057us (1186us total) trans 21474869634 rc 0/0
00000100:00100000:0.0:1651532268.858722:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 44978
00010000:00010000:0.0:1651532268.858730:0:206699:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca5a01 lrc: 3/0,1 mode: PW/PW res: [0x34551:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532268.858734:0:206699:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca5a01 lrc: 3/0,1 mode: PW/PW res: [0x34551:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532268.858737:0:206699:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca5a01 lrc: 3/0,1 mode: PW/PW res: [0x34551:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532268.858740:0:206699:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca5a01 lrc: 2/0,0 mode: PW/PW res: [0x34551:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532268.858782:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca5a01 lrc: 2/0,0 mode: PW/PW res: [0x34551:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532268.858786:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000014685f38 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651532268.858787:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca5a01 lrc: 2/0,0 mode: PW/PW res: [0x34551:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532268.858790:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca5a01 lrc: 3/0,0 mode: PW/PW res: [0x34551:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532268.858795:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca5a01 lrc: 1/0,0 mode: --/PW res: [0x34551:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532268.858798:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca5a01 lrc: 0/0,0 mode: --/PW res: [0x34551:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532268.859162:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007a31f638 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745951240000:12345-10.240.43.61@tcp:6:osp-syn-1-0.0 Request processed in 1604us (1641us total) trans 21474869635 rc 0/0
00000100:00100000:0.0:1651532268.859166:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 44977
00000100:00100000:1.0:1651532272.864112:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:0.0:1651532272.864138:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951240320
00000100:00100000:0.0:1651532272.864151:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 67
00000100:00100000:0.0:1651532272.864154:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001797bd5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745951240320:12345-10.240.43.61@tcp:400:kworker/u4:2.0
00000100:00100000:0.0:1651532272.864175:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001797bd5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745951240320:12345-10.240.43.61@tcp:400:kworker/u4:2.0 Request processed in 21us (65us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532272.864179:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 67
00000100:00100000:1.0:1651532273.888138:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651532273.888148:0:182071:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951240448
00000100:00100000:1.0:1651532273.888157:0:182071:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 526
00000100:00100000:1.0:1651532273.888159:0:182071:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a899ddab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745951240448:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:1.0:1651532273.888167:0:182071:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 2146304 granted 353182272 pending 0 free 81279307776 avail 77108596736
00000100:00100000:1.0:1651532273.888178:0:182071:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a899ddab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:39029:x1731745951240448:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 19us (42us total) trans 0 rc 0/0
00000100:00100000:1.0:1651532273.888182:0:182071:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 526
00000001:00080000:1.0:1651532274.329010:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869635 is committed
00000100:00100000:1.0:1651532279.008135:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651532279.008146:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651532279.008159:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951240512
00000100:00100000:1.0:1651532279.008169:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 527
00000100:00100000:0.0:1651532279.008170:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951240704
00000100:00100000:1.0:1651532279.008171:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000053de45f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951240512:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:1.0:1651532279.008179:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 2146304 granted 353182272 pending 0 free 81279307776 avail 77108596736
00000100:00100000:0.0:1651532279.008182:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 68
00000100:00100000:0.0:1651532279.008185:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000036ee6adc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:39029:x1731745951240704:12345-10.240.43.61@tcp:400:kworker/u4:2.0
00000100:00100000:1.0:1651532279.008192:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000053de45f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:39030:x1731745951240512:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 20us (59us total) trans 0 rc 0/0
00000100:00100000:1.0:1651532279.008195:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 527
00000100:00100000:0.0:1651532279.008199:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000036ee6adc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951240704:12345-10.240.43.61@tcp:400:kworker/u4:2.0 Request processed in 14us (53us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532279.008202:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 68
00000100:00100000:1.0:1651532284.128120:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651532284.128130:0:182071:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951240832
00000100:00100000:1.0:1651532284.128140:0:182071:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 528
00000100:00100000:1.0:1651532284.128142:0:182071:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000089660739 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951240832:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:1.0:1651532284.128154:0:182071:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 2146304 granted 353182272 pending 0 free 81279307776 avail 77108596736
00000100:00100000:1.0:1651532284.128173:0:182071:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000089660739 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951240832:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 29us (54us total) trans 0 rc 0/0
00000100:00100000:1.0:1651532284.128178:0:182071:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 528
00000100:00100000:0.0:1651532289.149274:0:39099:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005f06cf32 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9063caa-b124-4cb6-99ef-d01a735595c3:39099:1731745997364992:10.240.43.61@tcp:400:kworker/u4:2.0
00000100:00100000:1.0:1651532289.149289:0:39100:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000015ad4671 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:39100:1731745997365056:10.240.43.61@tcp:400:kworker/u4:2.0
00000100:00100000:1.0:1651532289.149585:0:39100:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000015ad4671 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:39100:1731745997365056:10.240.43.61@tcp:400:kworker/u4:2.0
00000100:00100000:0.0:1651532289.149588:0:39099:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005f06cf32 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9063caa-b124-4cb6-99ef-d01a735595c3:39099:1731745997364992:10.240.43.61@tcp:400:kworker/u4:2.0
00000100:00100000:0.0:1651532289.248086:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651532289.248110:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951241024
00000100:00100000:1.0:1651532289.248121:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 529
00000100:00100000:1.0:1651532289.248124:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005f06cf32 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951241024:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:1.0:1651532289.248131:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 2146304 granted 353182272 pending 0 free 81279307776 avail 77108596736
00000100:00100000:1.0:1651532289.248143:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005f06cf32 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951241024:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 19us (59us total) trans 0 rc 0/0
00000100:00100000:1.0:1651532289.248147:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 529
00000100:00100000:0.0:1651532293.824982:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532293.824992:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469131392
00000100:00100000:0.0:1651532293.825002:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 69
00000100:00100000:0.0:1651532293.825004:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000bd28b3f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438147:x1731754469131392:12345-10.240.43.64@tcp:400:kworker/u4:0.0
00000100:00100000:0.0:1651532293.825028:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000bd28b3f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438147:x1731754469131392:12345-10.240.43.64@tcp:400:kworker/u4:0.0 Request processed in 23us (47us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532293.825031:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 69
00000100:00100000:0.0:1651532294.368093:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651532294.368118:0:182071:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951241152
00000100:00100000:1.0:1651532294.368130:0:182071:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 530
00000100:00100000:1.0:1651532294.368132:0:182071:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000862392e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951241152:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:1.0:1651532294.368140:0:182071:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 2146304 granted 353182272 pending 0 free 81279307776 avail 77108596736
00000100:00100000:1.0:1651532294.368153:0:182071:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000862392e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951241152:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 20us (61us total) trans 0 rc 0/0
00000100:00100000:1.0:1651532294.368156:0:182071:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 530
00000100:00100000:0.0:1651532299.488211:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651532299.488241:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951241280
00000100:00100000:1.0:1651532299.488253:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 531
00000100:00100000:1.0:1651532299.488255:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000609b5f90 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951241280:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:1.0:1651532299.488263:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 2146304 granted 353182272 pending 0 free 81279307776 avail 77108596736
00000100:00100000:1.0:1651532299.488276:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000609b5f90 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951241280:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 20us (67us total) trans 0 rc 0/0
00000100:00100000:1.0:1651532299.488280:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 531
00000100:00100000:0.0:1651532304.608152:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651532304.608182:0:182071:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951241536
00000100:00100000:1.0:1651532304.608194:0:182071:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 532
00000100:00100000:1.0:1651532304.608196:0:182071:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000085f82b51 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951241536:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:1.0:1651532304.608204:0:182071:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 2146304 granted 353182272 pending 0 free 81279307776 avail 77108596736
00000100:00100000:1.0:1651532304.608217:0:182071:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000085f82b51 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951241536:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 20us (66us total) trans 0 rc 0/0
00000100:00100000:1.0:1651532304.608220:0:182071:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 532
00000100:00100000:0.0:1651532309.728128:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651532309.728159:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951241600
00000100:00100000:1.0:1651532309.728170:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 533
00000100:00100000:1.0:1651532309.728172:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000588d3697 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951241600:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:1.0:1651532309.728179:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 2146304 granted 353182272 pending 0 free 81279307776 avail 77108596736
00000100:00100000:1.0:1651532309.728198:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000588d3697 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951241600:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 25us (71us total) trans 0 rc 0/0
00000100:00100000:1.0:1651532309.728202:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 533
00000100:00100000:0.0:1651532314.237280:0:39099:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000015ad4671 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9063caa-b124-4cb6-99ef-d01a735595c3:39099:1731745997365120:10.240.43.61@tcp:400:kworker/u4:2.0
00000100:00100000:1.0:1651532314.237297:0:39100:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ffcc974c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:39100:1731745997365184:10.240.43.61@tcp:400:kworker/u4:2.0
00000100:00100000:0.0:1651532314.237704:0:39099:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000015ad4671 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9063caa-b124-4cb6-99ef-d01a735595c3:39099:1731745997365120:10.240.43.61@tcp:400:kworker/u4:2.0
00000100:00100000:1.0:1651532314.237715:0:39100:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ffcc974c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:39100:1731745997365184:10.240.43.61@tcp:400:kworker/u4:2.0
00000100:00100000:0.0:1651532314.848110:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651532314.848128:0:182071:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951241792
00000100:00100000:1.0:1651532314.848139:0:182071:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 534
00000100:00100000:1.0:1651532314.848141:0:182071:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ffcc974c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951241792:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:1.0:1651532314.848149:0:182071:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 2146304 granted 353182272 pending 0 free 81279307776 avail 77108596736
00000100:00100000:1.0:1651532314.848167:0:182071:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ffcc974c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951241792:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 25us (58us total) trans 0 rc 0/0
00000100:00100000:1.0:1651532314.848171:0:182071:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 534
00000100:00100000:0.0:1651532319.424935:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532319.424945:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469131968
00000100:00100000:0.0:1651532319.424956:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 70
00000100:00100000:0.0:1651532319.424958:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000015ad4671 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438146:x1731754469131968:12345-10.240.43.64@tcp:400:kworker/u4:0.0
00000100:00100000:0.0:1651532319.424973:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000015ad4671 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438146:x1731754469131968:12345-10.240.43.64@tcp:400:kworker/u4:0.0 Request processed in 15us (40us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532319.424976:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 70
00000100:00100000:0.0:1651532319.968139:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651532319.968172:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951241856
00000100:00100000:1.0:1651532319.968183:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 535
00000100:00100000:1.0:1651532319.968187:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001304ce4c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951241856:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:1.0:1651532319.968194:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 2146304 granted 353182272 pending 0 free 81279307776 avail 77108596736
00000100:00100000:1.0:1651532319.968213:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001304ce4c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951241856:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 25us (74us total) trans 0 rc 0/0
00000100:00100000:1.0:1651532319.968216:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 535
00000100:00100000:0.0:1651532320.649436:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532320.649454:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469132480
00000100:00100000:0.0:1651532320.649464:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44979
00000100:00100000:0.0:1651532320.649465:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d710c5fd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+6:687807:x1731754469132480:12345-10.240.43.64@tcp:101:dd.0
00010000:00010000:0.0:1651532320.649470:0:206699:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532320.649480:0:206699:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca5a0f lrc: 2/0,0 mode: --/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ff9f expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00002000:00010000:0.0:1651532320.649493:0:206699:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34555:0x0] initial LVB size: 2097152, mtime: 0x627061e8, atime: 0x0, ctime: 0x627061e8, blocks: 0x1000
00010000:00010000:0.0:1651532320.649501:0:206699:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532320.649502:0:206699:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532320.649505:0:206699:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca5a0f lrc: 3/0,0 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ff9f expref: 7 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532320.649513:0:206699:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca5a0f lrc: 3/0,0 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ff9f expref: 7 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532320.649518:0:206699:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000075a78972, rc 0)
00000100:00100000:0.0:1651532320.649529:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d710c5fd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+7:687807:x1731754469132480:12345-10.240.43.64@tcp:101:dd.0 Request processed in 63us (94us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532320.649532:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44979
00000100:00100000:0.0:1651532320.649833:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532320.649841:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469132544
00000100:00100000:0.0:1651532320.649849:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44980
00000100:00100000:0.0:1651532320.649851:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002512e905 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+7:687807:x1731754469132544:12345-10.240.43.64@tcp:101:dd.0
00010000:00010000:0.0:1651532320.649854:0:167632:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532320.649859:0:167632:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca5a16 lrc: 2/0,0 mode: --/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ffa6 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00002000:00010000:0.0:1651532320.649865:0:167632:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34556:0x0] initial LVB size: 2097152, mtime: 0x627061e8, atime: 0x0, ctime: 0x627061e8, blocks: 0x1000
00010000:00010000:0.0:1651532320.649869:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532320.649870:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532320.649871:0:167632:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca5a16 lrc: 3/0,0 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ffa6 expref: 8 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532320.649880:0:167632:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca5a16 lrc: 3/0,0 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ffa6 expref: 8 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532320.649884:0:167632:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000014685f38, rc 0)
00000100:00100000:0.0:1651532320.649893:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002512e905 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+8:687807:x1731754469132544:12345-10.240.43.64@tcp:101:dd.0 Request processed in 42us (60us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532320.649896:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44980
00000100:00100000:0.0:1651532320.650162:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532320.650175:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532320.650184:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469132672
00000100:00100000:1.0:1651532320.650186:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469132800
00002000:00010000:0.0:1651532320.650192:0:192755:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 214357/0 (0->18446744073709551615)
00002000:00010000:1.0:1651532320.650194:0:216323:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 214358/0 (0->18446744073709551615)
00002000:00100000:0.0:1651532320.650194:0:192755:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000009b569a7a with x1731754469132672 ext(0->18446744073709551615)
00002000:00100000:1.0:1651532320.650195:0:216323:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000002ef35a72 with x1731754469132800 ext(0->18446744073709551615)
00002000:00010000:0.0:1651532320.650197:0:192755:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000009b569a7a.
00002000:00010000:1.0:1651532320.650199:0:216323:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000002ef35a72.
00000100:00100000:0.0:1651532320.650204:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250814
00000100:00100000:1.0:1651532320.650212:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250815
00000100:00100000:0.0:1651532320.650212:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009b569a7a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754469132672:12345-10.240.43.64@tcp:10:dd.0
00000100:00100000:1.0:1651532320.650214:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002ef35a72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754469132800:12345-10.240.43.64@tcp:10:dd.0
00002000:00010000:1.0:1651532320.650521:0:216323:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x34556:0x0] updating lvb size from disk: 2097152 -> 0
00002000:00010000:0.0:1651532320.650521:0:192755:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x34555:0x0] updating lvb size from disk: 2097152 -> 0
00002000:00010000:1.0:1651532320.650523:0:216323:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x34556:0x0] updating lvb mtime from disk: 1651532264 -> 1651532320
00002000:00010000:0.0:1651532320.650523:0:192755:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x34555:0x0] updating lvb mtime from disk: 1651532264 -> 1651532320
00002000:00010000:1.0:1651532320.650524:0:216323:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x34556:0x0] updating lvb atime from disk: 0 -> 0
00002000:00010000:0.0:1651532320.650524:0:192755:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x34555:0x0] updating lvb atime from disk: 0 -> 0
00002000:00010000:1.0:1651532320.650525:0:216323:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x34556:0x0] updating lvb ctime from disk: 1651532264 -> 1651532320
00002000:00010000:0.0:1651532320.650525:0:192755:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x34555:0x0] updating lvb ctime from disk: 1651532264 -> 1651532320
00002000:00010000:1.0:1651532320.650526:0:216323:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x34556:0x0] updating lvb blocks from disk: 4096 -> 0
00002000:00010000:0.0:1651532320.650526:0:192755:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x34555:0x0] updating lvb blocks from disk: 4096 -> 0
00000100:00100000:1.0:1651532320.650540:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002ef35a72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754469132800:12345-10.240.43.64@tcp:10:dd.0 Request processed in 325us (364us total) trans 21474869637 rc 0/0
00000100:00100000:0.0:1651532320.650540:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009b569a7a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754469132672:12345-10.240.43.64@tcp:10:dd.0 Request processed in 327us (378us total) trans 21474869636 rc 0/0
00000100:00100000:0.0:1651532320.650543:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250814
00002000:00010000:0.0:1651532320.650544:0:192755:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 214357/0 (0->18446744073709551615)
00000100:00100000:1.0:1651532320.650545:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250815
00002000:00010000:1.0:1651532320.650546:0:216323:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 214358/0 (0->18446744073709551615)
00002000:00100000:1.0:1651532320.650547:0:216323:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000002ef35a72 with x1731754469132800 ext(0->18446744073709551615)
00002000:00100000:0.0:1651532320.650547:0:192755:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000009b569a7a with x1731754469132672 ext(0->18446744073709551615)
00002000:00010000:1.0:1651532320.650549:0:216323:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000002ef35a72.
00002000:00010000:0.0:1651532320.650549:0:192755:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000009b569a7a.
00000100:00100000:0.0:1651532320.688068:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532320.688087:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532320.688095:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469133248
00000100:00100000:0.0:1651532320.688111:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469133184
00000100:00100000:0.0:1651532320.688118:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250816
00000100:00100000:0.0:1651532320.688120:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000374facb9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754469133248:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:1.0:1651532320.688125:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250817
00000100:00100000:1.0:1651532320.688127:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000063869776 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438148:x1731754469133184:12345-10.240.43.64@tcp:4:dd.0
00010000:00010000:0.0:1651532320.688129:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca5a1d lrc: 3/0,1 mode: --/PW res: [0x34556:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532320.688135:0:216321:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca5a16 lrc: 2/0,0 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ffa6 expref: 11 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532320.688138:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532320.688139:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532320.688140:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca5a24 lrc: 3/0,1 mode: --/PW res: [0x34555:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532320.688140:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca5a1d lrc: 4/0,1 mode: --/PW res: [0x34556:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532320.688147:0:216323:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca5a0f lrc: 2/0,0 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ff9f expref: 11 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532320.688149:0:216321:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca5a16 lrc: 3/0,0 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ffa6 expref: 11 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532320.688150:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532320.688151:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532320.688152:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca5a24 lrc: 4/0,1 mode: --/PW res: [0x34555:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532320.688154:0:216321:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca5a16 lrc: 4/0,0 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ffa6 expref: 11 pid: 167632 timeout: 23129 lvb_type: 0
00000100:00100000:0.0:1651532320.688159:0:216321:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000052213cb9 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997365248:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651532320.688161:0:216323:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca5a0f lrc: 3/0,0 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ff9f expref: 11 pid: 206699 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532320.688165:0:216323:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca5a0f lrc: 4/0,0 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ff9f expref: 11 pid: 206699 timeout: 23129 lvb_type: 0
00000100:00100000:1.0:1651532320.688169:0:216323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000047c291a9 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_010:lustre-OST0001_UUID:216323:1731745997365312:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651532320.688173:0:216321:0:(client.c:2492:ptlrpc_set_wait()) set 00000000ed9ce67f going to sleep for 6 seconds
00000100:00100000:1.0:1651532320.688181:0:216323:0:(client.c:2492:ptlrpc_set_wait()) set 000000005d950c46 going to sleep for 6 seconds
00000100:00100000:0.0:1651532320.688633:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532320.688643:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532320.688645:0:169267:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469133504
00000100:00100000:0.0:1651532320.688651:0:166103:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469133568
00010000:00010000:1.0:1651532320.688652:0:169267:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca5a16 lrc: 5/0,0 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ffa6 expref: 12 pid: 167632 timeout: 23129 lvb_type: 0
00010000:00010000:0.0:1651532320.688657:0:166103:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca5a0f lrc: 5/0,0 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ff9f expref: 13 pid: 206699 timeout: 23129 lvb_type: 0
00000100:00100000:1.0:1651532320.688662:0:169267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 328
00000100:00100000:1.0:1651532320.688664:0:169267:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000be87d738 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754469133504:12345-10.240.43.64@tcp:103:ldlm_bl_06.0
00010000:00010000:1.0:1651532320.688668:0:169267:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00000100:00100000:0.0:1651532320.688672:0:166103:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 329
00000100:00100000:0.0:1651532320.688674:0:166103:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000d8a3e87c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754469133568:12345-10.240.43.64@tcp:103:ldlm_bl_06.0
00010000:00010000:1.0:1651532320.688678:0:169267:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca5a16 lrc: 5/0,0 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ffa6 expref: 13 pid: 167632 timeout: 23129 lvb_type: 0
00010000:00010000:0.0:1651532320.688678:0:166103:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651532320.688682:0:166103:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca5a0f lrc: 5/0,0 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ff9f expref: 13 pid: 206699 timeout: 23129 lvb_type: 0
00010000:00010000:1.0:1651532320.688684:0:169267:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca5a16 lrc: 4/0,0 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ffa6 expref: 13 pid: 167632 timeout: 23129 lvb_type: 0
00010000:00010000:0.0:1651532320.688686:0:166103:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca5a0f lrc: 4/0,0 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ff9f expref: 13 pid: 206699 timeout: 23129 lvb_type: 0
00010000:00010000:1.0:1651532320.688691:0:169267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532320.688692:0:169267:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532320.688693:0:169267:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca5a1d lrc: 3/0,1 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532320.688696:0:169267:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca5a1d lrc: 4/0,1 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532320.688701:0:169267:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1651532320.688708:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532320.688709:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532320.688709:0:166103:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca5a24 lrc: 3/0,1 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532320.688716:0:169267:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000be87d738 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+13:438146:x1731754469133504:12345-10.240.43.64@tcp:103:ldlm_bl_06.0 Request processed in 51us (83us total) trans 0 rc 0/0
00000100:00100000:1.0:1651532320.688719:0:169267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 328
00010000:00010000:0.0:1651532320.688719:0:166103:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca5a24 lrc: 4/0,1 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532320.688725:0:166103:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1651532320.688733:0:216323:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075a78972/0x3234de053ca5a0f lrc: 0/0,0 mode: --/PW res: [0x34555:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ff9f expref: 12 pid: 206699 timeout: 23129 lvb_type: 0
00000100:00100000:0.0:1651532320.688733:0:166103:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000d8a3e87c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438146:x1731754469133568:12345-10.240.43.64@tcp:103:ldlm_bl_06.0 Request processed in 58us (90us total) trans 0 rc 0/0
00000100:00100000:1.0:1651532320.688737:0:216323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000047c291a9 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_010:lustre-OST0001_UUID:216323:1731745997365312:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651532320.688737:0:166103:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 329
00010000:00010000:1.0:1651532320.688741:0:216323:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca5a24 lrc: 3/0,1 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532320.688745:0:216323:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca5a24 lrc: 3/0,1 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532320.688748:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca5a24 lrc: 3/0,1 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532320.688756:0:216321:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca5a16 lrc: 0/0,0 mode: --/PW res: [0x34556:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480000020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ffa6 expref: 10 pid: 167632 timeout: 23129 lvb_type: 0
00000100:00100000:0.0:1651532320.688765:0:216321:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000052213cb9 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997365248:10.240.43.64@tcp:104:
00010000:00010000:0.0:1651532320.688769:0:216321:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca5a1d lrc: 3/0,1 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532320.688788:0:216321:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca5a1d lrc: 3/0,1 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532320.688791:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca5a1d lrc: 3/0,1 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532320.688959:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532320.688974:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469133632
00000100:00100000:1.0:1651532320.688988:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250818
00000100:00100000:1.0:1651532320.688989:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000047c291a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438148:x1731754469133632:12345-10.240.43.64@tcp:4:dd.0
00010000:00010000:1.0:1651532320.689003:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca5a2b lrc: 3/0,1 mode: --/PW res: [0x34555:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532320.689008:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532320.689008:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532320.689009:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca5a2b lrc: 3/0,1 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532320.689013:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca5a2b lrc: 3/0,1 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532320.689217:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532320.689292:0:192753:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469133696
00000100:00100000:0.0:1651532320.689307:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250819
00000100:00100000:0.0:1651532320.689309:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000021f31110 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438148:x1731754469133696:12345-10.240.43.64@tcp:4:dd.0
00010000:00010000:0.0:1651532320.689316:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca5a32 lrc: 3/0,1 mode: --/PW res: [0x34556:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532320.689321:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532320.689321:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532320.689322:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca5a32 lrc: 3/0,1 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532320.689326:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca5a32 lrc: 3/0,1 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532321.036708:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869638 is committed
00002000:00010000:0.0:1651532321.036770:0:216323:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x34555:0x0] updating lvb size from disk: 0 -> 2097152
00002000:00010000:0.0:1651532321.036773:0:216323:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x34555:0x0] updating lvb blocks from disk: 0 -> 4096
00010000:00010000:0.0:1651532321.036779:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca5a24 lrc: 3/0,1 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532321.036785:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca5a24 lrc: 2/0,0 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532321.036812:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca5a24 lrc: 2/0,0 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532321.036818:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000063869776 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438148:x1731754469133184:12345-10.240.43.64@tcp:4:dd.0 Request processed in 348689us (348730us total) trans 21474869638 rc 0/0
00000100:00100000:0.0:1651532321.036822:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250817
00010000:00010000:1.0:1651532321.036832:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001cf49bf2 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651532321.036834:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca5a24 lrc: 2/0,0 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532321.036838:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca5a24 lrc: 3/0,0 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532321.036846:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca5a24 lrc: 1/0,0 mode: --/PW res: [0x34555:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532321.036851:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca5a24 lrc: 0/0,0 mode: --/PW res: [0x34555:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532321.094099:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869641 is committed
00002000:00010000:0.0:1651532321.094137:0:192753:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x34556:0x0] updating lvb size from disk: 0 -> 2097152
00002000:00010000:0.0:1651532321.094139:0:192753:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x34556:0x0] updating lvb blocks from disk: 0 -> 4096
00010000:00010000:0.0:1651532321.094142:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca5a32 lrc: 3/0,1 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532321.094146:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca5a32 lrc: 2/0,0 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532321.094167:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000021f31110 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438148:x1731754469133696:12345-10.240.43.64@tcp:4:dd.0 Request processed in 404857us (404950us total) trans 21474869641 rc 0/0
00010000:00010000:1.0:1651532321.094170:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca5a32 lrc: 2/0,0 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532321.094170:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250819
00010000:00010000:1.0:1651532321.094175:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000775318ab already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651532321.094176:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca5a32 lrc: 2/0,0 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532321.094179:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca5a32 lrc: 3/0,0 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532321.094184:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca5a32 lrc: 1/0,0 mode: --/PW res: [0x34556:0x0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532321.094187:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000775318ab/0x3234de053ca5a32 lrc: 0/0,0 mode: --/PW res: [0x34556:0x0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532321.094197:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca5a1d lrc: 3/0,1 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532321.094201:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca5a1d lrc: 2/0,0 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532321.094216:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000374facb9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754469133248:12345-10.240.43.64@tcp:4:dd.0 Request processed in 406096us (406149us total) trans 21474869639 rc 0/0
00000100:00100000:0.0:1651532321.094234:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250816
00010000:00010000:1.0:1651532321.094260:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca5a1d lrc: 2/0,0 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532321.094263:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca5a2b lrc: 3/0,1 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532321.094264:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000032ee36ee already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651532321.094265:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca5a1d lrc: 2/0,0 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532321.094268:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca5a1d lrc: 3/0,0 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532321.094275:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca5a1d lrc: 1/0,0 mode: --/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532321.094278:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032ee36ee/0x3234de053ca5a1d lrc: 0/0,0 mode: --/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532321.094283:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca5a2b lrc: 2/0,0 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532321.094301:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000047c291a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438148:x1731754469133632:12345-10.240.43.64@tcp:4:dd.0 Request processed in 405311us (405342us total) trans 21474869640 rc 0/0
00000100:00100000:0.0:1651532321.094317:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250818
00010000:00010000:0.0:1651532321.094345:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca5a2b lrc: 2/0,0 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532321.094350:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000eebd17a1 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651532321.094351:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca5a2b lrc: 2/0,0 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532321.094354:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca5a2b lrc: 3/0,0 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532321.094360:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca5a2b lrc: 1/0,0 mode: --/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532321.094362:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eebd17a1/0x3234de053ca5a2b lrc: 0/0,0 mode: --/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532321.131020:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532321.131045:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469134208
00000100:00100000:0.0:1651532321.131062:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250820
00000100:00100000:0.0:1651532321.131064:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000cc11a3b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754469134208:12345-10.240.43.64@tcp:4:dd.0
00002000:00010000:0.0:1651532321.131076:0:192755:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34555:0x0] initial LVB size: 2097152, mtime: 0x62706220, atime: 0x0, ctime: 0x62706220, blocks: 0x1000
00010000:00010000:0.0:1651532321.131078:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca5a39 lrc: 3/0,1 mode: --/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532321.131083:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532321.131084:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532321.131085:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca5a39 lrc: 3/0,1 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532321.131090:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca5a39 lrc: 3/0,1 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532321.132075:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532321.132084:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532321.132095:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469134656
00000100:00100000:1.0:1651532321.132109:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469134592
00000100:00100000:0.0:1651532321.132122:0:192753:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250821
00000100:00100000:1.0:1651532321.132125:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250822
00000100:00100000:0.0:1651532321.132125:0:192753:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000000615301 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438149:x1731754469134656:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:1.0:1651532321.132127:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000003158b8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438149:x1731754469134592:12345-10.240.43.64@tcp:4:dd.0
00010000:00010000:0.0:1651532321.132133:0:192753:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca5a40 lrc: 3/0,1 mode: --/PW res: [0x34555:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651532321.132138:0:216321:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34556:0x0] initial LVB size: 2097152, mtime: 0x62706220, atime: 0x0, ctime: 0x62706220, blocks: 0x1000
00010000:00010000:0.0:1651532321.132138:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532321.132138:0:192753:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532321.132139:0:192753:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca5a40 lrc: 3/0,1 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532321.132140:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca5a47 lrc: 3/0,1 mode: --/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532321.132143:0:192753:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca5a40 lrc: 3/0,1 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532321.132145:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532321.132145:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532321.132146:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca5a47 lrc: 3/0,1 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532321.132150:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca5a47 lrc: 3/0,1 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532321.353213:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869644 is committed
00002000:00010000:0.0:1651532321.353266:0:192753:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x34555:0x0] updating lvb size from disk: 2097152 -> 4194304
00002000:00010000:0.0:1651532321.353268:0:192753:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x34555:0x0] updating lvb mtime from disk: 1651532320 -> 1651532321
00002000:00010000:1.0:1651532321.353271:0:216321:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x34556:0x0] updating lvb size from disk: 2097152 -> 4194304
00002000:00010000:0.0:1651532321.353271:0:192753:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x34555:0x0] updating lvb ctime from disk: 1651532320 -> 1651532321
00002000:00010000:0.0:1651532321.353272:0:192753:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x34555:0x0] updating lvb blocks from disk: 4096 -> 8192
00002000:00010000:1.0:1651532321.353274:0:216321:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x34556:0x0] updating lvb mtime from disk: 1651532320 -> 1651532321
00002000:00010000:1.0:1651532321.353275:0:216321:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x34556:0x0] updating lvb ctime from disk: 1651532320 -> 1651532321
00002000:00010000:1.0:1651532321.353276:0:216321:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x34556:0x0] updating lvb blocks from disk: 4096 -> 8192
00010000:00010000:0.0:1651532321.353276:0:192753:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca5a40 lrc: 3/0,1 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532321.353280:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca5a47 lrc: 3/0,1 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532321.353281:0:192753:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca5a40 lrc: 2/0,0 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532321.353285:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca5a47 lrc: 2/0,0 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532321.353310:0:192753:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000000615301 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438149:x1731754469134656:12345-10.240.43.64@tcp:4:dd.0 Request processed in 221184us (221234us total) trans 21474869643 rc 0/0
00000100:00100000:1.0:1651532321.353311:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000003158b8a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438149:x1731754469134592:12345-10.240.43.64@tcp:4:dd.0 Request processed in 221183us (221226us total) trans 21474869644 rc 0/0
00000100:00100000:0.0:1651532321.353314:0:192753:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250821
00000100:00100000:1.0:1651532321.353317:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250822
00010000:00010000:1.0:1651532321.353326:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca5a40 lrc: 2/0,0 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532321.353330:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000002c5e01dd already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651532321.353331:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca5a40 lrc: 2/0,0 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532321.353335:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca5a40 lrc: 3/0,0 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532321.353342:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca5a40 lrc: 1/0,0 mode: --/PW res: [0x34555:0x0:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532321.353345:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c5e01dd/0x3234de053ca5a40 lrc: 0/0,0 mode: --/PW res: [0x34555:0x0:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192753 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532321.353349:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca5a47 lrc: 2/0,0 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532321.353353:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001cf49bf2 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651532321.353354:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca5a47 lrc: 2/0,0 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532321.353367:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca5a47 lrc: 3/0,0 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532321.353371:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca5a47 lrc: 1/0,0 mode: --/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532321.353371:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca5a39 lrc: 3/0,1 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532321.353374:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca5a47 lrc: 0/0,0 mode: --/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532321.353376:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca5a39 lrc: 2/0,0 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532321.353385:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca5a39 lrc: 2/0,0 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532321.353388:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000014685f38 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651532321.353388:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca5a39 lrc: 2/0,0 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532321.353391:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca5a39 lrc: 3/0,0 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532321.353396:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000cc11a3b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754469134208:12345-10.240.43.64@tcp:4:dd.0 Request processed in 222331us (222377us total) trans 21474869642 rc 0/0
00010000:00010000:1.0:1651532321.353399:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca5a39 lrc: 1/0,0 mode: --/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532321.353399:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250820
00010000:00010000:1.0:1651532321.353402:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014685f38/0x3234de053ca5a39 lrc: 0/0,0 mode: --/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532321.390922:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532321.390931:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469135040
00000100:00100000:0.0:1651532321.390950:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250823
00000100:00100000:0.0:1651532321.390952:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000052213cb9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754469135040:12345-10.240.43.64@tcp:4:dd.0
00002000:00010000:0.0:1651532321.390963:0:192755:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34555:0x0] initial LVB size: 4194304, mtime: 0x62706221, atime: 0x0, ctime: 0x62706221, blocks: 0x2000
00010000:00010000:0.0:1651532321.390965:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca5a4e lrc: 3/0,1 mode: --/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532321.390993:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532321.390994:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532321.390995:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca5a4e lrc: 3/0,1 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [4194304->6291455] (req 4194304->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532321.391000:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca5a4e lrc: 3/0,1 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [4194304->6291455] (req 4194304->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532321.391032:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532321.391042:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469135104
00000100:00100000:1.0:1651532321.391058:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250824
00000100:00100000:1.0:1651532321.391060:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000e33e11e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438149:x1731754469135104:12345-10.240.43.64@tcp:4:dd.0
00002000:00010000:1.0:1651532321.391071:0:216321:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34556:0x0] initial LVB size: 4194304, mtime: 0x62706221, atime: 0x0, ctime: 0x62706221, blocks: 0x2000
00010000:00010000:1.0:1651532321.391073:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca5a55 lrc: 3/0,1 mode: --/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532321.391077:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532321.391078:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532321.391079:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca5a55 lrc: 3/0,1 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [4194304->6291455] (req 4194304->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532321.391083:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca5a55 lrc: 3/0,1 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [4194304->6291455] (req 4194304->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532321.613280:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869646 is committed
00002000:00010000:1.0:1651532321.613318:0:216321:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x34556:0x0] updating lvb size from disk: 4194304 -> 6291456
00002000:00010000:1.0:1651532321.613320:0:216321:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x34556:0x0] updating lvb blocks from disk: 8192 -> 12288
00010000:00010000:1.0:1651532321.613325:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca5a55 lrc: 3/0,1 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [4194304->6291455] (req 4194304->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532321.613331:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca5a55 lrc: 2/0,0 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [4194304->6291455] (req 4194304->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00002000:00010000:0.0:1651532321.613336:0:192755:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x34555:0x0] updating lvb size from disk: 4194304 -> 6291456
00002000:00010000:0.0:1651532321.613338:0:192755:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x34555:0x0] updating lvb blocks from disk: 8192 -> 12288
00010000:00010000:0.0:1651532321.613342:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca5a4e lrc: 3/0,1 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [4194304->6291455] (req 4194304->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532321.613347:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca5a4e lrc: 2/0,0 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [4194304->6291455] (req 4194304->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532321.613356:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000e33e11e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438149:x1731754469135104:12345-10.240.43.64@tcp:4:dd.0 Request processed in 222294us (222324us total) trans 21474869646 rc 0/0
00000100:00100000:1.0:1651532321.613363:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250824
00000100:00100000:0.0:1651532321.613367:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000052213cb9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754469135040:12345-10.240.43.64@tcp:4:dd.0 Request processed in 222414us (222446us total) trans 21474869645 rc 0/0
00000100:00100000:0.0:1651532321.613371:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250823
00010000:00010000:1.0:1651532321.613372:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca5a55 lrc: 2/0,0 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [4194304->6291455] (req 4194304->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532321.613376:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001cf49bf2 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651532321.613378:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca5a55 lrc: 2/0,0 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [4194304->6291455] (req 4194304->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532321.613380:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca5a4e lrc: 2/0,0 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [4194304->6291455] (req 4194304->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532321.613381:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca5a55 lrc: 3/0,0 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [4194304->6291455] (req 4194304->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532321.613384:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fab23815 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651532321.613385:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca5a4e lrc: 2/0,0 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [4194304->6291455] (req 4194304->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532321.613388:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca5a55 lrc: 1/0,0 mode: --/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [4194304->6291455] (req 4194304->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532321.613388:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca5a4e lrc: 3/0,0 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [4194304->6291455] (req 4194304->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532321.613390:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca5a55 lrc: 0/0,0 mode: --/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [4194304->6291455] (req 4194304->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532321.613395:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca5a4e lrc: 1/0,0 mode: --/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [4194304->6291455] (req 4194304->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532321.613398:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca5a4e lrc: 0/0,0 mode: --/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [4194304->6291455] (req 4194304->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532321.650045:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532321.650067:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532321.650081:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469135808
00000100:00100000:1.0:1651532321.650090:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469135744
00000100:00100000:0.0:1651532321.650095:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250825
00000100:00100000:0.0:1651532321.650097:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000be87d738 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438149:x1731754469135808:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:1.0:1651532321.650105:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250826
00000100:00100000:1.0:1651532321.650107:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000006ea40253 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438149:x1731754469135744:12345-10.240.43.64@tcp:4:dd.0
00002000:00010000:0.0:1651532321.650114:0:192755:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34556:0x0] initial LVB size: 6291456, mtime: 0x62706221, atime: 0x0, ctime: 0x62706221, blocks: 0x3000
00010000:00010000:0.0:1651532321.650116:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca5a5c lrc: 3/0,1 mode: --/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651532321.650117:0:216321:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34555:0x0] initial LVB size: 6291456, mtime: 0x62706221, atime: 0x0, ctime: 0x62706221, blocks: 0x3000
00010000:00010000:1.0:1651532321.650119:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca5a63 lrc: 3/0,1 mode: --/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532321.650121:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532321.650122:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532321.650123:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532321.650123:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca5a5c lrc: 3/0,1 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532321.650124:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532321.650125:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca5a63 lrc: 3/0,1 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532321.650127:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca5a5c lrc: 3/0,1 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532321.650130:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca5a63 lrc: 3/0,1 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532321.651467:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532321.651476:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532321.651484:0:192756:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469136320
00000100:00100000:0.0:1651532321.651494:0:192756:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469136256
00000100:00100000:0.0:1651532321.651506:0:192756:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250827
00000100:00100000:0.0:1651532321.651508:0:192756:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009c93d7f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754469136320:12345-10.240.43.64@tcp:4:dd.0
00010000:00010000:0.0:1651532321.651515:0:192756:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca5a6a lrc: 3/0,1 mode: --/PW res: [0x34556:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192756 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532321.651520:0:192756:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532321.651521:0:192756:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532321.651521:0:192756:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca5a6a lrc: 3/0,1 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192756 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532321.651526:0:192756:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca5a6a lrc: 3/0,1 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192756 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532321.651546:0:216322:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250828
00000100:00100000:1.0:1651532321.651548:0:216322:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007d76765b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754469136256:12345-10.240.43.64@tcp:4:dd.0
00010000:00010000:1.0:1651532321.651557:0:216322:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca5a71 lrc: 3/0,1 mode: --/PW res: [0x34555:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532321.651561:0:216322:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532321.651562:0:216322:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532321.651563:0:216322:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca5a71 lrc: 3/0,1 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532321.651567:0:216322:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca5a71 lrc: 3/0,1 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532321.924141:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869647 is committed
00002000:00010000:0.0:1651532321.924196:0:216321:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x34555:0x0] updating lvb size from disk: 6291456 -> 8388608
00002000:00010000:0.0:1651532321.924198:0:216321:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x34555:0x0] updating lvb blocks from disk: 12288 -> 16384
00010000:00010000:0.0:1651532321.924202:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca5a63 lrc: 3/0,1 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532321.924207:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca5a63 lrc: 2/0,0 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532321.924235:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca5a63 lrc: 2/0,0 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532321.924241:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001cf49bf2 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651532321.924243:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca5a63 lrc: 2/0,0 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532321.924250:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000006ea40253 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+18:438149:x1731754469135744:12345-10.240.43.64@tcp:4:dd.0 Request processed in 274141us (274182us total) trans 21474869647 rc 0/0
00010000:00010000:1.0:1651532321.924251:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca5a63 lrc: 3/0,0 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532321.924254:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250826
00010000:00010000:1.0:1651532321.924277:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca5a63 lrc: 1/0,0 mode: --/PW res: [0x34555:0x0:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532321.924280:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca5a63 lrc: 0/0,0 mode: --/PW res: [0x34555:0x0:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532321.949165:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869650 is committed
00010000:00010000:0.0:1651532321.949205:0:216322:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca5a71 lrc: 3/0,1 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532321.949209:0:216322:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca5a71 lrc: 2/0,0 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532321.949237:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca5a71 lrc: 2/0,0 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532321.949241:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d3014069 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651532321.949242:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca5a71 lrc: 2/0,0 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532321.949245:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca5a71 lrc: 3/0,0 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532321.949247:0:216322:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007d76765b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754469136256:12345-10.240.43.64@tcp:4:dd.0 Request processed in 297698us (297770us total) trans 21474869649 rc 0/0
00010000:00010000:1.0:1651532321.949250:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca5a71 lrc: 1/0,0 mode: --/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532321.949251:0:216322:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250828
00010000:00010000:1.0:1651532321.949253:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca5a71 lrc: 0/0,0 mode: --/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216322 timeout: 0 lvb_type: 0
00002000:00010000:0.0:1651532321.949271:0:192756:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x34556:0x0] updating lvb size from disk: 6291456 -> 8388608
00002000:00010000:0.0:1651532321.949273:0:192756:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x34556:0x0] updating lvb blocks from disk: 12288 -> 16384
00010000:00010000:0.0:1651532321.949275:0:192756:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca5a6a lrc: 3/0,1 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192756 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532321.949278:0:192756:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca5a6a lrc: 2/0,0 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192756 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532321.949285:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca5a5c lrc: 3/0,1 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532321.949289:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca5a5c lrc: 2/0,0 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532321.949291:0:192756:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009c93d7f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754469136320:12345-10.240.43.64@tcp:4:dd.0 Request processed in 297782us (297825us total) trans 21474869650 rc 0/0
00000100:00100000:0.0:1651532321.949293:0:192756:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250827
00010000:00010000:0.0:1651532321.949299:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca5a6a lrc: 2/0,0 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192756 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532321.949303:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f968d777 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651532321.949304:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca5a6a lrc: 2/0,0 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192756 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532321.949307:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca5a6a lrc: 3/0,0 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192756 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532321.949309:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000be87d738 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754469135808:12345-10.240.43.64@tcp:4:dd.0 Request processed in 299211us (299264us total) trans 21474869648 rc 0/0
00000100:00100000:1.0:1651532321.949312:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250825
00010000:00010000:0.0:1651532321.949312:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca5a6a lrc: 1/0,0 mode: --/PW res: [0x34556:0x0:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192756 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532321.949318:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca5a6a lrc: 0/0,0 mode: --/PW res: [0x34556:0x0:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192756 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532321.949321:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca5a5c lrc: 2/0,0 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532321.949324:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fab23815 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651532321.949325:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca5a5c lrc: 2/0,0 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532321.949328:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca5a5c lrc: 3/0,0 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532321.949333:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca5a5c lrc: 1/0,0 mode: --/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532321.949335:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fab23815/0x3234de053ca5a5c lrc: 0/0,0 mode: --/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532321.986089:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532321.986103:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532321.986111:0:192756:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469136832
00000100:00100000:1.0:1651532321.986118:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469136768
00000100:00100000:0.0:1651532321.986124:0:192756:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250829
00000100:00100000:0.0:1651532321.986126:0:192756:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a925fbf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438149:x1731754469136832:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:1.0:1651532321.986134:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250830
00000100:00100000:1.0:1651532321.986136:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c4ea889e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438149:x1731754469136768:12345-10.240.43.64@tcp:4:dd.0
00002000:00010000:0.0:1651532321.986143:0:192756:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34556:0x0] initial LVB size: 8388608, mtime: 0x62706221, atime: 0x0, ctime: 0x62706221, blocks: 0x4000
00002000:00010000:1.0:1651532321.986145:0:192755:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34555:0x0] initial LVB size: 8388608, mtime: 0x62706221, atime: 0x0, ctime: 0x62706221, blocks: 0x4000
00010000:00010000:0.0:1651532321.986145:0:192756:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca5a78 lrc: 3/0,1 mode: --/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192756 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532321.986148:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca5a7f lrc: 3/0,1 mode: --/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532321.986150:0:192756:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532321.986151:0:192756:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532321.986152:0:192756:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca5a78 lrc: 3/0,1 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [8388608->10485759] (req 8388608->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192756 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532321.986155:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532321.986156:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532321.986156:0:192756:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca5a78 lrc: 3/0,1 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [8388608->10485759] (req 8388608->10485759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192756 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532321.986157:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca5a7f lrc: 3/0,1 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [8388608->10485759] (req 8388608->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532321.986161:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca5a7f lrc: 3/0,1 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [8388608->10485759] (req 8388608->10485759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000001:00080000:1.0:1651532322.216327:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869652 is committed
00002000:00010000:1.0:1651532322.216370:0:192755:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x34555:0x0] updating lvb size from disk: 8388608 -> 10485760
00002000:00010000:1.0:1651532322.216371:0:192755:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x34555:0x0] updating lvb blocks from disk: 16384 -> 20488
00010000:00010000:1.0:1651532322.216376:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca5a7f lrc: 3/0,1 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [8388608->10485759] (req 8388608->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00002000:00010000:0.0:1651532322.216377:0:192756:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x34556:0x0] updating lvb size from disk: 8388608 -> 10485760
00010000:00010000:1.0:1651532322.216380:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca5a7f lrc: 2/0,0 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [8388608->10485759] (req 8388608->10485759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00002000:00010000:0.0:1651532322.216380:0:192756:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x34556:0x0] updating lvb blocks from disk: 16384 -> 20488
00010000:00010000:0.0:1651532322.216383:0:192756:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca5a78 lrc: 3/0,1 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [8388608->10485759] (req 8388608->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192756 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532322.216388:0:192756:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca5a78 lrc: 2/0,0 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [8388608->10485759] (req 8388608->10485759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192756 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532322.216416:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c4ea889e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438149:x1731754469136768:12345-10.240.43.64@tcp:4:dd.0 Request processed in 230278us (230312us total) trans 21474869651 rc 0/0
00000100:00100000:1.0:1651532322.216420:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250830
00000100:00100000:0.0:1651532322.216425:0:192756:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a925fbf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754469136832:12345-10.240.43.64@tcp:4:dd.0 Request processed in 230298us (230336us total) trans 21474869652 rc 0/0
00000100:00100000:0.0:1651532322.216429:0:192756:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250829
00010000:00010000:1.0:1651532322.216430:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca5a7f lrc: 2/0,0 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [8388608->10485759] (req 8388608->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532322.216434:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d3014069 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651532322.216435:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca5a7f lrc: 2/0,0 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [8388608->10485759] (req 8388608->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532322.216452:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca5a78 lrc: 2/0,0 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [8388608->10485759] (req 8388608->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192756 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532322.216456:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca5a7f lrc: 3/0,0 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [8388608->10485759] (req 8388608->10485759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532322.216457:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f968d777 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651532322.216458:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca5a78 lrc: 2/0,0 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [8388608->10485759] (req 8388608->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192756 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532322.216461:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca5a78 lrc: 3/0,0 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [8388608->10485759] (req 8388608->10485759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192756 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532322.216463:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca5a7f lrc: 1/0,0 mode: --/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [8388608->10485759] (req 8388608->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532322.216466:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca5a7f lrc: 0/0,0 mode: --/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [8388608->10485759] (req 8388608->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532322.216467:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca5a78 lrc: 1/0,0 mode: --/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [8388608->10485759] (req 8388608->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192756 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532322.216470:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca5a78 lrc: 0/0,0 mode: --/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [8388608->10485759] (req 8388608->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192756 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532322.253012:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532322.253021:0:192756:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469137280
00000100:00100000:0.0:1651532322.253042:0:192756:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250831
00000100:00100000:0.0:1651532322.253044:0:192756:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000059e5b3a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754469137280:12345-10.240.43.64@tcp:4:dd.0
00002000:00010000:0.0:1651532322.253055:0:192756:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34555:0x0] initial LVB size: 10485760, mtime: 0x62706221, atime: 0x0, ctime: 0x62706221, blocks: 0x5008
00010000:00010000:0.0:1651532322.253057:0:192756:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca5a86 lrc: 3/0,1 mode: --/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192756 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532322.253063:0:192756:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532322.253064:0:192756:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532322.253066:0:192756:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca5a86 lrc: 3/0,1 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192756 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532322.253070:0:192756:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca5a86 lrc: 3/0,1 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192756 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532322.254105:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532322.254117:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532322.254118:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469137472
00000100:00100000:1.0:1651532322.254134:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469137536
00000100:00100000:1.0:1651532322.254144:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250832
00000100:00100000:1.0:1651532322.254146:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000028bdd7b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438149:x1731754469137472:12345-10.240.43.64@tcp:4:dd.0
00002000:00010000:1.0:1651532322.254156:0:192755:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34556:0x0] initial LVB size: 10485760, mtime: 0x62706221, atime: 0x0, ctime: 0x62706221, blocks: 0x5008
00010000:00010000:1.0:1651532322.254158:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca5a8d lrc: 3/0,1 mode: --/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532322.254162:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532322.254163:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532322.254164:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca5a8d lrc: 3/0,1 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [10485760->12582911] (req 10485760->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532322.254168:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca5a8d lrc: 3/0,1 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [10485760->12582911] (req 10485760->12582911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532322.254247:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250833
00000100:00100000:0.0:1651532322.254249:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000000aeca6f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754469137536:12345-10.240.43.64@tcp:4:dd.0
00010000:00010000:0.0:1651532322.254258:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca5a94 lrc: 3/0,1 mode: --/PW res: [0x34555:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532322.254262:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532322.254263:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532322.254264:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca5a94 lrc: 3/0,1 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532322.254268:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca5a94 lrc: 3/0,1 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532322.561782:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869653 is committed
00002000:00010000:1.0:1651532322.561836:0:192756:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x34555:0x0] updating lvb size from disk: 10485760 -> 12582912
00002000:00010000:1.0:1651532322.561838:0:192756:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x34555:0x0] updating lvb mtime from disk: 1651532321 -> 1651532322
00002000:00010000:1.0:1651532322.561842:0:192756:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x34555:0x0] updating lvb ctime from disk: 1651532321 -> 1651532322
00002000:00010000:1.0:1651532322.561843:0:192756:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x34555:0x0] updating lvb blocks from disk: 20488 -> 24584
00010000:00010000:1.0:1651532322.561847:0:192756:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca5a86 lrc: 3/0,1 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192756 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532322.561852:0:192756:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca5a86 lrc: 2/0,0 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192756 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532322.561879:0:192756:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000059e5b3a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438149:x1731754469137280:12345-10.240.43.64@tcp:4:dd.0 Request processed in 308833us (308866us total) trans 21474869653 rc 0/0
00000100:00100000:1.0:1651532322.561883:0:192756:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250831
00010000:00010000:1.0:1651532322.561894:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca5a86 lrc: 2/0,0 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192756 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532322.561898:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f968d777 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651532322.561900:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca5a86 lrc: 2/0,0 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192756 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532322.561903:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca5a86 lrc: 3/0,0 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192756 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532322.561910:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca5a86 lrc: 1/0,0 mode: --/PW res: [0x34555:0x0:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192756 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532322.561913:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f968d777/0x3234de053ca5a86 lrc: 0/0,0 mode: --/PW res: [0x34555:0x0:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192756 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532322.602231:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869655 is committed
00010000:00010000:1.0:1651532322.602271:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca5a94 lrc: 3/0,1 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532322.602277:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca5a94 lrc: 2/0,0 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532322.602300:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000000aeca6f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754469137536:12345-10.240.43.64@tcp:4:dd.0 Request processed in 348050us (348182us total) trans 21474869654 rc 0/0
00000100:00100000:1.0:1651532322.602303:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250833
00010000:00010000:1.0:1651532322.602312:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca5a94 lrc: 2/0,0 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532322.602315:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000f5657138 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651532322.602316:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca5a94 lrc: 2/0,0 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532322.602319:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca5a94 lrc: 3/0,0 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532322.602324:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca5a94 lrc: 1/0,0 mode: --/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532322.602327:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5657138/0x3234de053ca5a94 lrc: 0/0,0 mode: --/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651532322.602359:0:192755:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x34556:0x0] updating lvb size from disk: 10485760 -> 12582912
00002000:00010000:1.0:1651532322.602361:0:192755:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x34556:0x0] updating lvb mtime from disk: 1651532321 -> 1651532322
00002000:00010000:1.0:1651532322.602362:0:192755:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x34556:0x0] updating lvb ctime from disk: 1651532321 -> 1651532322
00002000:00010000:1.0:1651532322.602363:0:192755:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x34556:0x0] updating lvb blocks from disk: 20488 -> 24584
00010000:00010000:1.0:1651532322.602367:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca5a8d lrc: 3/0,1 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [10485760->12582911] (req 10485760->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532322.602370:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca5a8d lrc: 2/0,0 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [10485760->12582911] (req 10485760->12582911) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532322.602394:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000028bdd7b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754469137472:12345-10.240.43.64@tcp:4:dd.0 Request processed in 348246us (348289us total) trans 21474869655 rc 0/0
00000100:00100000:1.0:1651532322.602396:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250832
00010000:00010000:0.0:1651532322.602410:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca5a8d lrc: 2/0,0 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [10485760->12582911] (req 10485760->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532322.602420:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000d3014069 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651532322.602421:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca5a8d lrc: 2/0,0 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [10485760->12582911] (req 10485760->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532322.602425:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca5a8d lrc: 3/0,0 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [10485760->12582911] (req 10485760->12582911) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532322.602431:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca5a8d lrc: 1/0,0 mode: --/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [10485760->12582911] (req 10485760->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532322.602434:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d3014069/0x3234de053ca5a8d lrc: 0/0,0 mode: --/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [10485760->12582911] (req 10485760->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532322.639078:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532322.639093:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532322.639103:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469138240
00000100:00100000:1.0:1651532322.639117:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469138176
00000100:00100000:1.0:1651532322.639127:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250834
00000100:00100000:1.0:1651532322.639129:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c400d88f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438149:x1731754469138240:12345-10.240.43.64@tcp:4:dd.0
00002000:00010000:1.0:1651532322.639140:0:216323:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34556:0x0] initial LVB size: 12582912, mtime: 0x62706222, atime: 0x0, ctime: 0x62706222, blocks: 0x6008
00010000:00010000:1.0:1651532322.639143:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca5a9b lrc: 3/0,1 mode: --/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532322.639143:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250835
00000100:00100000:0.0:1651532322.639146:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f69c7290 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438149:x1731754469138176:12345-10.240.43.64@tcp:4:dd.0
00010000:00010000:1.0:1651532322.639148:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532322.639148:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532322.639150:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca5a9b lrc: 3/0,1 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [12582912->14680063] (req 12582912->14680063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532322.639154:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca5a9b lrc: 3/0,1 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [12582912->14680063] (req 12582912->14680063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00002000:00010000:0.0:1651532322.639158:0:216321:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34555:0x0] initial LVB size: 12582912, mtime: 0x62706222, atime: 0x0, ctime: 0x62706222, blocks: 0x6008
00010000:00010000:0.0:1651532322.639161:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca5aa2 lrc: 3/0,1 mode: --/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532322.639165:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532322.639166:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532322.639167:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca5aa2 lrc: 3/0,1 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [12582912->14680063] (req 12582912->14680063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532322.639171:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca5aa2 lrc: 3/0,1 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [12582912->14680063] (req 12582912->14680063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532322.869112:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869657 is committed
00002000:00010000:0.0:1651532322.869154:0:216321:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x34555:0x0] updating lvb size from disk: 12582912 -> 14680064
00002000:00010000:0.0:1651532322.869155:0:216321:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x34555:0x0] updating lvb blocks from disk: 24584 -> 28680
00010000:00010000:0.0:1651532322.869161:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca5aa2 lrc: 3/0,1 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [12582912->14680063] (req 12582912->14680063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532322.869166:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca5aa2 lrc: 2/0,0 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [12582912->14680063] (req 12582912->14680063) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651532322.869167:0:216323:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x34556:0x0] updating lvb size from disk: 12582912 -> 14680064
00002000:00010000:1.0:1651532322.869170:0:216323:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x34556:0x0] updating lvb blocks from disk: 24584 -> 28680
00010000:00010000:1.0:1651532322.869174:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca5a9b lrc: 3/0,1 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [12582912->14680063] (req 12582912->14680063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532322.869186:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca5a9b lrc: 2/0,0 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [12582912->14680063] (req 12582912->14680063) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532322.869197:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f69c7290 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438149:x1731754469138176:12345-10.240.43.64@tcp:4:dd.0 Request processed in 230050us (230102us total) trans 21474869657 rc 0/0
00000100:00100000:0.0:1651532322.869202:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250835
00000100:00100000:1.0:1651532322.869207:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c400d88f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754469138240:12345-10.240.43.64@tcp:4:dd.0 Request processed in 230076us (230129us total) trans 21474869656 rc 0/0
00000100:00100000:1.0:1651532322.869211:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250834
00010000:00010000:1.0:1651532322.869221:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca5aa2 lrc: 2/0,0 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [12582912->14680063] (req 12582912->14680063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532322.869238:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000080362f27 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651532322.869239:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca5aa2 lrc: 2/0,0 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [12582912->14680063] (req 12582912->14680063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532322.869243:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca5aa2 lrc: 3/0,0 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [12582912->14680063] (req 12582912->14680063) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532322.869250:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca5aa2 lrc: 1/0,0 mode: --/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [12582912->14680063] (req 12582912->14680063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532322.869253:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080362f27/0x3234de053ca5aa2 lrc: 0/0,0 mode: --/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [12582912->14680063] (req 12582912->14680063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532322.869256:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca5a9b lrc: 2/0,0 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [12582912->14680063] (req 12582912->14680063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532322.869261:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 000000001cf49bf2 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651532322.869262:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca5a9b lrc: 2/0,0 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [12582912->14680063] (req 12582912->14680063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532322.869265:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca5a9b lrc: 3/0,0 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [12582912->14680063] (req 12582912->14680063) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532322.869271:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca5a9b lrc: 1/0,0 mode: --/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [12582912->14680063] (req 12582912->14680063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532322.869274:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca5a9b lrc: 0/0,0 mode: --/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [12582912->14680063] (req 12582912->14680063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532322.905998:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532322.906008:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469138560
00000100:00100000:1.0:1651532322.906027:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250836
00000100:00100000:1.0:1651532322.906029:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009273ce78 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754469138560:12345-10.240.43.64@tcp:4:dd.0
00002000:00010000:1.0:1651532322.906043:0:216323:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34555:0x0] initial LVB size: 14680064, mtime: 0x62706222, atime: 0x0, ctime: 0x62706222, blocks: 0x7008
00010000:00010000:1.0:1651532322.906045:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5aa9 lrc: 3/0,1 mode: --/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532322.906050:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532322.906051:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532322.906053:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5aa9 lrc: 3/0,1 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532322.906057:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5aa9 lrc: 3/0,1 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532322.907116:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532322.907125:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532322.907137:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469139008
00000100:00100000:1.0:1651532322.907140:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469138944
00000100:00100000:0.0:1651532322.907152:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250837
00000100:00100000:0.0:1651532322.907160:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ec616e94 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754469139008:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:1.0:1651532322.907163:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250838
00000100:00100000:1.0:1651532322.907165:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c1c918a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438149:x1731754469138944:12345-10.240.43.64@tcp:4:dd.0
00010000:00010000:0.0:1651532322.907168:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca5ab0 lrc: 3/0,1 mode: --/PW res: [0x34555:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532322.907173:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532322.907173:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532322.907174:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca5ab0 lrc: 3/0,1 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651532322.907175:0:192755:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34556:0x0] initial LVB size: 14680064, mtime: 0x62706222, atime: 0x0, ctime: 0x62706222, blocks: 0x7008
00010000:00010000:1.0:1651532322.907177:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5ab7 lrc: 3/0,1 mode: --/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532322.907179:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca5ab0 lrc: 3/0,1 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532322.907181:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532322.907182:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532322.907183:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5ab7 lrc: 3/0,1 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [14680064->16777215] (req 14680064->16777215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532322.907187:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5ab7 lrc: 3/0,1 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [14680064->16777215] (req 14680064->16777215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532323.142566:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869660 is committed
00002000:00010000:0.0:1651532323.142598:0:216321:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x34555:0x0] updating lvb size from disk: 14680064 -> 16777216
00002000:00010000:0.0:1651532323.142599:0:216321:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x34555:0x0] updating lvb blocks from disk: 28680 -> 32776
00010000:00010000:0.0:1651532323.142603:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca5ab0 lrc: 3/0,1 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532323.142609:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca5ab0 lrc: 2/0,0 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 4 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532323.142621:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5aa9 lrc: 3/0,1 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532323.142629:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5aa9 lrc: 2/0,0 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532323.142636:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ec616e94 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438149:x1731754469139008:12345-10.240.43.64@tcp:4:dd.0 Request processed in 235480us (235520us total) trans 21474869659 rc 0/0
00000100:00100000:0.0:1651532323.142649:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250837
00000100:00100000:1.0:1651532323.142655:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009273ce78 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754469138560:12345-10.240.43.64@tcp:4:dd.0 Request processed in 236625us (236657us total) trans 21474869658 rc 0/0
00010000:00010000:0.0:1651532323.142658:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca5ab0 lrc: 2/0,0 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532323.142659:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250836
00010000:00010000:0.0:1651532323.142662:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e2ec18e1 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651532323.142663:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca5ab0 lrc: 2/0,0 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532323.142667:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca5ab0 lrc: 3/0,0 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532323.142668:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5aa9 lrc: 2/0,0 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 4 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532323.142672:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c806f265 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651532323.142673:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5aa9 lrc: 2/0,0 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 4 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532323.142673:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca5ab0 lrc: 1/0,0 mode: --/PW res: [0x34555:0x0:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532323.142676:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca5ab0 lrc: 0/0,0 mode: --/PW res: [0x34555:0x0:0x0].0x0 rrc: 4 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532323.142677:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5aa9 lrc: 3/0,0 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 4 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532323.142682:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5aa9 lrc: 1/0,0 mode: --/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532323.142684:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5aa9 lrc: 0/0,0 mode: --/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00002000:00010000:0.0:1651532323.142705:0:192755:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x34556:0x0] updating lvb size from disk: 14680064 -> 16777216
00002000:00010000:0.0:1651532323.142706:0:192755:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x34556:0x0] updating lvb blocks from disk: 28680 -> 32776
00010000:00010000:0.0:1651532323.142709:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5ab7 lrc: 3/0,1 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [14680064->16777215] (req 14680064->16777215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532323.142712:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5ab7 lrc: 2/0,0 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [14680064->16777215] (req 14680064->16777215) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532323.142723:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5ab7 lrc: 2/0,0 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [14680064->16777215] (req 14680064->16777215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532323.142728:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c1c918a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+6:438149:x1731754469138944:12345-10.240.43.64@tcp:4:dd.0 Request processed in 235562us (235603us total) trans 21474869660 rc 0/0
00000100:00100000:0.0:1651532323.142734:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250838
00010000:00010000:1.0:1651532323.142735:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000000bb25cc already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651532323.142736:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5ab7 lrc: 2/0,0 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [14680064->16777215] (req 14680064->16777215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532323.142741:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5ab7 lrc: 3/0,0 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [14680064->16777215] (req 14680064->16777215) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532323.142745:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5ab7 lrc: 1/0,0 mode: --/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [14680064->16777215] (req 14680064->16777215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532323.142748:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5ab7 lrc: 0/0,0 mode: --/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [14680064->16777215] (req 14680064->16777215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532323.334915:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532323.334929:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532323.334940:0:167632:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469139648
00000100:00100000:1.0:1651532323.334943:0:206699:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469139776
00000100:00100000:0.0:1651532323.334955:0:167632:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44981
00000100:00100000:0.0:1651532323.334957:0:167632:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000406dd259 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438148:x1731754469139648:12345-10.240.43.64@tcp:101:dd.0
00000100:00100000:1.0:1651532323.334962:0:206699:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44982
00010000:00010000:0.0:1651532323.334963:0:167632:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00000100:00100000:1.0:1651532323.334964:0:206699:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ee471aa7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438148:x1731754469139776:12345-10.240.43.64@tcp:101:dd.0
00010000:00010000:1.0:1651532323.334968:0:206699:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:0.0:1651532323.334969:0:167632:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca5abe lrc: 2/0,0 mode: --/PR res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ffc2 expref: -99 pid: 167632 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532323.334973:0:206699:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5ac5 lrc: 2/0,0 mode: --/PR res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ffd0 expref: -99 pid: 206699 timeout: 0 lvb_type: 0
00002000:00010000:0.0:1651532323.334975:0:167632:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34555:0x0] initial LVB size: 16777216, mtime: 0x62706222, atime: 0x0, ctime: 0x62706222, blocks: 0x8008
00002000:00010000:1.0:1651532323.334978:0:206699:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34556:0x0] initial LVB size: 16777216, mtime: 0x62706222, atime: 0x0, ctime: 0x62706222, blocks: 0x8008
00010000:00010000:0.0:1651532323.334981:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532323.334982:0:167632:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532323.334983:0:206699:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532323.334984:0:206699:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532323.334985:0:167632:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca5abe lrc: 3/0,0 mode: PR/PR res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ffc2 expref: 9 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532323.334986:0:206699:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5ac5 lrc: 3/0,0 mode: PR/PR res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ffd0 expref: 9 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532323.334991:0:206699:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5ac5 lrc: 3/0,0 mode: PR/PR res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ffd0 expref: 9 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532323.334991:0:167632:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca5abe lrc: 3/0,0 mode: PR/PR res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ffc2 expref: 9 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:0.0:1651532323.334996:0:167632:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e2ec18e1, rc 0)
00010000:00010000:1.0:1651532323.335000:0:206699:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000000bb25cc, rc 0)
00000100:00100000:0.0:1651532323.335007:0:167632:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000406dd259 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754469139648:12345-10.240.43.64@tcp:101:dd.0 Request processed in 49us (94us total) trans 0 rc 0/0
00000100:00100000:1.0:1651532323.335009:0:206699:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ee471aa7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754469139776:12345-10.240.43.64@tcp:101:dd.0 Request processed in 44us (80us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532323.335010:0:167632:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44981
00000100:00100000:1.0:1651532323.335012:0:206699:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44982
00000100:00100000:1.0:1651532323.339012:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532323.339026:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532323.339034:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469140160
00000100:00100000:0.0:1651532323.339034:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469140224
00000100:00100000:1.0:1651532323.339048:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250839
00000100:00100000:1.0:1651532323.339050:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000060c4b7c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754469140160:12345-10.240.43.64@tcp:3:dd.0
00000100:00100000:0.0:1651532323.339055:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250840
00000100:00100000:0.0:1651532323.339057:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005fd5b3bd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754469140224:12345-10.240.43.64@tcp:3:dd.0
00010000:00010000:1.0:1651532323.339058:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5acc lrc: 3/1,0 mode: --/PR res: [0x34555:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532323.339062:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532323.339062:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532323.339064:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5acc lrc: 3/1,0 mode: PR/PR res: [0x34555:0x0:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532323.339064:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca5ad3 lrc: 3/1,0 mode: --/PR res: [0x34556:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532323.339068:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5acc lrc: 3/1,0 mode: PR/PR res: [0x34555:0x0:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532323.339069:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532323.339070:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532323.339071:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca5ad3 lrc: 3/1,0 mode: PR/PR res: [0x34556:0x0:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532323.339075:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca5ad3 lrc: 3/1,0 mode: PR/PR res: [0x34556:0x0:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532323.341823:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5acc lrc: 3/1,0 mode: PR/PR res: [0x34555:0x0:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532323.341828:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5acc lrc: 2/0,0 mode: PR/PR res: [0x34555:0x0:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532323.341853:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000060c4b7c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438148:x1731754469140160:12345-10.240.43.64@tcp:3:dd.0 Request processed in 2802us (2825us total) trans 0 rc 2097152/2097152
00010000:00010000:0.0:1651532323.341855:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5acc lrc: 2/0,0 mode: PR/PR res: [0x34555:0x0:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532323.341857:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250839
00010000:00010000:0.0:1651532323.341860:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c806f265 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651532323.341862:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5acc lrc: 2/0,0 mode: PR/PR res: [0x34555:0x0:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532323.341865:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5acc lrc: 3/0,0 mode: PR/PR res: [0x34555:0x0:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532323.341871:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5acc lrc: 1/0,0 mode: --/PR res: [0x34555:0x0:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532323.341874:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5acc lrc: 0/0,0 mode: --/PR res: [0x34555:0x0:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532323.341978:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca5ad3 lrc: 3/1,0 mode: PR/PR res: [0x34556:0x0:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532323.341982:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca5ad3 lrc: 2/0,0 mode: PR/PR res: [0x34556:0x0:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532323.342001:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca5ad3 lrc: 2/0,0 mode: PR/PR res: [0x34556:0x0:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532323.342005:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000fb2f6575 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651532323.342006:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca5ad3 lrc: 2/0,0 mode: PR/PR res: [0x34556:0x0:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532323.342007:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005fd5b3bd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754469140224:12345-10.240.43.64@tcp:3:dd.0 Request processed in 2950us (2995us total) trans 0 rc 2097152/2097152
00010000:00010000:1.0:1651532323.342009:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca5ad3 lrc: 3/0,0 mode: PR/PR res: [0x34556:0x0:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532323.342011:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250840
00010000:00010000:1.0:1651532323.342015:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca5ad3 lrc: 1/0,0 mode: --/PR res: [0x34556:0x0:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532323.342018:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb2f6575/0x3234de053ca5ad3 lrc: 0/0,0 mode: --/PR res: [0x34556:0x0:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532325.088202:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651532325.088214:0:182071:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951242048
00000100:00100000:1.0:1651532325.088242:0:182071:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 536
00000100:00100000:1.0:1651532325.088244:0:182071:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005a58c8e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951242048:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:1.0:1651532325.088255:0:182071:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 355684928 pending 0 free 81249939456 avail 77079228416
00000100:00100000:1.0:1651532325.088272:0:182071:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005a58c8e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951242048:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 28us (72us total) trans 0 rc 0/0
00000100:00100000:1.0:1651532325.088275:0:182071:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 536
00000100:00100000:1.0:1651532330.208126:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651532330.208136:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951242240
00000100:00100000:1.0:1651532330.208146:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 537
00000100:00100000:1.0:1651532330.208148:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005cebe8e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951242240:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:1.0:1651532330.208156:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 355684928 pending 0 free 81249939456 avail 77079228416
00000100:00100000:1.0:1651532330.208173:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005cebe8e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951242240:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 24us (49us total) trans 0 rc 0/0
00000100:00100000:1.0:1651532330.208177:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 537
00000100:00100000:1.0:1651532335.328121:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651532335.328131:0:182071:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951242368
00000100:00100000:1.0:1651532335.328140:0:182071:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 538
00000100:00100000:1.0:1651532335.328142:0:182071:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000179bceb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951242368:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:1.0:1651532335.328150:0:182071:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 355684928 pending 0 free 81249939456 avail 77079228416
00000100:00100000:1.0:1651532335.328167:0:182071:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000179bceb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951242368:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 24us (47us total) trans 0 rc 0/0
00000100:00100000:1.0:1651532335.328170:0:182071:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 538
00000100:00100000:0.0:1651532339.325279:0:39099:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ca77a195 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9063caa-b124-4cb6-99ef-d01a735595c3:39099:1731745997365376:10.240.43.61@tcp:400:kworker/u4:2.0
00000100:00100000:1.0:1651532339.325290:0:39100:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005c3dfe19 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:39100:1731745997365440:10.240.43.61@tcp:400:kworker/u4:2.0
00000100:00100000:0.0:1651532339.325739:0:39099:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ca77a195 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9063caa-b124-4cb6-99ef-d01a735595c3:39099:1731745997365376:10.240.43.61@tcp:400:kworker/u4:2.0
00000100:00100000:1.0:1651532339.325755:0:39100:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005c3dfe19 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:39100:1731745997365440:10.240.43.61@tcp:400:kworker/u4:2.0
00000100:00100000:1.0:1651532340.448148:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651532340.448160:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951242496
00000100:00100000:1.0:1651532340.448177:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 539
00000100:00100000:1.0:1651532340.448180:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dae56eb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951242496:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:1.0:1651532340.448196:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 355684928 pending 0 free 81249939456 avail 77079228416
00000100:00100000:1.0:1651532340.448216:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dae56eb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951242496:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 36us (69us total) trans 0 rc 0/0
00000100:00100000:1.0:1651532340.448220:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 539
00000100:00100000:1.0:1651532345.568148:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651532345.568157:0:182071:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951242688
00000100:00100000:1.0:1651532345.568166:0:182071:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 540
00000100:00100000:1.0:1651532345.568168:0:182071:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005bcbef99 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951242688:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:1.0:1651532345.568176:0:182071:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 355684928 pending 0 free 81249939456 avail 77079228416
00000100:00100000:1.0:1651532345.568193:0:182071:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005bcbef99 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951242688:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 24us (46us total) trans 0 rc 0/0
00000100:00100000:1.0:1651532345.568196:0:182071:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 540
00000100:00100000:1.0:1651532349.120959:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532349.120971:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469141376
00000100:00100000:1.0:1651532349.120982:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 71
00000100:00100000:1.0:1651532349.120984:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e66563dc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754469141376:12345-10.240.43.64@tcp:400:kworker/u4:0.0
00000100:00100000:1.0:1651532349.121006:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e66563dc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754469141376:12345-10.240.43.64@tcp:400:kworker/u4:0.0 Request processed in 21us (47us total) trans 0 rc 0/0
00000100:00100000:1.0:1651532349.121009:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 71
00000100:00100000:1.0:1651532350.688142:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651532350.688152:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951242944
00000100:00100000:1.0:1651532350.688161:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 541
00000100:00100000:1.0:1651532350.688163:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dc87aa2d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951242944:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:1.0:1651532350.688172:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 355684928 pending 0 free 81249939456 avail 77079228416
00000100:00100000:1.0:1651532350.688190:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dc87aa2d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951242944:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 26us (49us total) trans 0 rc 0/0
00000100:00100000:1.0:1651532350.688193:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 541
00000100:00100000:1.0:1651532355.808110:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651532355.808120:0:182071:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951243008
00000100:00100000:1.0:1651532355.808131:0:182071:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 542
00000100:00100000:1.0:1651532355.808133:0:182071:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000512a5ed4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951243008:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:1.0:1651532355.808141:0:182071:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 355684928 pending 0 free 81249939456 avail 77079228416
00000100:00100000:1.0:1651532355.808159:0:182071:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000512a5ed4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951243008:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 25us (50us total) trans 0 rc 0/0
00000100:00100000:1.0:1651532355.808162:0:182071:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 542
00000100:00100000:1.0:1651532360.928138:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651532360.928148:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951243200
00000100:00100000:1.0:1651532360.928157:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 543
00000100:00100000:1.0:1651532360.928159:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007a05c3e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951243200:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:1.0:1651532360.928167:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 355684928 pending 0 free 81249939456 avail 77079228416
00000100:00100000:1.0:1651532360.928184:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007a05c3e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951243200:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 24us (46us total) trans 0 rc 0/0
00000100:00100000:1.0:1651532360.928187:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 543
00000100:00100000:0.0:1651532364.413279:0:39099:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ca77a195 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9063caa-b124-4cb6-99ef-d01a735595c3:39099:1731745997365504:10.240.43.61@tcp:400:kworker/u4:2.0
00000100:00100000:1.0:1651532364.413295:0:39100:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c9d21511 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:39100:1731745997365568:10.240.43.61@tcp:400:kworker/u4:2.0
00000100:00100000:1.0:1651532364.413627:0:39100:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c9d21511 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:39100:1731745997365568:10.240.43.61@tcp:400:kworker/u4:2.0
00000100:00100000:0.0:1651532364.413650:0:39099:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ca77a195 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9063caa-b124-4cb6-99ef-d01a735595c3:39099:1731745997365504:10.240.43.61@tcp:400:kworker/u4:2.0
00000100:00100000:0.0:1651532366.048099:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651532366.048124:0:182071:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951243264
00000100:00100000:1.0:1651532366.048137:0:182071:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 544
00000100:00100000:1.0:1651532366.048139:0:182071:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000ca77a195 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951243264:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:1.0:1651532366.048147:0:182071:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 355684928 pending 0 free 81249939456 avail 77079228416
00000100:00100000:1.0:1651532366.048166:0:182071:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000ca77a195 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951243264:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 27us (69us total) trans 0 rc 0/0
00000100:00100000:1.0:1651532366.048170:0:182071:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 544
00000100:00100000:0.0:1651532371.168119:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651532371.168153:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951243392
00000100:00100000:1.0:1651532371.168167:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 545
00000100:00100000:1.0:1651532371.168169:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002dca0b15 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951243392:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:1.0:1651532371.168177:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 355684928 pending 0 free 81249939456 avail 77079228416
00000100:00100000:1.0:1651532371.168197:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002dca0b15 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951243392:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 27us (80us total) trans 0 rc 0/0
00000100:00100000:1.0:1651532371.168200:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 545
00000100:00100000:0.0:1651532373.696906:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532373.696937:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469141952
00000100:00100000:1.0:1651532373.696951:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 72
00000100:00100000:1.0:1651532373.696953:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000863110f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754469141952:12345-10.240.43.64@tcp:400:kworker/u4:0.0
00000100:00100000:1.0:1651532373.696976:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000863110f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438149:x1731754469141952:12345-10.240.43.64@tcp:400:kworker/u4:0.0 Request processed in 22us (71us total) trans 0 rc 0/0
00000100:00100000:1.0:1651532373.696979:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 72
00000100:00100000:0.0:1651532376.288103:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651532376.288136:0:182071:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951243712
00000100:00100000:1.0:1651532376.288148:0:182071:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 546
00000100:00100000:1.0:1651532376.288150:0:182071:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c68ada5f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951243712:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:1.0:1651532376.288158:0:182071:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 355684928 pending 0 free 81249939456 avail 77079228416
00000100:00100000:1.0:1651532376.288176:0:182071:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c68ada5f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39030:x1731745951243712:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 26us (74us total) trans 0 rc 0/0
00000100:00100000:1.0:1651532376.288179:0:182071:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 546
00000100:00100000:0.0:1651532379.339150:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532379.339181:0:166111:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469142336
00000100:00100000:1.0:1651532379.339193:0:166111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44983
00000100:00100000:1.0:1651532379.339196:0:166111:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a8d7612 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438148:x1731754469142336:12345-10.240.43.64@tcp:101:rm.0
00010000:00010000:1.0:1651532379.339201:0:166111:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532379.339220:0:166111:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca5ada lrc: 2/0,0 mode: --/PR res: [0x34557:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44ffde expref: -99 pid: 166111 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651532379.339256:0:166111:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34557:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0
00010000:00010000:1.0:1651532379.339264:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532379.339265:0:166111:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532379.339269:0:166111:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca5ada lrc: 3/0,0 mode: PR/PR res: [0x34557:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ffde expref: 9 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532379.339276:0:166111:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c8969b4f/0x3234de053ca5ada lrc: 3/0,0 mode: PR/PR res: [0x34557:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ffde expref: 9 pid: 166111 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532379.339281:0:166111:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c8969b4f, rc 0)
00000100:00100000:1.0:1651532379.339299:0:166111:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a8d7612 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754469142336:12345-10.240.43.64@tcp:101:rm.0 Request processed in 102us (150us total) trans 0 rc 0/0
00000100:00100000:1.0:1651532379.339302:0:166111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44983
00000100:00100000:0.0:1651532379.532959:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532379.532990:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469142912
00000100:00100000:1.0:1651532379.533002:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44984
00000100:00100000:1.0:1651532379.533004:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c9d21511 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+9:687639:x1731754469142912:12345-10.240.43.64@tcp:101:bash.0
00010000:00010000:1.0:1651532379.533008:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532379.533013:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5ae1 lrc: 2/0,0 mode: --/PW res: [0x34555:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db44fff3 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532379.533023:0:166113:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca5abe lrc: 2/0,0 mode: PR/PR res: [0x34555:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ffc2 expref: 10 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532379.533027:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532379.533028:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532379.533029:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5ae1 lrc: 4/0,0 mode: --/PW res: [0x34555:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fff3 expref: 10 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532379.533041:0:166113:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca5abe lrc: 3/0,0 mode: PR/PR res: [0x34555:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ffc2 expref: 10 pid: 167632 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532379.533046:0:166113:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca5abe lrc: 4/0,0 mode: PR/PR res: [0x34555:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ffc2 expref: 10 pid: 167632 timeout: 23188 lvb_type: 1
00000100:00100000:1.0:1651532379.533051:0:166113:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005dd15341 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:166113:1731745997365632:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651532379.533072:0:166113:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fd6047a1 going to sleep for 6 seconds
00000100:00100000:0.0:1651532379.533378:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532379.533379:0:166113:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005dd15341 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:166113:1731745997365632:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651532379.533385:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5ae1 lrc: 3/0,0 mode: --/PW res: [0x34555:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fff3 expref: 10 pid: 166113 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532379.533388:0:166103:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469142976
00010000:00010000:1.0:1651532379.533391:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c806f265, rc 0)
00010000:00010000:0.0:1651532379.533397:0:166103:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca5abe lrc: 4/0,0 mode: PR/PR res: [0x34555:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ffc2 expref: 11 pid: 167632 timeout: 23188 lvb_type: 1
00000100:00100000:1.0:1651532379.533404:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c9d21511 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+11:687639:x1731754469142912:12345-10.240.43.64@tcp:101:bash.0 Request processed in 399us (445us total) trans 0 rc 0/0
00000100:00100000:1.0:1651532379.533407:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44984
00000100:00100000:0.0:1651532379.533418:0:166103:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 330
00000100:00100000:0.0:1651532379.533420:0:166103:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005c3dfe19 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438147:x1731754469142976:12345-10.240.43.64@tcp:103:ldlm_bl_06.0
00010000:00010000:0.0:1651532379.533424:0:166103:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651532379.533426:0:166103:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca5abe lrc: 4/0,0 mode: PR/PR res: [0x34555:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ffc2 expref: 10 pid: 167632 timeout: 23188 lvb_type: 1
00010000:00010000:0.0:1651532379.533433:0:166103:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca5abe lrc: 3/0,0 mode: PR/PR res: [0x34555:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ffc2 expref: 10 pid: 167632 timeout: 23188 lvb_type: 1
00010000:00010000:0.0:1651532379.533442:0:166103:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca5abe lrc: 0/0,0 mode: --/PR res: [0x34555:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ffc2 expref: 10 pid: 167632 timeout: 23188 lvb_type: 1
00010000:00010000:0.0:1651532379.533446:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532379.533447:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532379.533449:0:166103:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5ae1 lrc: 2/0,0 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fff3 expref: 9 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532379.533452:0:166103:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5ae1 lrc: 3/0,0 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fff3 expref: 9 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532379.533472:0:166103:0:(ldlm_lockd.c:1067:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5ae1 lrc: 3/0,0 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fff3 expref: 9 pid: 166113 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532379.533477:0:166103:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b9b10d48 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:166103:1731745997365696:10.240.43.64@tcp:105:
00000100:00100000:0.0:1651532379.533488:0:166103:0:(client.c:2492:ptlrpc_set_wait()) set 00000000a01e87d3 going to sleep for 6 seconds
00000100:00100000:0.0:1651532379.533690:0:166103:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b9b10d48 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:166103:1731745997365696:10.240.43.64@tcp:105:
00010000:00010000:0.0:1651532379.533694:0:166103:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1651532379.533703:0:166103:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005c3dfe19 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438147:x1731754469142976:12345-10.240.43.64@tcp:103:ldlm_bl_06.0 Request processed in 283us (326us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532379.533706:0:166103:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 330
00000100:00100000:0.0:1651532379.534514:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532379.534536:0:166113:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469143168
00000100:00100000:1.0:1651532379.534545:0:166113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 44985
00000100:00100000:1.0:1651532379.534547:0:166113:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b9b10d48 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+9:687639:x1731754469143168:12345-10.240.43.64@tcp:101:bash.0
00010000:00010000:1.0:1651532379.534550:0:166113:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00010000:1.0:1651532379.534554:0:166113:0:(ldlm_lockd.c:1316:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca5ae8 lrc: 2/0,0 mode: --/PW res: [0x34556:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x942f00f5db450001 expref: -99 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532379.534562:0:166113:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5ac5 lrc: 2/0,0 mode: PR/PR res: [0x34556:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ffd0 expref: 10 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532379.534567:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532379.534568:0:166113:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532379.534569:0:166113:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca5ae8 lrc: 4/0,0 mode: --/PW res: [0x34556:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 10.240.43.64@tcp remote: 0x942f00f5db450001 expref: 10 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532379.534575:0:166113:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5ac5 lrc: 3/0,0 mode: PR/PR res: [0x34556:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ffd0 expref: 10 pid: 206699 timeout: 0 lvb_type: 1
00010000:00010000:1.0:1651532379.534579:0:166113:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5ac5 lrc: 4/0,0 mode: PR/PR res: [0x34556:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ffd0 expref: 10 pid: 206699 timeout: 23188 lvb_type: 1
00000100:00100000:1.0:1651532379.534583:0:166113:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005dd15341 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:166113:1731745997365760:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651532379.534600:0:166113:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fd6047a1 going to sleep for 6 seconds
00000100:00100000:1.0:1651532379.534803:0:166113:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005dd15341 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:166113:1731745997365760:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651532379.534809:0:166113:0:(ldlm_lockd.c:1482:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca5ae8 lrc: 3/0,0 mode: --/PW res: [0x34556:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db450001 expref: 10 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532379.534814:0:166113:0:(ldlm_lockd.c:1563:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001cf49bf2, rc 0)
00000100:00100000:1.0:1651532379.534826:0:166113:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b9b10d48 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+10:687639:x1731754469143168:12345-10.240.43.64@tcp:101:bash.0 Request processed in 279us (313us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532379.534833:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532379.534837:0:166113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 44985
00000100:00100000:1.0:1651532379.534850:0:166103:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469143232
00010000:00010000:1.0:1651532379.534862:0:166103:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5ac5 lrc: 4/0,0 mode: PR/PR res: [0x34556:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ffd0 expref: 10 pid: 206699 timeout: 23188 lvb_type: 1
00000100:00100000:1.0:1651532379.534875:0:166103:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 331
00000100:00100000:1.0:1651532379.534876:0:166103:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000046de8644 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438148:x1731754469143232:12345-10.240.43.64@tcp:103:ldlm_bl_04.0
00010000:00010000:1.0:1651532379.534879:0:166103:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1651532379.534881:0:166103:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5ac5 lrc: 4/0,0 mode: PR/PR res: [0x34556:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ffd0 expref: 10 pid: 206699 timeout: 23188 lvb_type: 1
00010000:00010000:1.0:1651532379.534885:0:166103:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5ac5 lrc: 3/0,0 mode: PR/PR res: [0x34556:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ffd0 expref: 10 pid: 206699 timeout: 23188 lvb_type: 1
00010000:00010000:1.0:1651532379.534891:0:166103:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5ac5 lrc: 0/0,0 mode: --/PR res: [0x34556:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44ffd0 expref: 10 pid: 206699 timeout: 23188 lvb_type: 1
00010000:00010000:1.0:1651532379.534894:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532379.534895:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532379.534896:0:166103:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca5ae8 lrc: 2/0,0 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db450001 expref: 9 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532379.534900:0:166103:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca5ae8 lrc: 3/0,0 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db450001 expref: 9 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532379.534907:0:166103:0:(ldlm_lockd.c:1067:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca5ae8 lrc: 3/0,0 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db450001 expref: 9 pid: 166113 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532379.534911:0:166103:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005dd15341 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:166103:1731745997365824:10.240.43.64@tcp:105:
00000100:00100000:1.0:1651532379.534928:0:166103:0:(client.c:2492:ptlrpc_set_wait()) set 00000000fd6047a1 going to sleep for 6 seconds
00000100:00100000:1.0:1651532379.535128:0:166103:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005dd15341 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:166103:1731745997365824:10.240.43.64@tcp:105:
00010000:00010000:1.0:1651532379.535132:0:166103:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1651532379.535144:0:166103:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000046de8644 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438148:x1731754469143232:12345-10.240.43.64@tcp:103:ldlm_bl_04.0 Request processed in 267us (312us total) trans 0 rc 0/0
00000100:00100000:1.0:1651532379.535147:0:166103:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 331
00000100:00100000:0.0:1651532379.535257:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532379.535266:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532379.535278:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469143360
00000100:00100000:0.0:1651532379.535278:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469143488
00002000:00010000:1.0:1651532379.535286:0:216323:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 214357/0 (0->18446744073709551615)
00002000:00010000:0.0:1651532379.535286:0:192755:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 214358/0 (0->18446744073709551615)
00002000:00100000:1.0:1651532379.535288:0:216323:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000046e76bd1 with x1731754469143360 ext(0->18446744073709551615)
00002000:00100000:0.0:1651532379.535288:0:192755:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000005ec1cbc3 with x1731754469143488 ext(0->18446744073709551615)
00002000:00010000:1.0:1651532379.535290:0:216323:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000046e76bd1.
00002000:00010000:0.0:1651532379.535291:0:192755:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000005ec1cbc3.
00000100:00100000:1.0:1651532379.535298:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250841
00000100:00100000:0.0:1651532379.535303:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250842
00000100:00100000:1.0:1651532379.535305:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000046e76bd1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438147:x1731754469143360:12345-10.240.43.64@tcp:10:bash.0
00000100:00100000:0.0:1651532379.535305:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005ec1cbc3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438147:x1731754469143488:12345-10.240.43.64@tcp:10:bash.0
00002000:00010000:1.0:1651532379.536883:0:216323:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x34555:0x0] updating lvb size from disk: 16777216 -> 0
00002000:00010000:0.0:1651532379.536883:0:192755:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x34556:0x0] updating lvb size from disk: 16777216 -> 0
00002000:00010000:1.0:1651532379.536885:0:216323:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x34555:0x0] updating lvb mtime from disk: 1651532322 -> 1651532379
00002000:00010000:0.0:1651532379.536885:0:192755:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x34556:0x0] updating lvb mtime from disk: 1651532322 -> 1651532379
00002000:00010000:1.0:1651532379.536886:0:216323:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x34555:0x0] updating lvb atime from disk: 0 -> 0
00002000:00010000:0.0:1651532379.536886:0:192755:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x34556:0x0] updating lvb atime from disk: 0 -> 0
00002000:00010000:1.0:1651532379.536887:0:216323:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x34555:0x0] updating lvb ctime from disk: 1651532322 -> 1651532379
00002000:00010000:0.0:1651532379.536887:0:192755:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x34556:0x0] updating lvb ctime from disk: 1651532322 -> 1651532379
00002000:00010000:1.0:1651532379.536888:0:216323:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x34555:0x0] updating lvb blocks from disk: 32776 -> 0
00002000:00010000:0.0:1651532379.536888:0:192755:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x34556:0x0] updating lvb blocks from disk: 32776 -> 0
00000100:00100000:1.0:1651532379.536903:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000046e76bd1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754469143360:12345-10.240.43.64@tcp:10:bash.0 Request processed in 1603us (1646us total) trans 21474869661 rc 0/0
00000100:00100000:1.0:1651532379.536907:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250841
00002000:00010000:1.0:1651532379.536908:0:216323:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 214357/0 (0->18446744073709551615)
00002000:00100000:1.0:1651532379.536909:0:216323:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 0000000046e76bd1 with x1731754469143360 ext(0->18446744073709551615)
00000100:00100000:0.0:1651532379.536910:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005ec1cbc3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754469143488:12345-10.240.43.64@tcp:10:bash.0 Request processed in 1604us (1644us total) trans 21474869662 rc 0/0
00002000:00010000:1.0:1651532379.536911:0:216323:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 0000000046e76bd1.
00000100:00100000:0.0:1651532379.536914:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250842
00002000:00010000:0.0:1651532379.536915:0:192755:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 214358/0 (0->18446744073709551615)
00002000:00100000:0.0:1651532379.536916:0:192755:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 000000005ec1cbc3 with x1731754469143488 ext(0->18446744073709551615)
00002000:00010000:0.0:1651532379.536918:0:192755:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 000000005ec1cbc3.
00000100:00100000:0.0:1651532379.727374:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532379.727384:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532379.727398:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469143744
00002000:00010000:0.0:1651532379.727404:0:192755:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 214357/0 (0->18446744073709551615)
00002000:00100000:0.0:1651532379.727405:0:192755:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000c62d1815 with x1731754469143744 ext(0->18446744073709551615)
00002000:00010000:0.0:1651532379.727408:0:192755:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000c62d1815.
00000100:00100000:0.0:1651532379.727416:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469143872
00002000:00010000:0.0:1651532379.727419:0:192755:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 214358/0 (0->18446744073709551615)
00002000:00100000:0.0:1651532379.727420:0:192755:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000315bf4eb with x1731754469143872 ext(0->18446744073709551615)
00002000:00010000:0.0:1651532379.727422:0:192755:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000315bf4eb.
00000100:00100000:1.0:1651532379.727424:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250843
00000100:00100000:1.0:1651532379.727427:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c62d1815 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754469143744:12345-10.240.43.64@tcp:10:dd.0
00000100:00100000:0.0:1651532379.727431:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250844
00000100:00100000:0.0:1651532379.727433:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000315bf4eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754469143872:12345-10.240.43.64@tcp:10:dd.0
00002000:00010000:0.0:1651532379.727458:0:192755:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x34556:0x0] updating lvb size from disk: 0 -> 0
00002000:00010000:0.0:1651532379.727459:0:192755:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x34556:0x0] updating lvb mtime from disk: 1651532379 -> 1651532379
00002000:00010000:0.0:1651532379.727460:0:192755:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x34556:0x0] updating lvb atime from disk: 0 -> 0
00002000:00010000:0.0:1651532379.727461:0:192755:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x34556:0x0] updating lvb ctime from disk: 1651532379 -> 1651532379
00002000:00010000:1.0:1651532379.727462:0:216321:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x34555:0x0] updating lvb size from disk: 0 -> 0
00002000:00010000:0.0:1651532379.727462:0:192755:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x34556:0x0] updating lvb blocks from disk: 0 -> 0
00002000:00010000:1.0:1651532379.727475:0:216321:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x34555:0x0] updating lvb mtime from disk: 1651532379 -> 1651532379
00002000:00010000:1.0:1651532379.727476:0:216321:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x34555:0x0] updating lvb atime from disk: 0 -> 0
00002000:00010000:1.0:1651532379.727476:0:216321:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x34555:0x0] updating lvb ctime from disk: 1651532379 -> 1651532379
00002000:00010000:1.0:1651532379.727477:0:216321:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x34555:0x0] updating lvb blocks from disk: 0 -> 0
00000100:00100000:0.0:1651532379.727485:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000315bf4eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754469143872:12345-10.240.43.64@tcp:10:dd.0 Request processed in 51us (100us total) trans 21474869663 rc 0/0
00000100:00100000:0.0:1651532379.727488:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250844
00002000:00010000:0.0:1651532379.727489:0:192755:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 214358/0 (0->18446744073709551615)
00002000:00100000:0.0:1651532379.727490:0:192755:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000315bf4eb with x1731754469143872 ext(0->18446744073709551615)
00002000:00010000:0.0:1651532379.727492:0:192755:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000315bf4eb.
00000100:00100000:1.0:1651532379.727494:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c62d1815 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754469143744:12345-10.240.43.64@tcp:10:dd.0 Request processed in 67us (121us total) trans 21474869664 rc 0/0
00000100:00100000:1.0:1651532379.727498:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250843
00002000:00010000:1.0:1651532379.727499:0:216321:0:(ofd_dev.c:2734:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 214357/0 (0->18446744073709551615)
00002000:00100000:1.0:1651532379.727500:0:216321:0:(ofd_dev.c:2478:ofd_prolong_extent_locks()) Prolong locks for req 00000000c62d1815 with x1731754469143744 ext(0->18446744073709551615)
00002000:00010000:1.0:1651532379.727502:0:216321:0:(ofd_dev.c:2739:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req 00000000c62d1815.
00000100:00100000:0.0:1651532379.765145:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532379.765158:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532379.765166:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469144320
00000100:00100000:1.0:1651532379.765170:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469144256
00000100:00100000:0.0:1651532379.765177:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250845
00000100:00100000:0.0:1651532379.765178:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009a23bcd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754469144320:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:1.0:1651532379.765185:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250846
00000100:00100000:1.0:1651532379.765187:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000033723645 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+14:438147:x1731754469144256:12345-10.240.43.64@tcp:4:dd.0
00010000:00010000:0.0:1651532379.765193:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca5aef lrc: 3/0,1 mode: --/PW res: [0x34556:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532379.765195:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5af6 lrc: 3/0,1 mode: --/PW res: [0x34555:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532379.765199:0:216323:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca5ae8 lrc: 2/0,0 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db450001 expref: 14 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532379.765201:0:216321:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5ae1 lrc: 2/0,0 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fff3 expref: 14 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532379.765204:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532379.765205:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532379.765205:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532379.765205:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:1.0:1651532379.765206:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5af6 lrc: 4/0,1 mode: --/PW res: [0x34555:0x0:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532379.765206:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca5aef lrc: 4/0,1 mode: --/PW res: [0x34556:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532379.765214:0:216321:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5ae1 lrc: 3/0,0 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fff3 expref: 14 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532379.765214:0:216323:0:(ldlm_lockd.c:951:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca5ae8 lrc: 3/0,0 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db450001 expref: 14 pid: 166113 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532379.765218:0:216321:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5ae1 lrc: 4/0,0 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fff3 expref: 14 pid: 166113 timeout: 23188 lvb_type: 0
00010000:00010000:0.0:1651532379.765218:0:216323:0:(ldlm_lockd.c:487:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca5ae8 lrc: 4/0,0 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db450001 expref: 14 pid: 166113 timeout: 23188 lvb_type: 0
00000100:00100000:0.0:1651532379.765235:0:216323:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a9fc5082 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_010:lustre-OST0001_UUID:216323:1731745997365952:10.240.43.64@tcp:104:
00000100:00100000:1.0:1651532379.765238:0:216321:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005dd15341 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997365888:10.240.43.64@tcp:104:
00000100:00100000:0.0:1651532379.765248:0:216323:0:(client.c:2492:ptlrpc_set_wait()) set 000000000b5c3114 going to sleep for 6 seconds
00000100:00100000:1.0:1651532379.765249:0:216321:0:(client.c:2492:ptlrpc_set_wait()) set 000000001a1ce0e5 going to sleep for 6 seconds
00000100:00100000:0.0:1651532379.765406:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532379.765414:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469144512
00000100:00100000:0.0:1651532379.765424:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250847
00000100:00100000:0.0:1651532379.765426:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000001946d870 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754469144512:12345-10.240.43.64@tcp:4:dd.0
00010000:00010000:0.0:1651532379.765433:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca5afd lrc: 3/0,1 mode: --/PW res: [0x34556:0x0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532379.765437:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532379.765438:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1
00010000:00010000:0.0:1651532379.765439:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca5afd lrc: 3/0,1 mode: --/PW res: [0x34556:0x0:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532379.765442:0:192755:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca5afd lrc: 3/0,1 mode: --/PW res: [0x34556:0x0:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532379.765655:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532379.765662:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532379.765670:0:166103:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469144704
00000100:00100000:0.0:1651532379.765674:0:216323:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a9fc5082 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_010:lustre-OST0001_UUID:216323:1731745997365952:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651532379.765677:0:166103:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca5ae8 lrc: 4/0,0 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db450001 expref: 16 pid: 166113 timeout: 23188 lvb_type: 0
00010000:00010000:0.0:1651532379.765679:0:216323:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca5aef lrc: 3/0,1 mode: --/PW res: [0x34556:0x0:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532379.765685:0:166103:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469144768
00010000:00010000:1.0:1651532379.765687:0:166103:0:(ldlm_lockd.c:2612:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5ae1 lrc: 5/0,0 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fff3 expref: 17 pid: 166113 timeout: 23188 lvb_type: 0
00000100:00100000:0.0:1651532379.765692:0:166104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 332
00000100:00100000:0.0:1651532379.765694:0:166104:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000007fc0def2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438149:x1731754469144704:12345-10.240.43.64@tcp:103:ldlm_bl_02.0
00010000:00010000:0.0:1651532379.765698:0:166104:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00000100:00100000:1.0:1651532379.765699:0:166103:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 333
00000100:00100000:1.0:1651532379.765701:0:166103:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000add44b2e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+17:438146:x1731754469144768:12345-10.240.43.64@tcp:103:ldlm_bl_05.0
00010000:00010000:0.0:1651532379.765702:0:166104:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca5ae8 lrc: 4/0,0 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db450001 expref: 17 pid: 166113 timeout: 23188 lvb_type: 0
00010000:00010000:1.0:1651532379.765704:0:166103:0:(ldlm_lockd.c:1719:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1651532379.765706:0:166104:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca5ae8 lrc: 3/0,0 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db450001 expref: 17 pid: 166113 timeout: 23188 lvb_type: 0
00010000:00010000:1.0:1651532379.765708:0:166103:0:(ldlm_lockd.c:1764:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5ae1 lrc: 5/0,0 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fff3 expref: 17 pid: 166113 timeout: 23188 lvb_type: 0
00010000:00010000:1.0:1651532379.765712:0:166103:0:(ldlm_lockd.c:560:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5ae1 lrc: 4/0,0 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fff3 expref: 17 pid: 166113 timeout: 23188 lvb_type: 0
00010000:00010000:0.0:1651532379.765712:0:166104:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001cf49bf2/0x3234de053ca5ae8 lrc: 0/0,0 mode: --/PW res: [0x34556:0x0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db450001 expref: 17 pid: 166113 timeout: 23188 lvb_type: 0
00010000:00010000:0.0:1651532379.765716:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532379.765717:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532379.765717:0:166104:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca5aef lrc: 3/0,1 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532379.765719:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532379.765719:0:166103:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532379.765720:0:166103:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5af6 lrc: 3/0,1 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 4 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532379.765721:0:166104:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca5aef lrc: 4/0,1 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532379.765723:0:166103:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5af6 lrc: 4/0,1 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 4 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532379.765728:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532379.765728:0:166104:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532379.765729:0:166104:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca5afd lrc: 3/0,1 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532379.765730:0:166103:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1651532379.765732:0:166104:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca5afd lrc: 4/0,1 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532379.765739:0:166104:0:(ldlm_lockd.c:1775:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1651532379.765743:0:166103:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000add44b2e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c703c47-a140-4387-a181-4e0a15e9b24e+16:438146:x1731754469144768:12345-10.240.43.64@tcp:103:ldlm_bl_05.0 Request processed in 41us (80us total) trans 0 rc 0/0
00000100:00100000:1.0:1651532379.765746:0:166103:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 333
00000100:00100000:0.0:1651532379.765754:0:166104:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000007fc0def2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438149:x1731754469144704:12345-10.240.43.64@tcp:103:ldlm_bl_02.0 Request processed in 60us (99us total) trans 0 rc 0/0
00000100:00100000:0.0:1651532379.765757:0:166104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 332
00010000:00010000:1.0:1651532379.765758:0:216321:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5ae1 lrc: 0/0,0 mode: --/PW res: [0x34555:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480020020 nid: 10.240.43.64@tcp remote: 0x942f00f5db44fff3 expref: 15 pid: 166113 timeout: 23188 lvb_type: 0
00000100:00100000:1.0:1651532379.765763:0:216321:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005dd15341 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0001_UUID:216321:1731745997365888:10.240.43.64@tcp:104:
00010000:00010000:1.0:1651532379.765767:0:216321:0:(ldlm_request.c:285:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5af6 lrc: 3/0,1 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532379.765770:0:216321:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5af6 lrc: 3/0,1 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532379.765773:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5af6 lrc: 3/0,1 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532379.765790:0:192755:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca5afd lrc: 3/0,1 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532379.765794:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca5afd lrc: 3/0,1 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532379.765966:0:216323:0:(ldlm_request.c:201:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca5aef lrc: 3/0,1 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532379.765969:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca5aef lrc: 3/0,1 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532380.103726:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869665 is committed
00002000:00010000:1.0:1651532380.103794:0:192755:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x34556:0x0] updating lvb size from disk: 0 -> 2097152
00002000:00010000:1.0:1651532380.103796:0:192755:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x34556:0x0] updating lvb blocks from disk: 0 -> 4096
00010000:00010000:1.0:1651532380.103801:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca5afd lrc: 3/0,1 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532380.103807:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca5afd lrc: 2/0,0 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532380.103835:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca5afd lrc: 2/0,0 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532380.103845:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c1022d42 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651532380.103847:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca5afd lrc: 2/0,0 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532380.103856:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca5afd lrc: 3/0,0 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532380.103862:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000001946d870 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+15:438147:x1731754469144512:12345-10.240.43.64@tcp:4:dd.0 Request processed in 338425us (338446us total) trans 21474869665 rc 0/0
00000100:00100000:1.0:1651532380.103869:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250847
00010000:00010000:0.0:1651532380.103878:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca5afd lrc: 1/0,0 mode: --/PW res: [0x34556:0x0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532380.103881:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca5afd lrc: 0/0,0 mode: --/PW res: [0x34556:0x0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532380.144897:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869667 is committed
00002000:00010000:1.0:1651532380.144954:0:216321:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x34555:0x0] updating lvb size from disk: 0 -> 2097152
00002000:00010000:1.0:1651532380.144956:0:216321:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x34555:0x0] updating lvb blocks from disk: 0 -> 4096
00010000:00010000:1.0:1651532380.144959:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5af6 lrc: 3/0,1 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532380.144963:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5af6 lrc: 2/0,0 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532380.144988:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000033723645 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438147:x1731754469144256:12345-10.240.43.64@tcp:4:dd.0 Request processed in 379799us (379829us total) trans 21474869666 rc 0/0
00000100:00100000:1.0:1651532380.144991:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250846
00010000:00010000:1.0:1651532380.145000:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5af6 lrc: 2/0,0 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532380.145003:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000000bb25cc already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651532380.145005:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5af6 lrc: 2/0,0 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532380.145008:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5af6 lrc: 3/0,0 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532380.145014:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5af6 lrc: 1/0,0 mode: --/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532380.145016:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5af6 lrc: 0/0,0 mode: --/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532380.145053:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca5aef lrc: 3/0,1 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532380.145058:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca5aef lrc: 2/0,0 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532380.145079:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca5aef lrc: 2/0,0 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532380.145082:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000e2ec18e1 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651532380.145083:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca5aef lrc: 2/0,0 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532380.145086:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca5aef lrc: 3/0,0 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532380.145091:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca5aef lrc: 1/0,0 mode: --/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532380.145093:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2ec18e1/0x3234de053ca5aef lrc: 0/0,0 mode: --/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532380.145103:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009a23bcd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438147:x1731754469144320:12345-10.240.43.64@tcp:4:dd.0 Request processed in 379923us (379957us total) trans 21474869667 rc 0/0
00000100:00100000:0.0:1651532380.145107:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250845
00000100:00100000:0.0:1651532380.182149:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532380.182158:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532380.182172:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469145216
00000100:00100000:1.0:1651532380.182181:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469145152
00000100:00100000:0.0:1651532380.182191:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250848
00000100:00100000:0.0:1651532380.182195:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dce6a2c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754469145216:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:1.0:1651532380.182203:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250849
00000100:00100000:1.0:1651532380.182205:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000028779db6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754469145152:12345-10.240.43.64@tcp:4:dd.0
00002000:00010000:1.0:1651532380.182231:0:216321:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34555:0x0] initial LVB size: 2097152, mtime: 0x6270625b, atime: 0x0, ctime: 0x6270625b, blocks: 0x1000
00002000:00010000:0.0:1651532380.182233:0:216323:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34556:0x0] initial LVB size: 2097152, mtime: 0x6270625b, atime: 0x0, ctime: 0x6270625b, blocks: 0x1000
00010000:00010000:1.0:1651532380.182234:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5b0b lrc: 3/0,1 mode: --/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532380.182236:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca5b04 lrc: 3/0,1 mode: --/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532380.182239:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532380.182240:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532380.182241:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5b0b lrc: 3/0,1 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532380.182241:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532380.182242:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532380.182243:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca5b04 lrc: 3/0,1 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532380.182247:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca5b04 lrc: 3/0,1 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532380.182250:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5b0b lrc: 3/0,1 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532380.519985:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869669 is committed
00002000:00010000:0.0:1651532380.520031:0:216323:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x34556:0x0] updating lvb size from disk: 2097152 -> 4194304
00002000:00010000:0.0:1651532380.520033:0:216323:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x34556:0x0] updating lvb mtime from disk: 1651532379 -> 1651532380
00002000:00010000:0.0:1651532380.520034:0:216323:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x34556:0x0] updating lvb ctime from disk: 1651532379 -> 1651532380
00002000:00010000:0.0:1651532380.520035:0:216323:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x34556:0x0] updating lvb blocks from disk: 4096 -> 8192
00010000:00010000:0.0:1651532380.520041:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca5b04 lrc: 3/0,1 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532380.520046:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca5b04 lrc: 2/0,0 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651532380.520053:0:216321:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x34555:0x0] updating lvb size from disk: 2097152 -> 4194304
00002000:00010000:1.0:1651532380.520062:0:216321:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x34555:0x0] updating lvb mtime from disk: 1651532379 -> 1651532380
00002000:00010000:1.0:1651532380.520063:0:216321:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x34555:0x0] updating lvb ctime from disk: 1651532379 -> 1651532380
00002000:00010000:1.0:1651532380.520064:0:216321:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x34555:0x0] updating lvb blocks from disk: 4096 -> 8192
00010000:00010000:1.0:1651532380.520068:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5b0b lrc: 3/0,1 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532380.520073:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5b0b lrc: 2/0,0 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532380.520080:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dce6a2c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438147:x1731754469145216:12345-10.240.43.64@tcp:4:dd.0 Request processed in 337883us (337931us total) trans 21474869669 rc 0/0
00000100:00100000:0.0:1651532380.520085:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250848
00000100:00100000:1.0:1651532380.520099:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000028779db6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438147:x1731754469145152:12345-10.240.43.64@tcp:4:dd.0 Request processed in 337893us (337940us total) trans 21474869668 rc 0/0
00010000:00010000:0.0:1651532380.520101:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca5b04 lrc: 2/0,0 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532380.520103:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250849
00010000:00010000:0.0:1651532380.520106:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c1022d42 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651532380.520108:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca5b04 lrc: 2/0,0 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532380.520111:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca5b04 lrc: 3/0,0 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532380.520113:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5b0b lrc: 2/0,0 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532380.520117:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000000bb25cc already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651532380.520117:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca5b04 lrc: 1/0,0 mode: --/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532380.520118:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5b0b lrc: 2/0,0 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532380.520120:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca5b04 lrc: 0/0,0 mode: --/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532380.520121:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5b0b lrc: 3/0,0 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532380.520131:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5b0b lrc: 1/0,0 mode: --/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532380.520134:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5b0b lrc: 0/0,0 mode: --/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532380.596128:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532380.596152:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469145728
00000100:00100000:0.0:1651532380.596155:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532380.596165:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469145664
00000100:00100000:1.0:1651532380.596172:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250850
00000100:00100000:1.0:1651532380.596175:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000dccc50c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754469145728:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:0.0:1651532380.596186:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250851
00000100:00100000:0.0:1651532380.596188:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000670433b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754469145664:12345-10.240.43.64@tcp:4:dd.0
00002000:00010000:1.0:1651532380.596193:0:216321:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34556:0x0] initial LVB size: 4194304, mtime: 0x6270625c, atime: 0x0, ctime: 0x6270625c, blocks: 0x2000
00010000:00010000:1.0:1651532380.596195:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5b12 lrc: 3/0,1 mode: --/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00002000:00010000:0.0:1651532380.596198:0:216323:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34555:0x0] initial LVB size: 4194304, mtime: 0x6270625c, atime: 0x0, ctime: 0x6270625c, blocks: 0x2000
00010000:00010000:1.0:1651532380.596200:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532380.596201:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532380.596201:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca5b19 lrc: 3/0,1 mode: --/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532380.596203:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5b12 lrc: 3/0,1 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [4194304->6291455] (req 4194304->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532380.596205:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532380.596206:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532380.596207:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca5b19 lrc: 3/0,1 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [4194304->6291455] (req 4194304->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532380.596208:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5b12 lrc: 3/0,1 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [4194304->6291455] (req 4194304->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532380.596215:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca5b19 lrc: 3/0,1 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [4194304->6291455] (req 4194304->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532380.868817:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869671 is committed
00002000:00010000:0.0:1651532380.868860:0:216323:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x34555:0x0] updating lvb size from disk: 4194304 -> 6291456
00002000:00010000:0.0:1651532380.868862:0:216323:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x34555:0x0] updating lvb blocks from disk: 8192 -> 12288
00010000:00010000:0.0:1651532380.868867:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca5b19 lrc: 3/0,1 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [4194304->6291455] (req 4194304->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651532380.868872:0:216321:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x34556:0x0] updating lvb size from disk: 4194304 -> 6291456
00010000:00010000:0.0:1651532380.868872:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca5b19 lrc: 2/0,0 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [4194304->6291455] (req 4194304->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651532380.868875:0:216321:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x34556:0x0] updating lvb blocks from disk: 8192 -> 12288
00010000:00010000:1.0:1651532380.868878:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5b12 lrc: 3/0,1 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [4194304->6291455] (req 4194304->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532380.868883:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5b12 lrc: 2/0,0 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [4194304->6291455] (req 4194304->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532380.868904:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000670433b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754469145664:12345-10.240.43.64@tcp:4:dd.0 Request processed in 272714us (272748us total) trans 21474869671 rc 0/0
00000100:00100000:1.0:1651532380.868908:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000dccc50c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754469145728:12345-10.240.43.64@tcp:4:dd.0 Request processed in 272732us (272780us total) trans 21474869670 rc 0/0
00000100:00100000:0.0:1651532380.868909:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250851
00000100:00100000:1.0:1651532380.868912:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250850
00010000:00010000:0.0:1651532380.868919:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca5b19 lrc: 2/0,0 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [4194304->6291455] (req 4194304->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532380.868923:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c1022d42 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651532380.868924:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca5b19 lrc: 2/0,0 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [4194304->6291455] (req 4194304->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532380.868926:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5b12 lrc: 2/0,0 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [4194304->6291455] (req 4194304->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532380.868927:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca5b19 lrc: 3/0,0 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [4194304->6291455] (req 4194304->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532380.868930:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000000bb25cc already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651532380.868931:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5b12 lrc: 2/0,0 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [4194304->6291455] (req 4194304->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532380.868934:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca5b19 lrc: 1/0,0 mode: --/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [4194304->6291455] (req 4194304->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532380.868935:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5b12 lrc: 3/0,0 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [4194304->6291455] (req 4194304->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532380.868940:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5b12 lrc: 1/0,0 mode: --/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [4194304->6291455] (req 4194304->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532380.868941:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca5b19 lrc: 0/0,0 mode: --/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [4194304->6291455] (req 4194304->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532380.868943:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5b12 lrc: 0/0,0 mode: --/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [4194304->6291455] (req 4194304->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532380.941098:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532380.941108:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532380.941121:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469146240
00000100:00100000:0.0:1651532380.941130:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469146176
00000100:00100000:1.0:1651532380.941139:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250852
00000100:00100000:1.0:1651532380.941141:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000005dd15341 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754469146240:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:0.0:1651532380.941151:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250853
00000100:00100000:0.0:1651532380.941153:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a5d8c030 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754469146176:12345-10.240.43.64@tcp:4:dd.0
00002000:00010000:1.0:1651532380.941159:0:216321:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34556:0x0] initial LVB size: 6291456, mtime: 0x6270625c, atime: 0x0, ctime: 0x6270625c, blocks: 0x3000
00010000:00010000:1.0:1651532380.941161:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5b20 lrc: 3/0,1 mode: --/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00002000:00010000:0.0:1651532380.941162:0:216323:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34555:0x0] initial LVB size: 6291456, mtime: 0x6270625c, atime: 0x0, ctime: 0x6270625c, blocks: 0x3000
00010000:00010000:0.0:1651532380.941165:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca5b27 lrc: 3/0,1 mode: --/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532380.941167:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532380.941168:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532380.941169:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532380.941170:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5b20 lrc: 3/0,1 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [6291456->8388607] (req 6291456->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532380.941170:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532380.941171:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca5b27 lrc: 3/0,1 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [6291456->8388607] (req 6291456->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532380.941175:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5b20 lrc: 3/0,1 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [6291456->8388607] (req 6291456->8388607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532380.941175:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca5b27 lrc: 3/0,1 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [6291456->8388607] (req 6291456->8388607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532381.260449:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869673 is committed
00002000:00010000:0.0:1651532381.260501:0:216323:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x34555:0x0] updating lvb size from disk: 6291456 -> 8388608
00002000:00010000:0.0:1651532381.260503:0:216323:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x34555:0x0] updating lvb blocks from disk: 12288 -> 16384
00010000:00010000:0.0:1651532381.260508:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca5b27 lrc: 3/0,1 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [6291456->8388607] (req 6291456->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651532381.260514:0:216321:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x34556:0x0] updating lvb size from disk: 6291456 -> 8388608
00010000:00010000:0.0:1651532381.260514:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca5b27 lrc: 2/0,0 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [6291456->8388607] (req 6291456->8388607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651532381.260516:0:216321:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x34556:0x0] updating lvb blocks from disk: 12288 -> 16384
00010000:00010000:1.0:1651532381.260520:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5b20 lrc: 3/0,1 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [6291456->8388607] (req 6291456->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532381.260525:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5b20 lrc: 2/0,0 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [6291456->8388607] (req 6291456->8388607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532381.260557:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a5d8c030 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754469146176:12345-10.240.43.64@tcp:4:dd.0 Request processed in 319402us (319448us total) trans 21474869673 rc 0/0
00000100:00100000:1.0:1651532381.260561:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000005dd15341 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754469146240:12345-10.240.43.64@tcp:4:dd.0 Request processed in 319418us (319463us total) trans 21474869672 rc 0/0
00000100:00100000:0.0:1651532381.260562:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250853
00000100:00100000:1.0:1651532381.260565:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250852
00010000:00010000:0.0:1651532381.260573:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca5b27 lrc: 2/0,0 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [6291456->8388607] (req 6291456->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532381.260574:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5b20 lrc: 2/0,0 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [6291456->8388607] (req 6291456->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532381.260577:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c1022d42 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651532381.260578:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000000bb25cc already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651532381.260578:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca5b27 lrc: 2/0,0 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [6291456->8388607] (req 6291456->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532381.260579:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5b20 lrc: 2/0,0 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [6291456->8388607] (req 6291456->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532381.260581:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca5b27 lrc: 3/0,0 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [6291456->8388607] (req 6291456->8388607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532381.260582:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5b20 lrc: 3/0,0 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [6291456->8388607] (req 6291456->8388607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532381.260589:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca5b27 lrc: 1/0,0 mode: --/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [6291456->8388607] (req 6291456->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532381.260590:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5b20 lrc: 1/0,0 mode: --/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [6291456->8388607] (req 6291456->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532381.260591:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca5b27 lrc: 0/0,0 mode: --/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [6291456->8388607] (req 6291456->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532381.260593:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5b20 lrc: 0/0,0 mode: --/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [6291456->8388607] (req 6291456->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532381.332082:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532381.332092:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532381.332106:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469146752
00000100:00100000:0.0:1651532381.332114:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469146688
00000100:00100000:1.0:1651532381.332122:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250854
00000100:00100000:1.0:1651532381.332124:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000015411af3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754469146752:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:0.0:1651532381.332135:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250855
00000100:00100000:0.0:1651532381.332137:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000f646cd75 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754469146688:12345-10.240.43.64@tcp:4:dd.0
00002000:00010000:1.0:1651532381.332142:0:216321:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34556:0x0] initial LVB size: 8388608, mtime: 0x6270625c, atime: 0x0, ctime: 0x6270625c, blocks: 0x4000
00010000:00010000:1.0:1651532381.332145:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5b2e lrc: 3/0,1 mode: --/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00002000:00010000:0.0:1651532381.332146:0:216323:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34555:0x0] initial LVB size: 8388608, mtime: 0x6270625c, atime: 0x0, ctime: 0x6270625c, blocks: 0x4000
00010000:00010000:0.0:1651532381.332149:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca5b35 lrc: 3/0,1 mode: --/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532381.332150:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532381.332151:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532381.332152:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5b2e lrc: 3/0,1 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532381.332157:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5b2e lrc: 3/0,1 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532381.332157:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532381.332158:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532381.332159:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca5b35 lrc: 3/0,1 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532381.332162:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca5b35 lrc: 3/0,1 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532381.333368:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532381.333385:0:192756:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469147264
00000100:00100000:0.0:1651532381.333400:0:192756:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250856
00000100:00100000:0.0:1651532381.333402:0:192756:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000004ffe7cb4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438147:x1731754469147264:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:1.0:1651532381.333406:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00010000:00010000:0.0:1651532381.333409:0:192756:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca5b3c lrc: 3/0,1 mode: --/PW res: [0x34556:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192756 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532381.333418:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469147200
00010000:00010000:0.0:1651532381.333420:0:192756:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532381.333421:0:192756:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532381.333422:0:192756:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca5b3c lrc: 3/0,1 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192756 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532381.333426:0:192756:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca5b3c lrc: 3/0,1 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192756 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532381.333432:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250857
00000100:00100000:1.0:1651532381.333435:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000051619ab4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754469147200:12345-10.240.43.64@tcp:4:dd.0
00010000:00010000:1.0:1651532381.333443:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5b43 lrc: 3/0,1 mode: --/PW res: [0x34555:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532381.333448:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532381.333448:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532381.333449:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5b43 lrc: 3/0,1 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532381.333454:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5b43 lrc: 3/0,1 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532381.408180:0:39094:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.61@tcp (source: 12345-10.240.43.61@tcp)
00000100:00100000:1.0:1651532381.408193:0:166114:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731745951243840
00000100:00100000:1.0:1651532381.408205:0:166114:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.61@tcp, seq: 547
00000100:00100000:1.0:1651532381.408207:0:166114:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000055e8b273 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951243840:12345-10.240.43.61@tcp:13:osp-pre-1-0.0
00002000:00000024:1.0:1651532381.408219:0:166114:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 3219456 granted 355684928 pending 4292608 free 81262530560 avail 77091819520
00000100:00100000:1.0:1651532381.408252:0:166114:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000055e8b273 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:39029:x1731745951243840:12345-10.240.43.61@tcp:13:osp-pre-1-0.0 Request processed in 44us (73us total) trans 0 rc 0/0
00000100:00100000:1.0:1651532381.408256:0:166114:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.61@tcp, seq: 547
00000001:00080000:0.0:1651532381.606292:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869677 is committed
00002000:00010000:0.0:1651532381.606327:0:192756:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x34556:0x0] updating lvb size from disk: 8388608 -> 10485760
00002000:00010000:0.0:1651532381.606329:0:192756:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x34556:0x0] updating lvb mtime from disk: 1651532380 -> 1651532381
00002000:00010000:0.0:1651532381.606330:0:192756:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x34556:0x0] updating lvb ctime from disk: 1651532380 -> 1651532381
00002000:00010000:0.0:1651532381.606331:0:192756:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x34556:0x0] updating lvb blocks from disk: 16384 -> 20480
00002000:00010000:1.0:1651532381.606336:0:192755:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x34555:0x0] updating lvb size from disk: 8388608 -> 10485760
00010000:00010000:0.0:1651532381.606336:0:192756:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca5b3c lrc: 3/0,1 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192756 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651532381.606338:0:192755:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x34555:0x0] updating lvb mtime from disk: 1651532380 -> 1651532381
00002000:00010000:1.0:1651532381.606339:0:192755:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x34555:0x0] updating lvb ctime from disk: 1651532380 -> 1651532381
00002000:00010000:1.0:1651532381.606340:0:192755:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x34555:0x0] updating lvb blocks from disk: 16384 -> 20480
00010000:00010000:0.0:1651532381.606342:0:192756:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca5b3c lrc: 2/0,0 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192756 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532381.606344:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5b43 lrc: 3/0,1 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532381.606354:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5b43 lrc: 2/0,0 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532381.606368:0:192756:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000004ffe7cb4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754469147264:12345-10.240.43.64@tcp:4:dd.0 Request processed in 272965us (273000us total) trans 21474869677 rc 0/0
00000100:00100000:0.0:1651532381.606372:0:192756:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250856
00000100:00100000:1.0:1651532381.606379:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000051619ab4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+11:438147:x1731754469147200:12345-10.240.43.64@tcp:4:dd.0 Request processed in 272943us (272973us total) trans 21474869676 rc 0/0
00010000:00010000:0.0:1651532381.606381:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca5b3c lrc: 2/0,0 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192756 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532381.606383:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250857
00010000:00010000:0.0:1651532381.606386:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000820577fb already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651532381.606387:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca5b3c lrc: 2/0,0 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192756 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532381.606391:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca5b3c lrc: 3/0,0 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192756 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532381.606392:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5b43 lrc: 2/0,0 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532381.606395:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c806f265 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651532381.606397:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5b43 lrc: 2/0,0 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532381.606398:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca5b3c lrc: 1/0,0 mode: --/PW res: [0x34556:0x0:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192756 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532381.606400:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5b43 lrc: 3/0,0 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532381.606401:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca5b3c lrc: 0/0,0 mode: --/PW res: [0x34556:0x0:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192756 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532381.606405:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5b43 lrc: 1/0,0 mode: --/PW res: [0x34555:0x0:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532381.606408:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5b43 lrc: 0/0,0 mode: --/PW res: [0x34555:0x0:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532381.606425:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca5b35 lrc: 3/0,1 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532381.606428:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca5b35 lrc: 2/0,0 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532381.606431:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5b2e lrc: 3/0,1 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532381.606435:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5b2e lrc: 2/0,0 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532381.606450:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000f646cd75 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438147:x1731754469146688:12345-10.240.43.64@tcp:4:dd.0 Request processed in 274312us (274358us total) trans 21474869675 rc 0/0
00000100:00100000:0.0:1651532381.606460:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250855
00000100:00100000:1.0:1651532381.606477:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000015411af3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438147:x1731754469146752:12345-10.240.43.64@tcp:4:dd.0 Request processed in 274351us (274395us total) trans 21474869674 rc 0/0
00000100:00100000:1.0:1651532381.606480:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250854
00010000:00010000:0.0:1651532381.606480:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca5b35 lrc: 2/0,0 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532381.606484:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c1022d42 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651532381.606485:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca5b35 lrc: 2/0,0 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532381.606488:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5b2e lrc: 2/0,0 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532381.606488:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca5b35 lrc: 3/0,0 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532381.606491:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000000bb25cc already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651532381.606492:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5b2e lrc: 2/0,0 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532381.606493:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca5b35 lrc: 1/0,0 mode: --/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532381.606495:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5b2e lrc: 3/0,0 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532381.606496:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca5b35 lrc: 0/0,0 mode: --/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532381.606500:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5b2e lrc: 1/0,0 mode: --/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532381.606503:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5b2e lrc: 0/0,0 mode: --/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532381.686107:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532381.686122:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532381.686130:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469147776
00000100:00100000:1.0:1651532381.686133:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469147712
00000100:00100000:0.0:1651532381.686146:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250858
00000100:00100000:0.0:1651532381.686154:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000e4e3ecb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754469147776:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:1.0:1651532381.686156:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250859
00000100:00100000:1.0:1651532381.686158:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000b67ad021 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754469147712:12345-10.240.43.64@tcp:4:dd.0
00002000:00010000:0.0:1651532381.686164:0:216323:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34556:0x0] initial LVB size: 10485760, mtime: 0x6270625d, atime: 0x0, ctime: 0x6270625d, blocks: 0x5000
00002000:00010000:1.0:1651532381.686167:0:216321:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34555:0x0] initial LVB size: 10485760, mtime: 0x6270625d, atime: 0x0, ctime: 0x6270625d, blocks: 0x5000
00010000:00010000:0.0:1651532381.686167:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca5b4a lrc: 3/0,1 mode: --/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532381.686169:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5b51 lrc: 3/0,1 mode: --/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532381.686173:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532381.686174:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532381.686175:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca5b4a lrc: 3/0,1 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [10485760->12582911] (req 10485760->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532381.686177:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532381.686178:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532381.686179:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5b51 lrc: 3/0,1 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [10485760->12582911] (req 10485760->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532381.686180:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca5b4a lrc: 3/0,1 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [10485760->12582911] (req 10485760->12582911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532381.686183:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5b51 lrc: 3/0,1 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [10485760->12582911] (req 10485760->12582911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532381.917181:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869679 is committed
00002000:00010000:0.0:1651532381.917233:0:216323:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x34556:0x0] updating lvb size from disk: 10485760 -> 12582912
00002000:00010000:0.0:1651532381.917235:0:216323:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x34556:0x0] updating lvb blocks from disk: 20480 -> 24576
00010000:00010000:0.0:1651532381.917240:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca5b4a lrc: 3/0,1 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [10485760->12582911] (req 10485760->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651532381.917244:0:216321:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x34555:0x0] updating lvb size from disk: 10485760 -> 12582912
00010000:00010000:0.0:1651532381.917245:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca5b4a lrc: 2/0,0 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [10485760->12582911] (req 10485760->12582911) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651532381.917246:0:216321:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x34555:0x0] updating lvb blocks from disk: 20480 -> 24576
00010000:00010000:1.0:1651532381.917250:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5b51 lrc: 3/0,1 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [10485760->12582911] (req 10485760->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532381.917261:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5b51 lrc: 2/0,0 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [10485760->12582911] (req 10485760->12582911) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532381.917279:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000e4e3ecb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754469147776:12345-10.240.43.64@tcp:4:dd.0 Request processed in 231130us (231172us total) trans 21474869678 rc 0/0
00000100:00100000:1.0:1651532381.917284:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000b67ad021 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754469147712:12345-10.240.43.64@tcp:4:dd.0 Request processed in 231125us (231162us total) trans 21474869679 rc 0/0
00000100:00100000:0.0:1651532381.917284:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250858
00000100:00100000:1.0:1651532381.917288:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250859
00010000:00010000:0.0:1651532381.917294:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca5b4a lrc: 2/0,0 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [10485760->12582911] (req 10485760->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532381.917298:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5b51 lrc: 2/0,0 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [10485760->12582911] (req 10485760->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532381.917298:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c1022d42 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651532381.917299:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca5b4a lrc: 2/0,0 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [10485760->12582911] (req 10485760->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532381.917301:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000000bb25cc already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651532381.917302:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5b51 lrc: 2/0,0 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [10485760->12582911] (req 10485760->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532381.917306:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5b51 lrc: 3/0,0 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [10485760->12582911] (req 10485760->12582911) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532381.917307:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca5b4a lrc: 3/0,0 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [10485760->12582911] (req 10485760->12582911) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532381.917313:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5b51 lrc: 1/0,0 mode: --/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [10485760->12582911] (req 10485760->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532381.917313:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca5b4a lrc: 1/0,0 mode: --/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [10485760->12582911] (req 10485760->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532381.917316:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5b51 lrc: 0/0,0 mode: --/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [10485760->12582911] (req 10485760->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532381.917316:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca5b4a lrc: 0/0,0 mode: --/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [10485760->12582911] (req 10485760->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532381.954097:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532381.954112:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532381.954121:0:216321:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469148288
00000100:00100000:0.0:1651532381.954121:0:216323:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469148224
00000100:00100000:0.0:1651532381.954144:0:216323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250860
00000100:00100000:1.0:1651532381.954147:0:216321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250861
00000100:00100000:0.0:1651532381.954147:0:216323:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000009078ca7d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754469148224:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:1.0:1651532381.954149:0:216321:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000fb90eb28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754469148288:12345-10.240.43.64@tcp:4:dd.0
00002000:00010000:1.0:1651532381.954158:0:216321:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34556:0x0] initial LVB size: 12582912, mtime: 0x6270625d, atime: 0x0, ctime: 0x6270625d, blocks: 0x6000
00002000:00010000:0.0:1651532381.954158:0:216323:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34555:0x0] initial LVB size: 12582912, mtime: 0x6270625d, atime: 0x0, ctime: 0x6270625d, blocks: 0x6000
00010000:00010000:1.0:1651532381.954160:0:216321:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5b5f lrc: 3/0,1 mode: --/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532381.954160:0:216323:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca5b58 lrc: 3/0,1 mode: --/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532381.954165:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532381.954165:0:216321:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532381.954165:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532381.954165:0:216323:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532381.954167:0:216321:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5b5f lrc: 3/0,1 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532381.954167:0:216323:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca5b58 lrc: 3/0,1 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532381.954171:0:216321:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5b5f lrc: 3/0,1 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532381.954171:0:216323:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca5b58 lrc: 3/0,1 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532381.955108:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532381.955122:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532381.955131:0:192756:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469148544
00000100:00100000:0.0:1651532381.955138:0:192755:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469148608
00000100:00100000:1.0:1651532381.955146:0:192756:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250862
00000100:00100000:1.0:1651532381.955148:0:192756:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@0000000071f9ee43 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754469148544:12345-10.240.43.64@tcp:4:dd.0
00010000:00010000:1.0:1651532381.955155:0:192756:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5b66 lrc: 3/0,1 mode: --/PW res: [0x34555:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192756 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532381.955157:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250863
00000100:00100000:0.0:1651532381.955159:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@000000002d3e5ae4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+12:438147:x1731754469148608:12345-10.240.43.64@tcp:4:dd.0
00010000:00010000:1.0:1651532381.955163:0:192756:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532381.955164:0:192756:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532381.955165:0:192756:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5b66 lrc: 3/0,1 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192756 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532381.955167:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca5b6d lrc: 3/0,1 mode: --/PW res: [0x34556:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532381.955169:0:192756:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5b66 lrc: 3/0,1 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192756 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532381.955172:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532381.955172:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532381.955173:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca5b6d lrc: 3/0,1 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532381.955178:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca5b6d lrc: 3/0,1 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532382.263324:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869680 is committed
00002000:00010000:1.0:1651532382.263372:0:216321:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x34556:0x0] updating lvb size from disk: 12582912 -> 14680064
00002000:00010000:1.0:1651532382.263375:0:216321:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x34556:0x0] updating lvb blocks from disk: 24576 -> 28672
00010000:00010000:1.0:1651532382.263379:0:216321:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5b5f lrc: 3/0,1 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532382.263385:0:216321:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5b5f lrc: 2/0,0 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532382.263418:0:216321:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000fb90eb28 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0c703c47-a140-4387-a181-4e0a15e9b24e+19:438147:x1731754469148288:12345-10.240.43.64@tcp:4:dd.0 Request processed in 309267us (309320us total) trans 21474869680 rc 0/0
00000100:00100000:1.0:1651532382.263422:0:216321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250861
00010000:00010000:1.0:1651532382.263433:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5b5f lrc: 2/0,0 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532382.263447:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 0000000000bb25cc already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651532382.263449:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5b5f lrc: 2/0,0 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532382.263453:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5b5f lrc: 3/0,0 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532382.263480:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5b5f lrc: 1/0,0 mode: --/PW res: [0x34556:0x0:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532382.263483:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000000bb25cc/0x3234de053ca5b5f lrc: 0/0,0 mode: --/PW res: [0x34556:0x0:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216321 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532382.289180:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869683 is committed
00010000:00010000:0.0:1651532382.289212:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca5b6d lrc: 3/0,1 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532382.289217:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca5b6d lrc: 2/0,0 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651532382.289220:0:192756:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x34555:0x0] updating lvb size from disk: 12582912 -> 14680064
00002000:00010000:1.0:1651532382.289232:0:192756:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x34555:0x0] updating lvb blocks from disk: 24576 -> 28672
00010000:00010000:1.0:1651532382.289235:0:192756:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5b66 lrc: 3/0,1 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192756 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532382.289244:0:192756:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5b66 lrc: 2/0,0 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192756 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532382.289257:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000002d3e5ae4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+10:438147:x1731754469148608:12345-10.240.43.64@tcp:4:dd.0 Request processed in 334091us (334128us total) trans 21474869683 rc 0/0
00000100:00100000:0.0:1651532382.289261:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250863
00000100:00100000:1.0:1651532382.289265:0:192756:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@0000000071f9ee43 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+9:438147:x1731754469148544:12345-10.240.43.64@tcp:4:dd.0 Request processed in 334117us (334157us total) trans 21474869682 rc 0/0
00000100:00100000:1.0:1651532382.289269:0:192756:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250862
00010000:00010000:0.0:1651532382.289270:0:167633:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca5b6d lrc: 2/0,0 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532382.289278:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5b66 lrc: 2/0,0 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192756 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532382.289278:0:167633:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000820577fb already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651532382.289279:0:167633:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca5b6d lrc: 2/0,0 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532382.289282:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c806f265 already unused, calling callback (0000000049fddea7)
00010000:00010000:0.0:1651532382.289282:0:167633:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca5b6d lrc: 3/0,0 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532382.289283:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5b66 lrc: 2/0,0 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192756 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532382.289286:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5b66 lrc: 3/0,0 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192756 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532382.289287:0:167633:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca5b6d lrc: 1/0,0 mode: --/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532382.289290:0:167633:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca5b6d lrc: 0/0,0 mode: --/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532382.289295:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5b66 lrc: 1/0,0 mode: --/PW res: [0x34555:0x0:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192756 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532382.289298:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5b66 lrc: 0/0,0 mode: --/PW res: [0x34555:0x0:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192756 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532382.289324:0:216323:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca5b58 lrc: 3/0,1 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532382.289336:0:216323:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca5b58 lrc: 2/0,0 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:1.0:1651532382.289359:0:216323:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@000000009078ca7d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438147:x1731754469148224:12345-10.240.43.64@tcp:4:dd.0 Request processed in 335212us (335247us total) trans 21474869681 rc 0/0
00000100:00100000:1.0:1651532382.289363:0:216323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250860
00010000:00010000:1.0:1651532382.289370:0:166105:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca5b58 lrc: 2/0,0 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532382.289373:0:166105:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c1022d42 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651532382.289375:0:166105:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca5b58 lrc: 2/0,0 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532382.289377:0:166105:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca5b58 lrc: 3/0,0 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532382.289382:0:166105:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca5b58 lrc: 1/0,0 mode: --/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532382.289388:0:166105:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1022d42/0x3234de053ca5b58 lrc: 0/0,0 mode: --/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 216323 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532382.326117:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:0.0:1651532382.326132:0:39093:0:(events.c:361:request_in_callback()) peer: 12345-10.240.43.64@tcp (source: 12345-10.240.43.64@tcp)
00000100:00100000:1.0:1651532382.326141:0:192756:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469149184
00000100:00100000:1.0:1651532382.326159:0:192756:0:(service.c:2134:ptlrpc_server_handle_req_in()) got req x1731754469149120
00000100:00100000:1.0:1651532382.326166:0:192756:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250864
00000100:00100000:1.0:1651532382.326168:0:192756:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000a9fc5082 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754469149184:12345-10.240.43.64@tcp:4:dd.0
00000100:00100000:0.0:1651532382.326175:0:192755:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10.240.43.64@tcp, seq: 250865
00000100:00100000:0.0:1651532382.326178:0:192755:0:(service.c:2303:ptlrpc_server_handle_request()) Handling RPC req@00000000c65d6bc4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754469149120:12345-10.240.43.64@tcp:4:dd.0
00002000:00010000:1.0:1651532382.326179:0:192756:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34556:0x0] initial LVB size: 14680064, mtime: 0x6270625d, atime: 0x0, ctime: 0x6270625d, blocks: 0x7000
00010000:00010000:1.0:1651532382.326181:0:192756:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5b74 lrc: 3/0,1 mode: --/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192756 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532382.326185:0:192756:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532382.326186:0:192756:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:1.0:1651532382.326188:0:192756:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5b74 lrc: 3/0,1 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [14680064->16777215] (req 14680064->16777215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192756 timeout: 0 lvb_type: 0
00002000:00010000:0.0:1651532382.326189:0:192755:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x34555:0x0] initial LVB size: 14680064, mtime: 0x6270625d, atime: 0x0, ctime: 0x6270625d, blocks: 0x7000
00010000:00010000:0.0:1651532382.326191:0:192755:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca5b7b lrc: 3/0,1 mode: --/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532382.326192:0:192756:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5b74 lrc: 3/0,1 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [14680064->16777215] (req 14680064->16777215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192756 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532382.326196:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532382.326196:0:192755:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0
00010000:00010000:0.0:1651532382.326197:0:192755:0:(ldlm_resource.c:1647:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca5b7b lrc: 3/0,1 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [14680064->16777215] (req 14680064->16777215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:0.0:1651532382.326201:0:192755:0:(ldlm_request.c:530:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca5b7b lrc: 3/0,1 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [14680064->16777215] (req 14680064->16777215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00000001:00080000:0.0:1651532382.556855:0:166098:0:(tgt_lastrcvd.c:924:tgt_cb_last_committed()) lustre-OST0001: transno 21474869685 is committed
00002000:00010000:0.0:1651532382.556894:0:192755:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x34555:0x0] updating lvb size from disk: 14680064 -> 16777216
00002000:00010000:0.0:1651532382.556895:0:192755:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x34555:0x0] updating lvb mtime from disk: 1651532381 -> 1651532382
00002000:00010000:0.0:1651532382.556896:0:192755:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x34555:0x0] updating lvb ctime from disk: 1651532381 -> 1651532382
00002000:00010000:0.0:1651532382.556897:0:192755:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x34555:0x0] updating lvb blocks from disk: 28672 -> 32768
00010000:00010000:0.0:1651532382.556903:0:192755:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca5b7b lrc: 3/0,1 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [14680064->16777215] (req 14680064->16777215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651532382.556907:0:192756:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x34556:0x0] updating lvb size from disk: 14680064 -> 16777216
00010000:00010000:0.0:1651532382.556908:0:192755:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca5b7b lrc: 2/0,0 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [14680064->16777215] (req 14680064->16777215) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00002000:00010000:1.0:1651532382.556909:0:192756:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x34556:0x0] updating lvb mtime from disk: 1651532381 -> 1651532382
00002000:00010000:1.0:1651532382.556911:0:192756:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x34556:0x0] updating lvb ctime from disk: 1651532381 -> 1651532382
00002000:00010000:1.0:1651532382.556911:0:192756:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x34556:0x0] updating lvb blocks from disk: 28672 -> 32768
00010000:00010000:1.0:1651532382.556915:0:192756:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5b74 lrc: 3/0,1 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [14680064->16777215] (req 14680064->16777215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 192756 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532382.556926:0:192756:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5b74 lrc: 2/0,0 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [14680064->16777215] (req 14680064->16777215) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 192756 timeout: 0 lvb_type: 0
00000100:00100000:0.0:1651532382.556938:0:192755:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000c65d6bc4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:0c703c47-a140-4387-a181-4e0a15e9b24e+8:438147:x1731754469149120:12345-10.240.43.64@tcp:4:dd.0 Request processed in 230759us (230805us total) trans 21474869685 rc 0/0
00000100:00100000:0.0:1651532382.556942:0:192755:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250865
00000100:00100000:1.0:1651532382.556948:0:192756:0:(service.c:2352:ptlrpc_server_handle_request()) Handled RPC req@00000000a9fc5082 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:0c703c47-a140-4387-a181-4e0a15e9b24e+7:438147:x1731754469149184:12345-10.240.43.64@tcp:4:dd.0 Request processed in 230778us (230831us total) trans 21474869684 rc 0/0
00000100:00100000:1.0:1651532382.556952:0:192756:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10.240.43.64@tcp, seq: 250864
00010000:00010000:1.0:1651532382.556961:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca5b7b lrc: 2/0,0 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [14680064->16777215] (req 14680064->16777215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532382.556965:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000820577fb already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651532382.556966:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca5b7b lrc: 2/0,0 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [14680064->16777215] (req 14680064->16777215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532382.556970:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca5b7b lrc: 3/0,0 mode: PW/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [14680064->16777215] (req 14680064->16777215) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532382.556977:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca5b7b lrc: 1/0,0 mode: --/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [14680064->16777215] (req 14680064->16777215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532382.556979:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000820577fb/0x3234de053ca5b7b lrc: 0/0,0 mode: --/PW res: [0x34555:0x0:0x0].0x0 rrc: 2 type: EXT [14680064->16777215] (req 14680064->16777215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192755 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532382.556984:0:166106:0:(ldlm_lockd.c:1872:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5b74 lrc: 2/0,0 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [14680064->16777215] (req 14680064->16777215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192756 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532382.556996:0:166106:0:(ldlm_lockd.c:1886:ldlm_handle_bl_callback()) Lock 00000000c806f265 already unused, calling callback (0000000049fddea7)
00010000:00010000:1.0:1651532382.556997:0:166106:0:(ldlm_request.c:366:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5b74 lrc: 2/0,0 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [14680064->16777215] (req 14680064->16777215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 192756 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532382.557000:0:166106:0:(ldlm_request.c:1259:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5b74 lrc: 3/0,0 mode: PW/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [14680064->16777215] (req 14680064->16777215) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 192756 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532382.557006:0:166106:0:(ldlm_lockd.c:1896:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5b74 lrc: 1/0,0 mode: --/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [14680064->16777215] (req 14680064->16777215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192756 timeout: 0 lvb_type: 0
00010000:00010000:1.0:1651532382.557009:0:166106:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c806f265/0x3234de053ca5b74 lrc: 0/0,0 mode: --/PW res: [0x34556:0x0:0x0].0x0 rrc: 2 type: EXT [14680064->16777215] (req 14680064->16777215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 192756 timeout: 0 lvb_type: 0
00000400:00000080:1.0:1651532382.862565:0:233757:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648
00000001:02000400:1.0:1651532382.862568:0:233757:0:(debug.c:729:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity test_398m: @@@@@@ FAIL: parallel dio write with failure on first stripe succeeded
Debug log: 45766 lines, 45766 kept, 0 dropped, 0 bad.